2018-11-15 13:25:07 [DEBUG   ] Got command BAM from MCS: ref #514705
2018-11-15 13:25:07 [INFO    ] Finished processing BAM request
2018-11-15 13:25:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:25:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514705   8 58437 48307030 A  ERROR'
2018-11-15 13:25:07 [DEBUG   ] Got command BAM from MCS: ref #514704
2018-11-15 13:25:07 [INFO    ] Finished processing BAM request
2018-11-15 13:25:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:25:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514704   8 58437 48307034 A  ERROR'
2018-11-15 13:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 13:25:07 [DEBUG   ] spawn_process: at 2018-11-15 13:25:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 13:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 13:25:07 [DEBUG   ] spawn_process: at 2018-11-15 13:25:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 13:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 13:25:07 [DEBUG   ] spawn_process: at 2018-11-15 13:25:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 13:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 13:25:07 [DEBUG   ] spawn_process: at 2018-11-15 13:25:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 13:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 13:25:07 [DEBUG   ] spawn_process: at 2018-11-15 13:25:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 13:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 13:25:07 [DEBUG   ] spawn_process: at 2018-11-15 13:25:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 13:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 13:25:07 [DEBUG   ] spawn_process: at 2018-11-15 13:25:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 13:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 13:25:07 [DEBUG   ] spawn_process: at 2018-11-15 13:25:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 13:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 13:25:07 [DEBUG   ] spawn_process: at 2018-11-15 13:25:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 13:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 13:25:07 [DEBUG   ] spawn_process: at 2018-11-15 13:25:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 13:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 13:25:07 [DEBUG   ] spawn_process: at 2018-11-15 13:25:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 13:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 13:25:07 [DEBUG   ] spawn_process: at 2018-11-15 13:25:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 13:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 13:25:07 [DEBUG   ] spawn_process: at 2018-11-15 13:25:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 13:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 13:25:07 [DEBUG   ] spawn_process: at 2018-11-15 13:25:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 13:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 13:25:07 [DEBUG   ] spawn_process: at 2018-11-15 13:25:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 13:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 13:25:07 [DEBUG   ] spawn_process: at 2018-11-15 13:25:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 13:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 13:25:07 [DEBUG   ] spawn_process: at 2018-11-15 13:25:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 13:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 13:25:07 [DEBUG   ] spawn_process: at 2018-11-15 13:25:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 13:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 13:25:07 [DEBUG   ] spawn_process: at 2018-11-15 13:25:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 13:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 13:25:07 [DEBUG   ] spawn_process: at 2018-11-15 13:25:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 13:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 13:25:07 [DEBUG   ] spawn_process: at 2018-11-15 13:25:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 13:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 13:25:07 [DEBUG   ] spawn_process: at 2018-11-15 13:25:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 13:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 13:25:07 [DEBUG   ] spawn_process: at 2018-11-15 13:25:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 13:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 13:25:07 [DEBUG   ] spawn_process: at 2018-11-15 13:25:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 13:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 13:25:07 [DEBUG   ] spawn_process: at 2018-11-15 13:25:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 13:25:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 13:25:07 [DEBUG   ] spawn_process: at 2018-11-15 13:25:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 13:25:10 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 13:25:29 [DEBUG   ] Got command BAM from MCS: ref #514707
2018-11-15 13:25:29 [INFO    ] Finished processing BAM request
2018-11-15 13:25:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:25:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514707   8 58437 48329033 A  ERROR'
2018-11-15 13:25:29 [DEBUG   ] Got command BAM from MCS: ref #514706
2018-11-15 13:25:29 [INFO    ] Finished processing BAM request
2018-11-15 13:25:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:25:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514706   8 58437 48329037 A  ERROR'
2018-11-15 13:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 13:25:29 [DEBUG   ] spawn_process: at 2018-11-15 13:25:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 13:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 13:25:29 [DEBUG   ] spawn_process: at 2018-11-15 13:25:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 13:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 13:25:29 [DEBUG   ] spawn_process: at 2018-11-15 13:25:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 13:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 13:25:29 [DEBUG   ] spawn_process: at 2018-11-15 13:25:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 13:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 13:25:29 [DEBUG   ] spawn_process: at 2018-11-15 13:25:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 13:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 13:25:29 [DEBUG   ] spawn_process: at 2018-11-15 13:25:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 13:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 13:25:29 [DEBUG   ] spawn_process: at 2018-11-15 13:25:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 13:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 13:25:29 [DEBUG   ] spawn_process: at 2018-11-15 13:25:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 13:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 13:25:29 [DEBUG   ] spawn_process: at 2018-11-15 13:25:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 13:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 13:25:29 [DEBUG   ] spawn_process: at 2018-11-15 13:25:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 13:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 13:25:29 [DEBUG   ] spawn_process: at 2018-11-15 13:25:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 13:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 13:25:29 [DEBUG   ] spawn_process: at 2018-11-15 13:25:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 13:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 13:25:29 [DEBUG   ] spawn_process: at 2018-11-15 13:25:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 13:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 13:25:29 [DEBUG   ] spawn_process: at 2018-11-15 13:25:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 13:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 13:25:29 [DEBUG   ] spawn_process: at 2018-11-15 13:25:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 13:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 13:25:29 [DEBUG   ] spawn_process: at 2018-11-15 13:25:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 13:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 13:25:29 [DEBUG   ] spawn_process: at 2018-11-15 13:25:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 13:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 13:25:29 [DEBUG   ] spawn_process: at 2018-11-15 13:25:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 13:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 13:25:29 [DEBUG   ] spawn_process: at 2018-11-15 13:25:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 13:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 13:25:29 [DEBUG   ] spawn_process: at 2018-11-15 13:25:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 13:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 13:25:29 [DEBUG   ] spawn_process: at 2018-11-15 13:25:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 13:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 13:25:29 [DEBUG   ] spawn_process: at 2018-11-15 13:25:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 13:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 13:25:29 [DEBUG   ] spawn_process: at 2018-11-15 13:25:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 13:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 13:25:29 [DEBUG   ] spawn_process: at 2018-11-15 13:25:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 13:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 13:25:29 [DEBUG   ] spawn_process: at 2018-11-15 13:25:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 13:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 13:25:29 [DEBUG   ] spawn_process: at 2018-11-15 13:25:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 13:25:30 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 13:25:45 [DEBUG   ] Got command RPT from MCS: ref #514708
2018-11-15 13:25:45 [DEBUG   ] summary = ERROR
2018-11-15 13:25:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   514708  13 58437 48345093 A  ERRORERROR'
2018-11-15 13:25:45 [DEBUG   ] Got command RPT from MCS: ref #514709
2018-11-15 13:25:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 13:25:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   514709  77 58437 48345094 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 13:25:50 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 13:25:51 [DEBUG   ] Got command BAM from MCS: ref #514725
2018-11-15 13:25:51 [INFO    ] Finished processing BAM request
2018-11-15 13:25:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:25:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514725   8 58437 48351029 A  ERROR'
2018-11-15 13:25:51 [DEBUG   ] Got command BAM from MCS: ref #514726
2018-11-15 13:25:51 [INFO    ] Finished processing BAM request
2018-11-15 13:25:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:25:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514726   8 58437 48351033 A  ERROR'
2018-11-15 13:25:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 13:25:51 [DEBUG   ] spawn_process: at 2018-11-15 13:25:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 13:25:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 13:25:51 [DEBUG   ] spawn_process: at 2018-11-15 13:25:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 13:25:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 13:25:51 [DEBUG   ] spawn_process: at 2018-11-15 13:25:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 13:25:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 13:25:51 [DEBUG   ] spawn_process: at 2018-11-15 13:25:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 13:25:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 13:25:51 [DEBUG   ] spawn_process: at 2018-11-15 13:25:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 13:25:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 13:25:51 [DEBUG   ] spawn_process: at 2018-11-15 13:25:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 13:25:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 13:25:51 [DEBUG   ] spawn_process: at 2018-11-15 13:25:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 13:25:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 13:25:51 [DEBUG   ] spawn_process: at 2018-11-15 13:25:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 13:25:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 13:25:51 [DEBUG   ] spawn_process: at 2018-11-15 13:25:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 13:25:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 13:25:51 [DEBUG   ] spawn_process: at 2018-11-15 13:25:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 13:25:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 13:25:51 [DEBUG   ] spawn_process: at 2018-11-15 13:25:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 13:25:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 13:25:51 [DEBUG   ] spawn_process: at 2018-11-15 13:25:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 13:25:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 13:25:51 [DEBUG   ] spawn_process: at 2018-11-15 13:25:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 13:25:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 13:25:51 [DEBUG   ] spawn_process: at 2018-11-15 13:25:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 13:25:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 13:25:51 [DEBUG   ] spawn_process: at 2018-11-15 13:25:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 13:25:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 13:25:51 [DEBUG   ] spawn_process: at 2018-11-15 13:25:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 13:25:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 13:25:51 [DEBUG   ] spawn_process: at 2018-11-15 13:25:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 13:25:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 13:25:51 [DEBUG   ] spawn_process: at 2018-11-15 13:25:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 13:25:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 13:25:51 [DEBUG   ] spawn_process: at 2018-11-15 13:25:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 13:25:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 13:25:51 [DEBUG   ] spawn_process: at 2018-11-15 13:25:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 13:25:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 13:25:51 [DEBUG   ] spawn_process: at 2018-11-15 13:25:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 13:25:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 13:25:51 [DEBUG   ] spawn_process: at 2018-11-15 13:25:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 13:25:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 13:25:51 [DEBUG   ] spawn_process: at 2018-11-15 13:25:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 13:25:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 13:25:51 [DEBUG   ] spawn_process: at 2018-11-15 13:25:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 13:25:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 13:25:51 [DEBUG   ] spawn_process: at 2018-11-15 13:25:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 13:25:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 13:25:51 [DEBUG   ] spawn_process: at 2018-11-15 13:25:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 13:25:52 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 13:25:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 13:25:53 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-15 13:25:53 [WARNING ] (13, 1, 'bot')
2018-11-15 13:25:53 [WARNING ] (13, 1, 'bot')
2018-11-15 13:25:53 [WARNING ] (13, 1, 'bot')
2018-11-15 13:25:53 [WARNING ] (13, 1, 'bot')
2018-11-15 13:25:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 13:25:53 [DEBUG   ] Finished updating board flags in 1.002 seconds
2018-11-15 13:26:10 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 13:26:13 [DEBUG   ] Got command BAM from MCS: ref #514728
2018-11-15 13:26:13 [INFO    ] Finished processing BAM request
2018-11-15 13:26:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:26:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514728   8 58437 48373029 A  ERROR'
2018-11-15 13:26:13 [DEBUG   ] Got command BAM from MCS: ref #514727
2018-11-15 13:26:13 [INFO    ] Finished processing BAM request
2018-11-15 13:26:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:26:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514727   8 58437 48373033 A  ERROR'
2018-11-15 13:26:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 13:26:13 [DEBUG   ] spawn_process: at 2018-11-15 13:26:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 13:26:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 13:26:13 [DEBUG   ] spawn_process: at 2018-11-15 13:26:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 13:26:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 13:26:13 [DEBUG   ] spawn_process: at 2018-11-15 13:26:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 13:26:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 13:26:13 [DEBUG   ] spawn_process: at 2018-11-15 13:26:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 13:26:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 13:26:13 [DEBUG   ] spawn_process: at 2018-11-15 13:26:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 13:26:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 13:26:13 [DEBUG   ] spawn_process: at 2018-11-15 13:26:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 13:26:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 13:26:13 [DEBUG   ] spawn_process: at 2018-11-15 13:26:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 13:26:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 13:26:13 [DEBUG   ] spawn_process: at 2018-11-15 13:26:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 13:26:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 13:26:13 [DEBUG   ] spawn_process: at 2018-11-15 13:26:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 13:26:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 13:26:13 [DEBUG   ] spawn_process: at 2018-11-15 13:26:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 13:26:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 13:26:13 [DEBUG   ] spawn_process: at 2018-11-15 13:26:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 13:26:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 13:26:13 [DEBUG   ] spawn_process: at 2018-11-15 13:26:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 13:26:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 13:26:13 [DEBUG   ] spawn_process: at 2018-11-15 13:26:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 13:26:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 13:26:13 [DEBUG   ] spawn_process: at 2018-11-15 13:26:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 13:26:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 13:26:13 [DEBUG   ] spawn_process: at 2018-11-15 13:26:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 13:26:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 13:26:13 [DEBUG   ] spawn_process: at 2018-11-15 13:26:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 13:26:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 13:26:13 [DEBUG   ] spawn_process: at 2018-11-15 13:26:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 13:26:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 13:26:13 [DEBUG   ] spawn_process: at 2018-11-15 13:26:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 13:26:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 13:26:13 [DEBUG   ] spawn_process: at 2018-11-15 13:26:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 13:26:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 13:26:13 [DEBUG   ] spawn_process: at 2018-11-15 13:26:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 13:26:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 13:26:13 [DEBUG   ] spawn_process: at 2018-11-15 13:26:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 13:26:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 13:26:13 [DEBUG   ] spawn_process: at 2018-11-15 13:26:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 13:26:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 13:26:13 [DEBUG   ] spawn_process: at 2018-11-15 13:26:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 13:26:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 13:26:13 [DEBUG   ] spawn_process: at 2018-11-15 13:26:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 13:26:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 13:26:13 [DEBUG   ] spawn_process: at 2018-11-15 13:26:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 13:26:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 13:26:13 [DEBUG   ] spawn_process: at 2018-11-15 13:26:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 13:26:30 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 13:26:35 [DEBUG   ] Got command BAM from MCS: ref #514733
2018-11-15 13:26:35 [INFO    ] Finished processing BAM request
2018-11-15 13:26:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:26:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514733   8 58437 48395025 A  ERROR'
2018-11-15 13:26:35 [DEBUG   ] Got command BAM from MCS: ref #514734
2018-11-15 13:26:35 [INFO    ] Finished processing BAM request
2018-11-15 13:26:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:26:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514734   8 58437 48395029 A  ERROR'
2018-11-15 13:26:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 13:26:35 [DEBUG   ] spawn_process: at 2018-11-15 13:26:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 13:26:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 13:26:35 [DEBUG   ] spawn_process: at 2018-11-15 13:26:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 13:26:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 13:26:35 [DEBUG   ] spawn_process: at 2018-11-15 13:26:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 13:26:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 13:26:35 [DEBUG   ] spawn_process: at 2018-11-15 13:26:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 13:26:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 13:26:35 [DEBUG   ] spawn_process: at 2018-11-15 13:26:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 13:26:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 13:26:35 [DEBUG   ] spawn_process: at 2018-11-15 13:26:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 13:26:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 13:26:35 [DEBUG   ] spawn_process: at 2018-11-15 13:26:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 13:26:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 13:26:35 [DEBUG   ] spawn_process: at 2018-11-15 13:26:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 13:26:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 13:26:35 [DEBUG   ] spawn_process: at 2018-11-15 13:26:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 13:26:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 13:26:35 [DEBUG   ] spawn_process: at 2018-11-15 13:26:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 13:26:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 13:26:35 [DEBUG   ] spawn_process: at 2018-11-15 13:26:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 13:26:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 13:26:35 [DEBUG   ] spawn_process: at 2018-11-15 13:26:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 13:26:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 13:26:35 [DEBUG   ] spawn_process: at 2018-11-15 13:26:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 13:26:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 13:26:35 [DEBUG   ] spawn_process: at 2018-11-15 13:26:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 13:26:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 13:26:35 [DEBUG   ] spawn_process: at 2018-11-15 13:26:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 13:26:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 13:26:35 [DEBUG   ] spawn_process: at 2018-11-15 13:26:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 13:26:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 13:26:35 [DEBUG   ] spawn_process: at 2018-11-15 13:26:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 13:26:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 13:26:35 [DEBUG   ] spawn_process: at 2018-11-15 13:26:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 13:26:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 13:26:35 [DEBUG   ] spawn_process: at 2018-11-15 13:26:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 13:26:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 13:26:35 [DEBUG   ] spawn_process: at 2018-11-15 13:26:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 13:26:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 13:26:35 [DEBUG   ] spawn_process: at 2018-11-15 13:26:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 13:26:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 13:26:35 [DEBUG   ] spawn_process: at 2018-11-15 13:26:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 13:26:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 13:26:35 [DEBUG   ] spawn_process: at 2018-11-15 13:26:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 13:26:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 13:26:35 [DEBUG   ] spawn_process: at 2018-11-15 13:26:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 13:26:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 13:26:35 [DEBUG   ] spawn_process: at 2018-11-15 13:26:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 13:26:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 13:26:35 [DEBUG   ] spawn_process: at 2018-11-15 13:26:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 13:26:50 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 13:26:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 13:26:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-15 13:26:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 13:26:53 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-15 13:26:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 13:26:53 [WARNING ] (13, 1, 'bot')
2018-11-15 13:26:53 [WARNING ] (13, 1, 'bot')
2018-11-15 13:26:53 [WARNING ] (13, 1, 'bot')
2018-11-15 13:26:53 [WARNING ] (13, 1, 'bot')
2018-11-15 13:26:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 13:26:53 [DEBUG   ] Finished updating board flags in 1.004 seconds
2018-11-15 13:26:57 [DEBUG   ] Got command BAM from MCS: ref #514735
2018-11-15 13:26:57 [INFO    ] Finished processing BAM request
2018-11-15 13:26:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:26:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514735   8 58437 48417025 A  ERROR'
2018-11-15 13:26:57 [DEBUG   ] Got command BAM from MCS: ref #514736
2018-11-15 13:26:57 [INFO    ] Finished processing BAM request
2018-11-15 13:26:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:26:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514736   8 58437 48417029 A  ERROR'
2018-11-15 13:26:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 13:26:57 [DEBUG   ] spawn_process: at 2018-11-15 13:26:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 13:26:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 13:26:57 [DEBUG   ] spawn_process: at 2018-11-15 13:26:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 13:26:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 13:26:57 [DEBUG   ] spawn_process: at 2018-11-15 13:26:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 13:26:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 13:26:57 [DEBUG   ] spawn_process: at 2018-11-15 13:26:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 13:26:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 13:26:57 [DEBUG   ] spawn_process: at 2018-11-15 13:26:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 13:26:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 13:26:57 [DEBUG   ] spawn_process: at 2018-11-15 13:26:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 13:26:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 13:26:57 [DEBUG   ] spawn_process: at 2018-11-15 13:26:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 13:26:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 13:26:57 [DEBUG   ] spawn_process: at 2018-11-15 13:26:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 13:26:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 13:26:57 [DEBUG   ] spawn_process: at 2018-11-15 13:26:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 13:26:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 13:26:57 [DEBUG   ] spawn_process: at 2018-11-15 13:26:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 13:26:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 13:26:57 [DEBUG   ] spawn_process: at 2018-11-15 13:26:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 13:26:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 13:26:57 [DEBUG   ] spawn_process: at 2018-11-15 13:26:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 13:26:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 13:26:57 [DEBUG   ] spawn_process: at 2018-11-15 13:26:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 13:26:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 13:26:57 [DEBUG   ] spawn_process: at 2018-11-15 13:26:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 13:26:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 13:26:57 [DEBUG   ] spawn_process: at 2018-11-15 13:26:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 13:26:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 13:26:57 [DEBUG   ] spawn_process: at 2018-11-15 13:26:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 13:26:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 13:26:57 [DEBUG   ] spawn_process: at 2018-11-15 13:26:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 13:26:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 13:26:57 [DEBUG   ] spawn_process: at 2018-11-15 13:26:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 13:26:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 13:26:57 [DEBUG   ] spawn_process: at 2018-11-15 13:26:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 13:26:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 13:26:57 [DEBUG   ] spawn_process: at 2018-11-15 13:26:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 13:26:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 13:26:57 [DEBUG   ] spawn_process: at 2018-11-15 13:26:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 13:26:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 13:26:57 [DEBUG   ] spawn_process: at 2018-11-15 13:26:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 13:26:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 13:26:57 [DEBUG   ] spawn_process: at 2018-11-15 13:26:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 13:26:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 13:26:57 [DEBUG   ] spawn_process: at 2018-11-15 13:26:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 13:26:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 13:26:57 [DEBUG   ] spawn_process: at 2018-11-15 13:26:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 13:26:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 13:26:57 [DEBUG   ] spawn_process: at 2018-11-15 13:26:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 13:27:10 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 13:27:19 [DEBUG   ] Got command BAM from MCS: ref #514737
2018-11-15 13:27:19 [INFO    ] Finished processing BAM request
2018-11-15 13:27:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:27:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514737   8 58437 48439037 A  ERROR'
2018-11-15 13:27:19 [DEBUG   ] Got command BAM from MCS: ref #514738
2018-11-15 13:27:19 [INFO    ] Finished processing BAM request
2018-11-15 13:27:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:27:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514738   8 58437 48439045 A  ERROR'
2018-11-15 13:27:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 13:27:19 [DEBUG   ] spawn_process: at 2018-11-15 13:27:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 13:27:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 13:27:19 [DEBUG   ] spawn_process: at 2018-11-15 13:27:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 13:27:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 13:27:19 [DEBUG   ] spawn_process: at 2018-11-15 13:27:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 13:27:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 13:27:19 [DEBUG   ] spawn_process: at 2018-11-15 13:27:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 13:27:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 13:27:19 [DEBUG   ] spawn_process: at 2018-11-15 13:27:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 13:27:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 13:27:19 [DEBUG   ] spawn_process: at 2018-11-15 13:27:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 13:27:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 13:27:19 [DEBUG   ] spawn_process: at 2018-11-15 13:27:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 13:27:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 13:27:19 [DEBUG   ] spawn_process: at 2018-11-15 13:27:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 13:27:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 13:27:19 [DEBUG   ] spawn_process: at 2018-11-15 13:27:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 13:27:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 13:27:19 [DEBUG   ] spawn_process: at 2018-11-15 13:27:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 13:27:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 13:27:19 [DEBUG   ] spawn_process: at 2018-11-15 13:27:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 13:27:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 13:27:19 [DEBUG   ] spawn_process: at 2018-11-15 13:27:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 13:27:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 13:27:19 [DEBUG   ] spawn_process: at 2018-11-15 13:27:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 13:27:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 13:27:19 [DEBUG   ] spawn_process: at 2018-11-15 13:27:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 13:27:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 13:27:19 [DEBUG   ] spawn_process: at 2018-11-15 13:27:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 13:27:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 13:27:19 [DEBUG   ] spawn_process: at 2018-11-15 13:27:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 13:27:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 13:27:19 [DEBUG   ] spawn_process: at 2018-11-15 13:27:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 13:27:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 13:27:19 [DEBUG   ] spawn_process: at 2018-11-15 13:27:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 13:27:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 13:27:19 [DEBUG   ] spawn_process: at 2018-11-15 13:27:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 13:27:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 13:27:19 [DEBUG   ] spawn_process: at 2018-11-15 13:27:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 13:27:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 13:27:19 [DEBUG   ] spawn_process: at 2018-11-15 13:27:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 13:27:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 13:27:19 [DEBUG   ] spawn_process: at 2018-11-15 13:27:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 13:27:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 13:27:19 [DEBUG   ] spawn_process: at 2018-11-15 13:27:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 13:27:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 13:27:19 [DEBUG   ] spawn_process: at 2018-11-15 13:27:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 13:27:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 13:27:19 [DEBUG   ] spawn_process: at 2018-11-15 13:27:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 13:27:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 13:27:19 [DEBUG   ] spawn_process: at 2018-11-15 13:27:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 13:27:30 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 13:27:41 [DEBUG   ] Got command BAM from MCS: ref #514740
2018-11-15 13:27:41 [INFO    ] Finished processing BAM request
2018-11-15 13:27:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:27:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514740   8 58437 48461025 A  ERROR'
2018-11-15 13:27:41 [DEBUG   ] Got command BAM from MCS: ref #514739
2018-11-15 13:27:41 [INFO    ] Finished processing BAM request
2018-11-15 13:27:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:27:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514739   8 58437 48461029 A  ERROR'
2018-11-15 13:27:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 13:27:41 [DEBUG   ] spawn_process: at 2018-11-15 13:27:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 13:27:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 13:27:41 [DEBUG   ] spawn_process: at 2018-11-15 13:27:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 13:27:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 13:27:41 [DEBUG   ] spawn_process: at 2018-11-15 13:27:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 13:27:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 13:27:41 [DEBUG   ] spawn_process: at 2018-11-15 13:27:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 13:27:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 13:27:41 [DEBUG   ] spawn_process: at 2018-11-15 13:27:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 13:27:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 13:27:41 [DEBUG   ] spawn_process: at 2018-11-15 13:27:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 13:27:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 13:27:41 [DEBUG   ] spawn_process: at 2018-11-15 13:27:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 13:27:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 13:27:41 [DEBUG   ] spawn_process: at 2018-11-15 13:27:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 13:27:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 13:27:41 [DEBUG   ] spawn_process: at 2018-11-15 13:27:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 13:27:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 13:27:41 [DEBUG   ] spawn_process: at 2018-11-15 13:27:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 13:27:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 13:27:41 [DEBUG   ] spawn_process: at 2018-11-15 13:27:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 13:27:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 13:27:41 [DEBUG   ] spawn_process: at 2018-11-15 13:27:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 13:27:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 13:27:41 [DEBUG   ] spawn_process: at 2018-11-15 13:27:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 13:27:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 13:27:41 [DEBUG   ] spawn_process: at 2018-11-15 13:27:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 13:27:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 13:27:41 [DEBUG   ] spawn_process: at 2018-11-15 13:27:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 13:27:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 13:27:41 [DEBUG   ] spawn_process: at 2018-11-15 13:27:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 13:27:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 13:27:41 [DEBUG   ] spawn_process: at 2018-11-15 13:27:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 13:27:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 13:27:41 [DEBUG   ] spawn_process: at 2018-11-15 13:27:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 13:27:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 13:27:41 [DEBUG   ] spawn_process: at 2018-11-15 13:27:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 13:27:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 13:27:41 [DEBUG   ] spawn_process: at 2018-11-15 13:27:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 13:27:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 13:27:41 [DEBUG   ] spawn_process: at 2018-11-15 13:27:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 13:27:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 13:27:41 [DEBUG   ] spawn_process: at 2018-11-15 13:27:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 13:27:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 13:27:41 [DEBUG   ] spawn_process: at 2018-11-15 13:27:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 13:27:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 13:27:41 [DEBUG   ] spawn_process: at 2018-11-15 13:27:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 13:27:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 13:27:41 [DEBUG   ] spawn_process: at 2018-11-15 13:27:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 13:27:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 13:27:41 [DEBUG   ] spawn_process: at 2018-11-15 13:27:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 13:27:50 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 13:27:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 13:27:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-11-15 13:27:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 13:27:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-15 13:27:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 13:27:53 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 13:27:53 [WARNING ] (13, 1, 'bot')
2018-11-15 13:27:53 [WARNING ] (13, 1, 'bot')
2018-11-15 13:27:53 [WARNING ] (13, 1, 'bot')
2018-11-15 13:27:53 [WARNING ] (13, 1, 'bot')
2018-11-15 13:27:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 13:27:53 [DEBUG   ] Finished updating board flags in 1.007 seconds
2018-11-15 13:28:03 [DEBUG   ] Got command BAM from MCS: ref #514742
2018-11-15 13:28:03 [INFO    ] Finished processing BAM request
2018-11-15 13:28:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:28:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514742   8 58437 48483033 A  ERROR'
2018-11-15 13:28:03 [DEBUG   ] Got command BAM from MCS: ref #514741
2018-11-15 13:28:03 [INFO    ] Finished processing BAM request
2018-11-15 13:28:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:28:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514741   8 58437 48483037 A  ERROR'
2018-11-15 13:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 13:28:03 [DEBUG   ] spawn_process: at 2018-11-15 13:28:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 13:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 13:28:03 [DEBUG   ] spawn_process: at 2018-11-15 13:28:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 13:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 13:28:03 [DEBUG   ] spawn_process: at 2018-11-15 13:28:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 13:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 13:28:03 [DEBUG   ] spawn_process: at 2018-11-15 13:28:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 13:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 13:28:03 [DEBUG   ] spawn_process: at 2018-11-15 13:28:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 13:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 13:28:03 [DEBUG   ] spawn_process: at 2018-11-15 13:28:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 13:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 13:28:03 [DEBUG   ] spawn_process: at 2018-11-15 13:28:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 13:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 13:28:03 [DEBUG   ] spawn_process: at 2018-11-15 13:28:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 13:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 13:28:03 [DEBUG   ] spawn_process: at 2018-11-15 13:28:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 13:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 13:28:03 [DEBUG   ] spawn_process: at 2018-11-15 13:28:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 13:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 13:28:03 [DEBUG   ] spawn_process: at 2018-11-15 13:28:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 13:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 13:28:03 [DEBUG   ] spawn_process: at 2018-11-15 13:28:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 13:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 13:28:03 [DEBUG   ] spawn_process: at 2018-11-15 13:28:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 13:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 13:28:03 [DEBUG   ] spawn_process: at 2018-11-15 13:28:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 13:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 13:28:03 [DEBUG   ] spawn_process: at 2018-11-15 13:28:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 13:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 13:28:03 [DEBUG   ] spawn_process: at 2018-11-15 13:28:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 13:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 13:28:03 [DEBUG   ] spawn_process: at 2018-11-15 13:28:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 13:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 13:28:03 [DEBUG   ] spawn_process: at 2018-11-15 13:28:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 13:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 13:28:03 [DEBUG   ] spawn_process: at 2018-11-15 13:28:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 13:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 13:28:03 [DEBUG   ] spawn_process: at 2018-11-15 13:28:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 13:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 13:28:03 [DEBUG   ] spawn_process: at 2018-11-15 13:28:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 13:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 13:28:03 [DEBUG   ] spawn_process: at 2018-11-15 13:28:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 13:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 13:28:03 [DEBUG   ] spawn_process: at 2018-11-15 13:28:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 13:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 13:28:03 [DEBUG   ] spawn_process: at 2018-11-15 13:28:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 13:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 13:28:03 [DEBUG   ] spawn_process: at 2018-11-15 13:28:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 13:28:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 13:28:03 [DEBUG   ] spawn_process: at 2018-11-15 13:28:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 13:28:10 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 13:28:16 [DEBUG   ] Got command RPT from MCS: ref #514745
2018-11-15 13:28:16 [DEBUG   ] summary = ERROR
2018-11-15 13:28:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   514745  13 58437 48496393 A  ERRORERROR'
2018-11-15 13:28:16 [DEBUG   ] Got command RPT from MCS: ref #514746
2018-11-15 13:28:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 13:28:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   514746  77 58437 48496597 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 13:28:16 [DEBUG   ] Got command RPT from MCS: ref #514747
2018-11-15 13:28:16 [DEBUG   ] summary = ERROR
2018-11-15 13:28:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   514747  13 58437 48496801 A  ERRORERROR'
2018-11-15 13:28:17 [DEBUG   ] Got command RPT from MCS: ref #514749
2018-11-15 13:28:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 13:28:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   514749  77 58437 48497005 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 13:28:17 [DEBUG   ] Got command RPT from MCS: ref #514750
2018-11-15 13:28:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 13:28:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   514750  12 58437 48497197 A  ERRORB¢ff'
2018-11-15 13:28:25 [DEBUG   ] Got command BAM from MCS: ref #514755
2018-11-15 13:28:25 [INFO    ] Finished processing BAM request
2018-11-15 13:28:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:28:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514755   8 58437 48505025 A  ERROR'
2018-11-15 13:28:25 [DEBUG   ] Got command BAM from MCS: ref #514756
2018-11-15 13:28:25 [INFO    ] Finished processing BAM request
2018-11-15 13:28:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:28:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514756   8 58437 48505029 A  ERROR'
2018-11-15 13:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 13:28:25 [DEBUG   ] spawn_process: at 2018-11-15 13:28:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 13:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 13:28:25 [DEBUG   ] spawn_process: at 2018-11-15 13:28:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 13:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 13:28:25 [DEBUG   ] spawn_process: at 2018-11-15 13:28:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 13:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 13:28:25 [DEBUG   ] spawn_process: at 2018-11-15 13:28:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 13:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 13:28:25 [DEBUG   ] spawn_process: at 2018-11-15 13:28:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 13:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 13:28:25 [DEBUG   ] spawn_process: at 2018-11-15 13:28:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 13:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 13:28:25 [DEBUG   ] spawn_process: at 2018-11-15 13:28:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 13:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 13:28:25 [DEBUG   ] spawn_process: at 2018-11-15 13:28:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 13:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 13:28:25 [DEBUG   ] spawn_process: at 2018-11-15 13:28:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 13:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 13:28:25 [DEBUG   ] spawn_process: at 2018-11-15 13:28:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 13:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 13:28:25 [DEBUG   ] spawn_process: at 2018-11-15 13:28:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 13:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 13:28:25 [DEBUG   ] spawn_process: at 2018-11-15 13:28:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 13:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 13:28:25 [DEBUG   ] spawn_process: at 2018-11-15 13:28:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 13:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 13:28:25 [DEBUG   ] spawn_process: at 2018-11-15 13:28:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 13:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 13:28:25 [DEBUG   ] spawn_process: at 2018-11-15 13:28:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 13:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 13:28:25 [DEBUG   ] spawn_process: at 2018-11-15 13:28:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 13:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 13:28:25 [DEBUG   ] spawn_process: at 2018-11-15 13:28:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 13:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 13:28:25 [DEBUG   ] spawn_process: at 2018-11-15 13:28:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 13:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 13:28:25 [DEBUG   ] spawn_process: at 2018-11-15 13:28:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 13:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 13:28:25 [DEBUG   ] spawn_process: at 2018-11-15 13:28:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 13:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 13:28:25 [DEBUG   ] spawn_process: at 2018-11-15 13:28:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 13:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 13:28:25 [DEBUG   ] spawn_process: at 2018-11-15 13:28:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 13:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 13:28:25 [DEBUG   ] spawn_process: at 2018-11-15 13:28:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 13:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 13:28:25 [DEBUG   ] spawn_process: at 2018-11-15 13:28:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 13:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 13:28:25 [DEBUG   ] spawn_process: at 2018-11-15 13:28:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 13:28:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 13:28:25 [DEBUG   ] spawn_process: at 2018-11-15 13:28:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 13:28:30 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 13:28:47 [DEBUG   ] Got command BAM from MCS: ref #514757
2018-11-15 13:28:47 [INFO    ] Finished processing BAM request
2018-11-15 13:28:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:28:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514757   8 58437 48527025 A  ERROR'
2018-11-15 13:28:47 [DEBUG   ] Got command BAM from MCS: ref #514758
2018-11-15 13:28:47 [INFO    ] Finished processing BAM request
2018-11-15 13:28:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:28:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514758   8 58437 48527029 A  ERROR'
2018-11-15 13:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 13:28:47 [DEBUG   ] spawn_process: at 2018-11-15 13:28:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 13:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 13:28:47 [DEBUG   ] spawn_process: at 2018-11-15 13:28:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 13:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 13:28:47 [DEBUG   ] spawn_process: at 2018-11-15 13:28:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 13:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 13:28:47 [DEBUG   ] spawn_process: at 2018-11-15 13:28:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 13:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 13:28:47 [DEBUG   ] spawn_process: at 2018-11-15 13:28:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 13:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 13:28:47 [DEBUG   ] spawn_process: at 2018-11-15 13:28:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 13:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 13:28:47 [DEBUG   ] spawn_process: at 2018-11-15 13:28:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 13:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 13:28:47 [DEBUG   ] spawn_process: at 2018-11-15 13:28:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 13:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 13:28:47 [DEBUG   ] spawn_process: at 2018-11-15 13:28:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 13:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 13:28:47 [DEBUG   ] spawn_process: at 2018-11-15 13:28:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 13:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 13:28:47 [DEBUG   ] spawn_process: at 2018-11-15 13:28:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 13:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 13:28:47 [DEBUG   ] spawn_process: at 2018-11-15 13:28:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 13:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 13:28:47 [DEBUG   ] spawn_process: at 2018-11-15 13:28:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 13:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 13:28:47 [DEBUG   ] spawn_process: at 2018-11-15 13:28:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 13:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 13:28:47 [DEBUG   ] spawn_process: at 2018-11-15 13:28:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 13:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 13:28:47 [DEBUG   ] spawn_process: at 2018-11-15 13:28:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 13:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 13:28:47 [DEBUG   ] spawn_process: at 2018-11-15 13:28:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 13:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 13:28:47 [DEBUG   ] spawn_process: at 2018-11-15 13:28:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 13:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 13:28:47 [DEBUG   ] spawn_process: at 2018-11-15 13:28:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 13:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 13:28:47 [DEBUG   ] spawn_process: at 2018-11-15 13:28:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 13:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 13:28:47 [DEBUG   ] spawn_process: at 2018-11-15 13:28:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 13:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 13:28:47 [DEBUG   ] spawn_process: at 2018-11-15 13:28:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 13:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 13:28:47 [DEBUG   ] spawn_process: at 2018-11-15 13:28:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 13:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 13:28:47 [DEBUG   ] spawn_process: at 2018-11-15 13:28:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 13:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 13:28:47 [DEBUG   ] spawn_process: at 2018-11-15 13:28:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 13:28:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 13:28:47 [DEBUG   ] spawn_process: at 2018-11-15 13:28:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 13:28:50 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 13:28:52 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-11-15 13:28:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2018-11-15 13:28:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 13:28:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 13:28:53 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 13:28:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 13:28:53 [WARNING ] (13, 1, 'bot')
2018-11-15 13:28:53 [WARNING ] (13, 1, 'bot')
2018-11-15 13:28:53 [WARNING ] (13, 1, 'bot')
2018-11-15 13:28:53 [WARNING ] (13, 1, 'bot')
2018-11-15 13:28:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 13:28:53 [DEBUG   ] Finished updating board flags in 1.009 seconds
2018-11-15 13:29:09 [DEBUG   ] Got command BAM from MCS: ref #514760
2018-11-15 13:29:09 [INFO    ] Finished processing BAM request
2018-11-15 13:29:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:29:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514760   8 58437 48549025 A  ERROR'
2018-11-15 13:29:09 [DEBUG   ] Got command BAM from MCS: ref #514759
2018-11-15 13:29:09 [INFO    ] Finished processing BAM request
2018-11-15 13:29:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:29:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514759   8 58437 48549029 A  ERROR'
2018-11-15 13:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 13:29:09 [DEBUG   ] spawn_process: at 2018-11-15 13:29:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 13:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 13:29:09 [DEBUG   ] spawn_process: at 2018-11-15 13:29:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 13:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 13:29:09 [DEBUG   ] spawn_process: at 2018-11-15 13:29:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 13:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 13:29:09 [DEBUG   ] spawn_process: at 2018-11-15 13:29:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 13:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 13:29:09 [DEBUG   ] spawn_process: at 2018-11-15 13:29:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 13:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 13:29:09 [DEBUG   ] spawn_process: at 2018-11-15 13:29:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 13:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 13:29:09 [DEBUG   ] spawn_process: at 2018-11-15 13:29:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 13:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 13:29:09 [DEBUG   ] spawn_process: at 2018-11-15 13:29:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 13:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 13:29:09 [DEBUG   ] spawn_process: at 2018-11-15 13:29:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 13:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 13:29:09 [DEBUG   ] spawn_process: at 2018-11-15 13:29:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 13:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 13:29:09 [DEBUG   ] spawn_process: at 2018-11-15 13:29:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 13:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 13:29:09 [DEBUG   ] spawn_process: at 2018-11-15 13:29:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 13:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 13:29:09 [DEBUG   ] spawn_process: at 2018-11-15 13:29:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 13:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 13:29:09 [DEBUG   ] spawn_process: at 2018-11-15 13:29:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 13:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 13:29:09 [DEBUG   ] spawn_process: at 2018-11-15 13:29:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 13:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 13:29:09 [DEBUG   ] spawn_process: at 2018-11-15 13:29:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 13:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 13:29:09 [DEBUG   ] spawn_process: at 2018-11-15 13:29:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 13:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 13:29:09 [DEBUG   ] spawn_process: at 2018-11-15 13:29:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 13:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 13:29:09 [DEBUG   ] spawn_process: at 2018-11-15 13:29:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 13:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 13:29:09 [DEBUG   ] spawn_process: at 2018-11-15 13:29:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 13:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 13:29:09 [DEBUG   ] spawn_process: at 2018-11-15 13:29:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 13:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 13:29:09 [DEBUG   ] spawn_process: at 2018-11-15 13:29:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 13:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 13:29:09 [DEBUG   ] spawn_process: at 2018-11-15 13:29:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 13:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 13:29:09 [DEBUG   ] spawn_process: at 2018-11-15 13:29:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 13:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 13:29:09 [DEBUG   ] spawn_process: at 2018-11-15 13:29:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 13:29:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 13:29:09 [DEBUG   ] spawn_process: at 2018-11-15 13:29:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 13:29:10 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 13:29:30 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 13:29:31 [DEBUG   ] Got command BAM from MCS: ref #514765
2018-11-15 13:29:31 [INFO    ] Finished processing BAM request
2018-11-15 13:29:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:29:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514765   8 58437 48571029 A  ERROR'
2018-11-15 13:29:31 [DEBUG   ] Got command BAM from MCS: ref #514766
2018-11-15 13:29:31 [INFO    ] Finished processing BAM request
2018-11-15 13:29:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:29:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514766   8 58437 48571033 A  ERROR'
2018-11-15 13:29:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 13:29:31 [DEBUG   ] spawn_process: at 2018-11-15 13:29:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 13:29:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 13:29:31 [DEBUG   ] spawn_process: at 2018-11-15 13:29:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 13:29:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 13:29:31 [DEBUG   ] spawn_process: at 2018-11-15 13:29:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 13:29:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 13:29:31 [DEBUG   ] spawn_process: at 2018-11-15 13:29:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 13:29:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 13:29:31 [DEBUG   ] spawn_process: at 2018-11-15 13:29:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 13:29:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 13:29:31 [DEBUG   ] spawn_process: at 2018-11-15 13:29:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 13:29:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 13:29:31 [DEBUG   ] spawn_process: at 2018-11-15 13:29:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 13:29:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 13:29:31 [DEBUG   ] spawn_process: at 2018-11-15 13:29:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 13:29:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 13:29:31 [DEBUG   ] spawn_process: at 2018-11-15 13:29:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 13:29:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 13:29:31 [DEBUG   ] spawn_process: at 2018-11-15 13:29:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 13:29:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 13:29:31 [DEBUG   ] spawn_process: at 2018-11-15 13:29:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 13:29:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 13:29:31 [DEBUG   ] spawn_process: at 2018-11-15 13:29:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 13:29:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 13:29:31 [DEBUG   ] spawn_process: at 2018-11-15 13:29:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 13:29:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 13:29:31 [DEBUG   ] spawn_process: at 2018-11-15 13:29:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 13:29:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 13:29:31 [DEBUG   ] spawn_process: at 2018-11-15 13:29:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 13:29:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 13:29:31 [DEBUG   ] spawn_process: at 2018-11-15 13:29:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 13:29:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 13:29:31 [DEBUG   ] spawn_process: at 2018-11-15 13:29:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 13:29:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 13:29:31 [DEBUG   ] spawn_process: at 2018-11-15 13:29:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 13:29:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 13:29:31 [DEBUG   ] spawn_process: at 2018-11-15 13:29:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 13:29:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 13:29:31 [DEBUG   ] spawn_process: at 2018-11-15 13:29:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 13:29:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 13:29:31 [DEBUG   ] spawn_process: at 2018-11-15 13:29:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 13:29:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 13:29:31 [DEBUG   ] spawn_process: at 2018-11-15 13:29:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 13:29:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 13:29:31 [DEBUG   ] spawn_process: at 2018-11-15 13:29:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 13:29:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 13:29:31 [DEBUG   ] spawn_process: at 2018-11-15 13:29:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 13:29:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 13:29:31 [DEBUG   ] spawn_process: at 2018-11-15 13:29:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 13:29:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 13:29:31 [DEBUG   ] spawn_process: at 2018-11-15 13:29:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 13:29:50 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 13:29:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 13:29:52 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-15 13:29:53 [DEBUG   ] Got command BAM from MCS: ref #514767
2018-11-15 13:29:53 [INFO    ] Finished processing BAM request
2018-11-15 13:29:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:29:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514767   8 58437 48593037 A  ERROR'
2018-11-15 13:29:53 [DEBUG   ] Got command BAM from MCS: ref #514768
2018-11-15 13:29:53 [INFO    ] Finished processing BAM request
2018-11-15 13:29:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:29:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514768   8 58437 48593045 A  ERROR'
2018-11-15 13:29:53 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 13:29:53 [WARNING ] (13, 1, 'bot')
2018-11-15 13:29:53 [WARNING ] (13, 1, 'bot')
2018-11-15 13:29:53 [WARNING ] (13, 1, 'bot')
2018-11-15 13:29:53 [WARNING ] (13, 1, 'bot')
2018-11-15 13:29:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 13:29:53 [DEBUG   ] Finished updating board flags in 0.991 seconds
2018-11-15 13:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 13:29:53 [DEBUG   ] spawn_process: at 2018-11-15 13:29:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 13:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 13:29:53 [DEBUG   ] spawn_process: at 2018-11-15 13:29:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 13:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 13:29:53 [DEBUG   ] spawn_process: at 2018-11-15 13:29:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 13:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 13:29:53 [DEBUG   ] spawn_process: at 2018-11-15 13:29:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 13:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 13:29:53 [DEBUG   ] spawn_process: at 2018-11-15 13:29:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 13:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 13:29:53 [DEBUG   ] spawn_process: at 2018-11-15 13:29:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 13:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 13:29:53 [DEBUG   ] spawn_process: at 2018-11-15 13:29:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 13:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 13:29:53 [DEBUG   ] spawn_process: at 2018-11-15 13:29:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 13:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 13:29:53 [DEBUG   ] spawn_process: at 2018-11-15 13:29:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 13:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 13:29:53 [DEBUG   ] spawn_process: at 2018-11-15 13:29:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 13:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 13:29:53 [DEBUG   ] spawn_process: at 2018-11-15 13:29:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 13:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 13:29:53 [DEBUG   ] spawn_process: at 2018-11-15 13:29:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 13:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 13:29:53 [DEBUG   ] spawn_process: at 2018-11-15 13:29:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 13:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 13:29:53 [DEBUG   ] spawn_process: at 2018-11-15 13:29:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 13:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 13:29:53 [DEBUG   ] spawn_process: at 2018-11-15 13:29:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 13:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 13:29:53 [DEBUG   ] spawn_process: at 2018-11-15 13:29:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 13:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 13:29:53 [DEBUG   ] spawn_process: at 2018-11-15 13:29:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 13:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 13:29:53 [DEBUG   ] spawn_process: at 2018-11-15 13:29:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 13:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 13:29:53 [DEBUG   ] spawn_process: at 2018-11-15 13:29:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 13:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 13:29:53 [DEBUG   ] spawn_process: at 2018-11-15 13:29:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 13:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 13:29:53 [DEBUG   ] spawn_process: at 2018-11-15 13:29:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 13:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 13:29:53 [DEBUG   ] spawn_process: at 2018-11-15 13:29:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 13:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 13:29:53 [DEBUG   ] spawn_process: at 2018-11-15 13:29:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 13:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 13:29:53 [DEBUG   ] spawn_process: at 2018-11-15 13:29:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 13:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 13:29:53 [DEBUG   ] spawn_process: at 2018-11-15 13:29:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 13:29:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 13:29:53 [DEBUG   ] spawn_process: at 2018-11-15 13:29:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 13:30:10 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 13:30:15 [DEBUG   ] Got command BAM from MCS: ref #514769
2018-11-15 13:30:15 [INFO    ] Finished processing BAM request
2018-11-15 13:30:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:30:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514769   8 58437 48615025 A  ERROR'
2018-11-15 13:30:15 [DEBUG   ] Got command BAM from MCS: ref #514770
2018-11-15 13:30:15 [INFO    ] Finished processing BAM request
2018-11-15 13:30:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:30:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514770   8 58437 48615029 A  ERROR'
2018-11-15 13:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 13:30:15 [DEBUG   ] spawn_process: at 2018-11-15 13:30:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 13:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 13:30:15 [DEBUG   ] spawn_process: at 2018-11-15 13:30:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 13:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 13:30:15 [DEBUG   ] spawn_process: at 2018-11-15 13:30:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 13:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 13:30:15 [DEBUG   ] spawn_process: at 2018-11-15 13:30:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 13:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 13:30:15 [DEBUG   ] spawn_process: at 2018-11-15 13:30:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 13:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 13:30:15 [DEBUG   ] spawn_process: at 2018-11-15 13:30:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 13:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 13:30:15 [DEBUG   ] spawn_process: at 2018-11-15 13:30:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 13:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 13:30:15 [DEBUG   ] spawn_process: at 2018-11-15 13:30:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 13:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 13:30:15 [DEBUG   ] spawn_process: at 2018-11-15 13:30:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 13:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 13:30:15 [DEBUG   ] spawn_process: at 2018-11-15 13:30:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 13:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 13:30:15 [DEBUG   ] spawn_process: at 2018-11-15 13:30:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 13:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 13:30:15 [DEBUG   ] spawn_process: at 2018-11-15 13:30:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 13:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 13:30:15 [DEBUG   ] spawn_process: at 2018-11-15 13:30:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 13:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 13:30:15 [DEBUG   ] spawn_process: at 2018-11-15 13:30:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 13:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 13:30:15 [DEBUG   ] spawn_process: at 2018-11-15 13:30:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 13:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 13:30:15 [DEBUG   ] spawn_process: at 2018-11-15 13:30:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 13:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 13:30:15 [DEBUG   ] spawn_process: at 2018-11-15 13:30:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 13:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 13:30:15 [DEBUG   ] spawn_process: at 2018-11-15 13:30:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 13:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 13:30:15 [DEBUG   ] spawn_process: at 2018-11-15 13:30:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 13:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 13:30:15 [DEBUG   ] spawn_process: at 2018-11-15 13:30:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 13:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 13:30:15 [DEBUG   ] spawn_process: at 2018-11-15 13:30:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 13:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 13:30:15 [DEBUG   ] spawn_process: at 2018-11-15 13:30:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 13:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 13:30:15 [DEBUG   ] spawn_process: at 2018-11-15 13:30:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 13:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 13:30:15 [DEBUG   ] spawn_process: at 2018-11-15 13:30:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 13:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 13:30:15 [DEBUG   ] spawn_process: at 2018-11-15 13:30:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 13:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 13:30:15 [DEBUG   ] spawn_process: at 2018-11-15 13:30:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 13:30:30 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 13:30:37 [DEBUG   ] Got command BAM from MCS: ref #514771
2018-11-15 13:30:37 [INFO    ] Finished processing BAM request
2018-11-15 13:30:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514771   8 58437 48637029 A  ERROR'
2018-11-15 13:30:37 [DEBUG   ] Got command BAM from MCS: ref #514772
2018-11-15 13:30:37 [INFO    ] Finished processing BAM request
2018-11-15 13:30:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:30:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514772   8 58437 48637033 A  ERROR'
2018-11-15 13:30:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 13:30:37 [DEBUG   ] spawn_process: at 2018-11-15 13:30:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 13:30:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 13:30:37 [DEBUG   ] spawn_process: at 2018-11-15 13:30:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 13:30:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 13:30:37 [DEBUG   ] spawn_process: at 2018-11-15 13:30:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 13:30:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 13:30:37 [DEBUG   ] spawn_process: at 2018-11-15 13:30:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 13:30:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 13:30:37 [DEBUG   ] spawn_process: at 2018-11-15 13:30:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 13:30:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 13:30:37 [DEBUG   ] spawn_process: at 2018-11-15 13:30:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 13:30:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 13:30:37 [DEBUG   ] spawn_process: at 2018-11-15 13:30:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 13:30:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 13:30:37 [DEBUG   ] spawn_process: at 2018-11-15 13:30:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 13:30:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 13:30:37 [DEBUG   ] spawn_process: at 2018-11-15 13:30:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 13:30:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 13:30:37 [DEBUG   ] spawn_process: at 2018-11-15 13:30:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 13:30:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 13:30:37 [DEBUG   ] spawn_process: at 2018-11-15 13:30:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 13:30:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 13:30:37 [DEBUG   ] spawn_process: at 2018-11-15 13:30:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 13:30:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 13:30:37 [DEBUG   ] spawn_process: at 2018-11-15 13:30:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 13:30:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 13:30:37 [DEBUG   ] spawn_process: at 2018-11-15 13:30:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 13:30:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 13:30:37 [DEBUG   ] spawn_process: at 2018-11-15 13:30:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 13:30:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 13:30:37 [DEBUG   ] spawn_process: at 2018-11-15 13:30:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 13:30:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 13:30:37 [DEBUG   ] spawn_process: at 2018-11-15 13:30:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 13:30:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 13:30:37 [DEBUG   ] spawn_process: at 2018-11-15 13:30:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 13:30:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 13:30:37 [DEBUG   ] spawn_process: at 2018-11-15 13:30:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 13:30:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 13:30:37 [DEBUG   ] spawn_process: at 2018-11-15 13:30:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 13:30:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 13:30:37 [DEBUG   ] spawn_process: at 2018-11-15 13:30:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 13:30:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 13:30:37 [DEBUG   ] spawn_process: at 2018-11-15 13:30:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 13:30:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 13:30:37 [DEBUG   ] spawn_process: at 2018-11-15 13:30:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 13:30:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 13:30:37 [DEBUG   ] spawn_process: at 2018-11-15 13:30:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 13:30:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 13:30:37 [DEBUG   ] spawn_process: at 2018-11-15 13:30:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 13:30:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 13:30:37 [DEBUG   ] spawn_process: at 2018-11-15 13:30:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 13:30:45 [DEBUG   ] Got command RPT from MCS: ref #514773
2018-11-15 13:30:45 [DEBUG   ] summary = ERROR
2018-11-15 13:30:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   514773  13 58437 48645097 A  ERRORERROR'
2018-11-15 13:30:45 [DEBUG   ] Got command RPT from MCS: ref #514774
2018-11-15 13:30:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 13:30:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   514774  77 58437 48645098 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 13:30:50 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 13:30:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 13:30:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-15 13:30:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-15 13:30:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 13:30:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa20, chip 4
2018-11-15 13:30:54 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 13:30:54 [WARNING ] (13, 1, 'bot')
2018-11-15 13:30:54 [WARNING ] (13, 1, 'bot')
2018-11-15 13:30:54 [WARNING ] (13, 1, 'bot')
2018-11-15 13:30:54 [WARNING ] (13, 1, 'bot')
2018-11-15 13:30:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 13:30:54 [DEBUG   ] Finished updating board flags in 1.868 seconds
2018-11-15 13:30:59 [DEBUG   ] Got command BAM from MCS: ref #514791
2018-11-15 13:30:59 [INFO    ] Finished processing BAM request
2018-11-15 13:30:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:30:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514791   8 58437 48659029 A  ERROR'
2018-11-15 13:30:59 [DEBUG   ] Got command BAM from MCS: ref #514790
2018-11-15 13:30:59 [INFO    ] Finished processing BAM request
2018-11-15 13:30:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:30:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514790   8 58437 48659033 A  ERROR'
2018-11-15 13:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 13:30:59 [DEBUG   ] spawn_process: at 2018-11-15 13:30:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 13:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 13:30:59 [DEBUG   ] spawn_process: at 2018-11-15 13:30:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 13:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 13:30:59 [DEBUG   ] spawn_process: at 2018-11-15 13:30:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 13:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 13:30:59 [DEBUG   ] spawn_process: at 2018-11-15 13:30:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 13:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 13:30:59 [DEBUG   ] spawn_process: at 2018-11-15 13:30:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 13:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 13:30:59 [DEBUG   ] spawn_process: at 2018-11-15 13:30:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 13:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 13:30:59 [DEBUG   ] spawn_process: at 2018-11-15 13:30:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 13:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 13:30:59 [DEBUG   ] spawn_process: at 2018-11-15 13:30:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 13:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 13:30:59 [DEBUG   ] spawn_process: at 2018-11-15 13:30:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 13:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 13:30:59 [DEBUG   ] spawn_process: at 2018-11-15 13:30:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 13:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 13:30:59 [DEBUG   ] spawn_process: at 2018-11-15 13:30:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 13:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 13:30:59 [DEBUG   ] spawn_process: at 2018-11-15 13:30:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 13:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 13:30:59 [DEBUG   ] spawn_process: at 2018-11-15 13:30:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 13:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 13:30:59 [DEBUG   ] spawn_process: at 2018-11-15 13:30:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 13:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 13:30:59 [DEBUG   ] spawn_process: at 2018-11-15 13:30:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 13:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 13:30:59 [DEBUG   ] spawn_process: at 2018-11-15 13:30:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 13:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 13:30:59 [DEBUG   ] spawn_process: at 2018-11-15 13:30:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 13:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 13:30:59 [DEBUG   ] spawn_process: at 2018-11-15 13:30:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 13:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 13:30:59 [DEBUG   ] spawn_process: at 2018-11-15 13:30:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 13:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 13:30:59 [DEBUG   ] spawn_process: at 2018-11-15 13:30:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 13:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 13:30:59 [DEBUG   ] spawn_process: at 2018-11-15 13:30:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 13:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 13:30:59 [DEBUG   ] spawn_process: at 2018-11-15 13:30:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 13:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 13:30:59 [DEBUG   ] spawn_process: at 2018-11-15 13:30:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 13:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 13:30:59 [DEBUG   ] spawn_process: at 2018-11-15 13:30:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 13:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 13:30:59 [DEBUG   ] spawn_process: at 2018-11-15 13:30:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 13:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 13:30:59 [DEBUG   ] spawn_process: at 2018-11-15 13:30:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 13:31:10 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 13:31:21 [DEBUG   ] Got command BAM from MCS: ref #514792
2018-11-15 13:31:21 [INFO    ] Finished processing BAM request
2018-11-15 13:31:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:31:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514792   8 58437 48681025 A  ERROR'
2018-11-15 13:31:21 [DEBUG   ] Got command BAM from MCS: ref #514793
2018-11-15 13:31:21 [INFO    ] Finished processing BAM request
2018-11-15 13:31:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:31:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514793   8 58437 48681029 A  ERROR'
2018-11-15 13:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 13:31:21 [DEBUG   ] spawn_process: at 2018-11-15 13:31:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 13:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 13:31:21 [DEBUG   ] spawn_process: at 2018-11-15 13:31:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 13:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 13:31:21 [DEBUG   ] spawn_process: at 2018-11-15 13:31:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 13:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 13:31:21 [DEBUG   ] spawn_process: at 2018-11-15 13:31:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 13:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 13:31:21 [DEBUG   ] spawn_process: at 2018-11-15 13:31:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 13:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 13:31:21 [DEBUG   ] spawn_process: at 2018-11-15 13:31:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 13:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 13:31:21 [DEBUG   ] spawn_process: at 2018-11-15 13:31:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 13:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 13:31:21 [DEBUG   ] spawn_process: at 2018-11-15 13:31:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 13:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 13:31:21 [DEBUG   ] spawn_process: at 2018-11-15 13:31:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 13:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 13:31:21 [DEBUG   ] spawn_process: at 2018-11-15 13:31:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 13:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 13:31:21 [DEBUG   ] spawn_process: at 2018-11-15 13:31:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 13:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 13:31:21 [DEBUG   ] spawn_process: at 2018-11-15 13:31:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 13:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 13:31:21 [DEBUG   ] spawn_process: at 2018-11-15 13:31:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 13:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 13:31:21 [DEBUG   ] spawn_process: at 2018-11-15 13:31:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 13:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 13:31:21 [DEBUG   ] spawn_process: at 2018-11-15 13:31:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 13:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 13:31:21 [DEBUG   ] spawn_process: at 2018-11-15 13:31:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 13:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 13:31:21 [DEBUG   ] spawn_process: at 2018-11-15 13:31:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 13:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 13:31:21 [DEBUG   ] spawn_process: at 2018-11-15 13:31:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 13:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 13:31:21 [DEBUG   ] spawn_process: at 2018-11-15 13:31:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 13:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 13:31:21 [DEBUG   ] spawn_process: at 2018-11-15 13:31:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 13:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 13:31:21 [DEBUG   ] spawn_process: at 2018-11-15 13:31:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 13:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 13:31:21 [DEBUG   ] spawn_process: at 2018-11-15 13:31:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 13:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 13:31:21 [DEBUG   ] spawn_process: at 2018-11-15 13:31:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 13:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 13:31:21 [DEBUG   ] spawn_process: at 2018-11-15 13:31:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 13:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 13:31:21 [DEBUG   ] spawn_process: at 2018-11-15 13:31:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 13:31:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 13:31:21 [DEBUG   ] spawn_process: at 2018-11-15 13:31:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 13:31:30 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 13:31:43 [DEBUG   ] Got command BAM from MCS: ref #514795
2018-11-15 13:31:43 [INFO    ] Finished processing BAM request
2018-11-15 13:31:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:31:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514795   8 58437 48703025 A  ERROR'
2018-11-15 13:31:43 [DEBUG   ] Got command BAM from MCS: ref #514794
2018-11-15 13:31:43 [INFO    ] Finished processing BAM request
2018-11-15 13:31:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:31:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514794   8 58437 48703029 A  ERROR'
2018-11-15 13:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 13:31:43 [DEBUG   ] spawn_process: at 2018-11-15 13:31:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 13:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 13:31:43 [DEBUG   ] spawn_process: at 2018-11-15 13:31:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 13:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 13:31:43 [DEBUG   ] spawn_process: at 2018-11-15 13:31:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 13:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 13:31:43 [DEBUG   ] spawn_process: at 2018-11-15 13:31:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 13:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 13:31:43 [DEBUG   ] spawn_process: at 2018-11-15 13:31:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 13:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 13:31:43 [DEBUG   ] spawn_process: at 2018-11-15 13:31:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 13:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 13:31:43 [DEBUG   ] spawn_process: at 2018-11-15 13:31:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 13:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 13:31:43 [DEBUG   ] spawn_process: at 2018-11-15 13:31:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 13:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 13:31:43 [DEBUG   ] spawn_process: at 2018-11-15 13:31:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 13:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 13:31:43 [DEBUG   ] spawn_process: at 2018-11-15 13:31:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 13:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 13:31:43 [DEBUG   ] spawn_process: at 2018-11-15 13:31:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 13:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 13:31:43 [DEBUG   ] spawn_process: at 2018-11-15 13:31:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 13:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 13:31:43 [DEBUG   ] spawn_process: at 2018-11-15 13:31:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 13:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 13:31:43 [DEBUG   ] spawn_process: at 2018-11-15 13:31:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 13:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 13:31:43 [DEBUG   ] spawn_process: at 2018-11-15 13:31:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 13:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 13:31:43 [DEBUG   ] spawn_process: at 2018-11-15 13:31:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 13:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 13:31:43 [DEBUG   ] spawn_process: at 2018-11-15 13:31:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 13:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 13:31:43 [DEBUG   ] spawn_process: at 2018-11-15 13:31:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 13:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 13:31:43 [DEBUG   ] spawn_process: at 2018-11-15 13:31:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 13:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 13:31:43 [DEBUG   ] spawn_process: at 2018-11-15 13:31:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 13:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 13:31:43 [DEBUG   ] spawn_process: at 2018-11-15 13:31:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 13:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 13:31:43 [DEBUG   ] spawn_process: at 2018-11-15 13:31:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 13:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 13:31:43 [DEBUG   ] spawn_process: at 2018-11-15 13:31:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 13:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 13:31:43 [DEBUG   ] spawn_process: at 2018-11-15 13:31:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 13:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 13:31:43 [DEBUG   ] spawn_process: at 2018-11-15 13:31:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 13:31:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 13:31:43 [DEBUG   ] spawn_process: at 2018-11-15 13:31:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 13:31:50 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 13:31:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 13:31:54 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 13:31:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 13:31:54 [WARNING ] (13, 1, 'bot')
2018-11-15 13:31:54 [WARNING ] (13, 1, 'bot')
2018-11-15 13:31:54 [WARNING ] (13, 1, 'bot')
2018-11-15 13:31:54 [WARNING ] (13, 1, 'bot')
2018-11-15 13:31:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 13:31:54 [DEBUG   ] Finished updating board flags in 1.815 seconds
2018-11-15 13:32:05 [DEBUG   ] Got command BAM from MCS: ref #514797
2018-11-15 13:32:05 [INFO    ] Finished processing BAM request
2018-11-15 13:32:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:32:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514797   8 58437 48725033 A  ERROR'
2018-11-15 13:32:05 [DEBUG   ] Got command BAM from MCS: ref #514796
2018-11-15 13:32:05 [INFO    ] Finished processing BAM request
2018-11-15 13:32:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:32:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514796   8 58437 48725037 A  ERROR'
2018-11-15 13:32:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 13:32:05 [DEBUG   ] spawn_process: at 2018-11-15 13:32:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 13:32:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 13:32:05 [DEBUG   ] spawn_process: at 2018-11-15 13:32:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 13:32:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 13:32:05 [DEBUG   ] spawn_process: at 2018-11-15 13:32:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 13:32:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 13:32:05 [DEBUG   ] spawn_process: at 2018-11-15 13:32:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 13:32:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 13:32:05 [DEBUG   ] spawn_process: at 2018-11-15 13:32:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 13:32:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 13:32:05 [DEBUG   ] spawn_process: at 2018-11-15 13:32:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 13:32:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 13:32:05 [DEBUG   ] spawn_process: at 2018-11-15 13:32:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 13:32:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 13:32:05 [DEBUG   ] spawn_process: at 2018-11-15 13:32:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 13:32:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 13:32:05 [DEBUG   ] spawn_process: at 2018-11-15 13:32:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 13:32:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 13:32:05 [DEBUG   ] spawn_process: at 2018-11-15 13:32:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 13:32:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 13:32:05 [DEBUG   ] spawn_process: at 2018-11-15 13:32:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 13:32:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 13:32:05 [DEBUG   ] spawn_process: at 2018-11-15 13:32:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 13:32:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 13:32:05 [DEBUG   ] spawn_process: at 2018-11-15 13:32:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 13:32:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 13:32:05 [DEBUG   ] spawn_process: at 2018-11-15 13:32:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 13:32:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 13:32:05 [DEBUG   ] spawn_process: at 2018-11-15 13:32:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 13:32:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 13:32:05 [DEBUG   ] spawn_process: at 2018-11-15 13:32:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 13:32:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 13:32:05 [DEBUG   ] spawn_process: at 2018-11-15 13:32:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 13:32:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 13:32:05 [DEBUG   ] spawn_process: at 2018-11-15 13:32:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 13:32:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 13:32:05 [DEBUG   ] spawn_process: at 2018-11-15 13:32:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 13:32:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 13:32:05 [DEBUG   ] spawn_process: at 2018-11-15 13:32:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 13:32:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 13:32:05 [DEBUG   ] spawn_process: at 2018-11-15 13:32:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 13:32:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 13:32:05 [DEBUG   ] spawn_process: at 2018-11-15 13:32:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 13:32:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 13:32:05 [DEBUG   ] spawn_process: at 2018-11-15 13:32:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 13:32:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 13:32:05 [DEBUG   ] spawn_process: at 2018-11-15 13:32:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 13:32:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 13:32:05 [DEBUG   ] spawn_process: at 2018-11-15 13:32:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 13:32:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 13:32:05 [DEBUG   ] spawn_process: at 2018-11-15 13:32:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 13:32:10 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 13:32:27 [DEBUG   ] Got command BAM from MCS: ref #514802
2018-11-15 13:32:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:32:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514802   8 58437 48747033 A  ERROR'
2018-11-15 13:32:27 [DEBUG   ] Got command BAM from MCS: ref #514803
2018-11-15 13:32:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:32:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514803   8 58437 48747037 A  ERROR'
2018-11-15 13:32:27 [INFO    ] Finished processing BAM request
2018-11-15 13:32:27 [INFO    ] Finished processing BAM request
2018-11-15 13:32:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 13:32:27 [DEBUG   ] spawn_process: at 2018-11-15 13:32:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 13:32:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 13:32:27 [DEBUG   ] spawn_process: at 2018-11-15 13:32:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 13:32:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 13:32:27 [DEBUG   ] spawn_process: at 2018-11-15 13:32:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 13:32:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 13:32:27 [DEBUG   ] spawn_process: at 2018-11-15 13:32:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 13:32:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 13:32:27 [DEBUG   ] spawn_process: at 2018-11-15 13:32:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 13:32:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 13:32:27 [DEBUG   ] spawn_process: at 2018-11-15 13:32:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 13:32:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 13:32:27 [DEBUG   ] spawn_process: at 2018-11-15 13:32:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 13:32:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 13:32:27 [DEBUG   ] spawn_process: at 2018-11-15 13:32:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 13:32:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 13:32:27 [DEBUG   ] spawn_process: at 2018-11-15 13:32:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 13:32:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 13:32:27 [DEBUG   ] spawn_process: at 2018-11-15 13:32:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 13:32:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 13:32:27 [DEBUG   ] spawn_process: at 2018-11-15 13:32:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 13:32:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 13:32:27 [DEBUG   ] spawn_process: at 2018-11-15 13:32:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 13:32:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 13:32:27 [DEBUG   ] spawn_process: at 2018-11-15 13:32:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 13:32:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 13:32:27 [DEBUG   ] spawn_process: at 2018-11-15 13:32:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 13:32:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 13:32:27 [DEBUG   ] spawn_process: at 2018-11-15 13:32:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 13:32:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 13:32:27 [DEBUG   ] spawn_process: at 2018-11-15 13:32:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 13:32:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 13:32:27 [DEBUG   ] spawn_process: at 2018-11-15 13:32:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 13:32:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 13:32:27 [DEBUG   ] spawn_process: at 2018-11-15 13:32:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 13:32:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 13:32:27 [DEBUG   ] spawn_process: at 2018-11-15 13:32:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 13:32:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 13:32:27 [DEBUG   ] spawn_process: at 2018-11-15 13:32:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 13:32:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 13:32:27 [DEBUG   ] spawn_process: at 2018-11-15 13:32:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 13:32:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 13:32:27 [DEBUG   ] spawn_process: at 2018-11-15 13:32:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 13:32:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 13:32:27 [DEBUG   ] spawn_process: at 2018-11-15 13:32:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 13:32:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 13:32:27 [DEBUG   ] spawn_process: at 2018-11-15 13:32:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 13:32:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 13:32:27 [DEBUG   ] spawn_process: at 2018-11-15 13:32:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 13:32:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 13:32:27 [DEBUG   ] spawn_process: at 2018-11-15 13:32:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 13:32:30 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 13:32:49 [DEBUG   ] Got command BAM from MCS: ref #514805
2018-11-15 13:32:49 [INFO    ] Finished processing BAM request
2018-11-15 13:32:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:32:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514805   8 58437 48769033 A  ERROR'
2018-11-15 13:32:49 [DEBUG   ] Got command BAM from MCS: ref #514804
2018-11-15 13:32:49 [INFO    ] Finished processing BAM request
2018-11-15 13:32:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:32:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514804   8 58437 48769037 A  ERROR'
2018-11-15 13:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 13:32:49 [DEBUG   ] spawn_process: at 2018-11-15 13:32:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 13:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 13:32:49 [DEBUG   ] spawn_process: at 2018-11-15 13:32:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 13:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 13:32:49 [DEBUG   ] spawn_process: at 2018-11-15 13:32:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 13:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 13:32:49 [DEBUG   ] spawn_process: at 2018-11-15 13:32:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 13:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 13:32:49 [DEBUG   ] spawn_process: at 2018-11-15 13:32:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 13:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 13:32:49 [DEBUG   ] spawn_process: at 2018-11-15 13:32:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 13:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 13:32:49 [DEBUG   ] spawn_process: at 2018-11-15 13:32:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 13:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 13:32:49 [DEBUG   ] spawn_process: at 2018-11-15 13:32:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 13:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 13:32:49 [DEBUG   ] spawn_process: at 2018-11-15 13:32:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 13:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 13:32:49 [DEBUG   ] spawn_process: at 2018-11-15 13:32:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 13:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 13:32:49 [DEBUG   ] spawn_process: at 2018-11-15 13:32:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 13:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 13:32:49 [DEBUG   ] spawn_process: at 2018-11-15 13:32:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 13:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 13:32:49 [DEBUG   ] spawn_process: at 2018-11-15 13:32:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 13:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 13:32:49 [DEBUG   ] spawn_process: at 2018-11-15 13:32:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 13:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 13:32:49 [DEBUG   ] spawn_process: at 2018-11-15 13:32:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 13:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 13:32:49 [DEBUG   ] spawn_process: at 2018-11-15 13:32:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 13:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 13:32:49 [DEBUG   ] spawn_process: at 2018-11-15 13:32:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 13:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 13:32:49 [DEBUG   ] spawn_process: at 2018-11-15 13:32:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 13:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 13:32:49 [DEBUG   ] spawn_process: at 2018-11-15 13:32:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 13:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 13:32:49 [DEBUG   ] spawn_process: at 2018-11-15 13:32:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 13:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 13:32:49 [DEBUG   ] spawn_process: at 2018-11-15 13:32:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 13:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 13:32:49 [DEBUG   ] spawn_process: at 2018-11-15 13:32:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 13:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 13:32:49 [DEBUG   ] spawn_process: at 2018-11-15 13:32:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 13:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 13:32:49 [DEBUG   ] spawn_process: at 2018-11-15 13:32:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 13:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 13:32:49 [DEBUG   ] spawn_process: at 2018-11-15 13:32:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 13:32:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 13:32:49 [DEBUG   ] spawn_process: at 2018-11-15 13:32:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 13:32:50 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 13:32:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 13:32:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-11-15 13:32:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-15 13:32:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 13:32:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 13:32:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-15 13:32:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-11-15 13:32:53 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 13:32:53 [WARNING ] (13, 1, 'bot')
2018-11-15 13:32:53 [WARNING ] (13, 1, 'bot')
2018-11-15 13:32:53 [WARNING ] (13, 1, 'bot')
2018-11-15 13:32:53 [WARNING ] (13, 1, 'bot')
2018-11-15 13:32:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 13:32:53 [DEBUG   ] Finished updating board flags in 1.167 seconds
2018-11-15 13:33:10 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 13:33:11 [DEBUG   ] Got command BAM from MCS: ref #514806
2018-11-15 13:33:11 [INFO    ] Finished processing BAM request
2018-11-15 13:33:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:33:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514806   8 58437 48791033 A  ERROR'
2018-11-15 13:33:11 [DEBUG   ] Got command BAM from MCS: ref #514807
2018-11-15 13:33:11 [INFO    ] Finished processing BAM request
2018-11-15 13:33:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:33:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514807   8 58437 48791037 A  ERROR'
2018-11-15 13:33:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 13:33:11 [DEBUG   ] spawn_process: at 2018-11-15 13:33:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 13:33:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 13:33:11 [DEBUG   ] spawn_process: at 2018-11-15 13:33:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 13:33:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 13:33:11 [DEBUG   ] spawn_process: at 2018-11-15 13:33:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 13:33:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 13:33:11 [DEBUG   ] spawn_process: at 2018-11-15 13:33:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 13:33:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 13:33:11 [DEBUG   ] spawn_process: at 2018-11-15 13:33:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 13:33:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 13:33:11 [DEBUG   ] spawn_process: at 2018-11-15 13:33:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 13:33:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 13:33:11 [DEBUG   ] spawn_process: at 2018-11-15 13:33:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 13:33:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 13:33:11 [DEBUG   ] spawn_process: at 2018-11-15 13:33:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 13:33:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 13:33:11 [DEBUG   ] spawn_process: at 2018-11-15 13:33:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 13:33:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 13:33:11 [DEBUG   ] spawn_process: at 2018-11-15 13:33:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 13:33:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 13:33:11 [DEBUG   ] spawn_process: at 2018-11-15 13:33:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 13:33:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 13:33:11 [DEBUG   ] spawn_process: at 2018-11-15 13:33:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 13:33:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 13:33:11 [DEBUG   ] spawn_process: at 2018-11-15 13:33:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 13:33:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 13:33:11 [DEBUG   ] spawn_process: at 2018-11-15 13:33:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 13:33:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 13:33:11 [DEBUG   ] spawn_process: at 2018-11-15 13:33:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 13:33:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 13:33:11 [DEBUG   ] spawn_process: at 2018-11-15 13:33:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 13:33:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 13:33:11 [DEBUG   ] spawn_process: at 2018-11-15 13:33:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 13:33:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 13:33:11 [DEBUG   ] spawn_process: at 2018-11-15 13:33:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 13:33:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 13:33:11 [DEBUG   ] spawn_process: at 2018-11-15 13:33:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 13:33:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 13:33:11 [DEBUG   ] spawn_process: at 2018-11-15 13:33:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 13:33:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 13:33:11 [DEBUG   ] spawn_process: at 2018-11-15 13:33:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 13:33:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 13:33:11 [DEBUG   ] spawn_process: at 2018-11-15 13:33:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 13:33:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 13:33:11 [DEBUG   ] spawn_process: at 2018-11-15 13:33:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 13:33:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 13:33:11 [DEBUG   ] spawn_process: at 2018-11-15 13:33:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 13:33:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 13:33:11 [DEBUG   ] spawn_process: at 2018-11-15 13:33:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 13:33:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 13:33:11 [DEBUG   ] spawn_process: at 2018-11-15 13:33:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 13:33:16 [DEBUG   ] Got command RPT from MCS: ref #514808
2018-11-15 13:33:16 [DEBUG   ] summary = ERROR
2018-11-15 13:33:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   514808  13 58437 48796485 A  ERRORERROR'
2018-11-15 13:33:16 [DEBUG   ] Got command RPT from MCS: ref #514809
2018-11-15 13:33:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 13:33:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   514809  77 58437 48796689 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 13:33:16 [DEBUG   ] Got command RPT from MCS: ref #514810
2018-11-15 13:33:16 [DEBUG   ] summary = ERROR
2018-11-15 13:33:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   514810  13 58437 48796881 A  ERRORERROR'
2018-11-15 13:33:17 [DEBUG   ] Got command RPT from MCS: ref #514811
2018-11-15 13:33:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 13:33:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   514811  77 58437 48797085 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 13:33:17 [DEBUG   ] Got command RPT from MCS: ref #514812
2018-11-15 13:33:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 13:33:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   514812  12 58437 48797289 A  ERRORB¢ff'
2018-11-15 13:33:30 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 13:33:33 [DEBUG   ] Got command BAM from MCS: ref #514813
2018-11-15 13:33:33 [INFO    ] Finished processing BAM request
2018-11-15 13:33:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:33:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514813   8 58437 48813033 A  ERROR'
2018-11-15 13:33:33 [DEBUG   ] Got command BAM from MCS: ref #514814
2018-11-15 13:33:33 [INFO    ] Finished processing BAM request
2018-11-15 13:33:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:33:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514814   8 58437 48813037 A  ERROR'
2018-11-15 13:33:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 13:33:33 [DEBUG   ] spawn_process: at 2018-11-15 13:33:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 13:33:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 13:33:33 [DEBUG   ] spawn_process: at 2018-11-15 13:33:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 13:33:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 13:33:33 [DEBUG   ] spawn_process: at 2018-11-15 13:33:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 13:33:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 13:33:33 [DEBUG   ] spawn_process: at 2018-11-15 13:33:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 13:33:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 13:33:33 [DEBUG   ] spawn_process: at 2018-11-15 13:33:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 13:33:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 13:33:33 [DEBUG   ] spawn_process: at 2018-11-15 13:33:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 13:33:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 13:33:33 [DEBUG   ] spawn_process: at 2018-11-15 13:33:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 13:33:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 13:33:33 [DEBUG   ] spawn_process: at 2018-11-15 13:33:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 13:33:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 13:33:33 [DEBUG   ] spawn_process: at 2018-11-15 13:33:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 13:33:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 13:33:33 [DEBUG   ] spawn_process: at 2018-11-15 13:33:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 13:33:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 13:33:33 [DEBUG   ] spawn_process: at 2018-11-15 13:33:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 13:33:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 13:33:33 [DEBUG   ] spawn_process: at 2018-11-15 13:33:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 13:33:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 13:33:33 [DEBUG   ] spawn_process: at 2018-11-15 13:33:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 13:33:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 13:33:33 [DEBUG   ] spawn_process: at 2018-11-15 13:33:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 13:33:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 13:33:33 [DEBUG   ] spawn_process: at 2018-11-15 13:33:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 13:33:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 13:33:33 [DEBUG   ] spawn_process: at 2018-11-15 13:33:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 13:33:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 13:33:33 [DEBUG   ] spawn_process: at 2018-11-15 13:33:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 13:33:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 13:33:33 [DEBUG   ] spawn_process: at 2018-11-15 13:33:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 13:33:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 13:33:33 [DEBUG   ] spawn_process: at 2018-11-15 13:33:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 13:33:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 13:33:33 [DEBUG   ] spawn_process: at 2018-11-15 13:33:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 13:33:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 13:33:33 [DEBUG   ] spawn_process: at 2018-11-15 13:33:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 13:33:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 13:33:33 [DEBUG   ] spawn_process: at 2018-11-15 13:33:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 13:33:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 13:33:33 [DEBUG   ] spawn_process: at 2018-11-15 13:33:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 13:33:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 13:33:33 [DEBUG   ] spawn_process: at 2018-11-15 13:33:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 13:33:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 13:33:33 [DEBUG   ] spawn_process: at 2018-11-15 13:33:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 13:33:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 13:33:33 [DEBUG   ] spawn_process: at 2018-11-15 13:33:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 13:33:50 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 13:33:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 13:33:53 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 13:33:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 13:33:53 [WARNING ] (13, 1, 'bot')
2018-11-15 13:33:53 [WARNING ] (13, 1, 'bot')
2018-11-15 13:33:53 [WARNING ] (13, 1, 'bot')
2018-11-15 13:33:53 [WARNING ] (13, 1, 'bot')
2018-11-15 13:33:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 13:33:53 [DEBUG   ] Finished updating board flags in 1.024 seconds
2018-11-15 13:33:55 [DEBUG   ] Got command BAM from MCS: ref #514816
2018-11-15 13:33:55 [INFO    ] Finished processing BAM request
2018-11-15 13:33:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:33:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514816   8 58437 48835033 A  ERROR'
2018-11-15 13:33:55 [DEBUG   ] Got command BAM from MCS: ref #514815
2018-11-15 13:33:55 [INFO    ] Finished processing BAM request
2018-11-15 13:33:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:33:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514815   8 58437 48835037 A  ERROR'
2018-11-15 13:33:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 13:33:55 [DEBUG   ] spawn_process: at 2018-11-15 13:33:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 13:33:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 13:33:55 [DEBUG   ] spawn_process: at 2018-11-15 13:33:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 13:33:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 13:33:55 [DEBUG   ] spawn_process: at 2018-11-15 13:33:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 13:33:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 13:33:55 [DEBUG   ] spawn_process: at 2018-11-15 13:33:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 13:33:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 13:33:55 [DEBUG   ] spawn_process: at 2018-11-15 13:33:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 13:33:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 13:33:55 [DEBUG   ] spawn_process: at 2018-11-15 13:33:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 13:33:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 13:33:55 [DEBUG   ] spawn_process: at 2018-11-15 13:33:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 13:33:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 13:33:55 [DEBUG   ] spawn_process: at 2018-11-15 13:33:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 13:33:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 13:33:55 [DEBUG   ] spawn_process: at 2018-11-15 13:33:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 13:33:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 13:33:55 [DEBUG   ] spawn_process: at 2018-11-15 13:33:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 13:33:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 13:33:55 [DEBUG   ] spawn_process: at 2018-11-15 13:33:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 13:33:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 13:33:55 [DEBUG   ] spawn_process: at 2018-11-15 13:33:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 13:33:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 13:33:55 [DEBUG   ] spawn_process: at 2018-11-15 13:33:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 13:33:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 13:33:55 [DEBUG   ] spawn_process: at 2018-11-15 13:33:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 13:33:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 13:33:55 [DEBUG   ] spawn_process: at 2018-11-15 13:33:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 13:33:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 13:33:55 [DEBUG   ] spawn_process: at 2018-11-15 13:33:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 13:33:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 13:33:55 [DEBUG   ] spawn_process: at 2018-11-15 13:33:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 13:33:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 13:33:55 [DEBUG   ] spawn_process: at 2018-11-15 13:33:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 13:33:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 13:33:55 [DEBUG   ] spawn_process: at 2018-11-15 13:33:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 13:33:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 13:33:55 [DEBUG   ] spawn_process: at 2018-11-15 13:33:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 13:33:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 13:33:55 [DEBUG   ] spawn_process: at 2018-11-15 13:33:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 13:33:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 13:33:55 [DEBUG   ] spawn_process: at 2018-11-15 13:33:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 13:33:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 13:33:55 [DEBUG   ] spawn_process: at 2018-11-15 13:33:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 13:33:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 13:33:55 [DEBUG   ] spawn_process: at 2018-11-15 13:33:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 13:33:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 13:33:55 [DEBUG   ] spawn_process: at 2018-11-15 13:33:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 13:33:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 13:33:55 [DEBUG   ] spawn_process: at 2018-11-15 13:33:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 13:34:10 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-15 13:34:17 [DEBUG   ] Got command BAM from MCS: ref #514818
2018-11-15 13:34:17 [INFO    ] Finished processing BAM request
2018-11-15 13:34:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:34:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514818   8 58437 48857033 A  ERROR'
2018-11-15 13:34:17 [DEBUG   ] Got command BAM from MCS: ref #514817
2018-11-15 13:34:17 [INFO    ] Finished processing BAM request
2018-11-15 13:34:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:34:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514817   8 58437 48857037 A  ERROR'
2018-11-15 13:34:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 13:34:17 [DEBUG   ] spawn_process: at 2018-11-15 13:34:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 13:34:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 13:34:17 [DEBUG   ] spawn_process: at 2018-11-15 13:34:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 13:34:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 13:34:17 [DEBUG   ] spawn_process: at 2018-11-15 13:34:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 13:34:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 13:34:17 [DEBUG   ] spawn_process: at 2018-11-15 13:34:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 13:34:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 13:34:17 [DEBUG   ] spawn_process: at 2018-11-15 13:34:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 13:34:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 13:34:17 [DEBUG   ] spawn_process: at 2018-11-15 13:34:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 13:34:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 13:34:17 [DEBUG   ] spawn_process: at 2018-11-15 13:34:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 13:34:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 13:34:17 [DEBUG   ] spawn_process: at 2018-11-15 13:34:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 13:34:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 13:34:17 [DEBUG   ] spawn_process: at 2018-11-15 13:34:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 13:34:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 13:34:17 [DEBUG   ] spawn_process: at 2018-11-15 13:34:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 13:34:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 13:34:17 [DEBUG   ] spawn_process: at 2018-11-15 13:34:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 13:34:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 13:34:17 [DEBUG   ] spawn_process: at 2018-11-15 13:34:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 13:34:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 13:34:17 [DEBUG   ] spawn_process: at 2018-11-15 13:34:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 13:34:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 13:34:17 [DEBUG   ] spawn_process: at 2018-11-15 13:34:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 13:34:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 13:34:17 [DEBUG   ] spawn_process: at 2018-11-15 13:34:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 13:34:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 13:34:17 [DEBUG   ] spawn_process: at 2018-11-15 13:34:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 13:34:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 13:34:17 [DEBUG   ] spawn_process: at 2018-11-15 13:34:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 13:34:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 13:34:17 [DEBUG   ] spawn_process: at 2018-11-15 13:34:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 13:34:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 13:34:17 [DEBUG   ] spawn_process: at 2018-11-15 13:34:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 13:34:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 13:34:17 [DEBUG   ] spawn_process: at 2018-11-15 13:34:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 13:34:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 13:34:17 [DEBUG   ] spawn_process: at 2018-11-15 13:34:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 13:34:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 13:34:17 [DEBUG   ] spawn_process: at 2018-11-15 13:34:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 13:34:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 13:34:17 [DEBUG   ] spawn_process: at 2018-11-15 13:34:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 13:34:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 13:34:17 [DEBUG   ] spawn_process: at 2018-11-15 13:34:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 13:34:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 13:34:17 [DEBUG   ] spawn_process: at 2018-11-15 13:34:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 13:34:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 13:34:17 [DEBUG   ] spawn_process: at 2018-11-15 13:34:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 13:34:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 13:34:39 [DEBUG   ] Got command BAM from MCS: ref #514819
2018-11-15 13:34:39 [INFO    ] Finished processing BAM request
2018-11-15 13:34:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:34:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514819   8 58437 48879033 A  ERROR'
2018-11-15 13:34:39 [DEBUG   ] Got command BAM from MCS: ref #514820
2018-11-15 13:34:39 [INFO    ] Finished processing BAM request
2018-11-15 13:34:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:34:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514820   8 58437 48879037 A  ERROR'
2018-11-15 13:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 13:34:39 [DEBUG   ] spawn_process: at 2018-11-15 13:34:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 13:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 13:34:39 [DEBUG   ] spawn_process: at 2018-11-15 13:34:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 13:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 13:34:39 [DEBUG   ] spawn_process: at 2018-11-15 13:34:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 13:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 13:34:39 [DEBUG   ] spawn_process: at 2018-11-15 13:34:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 13:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 13:34:39 [DEBUG   ] spawn_process: at 2018-11-15 13:34:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 13:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 13:34:39 [DEBUG   ] spawn_process: at 2018-11-15 13:34:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 13:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 13:34:39 [DEBUG   ] spawn_process: at 2018-11-15 13:34:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 13:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 13:34:39 [DEBUG   ] spawn_process: at 2018-11-15 13:34:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 13:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 13:34:39 [DEBUG   ] spawn_process: at 2018-11-15 13:34:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 13:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 13:34:39 [DEBUG   ] spawn_process: at 2018-11-15 13:34:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 13:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 13:34:39 [DEBUG   ] spawn_process: at 2018-11-15 13:34:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 13:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 13:34:39 [DEBUG   ] spawn_process: at 2018-11-15 13:34:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 13:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 13:34:39 [DEBUG   ] spawn_process: at 2018-11-15 13:34:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 13:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 13:34:39 [DEBUG   ] spawn_process: at 2018-11-15 13:34:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 13:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 13:34:39 [DEBUG   ] spawn_process: at 2018-11-15 13:34:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 13:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 13:34:39 [DEBUG   ] spawn_process: at 2018-11-15 13:34:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 13:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 13:34:39 [DEBUG   ] spawn_process: at 2018-11-15 13:34:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 13:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 13:34:39 [DEBUG   ] spawn_process: at 2018-11-15 13:34:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 13:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 13:34:39 [DEBUG   ] spawn_process: at 2018-11-15 13:34:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 13:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 13:34:39 [DEBUG   ] spawn_process: at 2018-11-15 13:34:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 13:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 13:34:39 [DEBUG   ] spawn_process: at 2018-11-15 13:34:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 13:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 13:34:39 [DEBUG   ] spawn_process: at 2018-11-15 13:34:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 13:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 13:34:39 [DEBUG   ] spawn_process: at 2018-11-15 13:34:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 13:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 13:34:39 [DEBUG   ] spawn_process: at 2018-11-15 13:34:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 13:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 13:34:39 [DEBUG   ] spawn_process: at 2018-11-15 13:34:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 13:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 13:34:39 [DEBUG   ] spawn_process: at 2018-11-15 13:34:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 13:34:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 13:34:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 13:34:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 13:34:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-11-15 13:34:53 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 13:34:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2018-11-15 13:34:53 [WARNING ] (13, 1, 'bot')
2018-11-15 13:34:53 [WARNING ] (13, 1, 'bot')
2018-11-15 13:34:53 [WARNING ] (13, 1, 'bot')
2018-11-15 13:34:53 [WARNING ] (13, 1, 'bot')
2018-11-15 13:34:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 13:34:53 [DEBUG   ] Finished updating board flags in 0.975 seconds
2018-11-15 13:35:01 [DEBUG   ] Got command BAM from MCS: ref #514822
2018-11-15 13:35:01 [INFO    ] Finished processing BAM request
2018-11-15 13:35:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:35:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514822   8 58437 48901025 A  ERROR'
2018-11-15 13:35:01 [DEBUG   ] Got command BAM from MCS: ref #514821
2018-11-15 13:35:01 [INFO    ] Finished processing BAM request
2018-11-15 13:35:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:35:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514821   8 58437 48901029 A  ERROR'
2018-11-15 13:35:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 13:35:01 [DEBUG   ] spawn_process: at 2018-11-15 13:35:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 13:35:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 13:35:01 [DEBUG   ] spawn_process: at 2018-11-15 13:35:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 13:35:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 13:35:01 [DEBUG   ] spawn_process: at 2018-11-15 13:35:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 13:35:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 13:35:01 [DEBUG   ] spawn_process: at 2018-11-15 13:35:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 13:35:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 13:35:01 [DEBUG   ] spawn_process: at 2018-11-15 13:35:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 13:35:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 13:35:01 [DEBUG   ] spawn_process: at 2018-11-15 13:35:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 13:35:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 13:35:01 [DEBUG   ] spawn_process: at 2018-11-15 13:35:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 13:35:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 13:35:01 [DEBUG   ] spawn_process: at 2018-11-15 13:35:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 13:35:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 13:35:01 [DEBUG   ] spawn_process: at 2018-11-15 13:35:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 13:35:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 13:35:01 [DEBUG   ] spawn_process: at 2018-11-15 13:35:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 13:35:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 13:35:01 [DEBUG   ] spawn_process: at 2018-11-15 13:35:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 13:35:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 13:35:01 [DEBUG   ] spawn_process: at 2018-11-15 13:35:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 13:35:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 13:35:01 [DEBUG   ] spawn_process: at 2018-11-15 13:35:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 13:35:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 13:35:01 [DEBUG   ] spawn_process: at 2018-11-15 13:35:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 13:35:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 13:35:01 [DEBUG   ] spawn_process: at 2018-11-15 13:35:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 13:35:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 13:35:01 [DEBUG   ] spawn_process: at 2018-11-15 13:35:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 13:35:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 13:35:01 [DEBUG   ] spawn_process: at 2018-11-15 13:35:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 13:35:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 13:35:01 [DEBUG   ] spawn_process: at 2018-11-15 13:35:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 13:35:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 13:35:01 [DEBUG   ] spawn_process: at 2018-11-15 13:35:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 13:35:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 13:35:01 [DEBUG   ] spawn_process: at 2018-11-15 13:35:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 13:35:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 13:35:01 [DEBUG   ] spawn_process: at 2018-11-15 13:35:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 13:35:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 13:35:01 [DEBUG   ] spawn_process: at 2018-11-15 13:35:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 13:35:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 13:35:01 [DEBUG   ] spawn_process: at 2018-11-15 13:35:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 13:35:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 13:35:01 [DEBUG   ] spawn_process: at 2018-11-15 13:35:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 13:35:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 13:35:01 [DEBUG   ] spawn_process: at 2018-11-15 13:35:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 13:35:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 13:35:01 [DEBUG   ] spawn_process: at 2018-11-15 13:35:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 13:35:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 13:35:23 [DEBUG   ] Got command BAM from MCS: ref #514827
2018-11-15 13:35:23 [INFO    ] Finished processing BAM request
2018-11-15 13:35:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:35:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514827   8 58437 48923025 A  ERROR'
2018-11-15 13:35:23 [DEBUG   ] Got command BAM from MCS: ref #514828
2018-11-15 13:35:23 [INFO    ] Finished processing BAM request
2018-11-15 13:35:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:35:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514828   8 58437 48923029 A  ERROR'
2018-11-15 13:35:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 13:35:23 [DEBUG   ] spawn_process: at 2018-11-15 13:35:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 13:35:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 13:35:23 [DEBUG   ] spawn_process: at 2018-11-15 13:35:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 13:35:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 13:35:23 [DEBUG   ] spawn_process: at 2018-11-15 13:35:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 13:35:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 13:35:23 [DEBUG   ] spawn_process: at 2018-11-15 13:35:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 13:35:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 13:35:23 [DEBUG   ] spawn_process: at 2018-11-15 13:35:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 13:35:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 13:35:23 [DEBUG   ] spawn_process: at 2018-11-15 13:35:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 13:35:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 13:35:23 [DEBUG   ] spawn_process: at 2018-11-15 13:35:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 13:35:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 13:35:23 [DEBUG   ] spawn_process: at 2018-11-15 13:35:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 13:35:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 13:35:23 [DEBUG   ] spawn_process: at 2018-11-15 13:35:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 13:35:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 13:35:23 [DEBUG   ] spawn_process: at 2018-11-15 13:35:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 13:35:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 13:35:23 [DEBUG   ] spawn_process: at 2018-11-15 13:35:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 13:35:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 13:35:23 [DEBUG   ] spawn_process: at 2018-11-15 13:35:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 13:35:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 13:35:23 [DEBUG   ] spawn_process: at 2018-11-15 13:35:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 13:35:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 13:35:23 [DEBUG   ] spawn_process: at 2018-11-15 13:35:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 13:35:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 13:35:23 [DEBUG   ] spawn_process: at 2018-11-15 13:35:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 13:35:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 13:35:23 [DEBUG   ] spawn_process: at 2018-11-15 13:35:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 13:35:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 13:35:23 [DEBUG   ] spawn_process: at 2018-11-15 13:35:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 13:35:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 13:35:23 [DEBUG   ] spawn_process: at 2018-11-15 13:35:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 13:35:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 13:35:23 [DEBUG   ] spawn_process: at 2018-11-15 13:35:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 13:35:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 13:35:23 [DEBUG   ] spawn_process: at 2018-11-15 13:35:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 13:35:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 13:35:23 [DEBUG   ] spawn_process: at 2018-11-15 13:35:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 13:35:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 13:35:23 [DEBUG   ] spawn_process: at 2018-11-15 13:35:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 13:35:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 13:35:23 [DEBUG   ] spawn_process: at 2018-11-15 13:35:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 13:35:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 13:35:23 [DEBUG   ] spawn_process: at 2018-11-15 13:35:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 13:35:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 13:35:23 [DEBUG   ] spawn_process: at 2018-11-15 13:35:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 13:35:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 13:35:23 [DEBUG   ] spawn_process: at 2018-11-15 13:35:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 13:35:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 13:35:45 [DEBUG   ] Got command BAM from MCS: ref #514830
2018-11-15 13:35:45 [INFO    ] Finished processing BAM request
2018-11-15 13:35:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:35:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514830   8 58437 48945029 A  ERROR'
2018-11-15 13:35:45 [DEBUG   ] Got command BAM from MCS: ref #514829
2018-11-15 13:35:45 [INFO    ] Finished processing BAM request
2018-11-15 13:35:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:35:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514829   8 58437 48945033 A  ERROR'
2018-11-15 13:35:45 [DEBUG   ] Got command RPT from MCS: ref #514831
2018-11-15 13:35:45 [DEBUG   ] summary = ERROR
2018-11-15 13:35:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   514831  13 58437 48945093 A  ERRORERROR'
2018-11-15 13:35:45 [DEBUG   ] Got command RPT from MCS: ref #514832
2018-11-15 13:35:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 13:35:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   514832  77 58437 48945094 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 13:35:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 13:35:45 [DEBUG   ] spawn_process: at 2018-11-15 13:35:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 13:35:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 13:35:45 [DEBUG   ] spawn_process: at 2018-11-15 13:35:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 13:35:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 13:35:45 [DEBUG   ] spawn_process: at 2018-11-15 13:35:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 13:35:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 13:35:45 [DEBUG   ] spawn_process: at 2018-11-15 13:35:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 13:35:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 13:35:45 [DEBUG   ] spawn_process: at 2018-11-15 13:35:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 13:35:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 13:35:45 [DEBUG   ] spawn_process: at 2018-11-15 13:35:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 13:35:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 13:35:45 [DEBUG   ] spawn_process: at 2018-11-15 13:35:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 13:35:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 13:35:45 [DEBUG   ] spawn_process: at 2018-11-15 13:35:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 13:35:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 13:35:45 [DEBUG   ] spawn_process: at 2018-11-15 13:35:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 13:35:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 13:35:45 [DEBUG   ] spawn_process: at 2018-11-15 13:35:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 13:35:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 13:35:45 [DEBUG   ] spawn_process: at 2018-11-15 13:35:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 13:35:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 13:35:45 [DEBUG   ] spawn_process: at 2018-11-15 13:35:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 13:35:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 13:35:45 [DEBUG   ] spawn_process: at 2018-11-15 13:35:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 13:35:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 13:35:45 [DEBUG   ] spawn_process: at 2018-11-15 13:35:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 13:35:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 13:35:45 [DEBUG   ] spawn_process: at 2018-11-15 13:35:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 13:35:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 13:35:45 [DEBUG   ] spawn_process: at 2018-11-15 13:35:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 13:35:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 13:35:45 [DEBUG   ] spawn_process: at 2018-11-15 13:35:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 13:35:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 13:35:45 [DEBUG   ] spawn_process: at 2018-11-15 13:35:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 13:35:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 13:35:45 [DEBUG   ] spawn_process: at 2018-11-15 13:35:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 13:35:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 13:35:45 [DEBUG   ] spawn_process: at 2018-11-15 13:35:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 13:35:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 13:35:45 [DEBUG   ] spawn_process: at 2018-11-15 13:35:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 13:35:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 13:35:45 [DEBUG   ] spawn_process: at 2018-11-15 13:35:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 13:35:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 13:35:45 [DEBUG   ] spawn_process: at 2018-11-15 13:35:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 13:35:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 13:35:45 [DEBUG   ] spawn_process: at 2018-11-15 13:35:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 13:35:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 13:35:45 [DEBUG   ] spawn_process: at 2018-11-15 13:35:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 13:35:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 13:35:45 [DEBUG   ] spawn_process: at 2018-11-15 13:35:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 13:35:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 13:35:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 13:35:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-15 13:35:54 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 13:35:54 [WARNING ] (13, 1, 'bot')
2018-11-15 13:35:54 [WARNING ] (13, 1, 'bot')
2018-11-15 13:35:54 [WARNING ] (13, 1, 'bot')
2018-11-15 13:35:54 [WARNING ] (13, 1, 'bot')
2018-11-15 13:35:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 13:35:54 [DEBUG   ] Finished updating board flags in 1.359 seconds
2018-11-15 13:36:07 [DEBUG   ] Got command BAM from MCS: ref #514848
2018-11-15 13:36:07 [INFO    ] Finished processing BAM request
2018-11-15 13:36:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:36:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514848   8 58437 48967033 A  ERROR'
2018-11-15 13:36:07 [DEBUG   ] Got command BAM from MCS: ref #514849
2018-11-15 13:36:07 [INFO    ] Finished processing BAM request
2018-11-15 13:36:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:36:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514849   8 58437 48967037 A  ERROR'
2018-11-15 13:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 13:36:07 [DEBUG   ] spawn_process: at 2018-11-15 13:36:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 13:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 13:36:07 [DEBUG   ] spawn_process: at 2018-11-15 13:36:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 13:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 13:36:07 [DEBUG   ] spawn_process: at 2018-11-15 13:36:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 13:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 13:36:07 [DEBUG   ] spawn_process: at 2018-11-15 13:36:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 13:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 13:36:07 [DEBUG   ] spawn_process: at 2018-11-15 13:36:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 13:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 13:36:07 [DEBUG   ] spawn_process: at 2018-11-15 13:36:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 13:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 13:36:07 [DEBUG   ] spawn_process: at 2018-11-15 13:36:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 13:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 13:36:07 [DEBUG   ] spawn_process: at 2018-11-15 13:36:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 13:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 13:36:07 [DEBUG   ] spawn_process: at 2018-11-15 13:36:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 13:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 13:36:07 [DEBUG   ] spawn_process: at 2018-11-15 13:36:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 13:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 13:36:07 [DEBUG   ] spawn_process: at 2018-11-15 13:36:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 13:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 13:36:07 [DEBUG   ] spawn_process: at 2018-11-15 13:36:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 13:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 13:36:07 [DEBUG   ] spawn_process: at 2018-11-15 13:36:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 13:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 13:36:07 [DEBUG   ] spawn_process: at 2018-11-15 13:36:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 13:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 13:36:07 [DEBUG   ] spawn_process: at 2018-11-15 13:36:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 13:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 13:36:07 [DEBUG   ] spawn_process: at 2018-11-15 13:36:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 13:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 13:36:07 [DEBUG   ] spawn_process: at 2018-11-15 13:36:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 13:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 13:36:07 [DEBUG   ] spawn_process: at 2018-11-15 13:36:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 13:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 13:36:07 [DEBUG   ] spawn_process: at 2018-11-15 13:36:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 13:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 13:36:07 [DEBUG   ] spawn_process: at 2018-11-15 13:36:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 13:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 13:36:07 [DEBUG   ] spawn_process: at 2018-11-15 13:36:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 13:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 13:36:07 [DEBUG   ] spawn_process: at 2018-11-15 13:36:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 13:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 13:36:07 [DEBUG   ] spawn_process: at 2018-11-15 13:36:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 13:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 13:36:07 [DEBUG   ] spawn_process: at 2018-11-15 13:36:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 13:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 13:36:07 [DEBUG   ] spawn_process: at 2018-11-15 13:36:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 13:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 13:36:07 [DEBUG   ] spawn_process: at 2018-11-15 13:36:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 13:36:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 13:36:29 [DEBUG   ] Got command BAM from MCS: ref #514851
2018-11-15 13:36:29 [INFO    ] Finished processing BAM request
2018-11-15 13:36:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:36:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514851   8 58437 48989029 A  ERROR'
2018-11-15 13:36:29 [DEBUG   ] Got command BAM from MCS: ref #514850
2018-11-15 13:36:29 [INFO    ] Finished processing BAM request
2018-11-15 13:36:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:36:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514850   8 58437 48989033 A  ERROR'
2018-11-15 13:36:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 13:36:29 [DEBUG   ] spawn_process: at 2018-11-15 13:36:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 13:36:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 13:36:29 [DEBUG   ] spawn_process: at 2018-11-15 13:36:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 13:36:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 13:36:29 [DEBUG   ] spawn_process: at 2018-11-15 13:36:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 13:36:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 13:36:29 [DEBUG   ] spawn_process: at 2018-11-15 13:36:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 13:36:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 13:36:29 [DEBUG   ] spawn_process: at 2018-11-15 13:36:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 13:36:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 13:36:29 [DEBUG   ] spawn_process: at 2018-11-15 13:36:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 13:36:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 13:36:29 [DEBUG   ] spawn_process: at 2018-11-15 13:36:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 13:36:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 13:36:29 [DEBUG   ] spawn_process: at 2018-11-15 13:36:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 13:36:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 13:36:29 [DEBUG   ] spawn_process: at 2018-11-15 13:36:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 13:36:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 13:36:29 [DEBUG   ] spawn_process: at 2018-11-15 13:36:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 13:36:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 13:36:29 [DEBUG   ] spawn_process: at 2018-11-15 13:36:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 13:36:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 13:36:29 [DEBUG   ] spawn_process: at 2018-11-15 13:36:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 13:36:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 13:36:29 [DEBUG   ] spawn_process: at 2018-11-15 13:36:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 13:36:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 13:36:29 [DEBUG   ] spawn_process: at 2018-11-15 13:36:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 13:36:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 13:36:29 [DEBUG   ] spawn_process: at 2018-11-15 13:36:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 13:36:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 13:36:29 [DEBUG   ] spawn_process: at 2018-11-15 13:36:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 13:36:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 13:36:29 [DEBUG   ] spawn_process: at 2018-11-15 13:36:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 13:36:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 13:36:29 [DEBUG   ] spawn_process: at 2018-11-15 13:36:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 13:36:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 13:36:29 [DEBUG   ] spawn_process: at 2018-11-15 13:36:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 13:36:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 13:36:29 [DEBUG   ] spawn_process: at 2018-11-15 13:36:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 13:36:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 13:36:29 [DEBUG   ] spawn_process: at 2018-11-15 13:36:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 13:36:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 13:36:29 [DEBUG   ] spawn_process: at 2018-11-15 13:36:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 13:36:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 13:36:29 [DEBUG   ] spawn_process: at 2018-11-15 13:36:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 13:36:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 13:36:29 [DEBUG   ] spawn_process: at 2018-11-15 13:36:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 13:36:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 13:36:29 [DEBUG   ] spawn_process: at 2018-11-15 13:36:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 13:36:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 13:36:29 [DEBUG   ] spawn_process: at 2018-11-15 13:36:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 13:36:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 13:36:51 [DEBUG   ] Got command BAM from MCS: ref #514853
2018-11-15 13:36:51 [INFO    ] Finished processing BAM request
2018-11-15 13:36:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:36:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514853   8 58437 49011033 A  ERROR'
2018-11-15 13:36:51 [DEBUG   ] Got command BAM from MCS: ref #514852
2018-11-15 13:36:51 [INFO    ] Finished processing BAM request
2018-11-15 13:36:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:36:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514852   8 58437 49011037 A  ERROR'
2018-11-15 13:36:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 13:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 13:36:51 [DEBUG   ] spawn_process: at 2018-11-15 13:36:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 13:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 13:36:51 [DEBUG   ] spawn_process: at 2018-11-15 13:36:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 13:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 13:36:51 [DEBUG   ] spawn_process: at 2018-11-15 13:36:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 13:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 13:36:51 [DEBUG   ] spawn_process: at 2018-11-15 13:36:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 13:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 13:36:51 [DEBUG   ] spawn_process: at 2018-11-15 13:36:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 13:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 13:36:51 [DEBUG   ] spawn_process: at 2018-11-15 13:36:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 13:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 13:36:51 [DEBUG   ] spawn_process: at 2018-11-15 13:36:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 13:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 13:36:51 [DEBUG   ] spawn_process: at 2018-11-15 13:36:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 13:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 13:36:51 [DEBUG   ] spawn_process: at 2018-11-15 13:36:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 13:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 13:36:51 [DEBUG   ] spawn_process: at 2018-11-15 13:36:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 13:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 13:36:51 [DEBUG   ] spawn_process: at 2018-11-15 13:36:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 13:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 13:36:51 [DEBUG   ] spawn_process: at 2018-11-15 13:36:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 13:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 13:36:51 [DEBUG   ] spawn_process: at 2018-11-15 13:36:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 13:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 13:36:51 [DEBUG   ] spawn_process: at 2018-11-15 13:36:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 13:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 13:36:51 [DEBUG   ] spawn_process: at 2018-11-15 13:36:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 13:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 13:36:51 [DEBUG   ] spawn_process: at 2018-11-15 13:36:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 13:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 13:36:51 [DEBUG   ] spawn_process: at 2018-11-15 13:36:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 13:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 13:36:51 [DEBUG   ] spawn_process: at 2018-11-15 13:36:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 13:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 13:36:51 [DEBUG   ] spawn_process: at 2018-11-15 13:36:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 13:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 13:36:51 [DEBUG   ] spawn_process: at 2018-11-15 13:36:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 13:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 13:36:51 [DEBUG   ] spawn_process: at 2018-11-15 13:36:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 13:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 13:36:51 [DEBUG   ] spawn_process: at 2018-11-15 13:36:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 13:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 13:36:51 [DEBUG   ] spawn_process: at 2018-11-15 13:36:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 13:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 13:36:51 [DEBUG   ] spawn_process: at 2018-11-15 13:36:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 13:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 13:36:51 [DEBUG   ] spawn_process: at 2018-11-15 13:36:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 13:36:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 13:36:51 [DEBUG   ] spawn_process: at 2018-11-15 13:36:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 13:36:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 13:36:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 13:36:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-15 13:36:54 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-15 13:36:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 13:36:54 [WARNING ] (13, 1, 'bot')
2018-11-15 13:36:54 [WARNING ] (13, 1, 'bot')
2018-11-15 13:36:54 [WARNING ] (13, 1, 'bot')
2018-11-15 13:36:54 [WARNING ] (13, 1, 'bot')
2018-11-15 13:36:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 13:36:54 [DEBUG   ] Finished updating board flags in 1.206 seconds
2018-11-15 13:37:11 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-15 13:37:13 [DEBUG   ] Got command BAM from MCS: ref #514855
2018-11-15 13:37:13 [INFO    ] Finished processing BAM request
2018-11-15 13:37:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:37:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514855   8 58437 49033029 A  ERROR'
2018-11-15 13:37:13 [DEBUG   ] Got command BAM from MCS: ref #514854
2018-11-15 13:37:13 [INFO    ] Finished processing BAM request
2018-11-15 13:37:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:37:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514854   8 58437 49033033 A  ERROR'
2018-11-15 13:37:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 13:37:13 [DEBUG   ] spawn_process: at 2018-11-15 13:37:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 13:37:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 13:37:13 [DEBUG   ] spawn_process: at 2018-11-15 13:37:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 13:37:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 13:37:13 [DEBUG   ] spawn_process: at 2018-11-15 13:37:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 13:37:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 13:37:13 [DEBUG   ] spawn_process: at 2018-11-15 13:37:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 13:37:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 13:37:13 [DEBUG   ] spawn_process: at 2018-11-15 13:37:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 13:37:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 13:37:13 [DEBUG   ] spawn_process: at 2018-11-15 13:37:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 13:37:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 13:37:13 [DEBUG   ] spawn_process: at 2018-11-15 13:37:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 13:37:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 13:37:13 [DEBUG   ] spawn_process: at 2018-11-15 13:37:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 13:37:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 13:37:13 [DEBUG   ] spawn_process: at 2018-11-15 13:37:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 13:37:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 13:37:13 [DEBUG   ] spawn_process: at 2018-11-15 13:37:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 13:37:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 13:37:13 [DEBUG   ] spawn_process: at 2018-11-15 13:37:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 13:37:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 13:37:13 [DEBUG   ] spawn_process: at 2018-11-15 13:37:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 13:37:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 13:37:13 [DEBUG   ] spawn_process: at 2018-11-15 13:37:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 13:37:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 13:37:13 [DEBUG   ] spawn_process: at 2018-11-15 13:37:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 13:37:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 13:37:13 [DEBUG   ] spawn_process: at 2018-11-15 13:37:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 13:37:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 13:37:13 [DEBUG   ] spawn_process: at 2018-11-15 13:37:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 13:37:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 13:37:13 [DEBUG   ] spawn_process: at 2018-11-15 13:37:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 13:37:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 13:37:13 [DEBUG   ] spawn_process: at 2018-11-15 13:37:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 13:37:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 13:37:13 [DEBUG   ] spawn_process: at 2018-11-15 13:37:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 13:37:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 13:37:13 [DEBUG   ] spawn_process: at 2018-11-15 13:37:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 13:37:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 13:37:13 [DEBUG   ] spawn_process: at 2018-11-15 13:37:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 13:37:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 13:37:13 [DEBUG   ] spawn_process: at 2018-11-15 13:37:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 13:37:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 13:37:13 [DEBUG   ] spawn_process: at 2018-11-15 13:37:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 13:37:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 13:37:13 [DEBUG   ] spawn_process: at 2018-11-15 13:37:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 13:37:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 13:37:13 [DEBUG   ] spawn_process: at 2018-11-15 13:37:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 13:37:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 13:37:13 [DEBUG   ] spawn_process: at 2018-11-15 13:37:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 13:37:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 13:37:35 [DEBUG   ] Got command BAM from MCS: ref #514857
2018-11-15 13:37:35 [INFO    ] Finished processing BAM request
2018-11-15 13:37:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514857   8 58437 49055033 A  ERROR'
2018-11-15 13:37:35 [DEBUG   ] Got command BAM from MCS: ref #514856
2018-11-15 13:37:35 [INFO    ] Finished processing BAM request
2018-11-15 13:37:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514856   8 58437 49055037 A  ERROR'
2018-11-15 13:37:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 13:37:35 [DEBUG   ] spawn_process: at 2018-11-15 13:37:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 13:37:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 13:37:35 [DEBUG   ] spawn_process: at 2018-11-15 13:37:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 13:37:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 13:37:35 [DEBUG   ] spawn_process: at 2018-11-15 13:37:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 13:37:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 13:37:35 [DEBUG   ] spawn_process: at 2018-11-15 13:37:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 13:37:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 13:37:35 [DEBUG   ] spawn_process: at 2018-11-15 13:37:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 13:37:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 13:37:35 [DEBUG   ] spawn_process: at 2018-11-15 13:37:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 13:37:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 13:37:35 [DEBUG   ] spawn_process: at 2018-11-15 13:37:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 13:37:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 13:37:35 [DEBUG   ] spawn_process: at 2018-11-15 13:37:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 13:37:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 13:37:35 [DEBUG   ] spawn_process: at 2018-11-15 13:37:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 13:37:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 13:37:35 [DEBUG   ] spawn_process: at 2018-11-15 13:37:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 13:37:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 13:37:35 [DEBUG   ] spawn_process: at 2018-11-15 13:37:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 13:37:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 13:37:35 [DEBUG   ] spawn_process: at 2018-11-15 13:37:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 13:37:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 13:37:35 [DEBUG   ] spawn_process: at 2018-11-15 13:37:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 13:37:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 13:37:35 [DEBUG   ] spawn_process: at 2018-11-15 13:37:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 13:37:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 13:37:35 [DEBUG   ] spawn_process: at 2018-11-15 13:37:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 13:37:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 13:37:35 [DEBUG   ] spawn_process: at 2018-11-15 13:37:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 13:37:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 13:37:35 [DEBUG   ] spawn_process: at 2018-11-15 13:37:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 13:37:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 13:37:35 [DEBUG   ] spawn_process: at 2018-11-15 13:37:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 13:37:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 13:37:35 [DEBUG   ] spawn_process: at 2018-11-15 13:37:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 13:37:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 13:37:35 [DEBUG   ] spawn_process: at 2018-11-15 13:37:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 13:37:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 13:37:35 [DEBUG   ] spawn_process: at 2018-11-15 13:37:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 13:37:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 13:37:35 [DEBUG   ] spawn_process: at 2018-11-15 13:37:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 13:37:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 13:37:35 [DEBUG   ] spawn_process: at 2018-11-15 13:37:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 13:37:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 13:37:35 [DEBUG   ] spawn_process: at 2018-11-15 13:37:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 13:37:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 13:37:35 [DEBUG   ] spawn_process: at 2018-11-15 13:37:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 13:37:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 13:37:35 [DEBUG   ] spawn_process: at 2018-11-15 13:37:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 13:37:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 13:37:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 13:37:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 13:37:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 13:37:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 13:37:54 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 13:37:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 13:37:54 [WARNING ] (13, 1, 'bot')
2018-11-15 13:37:54 [WARNING ] (13, 1, 'bot')
2018-11-15 13:37:54 [WARNING ] (13, 1, 'bot')
2018-11-15 13:37:54 [WARNING ] (13, 1, 'bot')
2018-11-15 13:37:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 13:37:54 [DEBUG   ] Finished updating board flags in 1.208 seconds
2018-11-15 13:37:57 [DEBUG   ] Got command BAM from MCS: ref #514858
2018-11-15 13:37:57 [INFO    ] Finished processing BAM request
2018-11-15 13:37:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:37:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514858   8 58437 49077029 A  ERROR'
2018-11-15 13:37:57 [DEBUG   ] Got command BAM from MCS: ref #514859
2018-11-15 13:37:57 [INFO    ] Finished processing BAM request
2018-11-15 13:37:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:37:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514859   8 58437 49077033 A  ERROR'
2018-11-15 13:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 13:37:57 [DEBUG   ] spawn_process: at 2018-11-15 13:37:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 13:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 13:37:57 [DEBUG   ] spawn_process: at 2018-11-15 13:37:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 13:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 13:37:57 [DEBUG   ] spawn_process: at 2018-11-15 13:37:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 13:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 13:37:57 [DEBUG   ] spawn_process: at 2018-11-15 13:37:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 13:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 13:37:57 [DEBUG   ] spawn_process: at 2018-11-15 13:37:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 13:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 13:37:57 [DEBUG   ] spawn_process: at 2018-11-15 13:37:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 13:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 13:37:57 [DEBUG   ] spawn_process: at 2018-11-15 13:37:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 13:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 13:37:57 [DEBUG   ] spawn_process: at 2018-11-15 13:37:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 13:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 13:37:57 [DEBUG   ] spawn_process: at 2018-11-15 13:37:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 13:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 13:37:57 [DEBUG   ] spawn_process: at 2018-11-15 13:37:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 13:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 13:37:57 [DEBUG   ] spawn_process: at 2018-11-15 13:37:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 13:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 13:37:57 [DEBUG   ] spawn_process: at 2018-11-15 13:37:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 13:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 13:37:57 [DEBUG   ] spawn_process: at 2018-11-15 13:37:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 13:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 13:37:57 [DEBUG   ] spawn_process: at 2018-11-15 13:37:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 13:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 13:37:57 [DEBUG   ] spawn_process: at 2018-11-15 13:37:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 13:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 13:37:57 [DEBUG   ] spawn_process: at 2018-11-15 13:37:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 13:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 13:37:57 [DEBUG   ] spawn_process: at 2018-11-15 13:37:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 13:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 13:37:57 [DEBUG   ] spawn_process: at 2018-11-15 13:37:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 13:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 13:37:57 [DEBUG   ] spawn_process: at 2018-11-15 13:37:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 13:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 13:37:57 [DEBUG   ] spawn_process: at 2018-11-15 13:37:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 13:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 13:37:57 [DEBUG   ] spawn_process: at 2018-11-15 13:37:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 13:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 13:37:57 [DEBUG   ] spawn_process: at 2018-11-15 13:37:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 13:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 13:37:57 [DEBUG   ] spawn_process: at 2018-11-15 13:37:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 13:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 13:37:57 [DEBUG   ] spawn_process: at 2018-11-15 13:37:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 13:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 13:37:57 [DEBUG   ] spawn_process: at 2018-11-15 13:37:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 13:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 13:37:57 [DEBUG   ] spawn_process: at 2018-11-15 13:37:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 13:38:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 13:38:16 [DEBUG   ] Got command RPT from MCS: ref #514862
2018-11-15 13:38:16 [DEBUG   ] summary = ERROR
2018-11-15 13:38:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   514862  13 58437 49096577 A  ERRORERROR'
2018-11-15 13:38:16 [DEBUG   ] Got command RPT from MCS: ref #514863
2018-11-15 13:38:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 13:38:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   514863  77 58437 49096769 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 13:38:16 [DEBUG   ] Got command RPT from MCS: ref #514864
2018-11-15 13:38:16 [DEBUG   ] summary = ERROR
2018-11-15 13:38:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   514864  13 58437 49096973 A  ERRORERROR'
2018-11-15 13:38:17 [DEBUG   ] Got command RPT from MCS: ref #514866
2018-11-15 13:38:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 13:38:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   514866  77 58437 49097177 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 13:38:17 [DEBUG   ] Got command RPT from MCS: ref #514867
2018-11-15 13:38:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 13:38:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   514867  12 58437 49097381 A  ERRORB¢ff'
2018-11-15 13:38:19 [DEBUG   ] Got command BAM from MCS: ref #514872
2018-11-15 13:38:19 [INFO    ] Finished processing BAM request
2018-11-15 13:38:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:38:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514872   8 58437 49099029 A  ERROR'
2018-11-15 13:38:19 [DEBUG   ] Got command BAM from MCS: ref #514873
2018-11-15 13:38:19 [INFO    ] Finished processing BAM request
2018-11-15 13:38:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:38:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514873   8 58437 49099033 A  ERROR'
2018-11-15 13:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 13:38:19 [DEBUG   ] spawn_process: at 2018-11-15 13:38:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 13:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 13:38:19 [DEBUG   ] spawn_process: at 2018-11-15 13:38:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 13:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 13:38:19 [DEBUG   ] spawn_process: at 2018-11-15 13:38:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 13:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 13:38:19 [DEBUG   ] spawn_process: at 2018-11-15 13:38:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 13:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 13:38:19 [DEBUG   ] spawn_process: at 2018-11-15 13:38:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 13:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 13:38:19 [DEBUG   ] spawn_process: at 2018-11-15 13:38:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 13:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 13:38:19 [DEBUG   ] spawn_process: at 2018-11-15 13:38:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 13:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 13:38:19 [DEBUG   ] spawn_process: at 2018-11-15 13:38:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 13:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 13:38:19 [DEBUG   ] spawn_process: at 2018-11-15 13:38:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 13:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 13:38:19 [DEBUG   ] spawn_process: at 2018-11-15 13:38:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 13:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 13:38:19 [DEBUG   ] spawn_process: at 2018-11-15 13:38:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 13:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 13:38:19 [DEBUG   ] spawn_process: at 2018-11-15 13:38:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 13:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 13:38:19 [DEBUG   ] spawn_process: at 2018-11-15 13:38:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 13:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 13:38:19 [DEBUG   ] spawn_process: at 2018-11-15 13:38:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 13:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 13:38:19 [DEBUG   ] spawn_process: at 2018-11-15 13:38:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 13:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 13:38:19 [DEBUG   ] spawn_process: at 2018-11-15 13:38:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 13:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 13:38:19 [DEBUG   ] spawn_process: at 2018-11-15 13:38:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 13:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 13:38:19 [DEBUG   ] spawn_process: at 2018-11-15 13:38:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 13:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 13:38:19 [DEBUG   ] spawn_process: at 2018-11-15 13:38:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 13:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 13:38:19 [DEBUG   ] spawn_process: at 2018-11-15 13:38:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 13:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 13:38:19 [DEBUG   ] spawn_process: at 2018-11-15 13:38:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 13:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 13:38:19 [DEBUG   ] spawn_process: at 2018-11-15 13:38:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 13:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 13:38:19 [DEBUG   ] spawn_process: at 2018-11-15 13:38:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 13:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 13:38:19 [DEBUG   ] spawn_process: at 2018-11-15 13:38:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 13:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 13:38:19 [DEBUG   ] spawn_process: at 2018-11-15 13:38:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 13:38:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 13:38:19 [DEBUG   ] spawn_process: at 2018-11-15 13:38:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 13:38:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 13:38:41 [DEBUG   ] Got command BAM from MCS: ref #514879
2018-11-15 13:38:41 [INFO    ] Finished processing BAM request
2018-11-15 13:38:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:38:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514879   8 58437 49121029 A  ERROR'
2018-11-15 13:38:41 [DEBUG   ] Got command BAM from MCS: ref #514878
2018-11-15 13:38:41 [INFO    ] Finished processing BAM request
2018-11-15 13:38:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:38:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514878   8 58437 49121033 A  ERROR'
2018-11-15 13:38:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 13:38:41 [DEBUG   ] spawn_process: at 2018-11-15 13:38:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 13:38:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 13:38:41 [DEBUG   ] spawn_process: at 2018-11-15 13:38:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 13:38:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 13:38:41 [DEBUG   ] spawn_process: at 2018-11-15 13:38:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 13:38:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 13:38:41 [DEBUG   ] spawn_process: at 2018-11-15 13:38:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 13:38:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 13:38:41 [DEBUG   ] spawn_process: at 2018-11-15 13:38:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 13:38:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 13:38:41 [DEBUG   ] spawn_process: at 2018-11-15 13:38:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 13:38:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 13:38:41 [DEBUG   ] spawn_process: at 2018-11-15 13:38:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 13:38:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 13:38:41 [DEBUG   ] spawn_process: at 2018-11-15 13:38:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 13:38:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 13:38:41 [DEBUG   ] spawn_process: at 2018-11-15 13:38:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 13:38:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 13:38:41 [DEBUG   ] spawn_process: at 2018-11-15 13:38:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 13:38:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 13:38:41 [DEBUG   ] spawn_process: at 2018-11-15 13:38:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 13:38:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 13:38:41 [DEBUG   ] spawn_process: at 2018-11-15 13:38:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 13:38:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 13:38:41 [DEBUG   ] spawn_process: at 2018-11-15 13:38:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 13:38:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 13:38:41 [DEBUG   ] spawn_process: at 2018-11-15 13:38:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 13:38:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 13:38:41 [DEBUG   ] spawn_process: at 2018-11-15 13:38:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 13:38:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 13:38:41 [DEBUG   ] spawn_process: at 2018-11-15 13:38:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 13:38:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 13:38:41 [DEBUG   ] spawn_process: at 2018-11-15 13:38:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 13:38:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 13:38:41 [DEBUG   ] spawn_process: at 2018-11-15 13:38:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 13:38:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 13:38:41 [DEBUG   ] spawn_process: at 2018-11-15 13:38:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 13:38:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 13:38:41 [DEBUG   ] spawn_process: at 2018-11-15 13:38:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 13:38:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 13:38:41 [DEBUG   ] spawn_process: at 2018-11-15 13:38:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 13:38:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 13:38:41 [DEBUG   ] spawn_process: at 2018-11-15 13:38:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 13:38:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 13:38:41 [DEBUG   ] spawn_process: at 2018-11-15 13:38:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 13:38:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 13:38:41 [DEBUG   ] spawn_process: at 2018-11-15 13:38:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 13:38:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 13:38:41 [DEBUG   ] spawn_process: at 2018-11-15 13:38:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 13:38:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 13:38:41 [DEBUG   ] spawn_process: at 2018-11-15 13:38:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 13:38:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 13:38:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 13:38:54 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-15 13:38:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 13:38:54 [WARNING ] (13, 1, 'bot')
2018-11-15 13:38:54 [WARNING ] (13, 1, 'bot')
2018-11-15 13:38:54 [WARNING ] (13, 1, 'bot')
2018-11-15 13:38:54 [WARNING ] (13, 1, 'bot')
2018-11-15 13:38:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 13:38:54 [DEBUG   ] Finished updating board flags in 1.194 seconds
2018-11-15 13:39:03 [DEBUG   ] Got command BAM from MCS: ref #514881
2018-11-15 13:39:03 [INFO    ] Finished processing BAM request
2018-11-15 13:39:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:39:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514881   8 58437 49143025 A  ERROR'
2018-11-15 13:39:03 [DEBUG   ] Got command BAM from MCS: ref #514880
2018-11-15 13:39:03 [INFO    ] Finished processing BAM request
2018-11-15 13:39:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:39:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514880   8 58437 49143029 A  ERROR'
2018-11-15 13:39:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 13:39:03 [DEBUG   ] spawn_process: at 2018-11-15 13:39:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 13:39:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 13:39:03 [DEBUG   ] spawn_process: at 2018-11-15 13:39:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 13:39:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 13:39:03 [DEBUG   ] spawn_process: at 2018-11-15 13:39:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 13:39:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 13:39:03 [DEBUG   ] spawn_process: at 2018-11-15 13:39:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 13:39:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 13:39:03 [DEBUG   ] spawn_process: at 2018-11-15 13:39:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 13:39:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 13:39:03 [DEBUG   ] spawn_process: at 2018-11-15 13:39:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 13:39:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 13:39:03 [DEBUG   ] spawn_process: at 2018-11-15 13:39:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 13:39:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 13:39:03 [DEBUG   ] spawn_process: at 2018-11-15 13:39:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 13:39:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 13:39:03 [DEBUG   ] spawn_process: at 2018-11-15 13:39:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 13:39:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 13:39:03 [DEBUG   ] spawn_process: at 2018-11-15 13:39:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 13:39:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 13:39:03 [DEBUG   ] spawn_process: at 2018-11-15 13:39:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 13:39:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 13:39:03 [DEBUG   ] spawn_process: at 2018-11-15 13:39:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 13:39:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 13:39:03 [DEBUG   ] spawn_process: at 2018-11-15 13:39:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 13:39:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 13:39:03 [DEBUG   ] spawn_process: at 2018-11-15 13:39:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 13:39:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 13:39:03 [DEBUG   ] spawn_process: at 2018-11-15 13:39:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 13:39:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 13:39:03 [DEBUG   ] spawn_process: at 2018-11-15 13:39:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 13:39:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 13:39:03 [DEBUG   ] spawn_process: at 2018-11-15 13:39:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 13:39:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 13:39:03 [DEBUG   ] spawn_process: at 2018-11-15 13:39:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 13:39:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 13:39:03 [DEBUG   ] spawn_process: at 2018-11-15 13:39:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 13:39:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 13:39:03 [DEBUG   ] spawn_process: at 2018-11-15 13:39:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 13:39:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 13:39:03 [DEBUG   ] spawn_process: at 2018-11-15 13:39:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 13:39:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 13:39:03 [DEBUG   ] spawn_process: at 2018-11-15 13:39:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 13:39:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 13:39:03 [DEBUG   ] spawn_process: at 2018-11-15 13:39:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 13:39:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 13:39:03 [DEBUG   ] spawn_process: at 2018-11-15 13:39:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 13:39:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 13:39:03 [DEBUG   ] spawn_process: at 2018-11-15 13:39:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 13:39:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 13:39:03 [DEBUG   ] spawn_process: at 2018-11-15 13:39:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 13:39:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 13:39:25 [DEBUG   ] Got command BAM from MCS: ref #514883
2018-11-15 13:39:25 [INFO    ] Finished processing BAM request
2018-11-15 13:39:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:39:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514883   8 58437 49165033 A  ERROR'
2018-11-15 13:39:25 [DEBUG   ] Got command BAM from MCS: ref #514882
2018-11-15 13:39:25 [INFO    ] Finished processing BAM request
2018-11-15 13:39:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:39:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514882   8 58437 49165037 A  ERROR'
2018-11-15 13:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 13:39:25 [DEBUG   ] spawn_process: at 2018-11-15 13:39:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 13:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 13:39:25 [DEBUG   ] spawn_process: at 2018-11-15 13:39:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 13:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 13:39:25 [DEBUG   ] spawn_process: at 2018-11-15 13:39:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 13:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 13:39:25 [DEBUG   ] spawn_process: at 2018-11-15 13:39:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 13:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 13:39:25 [DEBUG   ] spawn_process: at 2018-11-15 13:39:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 13:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 13:39:25 [DEBUG   ] spawn_process: at 2018-11-15 13:39:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 13:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 13:39:25 [DEBUG   ] spawn_process: at 2018-11-15 13:39:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 13:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 13:39:25 [DEBUG   ] spawn_process: at 2018-11-15 13:39:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 13:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 13:39:25 [DEBUG   ] spawn_process: at 2018-11-15 13:39:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 13:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 13:39:25 [DEBUG   ] spawn_process: at 2018-11-15 13:39:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 13:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 13:39:25 [DEBUG   ] spawn_process: at 2018-11-15 13:39:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 13:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 13:39:25 [DEBUG   ] spawn_process: at 2018-11-15 13:39:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 13:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 13:39:25 [DEBUG   ] spawn_process: at 2018-11-15 13:39:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 13:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 13:39:25 [DEBUG   ] spawn_process: at 2018-11-15 13:39:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 13:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 13:39:25 [DEBUG   ] spawn_process: at 2018-11-15 13:39:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 13:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 13:39:25 [DEBUG   ] spawn_process: at 2018-11-15 13:39:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 13:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 13:39:25 [DEBUG   ] spawn_process: at 2018-11-15 13:39:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 13:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 13:39:25 [DEBUG   ] spawn_process: at 2018-11-15 13:39:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 13:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 13:39:25 [DEBUG   ] spawn_process: at 2018-11-15 13:39:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 13:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 13:39:25 [DEBUG   ] spawn_process: at 2018-11-15 13:39:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 13:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 13:39:25 [DEBUG   ] spawn_process: at 2018-11-15 13:39:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 13:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 13:39:25 [DEBUG   ] spawn_process: at 2018-11-15 13:39:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 13:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 13:39:25 [DEBUG   ] spawn_process: at 2018-11-15 13:39:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 13:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 13:39:25 [DEBUG   ] spawn_process: at 2018-11-15 13:39:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 13:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 13:39:25 [DEBUG   ] spawn_process: at 2018-11-15 13:39:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 13:39:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 13:39:25 [DEBUG   ] spawn_process: at 2018-11-15 13:39:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 13:39:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 13:39:47 [DEBUG   ] Got command BAM from MCS: ref #514885
2018-11-15 13:39:47 [INFO    ] Finished processing BAM request
2018-11-15 13:39:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:39:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514885   8 58437 49187025 A  ERROR'
2018-11-15 13:39:47 [DEBUG   ] Got command BAM from MCS: ref #514884
2018-11-15 13:39:47 [INFO    ] Finished processing BAM request
2018-11-15 13:39:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:39:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514884   8 58437 49187029 A  ERROR'
2018-11-15 13:39:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 13:39:47 [DEBUG   ] spawn_process: at 2018-11-15 13:39:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 13:39:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 13:39:47 [DEBUG   ] spawn_process: at 2018-11-15 13:39:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 13:39:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 13:39:47 [DEBUG   ] spawn_process: at 2018-11-15 13:39:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 13:39:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 13:39:47 [DEBUG   ] spawn_process: at 2018-11-15 13:39:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 13:39:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 13:39:47 [DEBUG   ] spawn_process: at 2018-11-15 13:39:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 13:39:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 13:39:47 [DEBUG   ] spawn_process: at 2018-11-15 13:39:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 13:39:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 13:39:47 [DEBUG   ] spawn_process: at 2018-11-15 13:39:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 13:39:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 13:39:47 [DEBUG   ] spawn_process: at 2018-11-15 13:39:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 13:39:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 13:39:47 [DEBUG   ] spawn_process: at 2018-11-15 13:39:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 13:39:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 13:39:47 [DEBUG   ] spawn_process: at 2018-11-15 13:39:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 13:39:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 13:39:47 [DEBUG   ] spawn_process: at 2018-11-15 13:39:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 13:39:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 13:39:47 [DEBUG   ] spawn_process: at 2018-11-15 13:39:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 13:39:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 13:39:47 [DEBUG   ] spawn_process: at 2018-11-15 13:39:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 13:39:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 13:39:47 [DEBUG   ] spawn_process: at 2018-11-15 13:39:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 13:39:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 13:39:47 [DEBUG   ] spawn_process: at 2018-11-15 13:39:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 13:39:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 13:39:47 [DEBUG   ] spawn_process: at 2018-11-15 13:39:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 13:39:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 13:39:47 [DEBUG   ] spawn_process: at 2018-11-15 13:39:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 13:39:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 13:39:47 [DEBUG   ] spawn_process: at 2018-11-15 13:39:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 13:39:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 13:39:47 [DEBUG   ] spawn_process: at 2018-11-15 13:39:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 13:39:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 13:39:47 [DEBUG   ] spawn_process: at 2018-11-15 13:39:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 13:39:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 13:39:47 [DEBUG   ] spawn_process: at 2018-11-15 13:39:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 13:39:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 13:39:47 [DEBUG   ] spawn_process: at 2018-11-15 13:39:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 13:39:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 13:39:47 [DEBUG   ] spawn_process: at 2018-11-15 13:39:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 13:39:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 13:39:47 [DEBUG   ] spawn_process: at 2018-11-15 13:39:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 13:39:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 13:39:47 [DEBUG   ] spawn_process: at 2018-11-15 13:39:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 13:39:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 13:39:47 [DEBUG   ] spawn_process: at 2018-11-15 13:39:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 13:39:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 13:39:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 13:39:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 13:39:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 13:39:54 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-15 13:39:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 13:39:54 [WARNING ] (13, 1, 'bot')
2018-11-15 13:39:54 [WARNING ] (13, 1, 'bot')
2018-11-15 13:39:54 [WARNING ] (13, 1, 'bot')
2018-11-15 13:39:54 [WARNING ] (13, 1, 'bot')
2018-11-15 13:39:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 13:39:54 [DEBUG   ] Finished updating board flags in 1.013 seconds
2018-11-15 13:40:09 [DEBUG   ] Got command BAM from MCS: ref #514887
2018-11-15 13:40:09 [INFO    ] Finished processing BAM request
2018-11-15 13:40:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:40:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514887   8 58437 49209033 A  ERROR'
2018-11-15 13:40:09 [DEBUG   ] Got command BAM from MCS: ref #514886
2018-11-15 13:40:09 [INFO    ] Finished processing BAM request
2018-11-15 13:40:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:40:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514886   8 58437 49209037 A  ERROR'
2018-11-15 13:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 13:40:09 [DEBUG   ] spawn_process: at 2018-11-15 13:40:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 13:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 13:40:09 [DEBUG   ] spawn_process: at 2018-11-15 13:40:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 13:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 13:40:09 [DEBUG   ] spawn_process: at 2018-11-15 13:40:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 13:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 13:40:09 [DEBUG   ] spawn_process: at 2018-11-15 13:40:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 13:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 13:40:09 [DEBUG   ] spawn_process: at 2018-11-15 13:40:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 13:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 13:40:09 [DEBUG   ] spawn_process: at 2018-11-15 13:40:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 13:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 13:40:09 [DEBUG   ] spawn_process: at 2018-11-15 13:40:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 13:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 13:40:09 [DEBUG   ] spawn_process: at 2018-11-15 13:40:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 13:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 13:40:09 [DEBUG   ] spawn_process: at 2018-11-15 13:40:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 13:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 13:40:09 [DEBUG   ] spawn_process: at 2018-11-15 13:40:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 13:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 13:40:09 [DEBUG   ] spawn_process: at 2018-11-15 13:40:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 13:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 13:40:09 [DEBUG   ] spawn_process: at 2018-11-15 13:40:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 13:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 13:40:09 [DEBUG   ] spawn_process: at 2018-11-15 13:40:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 13:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 13:40:09 [DEBUG   ] spawn_process: at 2018-11-15 13:40:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 13:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 13:40:09 [DEBUG   ] spawn_process: at 2018-11-15 13:40:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 13:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 13:40:09 [DEBUG   ] spawn_process: at 2018-11-15 13:40:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 13:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 13:40:09 [DEBUG   ] spawn_process: at 2018-11-15 13:40:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 13:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 13:40:09 [DEBUG   ] spawn_process: at 2018-11-15 13:40:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 13:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 13:40:09 [DEBUG   ] spawn_process: at 2018-11-15 13:40:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 13:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 13:40:09 [DEBUG   ] spawn_process: at 2018-11-15 13:40:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 13:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 13:40:09 [DEBUG   ] spawn_process: at 2018-11-15 13:40:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 13:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 13:40:09 [DEBUG   ] spawn_process: at 2018-11-15 13:40:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 13:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 13:40:09 [DEBUG   ] spawn_process: at 2018-11-15 13:40:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 13:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 13:40:09 [DEBUG   ] spawn_process: at 2018-11-15 13:40:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 13:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 13:40:09 [DEBUG   ] spawn_process: at 2018-11-15 13:40:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 13:40:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 13:40:09 [DEBUG   ] spawn_process: at 2018-11-15 13:40:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 13:40:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 13:40:31 [DEBUG   ] Got command BAM from MCS: ref #514888
2018-11-15 13:40:31 [INFO    ] Finished processing BAM request
2018-11-15 13:40:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:40:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514888   8 58437 49231029 A  ERROR'
2018-11-15 13:40:31 [DEBUG   ] Got command BAM from MCS: ref #514889
2018-11-15 13:40:31 [INFO    ] Finished processing BAM request
2018-11-15 13:40:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:40:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514889   8 58437 49231033 A  ERROR'
2018-11-15 13:40:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 13:40:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 13:40:31 [DEBUG   ] spawn_process: at 2018-11-15 13:40:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 13:40:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 13:40:31 [DEBUG   ] spawn_process: at 2018-11-15 13:40:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 13:40:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 13:40:31 [DEBUG   ] spawn_process: at 2018-11-15 13:40:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 13:40:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 13:40:31 [DEBUG   ] spawn_process: at 2018-11-15 13:40:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 13:40:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 13:40:31 [DEBUG   ] spawn_process: at 2018-11-15 13:40:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 13:40:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 13:40:31 [DEBUG   ] spawn_process: at 2018-11-15 13:40:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 13:40:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 13:40:31 [DEBUG   ] spawn_process: at 2018-11-15 13:40:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 13:40:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 13:40:31 [DEBUG   ] spawn_process: at 2018-11-15 13:40:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 13:40:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 13:40:31 [DEBUG   ] spawn_process: at 2018-11-15 13:40:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 13:40:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 13:40:31 [DEBUG   ] spawn_process: at 2018-11-15 13:40:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 13:40:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 13:40:31 [DEBUG   ] spawn_process: at 2018-11-15 13:40:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 13:40:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 13:40:31 [DEBUG   ] spawn_process: at 2018-11-15 13:40:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 13:40:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 13:40:31 [DEBUG   ] spawn_process: at 2018-11-15 13:40:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 13:40:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 13:40:31 [DEBUG   ] spawn_process: at 2018-11-15 13:40:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 13:40:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 13:40:31 [DEBUG   ] spawn_process: at 2018-11-15 13:40:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 13:40:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 13:40:31 [DEBUG   ] spawn_process: at 2018-11-15 13:40:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 13:40:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 13:40:31 [DEBUG   ] spawn_process: at 2018-11-15 13:40:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 13:40:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 13:40:31 [DEBUG   ] spawn_process: at 2018-11-15 13:40:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 13:40:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 13:40:31 [DEBUG   ] spawn_process: at 2018-11-15 13:40:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 13:40:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 13:40:31 [DEBUG   ] spawn_process: at 2018-11-15 13:40:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 13:40:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 13:40:31 [DEBUG   ] spawn_process: at 2018-11-15 13:40:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 13:40:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 13:40:31 [DEBUG   ] spawn_process: at 2018-11-15 13:40:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 13:40:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 13:40:31 [DEBUG   ] spawn_process: at 2018-11-15 13:40:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 13:40:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 13:40:31 [DEBUG   ] spawn_process: at 2018-11-15 13:40:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 13:40:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 13:40:31 [DEBUG   ] spawn_process: at 2018-11-15 13:40:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 13:40:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 13:40:31 [DEBUG   ] spawn_process: at 2018-11-15 13:40:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 13:40:45 [DEBUG   ] Got command RPT from MCS: ref #514890
2018-11-15 13:40:45 [DEBUG   ] summary = ERROR
2018-11-15 13:40:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   514890  13 58437 49245097 A  ERRORERROR'
2018-11-15 13:40:45 [DEBUG   ] Got command RPT from MCS: ref #514891
2018-11-15 13:40:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 13:40:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   514891  77 58437 49245098 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 13:40:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 13:40:53 [DEBUG   ] Got command BAM from MCS: ref #514907
2018-11-15 13:40:53 [INFO    ] Finished processing BAM request
2018-11-15 13:40:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:40:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514907   8 58437 49253033 A  ERROR'
2018-11-15 13:40:53 [DEBUG   ] Got command BAM from MCS: ref #514908
2018-11-15 13:40:53 [INFO    ] Finished processing BAM request
2018-11-15 13:40:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 13:40:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   514908   8 58437 49253037 A  ERROR'
2018-11-15 13:40:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 13:40:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 13:40:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-15 13:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 13:40:53 [DEBUG   ] spawn_process: at 2018-11-15 13:40:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 13:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 13:40:53 [DEBUG   ] spawn_process: at 2018-11-15 13:40:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 13:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 13:40:53 [DEBUG   ] spawn_process: at 2018-11-15 13:40:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 13:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 13:40:53 [DEBUG   ] spawn_process: at 2018-11-15 13:40:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 13:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 13:40:53 [DEBUG   ] spawn_process: at 2018-11-15 13:40:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 13:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 13:40:53 [DEBUG   ] spawn_process: at 2018-11-15 13:40:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 13:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 13:40:53 [DEBUG   ] spawn_process: at 2018-11-15 13:40:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 13:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 13:40:53 [DEBUG   ] spawn_process: at 2018-11-15 13:40:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 13:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 13:40:53 [DEBUG   ] spawn_process: at 2018-11-15 13:40:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 13:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 13:40:53 [DEBUG   ] spawn_process: at 2018-11-15 13:40:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 13:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 13:40:53 [DEBUG   ] spawn_process: at 2018-11-15 13:40:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 13:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 13:40:53 [DEBUG   ] spawn_process: at 2018-11-15 13:40:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 13:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 13:40:53 [DEBUG   ] spawn_process: at 2018-11-15 13:40:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 13:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 13:40:53 [DEBUG   ] spawn_process: at 2018-11-15 13:40:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 13:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 13:40:53 [DEBUG   ] spawn_process: at 2018-11-15 13:40:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 13:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 13:40:53 [DEBUG   ] spawn_process: at 2018-11-15 13:40:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 13:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 13:40:53 [DEBUG   ] spawn_process: at 2018-11-15 13:40:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 13:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 13:40:53 [DEBUG   ] spawn_process: at 2018-11-15 13:40:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 13:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 13:40:53 [DEBUG   ] spawn_process: at 2018-11-15 13:40:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 13:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 13:40:53 [DEBUG   ] spawn_process: at 2018-11-15 13:40:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 13:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 13:40:53 [DEBUG   ] spawn_process: at 2018-11-15 13:40:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 13:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 13:40:53 [DEBUG   ] spawn_process: at 2018-11-15 13:40:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 13:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 13:40:53 [DEBUG   ] spawn_process: at 2018-11-15 13:40:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 13:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 13:40:53 [DEBUG   ] spawn_process: at 2018-11-15 13:40:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 13:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 13:40:53 [DEBUG   ] spawn_process: at 2018-11-15 13:40:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 13:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 13:40:53 [DEBUG   ] spawn_process: at 2018-11-15 13:40:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 13:40:54 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 13:40:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 13:40:54 [WARNING ] (13, 1, 'bot')
2018-11-15 13:40:54 [WARNING ] (13, 1, 'bot')
2018-11-15 13:40:54 [WARNING ] (13, 1, 'bot')
2018-11-15 13:40:54 [WARNING ] (13, 1, 'bot')
2018-11-15 13:40:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 13:40:54 [DEBUG   ] Finished updating board flags in 0.986 seconds
2018-11-15 13:41:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 13:41:13 [DEBUG   ] Got command STP from MCS: ref #514909
2018-11-15 13:41:13 [INFO    ] Finished processing BAM request
2018-11-15 13:41:13 [INFO    ] Shutdown the adder chain on beam #3
2018-11-15 13:41:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP   514909   8 58437 49273025 A  ERROR'
2018-11-15 13:41:13 [DEBUG   ] Got command STP from MCS: ref #514910
2018-11-15 13:41:13 [INFO    ] Finished processing BAM request
2018-11-15 13:41:13 [INFO    ] Shutdown the adder chain on beam #4
2018-11-15 13:41:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP   514910   8 58437 49273029 A  ERROR'
2018-11-15 13:41:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 13:41:13 [DEBUG   ] spawn_process: at 2018-11-15 13:41:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 13:41:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 13:41:13 [DEBUG   ] spawn_process: at 2018-11-15 13:41:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 13:41:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 13:41:13 [DEBUG   ] spawn_process: at 2018-11-15 13:41:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 13:41:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 13:41:13 [DEBUG   ] spawn_process: at 2018-11-15 13:41:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 13:41:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 13:41:13 [DEBUG   ] spawn_process: at 2018-11-15 13:41:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 13:41:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 13:41:13 [DEBUG   ] spawn_process: at 2018-11-15 13:41:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 13:41:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 13:41:13 [DEBUG   ] spawn_process: at 2018-11-15 13:41:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 13:41:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 13:41:13 [DEBUG   ] spawn_process: at 2018-11-15 13:41:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 13:41:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 13:41:13 [DEBUG   ] spawn_process: at 2018-11-15 13:41:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 13:41:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 13:41:13 [DEBUG   ] spawn_process: at 2018-11-15 13:41:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 13:41:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 13:41:13 [DEBUG   ] spawn_process: at 2018-11-15 13:41:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 13:41:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 13:41:13 [DEBUG   ] spawn_process: at 2018-11-15 13:41:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 13:41:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 13:41:13 [DEBUG   ] spawn_process: at 2018-11-15 13:41:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 13:41:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 13:41:13 [DEBUG   ] spawn_process: at 2018-11-15 13:41:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 13:41:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 13:41:13 [DEBUG   ] spawn_process: at 2018-11-15 13:41:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 13:41:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 13:41:13 [DEBUG   ] spawn_process: at 2018-11-15 13:41:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 13:41:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 13:41:13 [DEBUG   ] spawn_process: at 2018-11-15 13:41:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 13:41:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 13:41:13 [DEBUG   ] spawn_process: at 2018-11-15 13:41:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 13:41:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 13:41:13 [DEBUG   ] spawn_process: at 2018-11-15 13:41:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 13:41:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 13:41:13 [DEBUG   ] spawn_process: at 2018-11-15 13:41:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 13:41:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 13:41:13 [DEBUG   ] spawn_process: at 2018-11-15 13:41:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 13:41:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 13:41:13 [DEBUG   ] spawn_process: at 2018-11-15 13:41:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 13:41:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 13:41:13 [DEBUG   ] spawn_process: at 2018-11-15 13:41:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 13:41:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 13:41:13 [DEBUG   ] spawn_process: at 2018-11-15 13:41:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 13:41:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 13:41:13 [DEBUG   ] spawn_process: at 2018-11-15 13:41:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 13:41:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 13:41:13 [DEBUG   ] spawn_process: at 2018-11-15 13:41:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 13:41:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 13:41:51 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 13:41:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 13:41:55 [WARNING ] (13, 1, 'bot')
2018-11-15 13:41:55 [WARNING ] (13, 1, 'bot')
2018-11-15 13:41:55 [WARNING ] (13, 1, 'bot')
2018-11-15 13:41:55 [WARNING ] (13, 1, 'bot')
2018-11-15 13:41:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 13:41:55 [DEBUG   ] Finished updating board flags in 1.885 seconds
2018-11-15 13:42:11 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-15 13:42:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 13:42:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 13:42:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 13:42:54 [WARNING ] (13, 1, 'bot')
2018-11-15 13:42:54 [WARNING ] (13, 1, 'bot')
2018-11-15 13:42:54 [WARNING ] (13, 1, 'bot')
2018-11-15 13:42:54 [WARNING ] (13, 1, 'bot')
2018-11-15 13:42:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 13:42:54 [DEBUG   ] Finished updating board flags in 1.165 seconds
2018-11-15 13:43:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 13:43:16 [DEBUG   ] Got command RPT from MCS: ref #514915
2018-11-15 13:43:16 [DEBUG   ] summary = ERROR
2018-11-15 13:43:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   514915  13 58437 49396661 A  ERRORERROR'
2018-11-15 13:43:16 [DEBUG   ] Got command RPT from MCS: ref #514916
2018-11-15 13:43:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 13:43:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   514916  77 58437 49396865 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 13:43:17 [DEBUG   ] Got command RPT from MCS: ref #514917
2018-11-15 13:43:17 [DEBUG   ] summary = ERROR
2018-11-15 13:43:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   514917  13 58437 49397057 A  ERRORERROR'
2018-11-15 13:43:17 [DEBUG   ] Got command RPT from MCS: ref #514918
2018-11-15 13:43:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 13:43:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   514918  77 58437 49397261 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 13:43:17 [DEBUG   ] Got command RPT from MCS: ref #514919
2018-11-15 13:43:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 13:43:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   514919  12 58437 49397465 A  ERRORB›™š'
2018-11-15 13:43:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 13:43:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 13:43:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 13:43:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 13:43:54 [WARNING ] (13, 1, 'bot')
2018-11-15 13:43:54 [WARNING ] (13, 1, 'bot')
2018-11-15 13:43:54 [WARNING ] (13, 1, 'bot')
2018-11-15 13:43:54 [WARNING ] (13, 1, 'bot')
2018-11-15 13:43:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 13:43:54 [DEBUG   ] Finished updating board flags in 1.028 seconds
2018-11-15 13:44:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 13:44:31 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 13:44:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 13:44:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 13:44:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-15 13:44:54 [WARNING ] (13, 1, 'bot')
2018-11-15 13:44:54 [WARNING ] (13, 1, 'bot')
2018-11-15 13:44:54 [WARNING ] (13, 1, 'bot')
2018-11-15 13:44:54 [WARNING ] (13, 1, 'bot')
2018-11-15 13:44:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 13:44:54 [DEBUG   ] Finished updating board flags in 1.005 seconds
2018-11-15 13:45:11 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-15 13:45:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 13:45:45 [DEBUG   ] Got command RPT from MCS: ref #514924
2018-11-15 13:45:45 [DEBUG   ] summary = ERROR
2018-11-15 13:45:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   514924  13 58437 49545093 A  ERRORERROR'
2018-11-15 13:45:45 [DEBUG   ] Got command RPT from MCS: ref #514925
2018-11-15 13:45:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 13:45:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   514925  77 58437 49545094 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 13:45:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 13:45:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 13:45:54 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 13:45:54 [WARNING ] (13, 1, 'bot')
2018-11-15 13:45:54 [WARNING ] (13, 1, 'bot')
2018-11-15 13:45:54 [WARNING ] (13, 1, 'bot')
2018-11-15 13:45:54 [WARNING ] (13, 1, 'bot')
2018-11-15 13:45:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 13:45:54 [DEBUG   ] Finished updating board flags in 1.006 seconds
2018-11-15 13:46:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 13:46:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 13:46:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 13:46:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 13:46:54 [WARNING ] (13, 1, 'bot')
2018-11-15 13:46:54 [WARNING ] (13, 1, 'bot')
2018-11-15 13:46:54 [WARNING ] (13, 1, 'bot')
2018-11-15 13:46:54 [WARNING ] (13, 1, 'bot')
2018-11-15 13:46:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 13:46:54 [DEBUG   ] Finished updating board flags in 0.969 seconds
2018-11-15 13:47:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 13:47:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 13:47:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 13:47:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 13:47:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 13:47:55 [WARNING ] (13, 1, 'bot')
2018-11-15 13:47:55 [WARNING ] (13, 1, 'bot')
2018-11-15 13:47:55 [WARNING ] (13, 1, 'bot')
2018-11-15 13:47:55 [WARNING ] (13, 1, 'bot')
2018-11-15 13:47:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 13:47:55 [DEBUG   ] Finished updating board flags in 1.427 seconds
2018-11-15 13:48:11 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-15 13:48:16 [DEBUG   ] Got command RPT from MCS: ref #514947
2018-11-15 13:48:16 [DEBUG   ] summary = ERROR
2018-11-15 13:48:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   514947  13 58437 49696741 A  ERRORERROR'
2018-11-15 13:48:16 [DEBUG   ] Got command RPT from MCS: ref #514948
2018-11-15 13:48:16 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 13:48:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   514948  77 58437 49696945 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 13:48:17 [DEBUG   ] Got command RPT from MCS: ref #514949
2018-11-15 13:48:17 [DEBUG   ] summary = ERROR
2018-11-15 13:48:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   514949  13 58437 49697149 A  ERRORERROR'
2018-11-15 13:48:17 [DEBUG   ] Got command RPT from MCS: ref #514951
2018-11-15 13:48:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 13:48:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   514951  77 58437 49697353 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 13:48:17 [DEBUG   ] Got command RPT from MCS: ref #514953
2018-11-15 13:48:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 13:48:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   514953  12 58437 49697545 A  ERRORB˜™š'
2018-11-15 13:48:31 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 13:48:51 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 13:48:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 13:48:55 [WARNING ] (13, 1, 'bot')
2018-11-15 13:48:55 [WARNING ] (13, 1, 'bot')
2018-11-15 13:48:55 [WARNING ] (13, 1, 'bot')
2018-11-15 13:48:55 [WARNING ] (13, 1, 'bot')
2018-11-15 13:48:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 13:48:55 [DEBUG   ] Finished updating board flags in 1.336 seconds
2018-11-15 13:49:11 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 13:49:31 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 13:49:51 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 13:49:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 13:49:55 [WARNING ] (13, 1, 'bot')
2018-11-15 13:49:55 [WARNING ] (13, 1, 'bot')
2018-11-15 13:49:55 [WARNING ] (13, 1, 'bot')
2018-11-15 13:49:55 [WARNING ] (13, 1, 'bot')
2018-11-15 13:49:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 13:49:55 [DEBUG   ] Finished updating board flags in 1.220 seconds
2018-11-15 13:50:11 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 13:50:31 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 13:50:45 [DEBUG   ] Got command RPT from MCS: ref #514961
2018-11-15 13:50:45 [DEBUG   ] summary = ERROR
2018-11-15 13:50:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   514961  13 58437 49845101 A  ERRORERROR'
2018-11-15 13:50:45 [DEBUG   ] Got command RPT from MCS: ref #514962
2018-11-15 13:50:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 13:50:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   514962  77 58437 49845102 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 13:50:51 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 13:50:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 13:50:55 [WARNING ] (13, 1, 'bot')
2018-11-15 13:50:55 [WARNING ] (13, 1, 'bot')
2018-11-15 13:50:55 [WARNING ] (13, 1, 'bot')
2018-11-15 13:50:55 [WARNING ] (13, 1, 'bot')
2018-11-15 13:50:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 13:50:55 [DEBUG   ] Finished updating board flags in 1.184 seconds
2018-11-15 13:51:11 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 13:51:31 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 13:51:51 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 13:51:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 13:51:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-15 13:51:55 [WARNING ] (13, 1, 'bot')
2018-11-15 13:51:55 [WARNING ] (13, 1, 'bot')
2018-11-15 13:51:55 [WARNING ] (13, 1, 'bot')
2018-11-15 13:51:55 [WARNING ] (13, 1, 'bot')
2018-11-15 13:51:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 13:51:55 [DEBUG   ] Finished updating board flags in 1.015 seconds
2018-11-15 13:52:11 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 13:52:31 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 13:52:51 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 13:52:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 13:52:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 13:52:55 [WARNING ] (13, 1, 'bot')
2018-11-15 13:52:55 [WARNING ] (13, 1, 'bot')
2018-11-15 13:52:55 [WARNING ] (13, 1, 'bot')
2018-11-15 13:52:55 [WARNING ] (13, 1, 'bot')
2018-11-15 13:52:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 13:52:55 [DEBUG   ] Finished updating board flags in 1.053 seconds
2018-11-15 13:53:11 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-15 13:53:16 [DEBUG   ] Got command RPT from MCS: ref #514978
2018-11-15 13:53:16 [DEBUG   ] summary = ERROR
2018-11-15 13:53:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   514978  13 58437 49996829 A  ERRORERROR'
2018-11-15 13:53:17 [DEBUG   ] Got command RPT from MCS: ref #514979
2018-11-15 13:53:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 13:53:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   514979  77 58437 49997033 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 13:53:17 [DEBUG   ] Got command RPT from MCS: ref #514980
2018-11-15 13:53:17 [DEBUG   ] summary = ERROR
2018-11-15 13:53:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   514980  13 58437 49997237 A  ERRORERROR'
2018-11-15 13:53:17 [DEBUG   ] Got command RPT from MCS: ref #514981
2018-11-15 13:53:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 13:53:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   514981  77 58437 49997441 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 13:53:17 [DEBUG   ] Got command RPT from MCS: ref #514982
2018-11-15 13:53:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 13:53:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   514982  12 58437 49997633 A  ERRORB˜™š'
2018-11-15 13:53:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 13:53:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 13:53:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 13:53:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 13:53:56 [WARNING ] (13, 1, 'bot')
2018-11-15 13:53:56 [WARNING ] (13, 1, 'bot')
2018-11-15 13:53:56 [WARNING ] (13, 1, 'bot')
2018-11-15 13:53:56 [WARNING ] (13, 1, 'bot')
2018-11-15 13:53:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 13:53:56 [DEBUG   ] Finished updating board flags in 2.000 seconds
2018-11-15 13:54:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 13:54:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 13:54:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 13:54:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 13:54:56 [WARNING ] (13, 1, 'bot')
2018-11-15 13:54:56 [WARNING ] (13, 1, 'bot')
2018-11-15 13:54:56 [WARNING ] (13, 1, 'bot')
2018-11-15 13:54:56 [WARNING ] (13, 1, 'bot')
2018-11-15 13:54:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 13:54:56 [DEBUG   ] Finished updating board flags in 1.939 seconds
2018-11-15 13:55:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 13:55:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 13:55:45 [DEBUG   ] Got command RPT from MCS: ref #514987
2018-11-15 13:55:45 [DEBUG   ] summary = ERROR
2018-11-15 13:55:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   514987  13 58437 50145093 A  ERRORERROR'
2018-11-15 13:55:45 [DEBUG   ] Got command RPT from MCS: ref #514988
2018-11-15 13:55:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 13:55:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   514988  77 58437 50145094 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 13:55:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 13:55:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 13:55:55 [WARNING ] (13, 1, 'bot')
2018-11-15 13:55:55 [WARNING ] (13, 1, 'bot')
2018-11-15 13:55:55 [WARNING ] (13, 1, 'bot')
2018-11-15 13:55:55 [WARNING ] (13, 1, 'bot')
2018-11-15 13:55:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 13:55:55 [DEBUG   ] Finished updating board flags in 1.249 seconds
2018-11-15 13:56:12 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-15 13:56:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 13:56:52 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 13:56:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 13:56:55 [WARNING ] (13, 1, 'bot')
2018-11-15 13:56:55 [WARNING ] (13, 1, 'bot')
2018-11-15 13:56:55 [WARNING ] (13, 1, 'bot')
2018-11-15 13:56:55 [WARNING ] (13, 1, 'bot')
2018-11-15 13:56:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 13:56:55 [DEBUG   ] Finished updating board flags in 1.219 seconds
2018-11-15 13:57:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 13:57:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 13:57:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 13:57:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 13:57:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 13:57:55 [WARNING ] (13, 1, 'bot')
2018-11-15 13:57:55 [WARNING ] (13, 1, 'bot')
2018-11-15 13:57:55 [WARNING ] (13, 1, 'bot')
2018-11-15 13:57:55 [WARNING ] (13, 1, 'bot')
2018-11-15 13:57:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 13:57:55 [DEBUG   ] Finished updating board flags in 1.221 seconds
2018-11-15 13:58:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 13:58:16 [DEBUG   ] Got command RPT from MCS: ref #515010
2018-11-15 13:58:16 [DEBUG   ] summary = ERROR
2018-11-15 13:58:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515010  13 58437 50296917 A  ERRORERROR'
2018-11-15 13:58:17 [DEBUG   ] Got command RPT from MCS: ref #515011
2018-11-15 13:58:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 13:58:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515011  77 58437 50297121 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 13:58:17 [DEBUG   ] Got command RPT from MCS: ref #515012
2018-11-15 13:58:17 [DEBUG   ] summary = ERROR
2018-11-15 13:58:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515012  13 58437 50297325 A  ERRORERROR'
2018-11-15 13:58:17 [DEBUG   ] Got command RPT from MCS: ref #515014
2018-11-15 13:58:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 13:58:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515014  77 58437 50297517 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 13:58:17 [DEBUG   ] Got command RPT from MCS: ref #515015
2018-11-15 13:58:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 13:58:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515015  12 58437 50297721 A  ERRORB˜™š'
2018-11-15 13:58:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 13:58:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 13:58:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 13:58:55 [WARNING ] (13, 1, 'bot')
2018-11-15 13:58:55 [WARNING ] (13, 1, 'bot')
2018-11-15 13:58:55 [WARNING ] (13, 1, 'bot')
2018-11-15 13:58:55 [WARNING ] (13, 1, 'bot')
2018-11-15 13:58:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 13:58:55 [DEBUG   ] Finished updating board flags in 1.157 seconds
2018-11-15 13:59:12 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 13:59:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 13:59:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 13:59:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 13:59:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 13:59:55 [WARNING ] (13, 1, 'bot')
2018-11-15 13:59:55 [WARNING ] (13, 1, 'bot')
2018-11-15 13:59:55 [WARNING ] (13, 1, 'bot')
2018-11-15 13:59:55 [WARNING ] (13, 1, 'bot')
2018-11-15 13:59:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 13:59:55 [DEBUG   ] Finished updating board flags in 1.034 seconds
2018-11-15 14:00:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 14:00:32 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-15 14:00:45 [DEBUG   ] Got command RPT from MCS: ref #515024
2018-11-15 14:00:45 [DEBUG   ] summary = ERROR
2018-11-15 14:00:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515024  13 58437 50445101 A  ERRORERROR'
2018-11-15 14:00:45 [DEBUG   ] Got command RPT from MCS: ref #515025
2018-11-15 14:00:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 14:00:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515025  77 58437 50445102 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 14:00:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 14:00:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:00:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 14:00:55 [WARNING ] (13, 1, 'bot')
2018-11-15 14:00:55 [WARNING ] (13, 1, 'bot')
2018-11-15 14:00:55 [WARNING ] (13, 1, 'bot')
2018-11-15 14:00:55 [WARNING ] (13, 1, 'bot')
2018-11-15 14:00:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:00:55 [DEBUG   ] Finished updating board flags in 0.963 seconds
2018-11-15 14:01:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 14:01:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 14:01:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 14:01:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:01:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 14:01:56 [WARNING ] (13, 1, 'bot')
2018-11-15 14:01:56 [WARNING ] (13, 1, 'bot')
2018-11-15 14:01:56 [WARNING ] (13, 1, 'bot')
2018-11-15 14:01:56 [WARNING ] (13, 1, 'bot')
2018-11-15 14:01:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:01:56 [DEBUG   ] Finished updating board flags in 1.436 seconds
2018-11-15 14:02:00 [DEBUG   ] Got command TBN from MCS: ref #515041
2018-11-15 14:02:00 [DEBUG   ] spawn_process: at 2018-11-15 14:02:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1542290521']
2018-11-15 14:02:00 [DEBUG   ] spawn_process: at 2018-11-15 14:02:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1542290521']
2018-11-15 14:02:00 [DEBUG   ] tbn = exited with status True, code 0x00
2018-11-15 14:02:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN   515041   8 58437 50520170 A  ERROR'
2018-11-15 14:02:00 [DEBUG   ] spawn_process: at 2018-11-15 14:02:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1542290521']
2018-11-15 14:02:00 [DEBUG   ] spawn_process: at 2018-11-15 14:02:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1542290521']
2018-11-15 14:02:00 [DEBUG   ] spawn_process: at 2018-11-15 14:02:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1542290521']
2018-11-15 14:02:00 [DEBUG   ] spawn_process: at 2018-11-15 14:02:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1542290521']
2018-11-15 14:02:00 [DEBUG   ] spawn_process: at 2018-11-15 14:02:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1542290521']
2018-11-15 14:02:00 [DEBUG   ] spawn_process: at 2018-11-15 14:02:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1542290521']
2018-11-15 14:02:00 [DEBUG   ] spawn_process: at 2018-11-15 14:02:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1542290521']
2018-11-15 14:02:00 [DEBUG   ] spawn_process: at 2018-11-15 14:02:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1542290521']
2018-11-15 14:02:00 [DEBUG   ] spawn_process: at 2018-11-15 14:02:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1542290521']
2018-11-15 14:02:00 [DEBUG   ] spawn_process: at 2018-11-15 14:02:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1542290521']
2018-11-15 14:02:00 [DEBUG   ] spawn_process: at 2018-11-15 14:02:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1542290521']
2018-11-15 14:02:00 [DEBUG   ] spawn_process: at 2018-11-15 14:02:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1542290521']
2018-11-15 14:02:00 [DEBUG   ] spawn_process: at 2018-11-15 14:02:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1542290521']
2018-11-15 14:02:00 [DEBUG   ] spawn_process: at 2018-11-15 14:02:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1542290521']
2018-11-15 14:02:00 [DEBUG   ] spawn_process: at 2018-11-15 14:02:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1542290521']
2018-11-15 14:02:00 [DEBUG   ] spawn_process: at 2018-11-15 14:02:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1542290521']
2018-11-15 14:02:00 [DEBUG   ] spawn_process: at 2018-11-15 14:02:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1542290521']
2018-11-15 14:02:00 [DEBUG   ] spawn_process: at 2018-11-15 14:02:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1542290521']
2018-11-15 14:02:00 [DEBUG   ] spawn_process: at 2018-11-15 14:02:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1542290521']
2018-11-15 14:02:00 [DEBUG   ] spawn_process: at 2018-11-15 14:02:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1542290521']
2018-11-15 14:02:00 [DEBUG   ] spawn_process: at 2018-11-15 14:02:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1542290521']
2018-11-15 14:02:00 [DEBUG   ] spawn_process: at 2018-11-15 14:02:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1542290521']
2018-11-15 14:02:00 [DEBUG   ] spawn_process: at 2018-11-15 14:02:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1542290521']
2018-11-15 14:02:00 [DEBUG   ] spawn_process: at 2018-11-15 14:02:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1542290521']
2018-11-15 14:02:00 [INFO    ] Finished spawning TBN in 0.048 s
2018-11-15 14:02:12 [DEBUG   ] Finished updating ant stats in 0.871 seconds
2018-11-15 14:02:32 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-15 14:02:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 14:02:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:02:56 [WARNING ] (13, 1, 'bot')
2018-11-15 14:02:56 [WARNING ] (13, 1, 'bot')
2018-11-15 14:02:56 [WARNING ] (13, 1, 'bot')
2018-11-15 14:02:56 [WARNING ] (13, 1, 'bot')
2018-11-15 14:02:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:02:56 [DEBUG   ] Finished updating board flags in 1.640 seconds
2018-11-15 14:03:12 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-15 14:03:17 [DEBUG   ] Got command RPT from MCS: ref #515046
2018-11-15 14:03:17 [DEBUG   ] summary = ERROR
2018-11-15 14:03:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515046  13 58437 50597009 A  ERRORERROR'
2018-11-15 14:03:17 [DEBUG   ] Got command RPT from MCS: ref #515047
2018-11-15 14:03:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 14:03:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515047  77 58437 50597213 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 14:03:17 [DEBUG   ] Got command RPT from MCS: ref #515048
2018-11-15 14:03:17 [DEBUG   ] summary = ERROR
2018-11-15 14:03:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515048  13 58437 50597405 A  ERRORERROR'
2018-11-15 14:03:17 [DEBUG   ] Got command RPT from MCS: ref #515049
2018-11-15 14:03:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 14:03:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515049  77 58437 50597609 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 14:03:17 [DEBUG   ] Got command RPT from MCS: ref #515050
2018-11-15 14:03:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 14:03:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515050  12 58437 50597813 A  ERRORB˜™š'
2018-11-15 14:03:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 14:03:52 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-15 14:03:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-15 14:03:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:03:56 [WARNING ] (13, 1, 'bot')
2018-11-15 14:03:56 [WARNING ] (13, 1, 'bot')
2018-11-15 14:03:56 [WARNING ] (13, 1, 'bot')
2018-11-15 14:03:56 [WARNING ] (13, 1, 'bot')
2018-11-15 14:03:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:03:56 [DEBUG   ] Finished updating board flags in 1.508 seconds
2018-11-15 14:04:12 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 14:04:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 14:04:52 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 14:04:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:04:56 [WARNING ] (13, 1, 'bot')
2018-11-15 14:04:56 [WARNING ] (13, 1, 'bot')
2018-11-15 14:04:56 [WARNING ] (13, 1, 'bot')
2018-11-15 14:04:56 [WARNING ] (13, 1, 'bot')
2018-11-15 14:04:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:04:56 [DEBUG   ] Finished updating board flags in 1.486 seconds
2018-11-15 14:05:12 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-15 14:05:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 14:05:45 [DEBUG   ] Got command RPT from MCS: ref #515055
2018-11-15 14:05:45 [DEBUG   ] summary = ERROR
2018-11-15 14:05:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515055  13 58437 50745097 A  ERRORERROR'
2018-11-15 14:05:45 [DEBUG   ] Got command RPT from MCS: ref #515056
2018-11-15 14:05:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 14:05:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515056  77 58437 50745098 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 14:05:52 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-15 14:05:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 14:05:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 14:05:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:05:56 [WARNING ] (13, 1, 'bot')
2018-11-15 14:05:56 [WARNING ] (13, 1, 'bot')
2018-11-15 14:05:56 [WARNING ] (13, 1, 'bot')
2018-11-15 14:05:56 [WARNING ] (13, 1, 'bot')
2018-11-15 14:05:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:05:56 [DEBUG   ] Finished updating board flags in 1.491 seconds
2018-11-15 14:06:11 [DEBUG   ] Got command TBW from MCS: ref #515073
2018-11-15 14:06:11 [DEBUG   ] tbw = exited with status True, code 0x00
2018-11-15 14:06:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW   515073   8 58437 50771242 A  ERROR'
2018-11-15 14:06:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2018-11-15 14:06:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2018-11-15 14:06:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2018-11-15 14:06:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2018-11-15 14:06:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2018-11-15 14:06:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2018-11-15 14:06:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2018-11-15 14:06:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2018-11-15 14:06:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2018-11-15 14:06:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2018-11-15 14:06:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2018-11-15 14:06:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2018-11-15 14:06:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2018-11-15 14:06:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2018-11-15 14:06:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2018-11-15 14:06:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2018-11-15 14:06:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2018-11-15 14:06:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2018-11-15 14:06:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2018-11-15 14:06:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2018-11-15 14:06:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2018-11-15 14:06:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2018-11-15 14:06:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2018-11-15 14:06:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2018-11-15 14:06:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2018-11-15 14:06:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2018-11-15 14:06:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2018-11-15 14:06:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2018-11-15 14:06:14 [DEBUG   ] spawn_process: at 2018-11-15 14:06:14 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2018-11-15 14:06:14 [DEBUG   ] spawn_process: at 2018-11-15 14:06:14 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2018-11-15 14:06:14 [DEBUG   ] spawn_process: at 2018-11-15 14:06:14 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2018-11-15 14:06:14 [DEBUG   ] spawn_process: at 2018-11-15 14:06:14 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2018-11-15 14:06:14 [DEBUG   ] spawn_process: at 2018-11-15 14:06:14 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2018-11-15 14:06:14 [DEBUG   ] spawn_process: at 2018-11-15 14:06:14 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2018-11-15 14:06:14 [DEBUG   ] spawn_process: at 2018-11-15 14:06:14 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2018-11-15 14:06:14 [DEBUG   ] spawn_process: at 2018-11-15 14:06:14 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2018-11-15 14:06:14 [DEBUG   ] spawn_process: at 2018-11-15 14:06:14 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2018-11-15 14:06:14 [DEBUG   ] spawn_process: at 2018-11-15 14:06:14 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2018-11-15 14:06:14 [DEBUG   ] spawn_process: at 2018-11-15 14:06:14 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2018-11-15 14:06:14 [DEBUG   ] spawn_process: at 2018-11-15 14:06:14 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2018-11-15 14:06:14 [DEBUG   ] spawn_process: at 2018-11-15 14:06:14 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2018-11-15 14:06:14 [DEBUG   ] spawn_process: at 2018-11-15 14:06:14 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2018-11-15 14:06:14 [DEBUG   ] spawn_process: at 2018-11-15 14:06:14 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2018-11-15 14:06:14 [DEBUG   ] spawn_process: at 2018-11-15 14:06:14 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2018-11-15 14:06:14 [DEBUG   ] spawn_process: at 2018-11-15 14:06:14 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2018-11-15 14:06:14 [DEBUG   ] spawn_process: at 2018-11-15 14:06:14 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2018-11-15 14:06:14 [DEBUG   ] spawn_process: at 2018-11-15 14:06:14 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2018-11-15 14:06:14 [DEBUG   ] spawn_process: at 2018-11-15 14:06:14 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2018-11-15 14:06:14 [DEBUG   ] spawn_process: at 2018-11-15 14:06:14 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2018-11-15 14:06:14 [DEBUG   ] spawn_process: at 2018-11-15 14:06:14 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2018-11-15 14:06:14 [DEBUG   ] spawn_process: at 2018-11-15 14:06:14 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2018-11-15 14:06:14 [DEBUG   ] spawn_process: at 2018-11-15 14:06:14 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2018-11-15 14:06:14 [DEBUG   ] spawn_process: at 2018-11-15 14:06:14 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2018-11-15 14:06:14 [DEBUG   ] spawn_process: at 2018-11-15 14:06:14 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2018-11-15 14:06:14 [INFO    ] Finished spawning TBW
2018-11-15 14:06:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:06:56 [WARNING ] (13, 1, 'bot')
2018-11-15 14:06:56 [WARNING ] (13, 1, 'bot')
2018-11-15 14:06:56 [WARNING ] (13, 1, 'bot')
2018-11-15 14:06:56 [WARNING ] (13, 1, 'bot')
2018-11-15 14:06:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:06:56 [DEBUG   ] Finished updating board flags in 1.092 seconds
2018-11-15 14:07:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:07:57 [WARNING ] (13, 1, 'bot')
2018-11-15 14:07:57 [WARNING ] (13, 1, 'bot')
2018-11-15 14:07:57 [WARNING ] (13, 1, 'bot')
2018-11-15 14:07:57 [WARNING ] (13, 1, 'bot')
2018-11-15 14:07:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:07:57 [DEBUG   ] Finished updating board flags in 2.116 seconds
2018-11-15 14:08:02 [INFO    ] __waitForTBW - TBW finished in 107.939 s
2018-11-15 14:08:03 [DEBUG   ] Finished updating ant stats in 0.519 seconds
2018-11-15 14:08:03 [INFO    ] Started antennas statistics background thread
2018-11-15 14:08:03 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2018-11-15 14:08:03 [DEBUG   ] spawn_process: at 2018-11-15 14:08:03 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1542290885']
2018-11-15 14:08:03 [DEBUG   ] spawn_process: at 2018-11-15 14:08:03 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1542290885']
2018-11-15 14:08:03 [DEBUG   ] spawn_process: at 2018-11-15 14:08:03 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1542290885']
2018-11-15 14:08:03 [DEBUG   ] spawn_process: at 2018-11-15 14:08:03 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1542290885']
2018-11-15 14:08:03 [DEBUG   ] spawn_process: at 2018-11-15 14:08:03 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1542290885']
2018-11-15 14:08:03 [DEBUG   ] spawn_process: at 2018-11-15 14:08:03 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1542290885']
2018-11-15 14:08:03 [DEBUG   ] spawn_process: at 2018-11-15 14:08:03 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1542290885']
2018-11-15 14:08:03 [DEBUG   ] spawn_process: at 2018-11-15 14:08:03 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1542290885']
2018-11-15 14:08:03 [DEBUG   ] spawn_process: at 2018-11-15 14:08:03 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1542290885']
2018-11-15 14:08:03 [DEBUG   ] spawn_process: at 2018-11-15 14:08:03 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1542290885']
2018-11-15 14:08:03 [DEBUG   ] spawn_process: at 2018-11-15 14:08:03 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1542290885']
2018-11-15 14:08:03 [DEBUG   ] spawn_process: at 2018-11-15 14:08:03 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1542290885']
2018-11-15 14:08:03 [DEBUG   ] spawn_process: at 2018-11-15 14:08:03 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1542290885']
2018-11-15 14:08:03 [DEBUG   ] spawn_process: at 2018-11-15 14:08:03 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1542290885']
2018-11-15 14:08:03 [DEBUG   ] spawn_process: at 2018-11-15 14:08:03 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1542290885']
2018-11-15 14:08:03 [DEBUG   ] spawn_process: at 2018-11-15 14:08:03 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1542290885']
2018-11-15 14:08:03 [DEBUG   ] spawn_process: at 2018-11-15 14:08:03 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1542290885']
2018-11-15 14:08:03 [DEBUG   ] spawn_process: at 2018-11-15 14:08:03 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1542290885']
2018-11-15 14:08:03 [DEBUG   ] spawn_process: at 2018-11-15 14:08:03 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1542290885']
2018-11-15 14:08:03 [DEBUG   ] spawn_process: at 2018-11-15 14:08:03 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1542290885']
2018-11-15 14:08:03 [DEBUG   ] spawn_process: at 2018-11-15 14:08:03 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1542290885']
2018-11-15 14:08:03 [DEBUG   ] spawn_process: at 2018-11-15 14:08:03 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1542290885']
2018-11-15 14:08:03 [DEBUG   ] spawn_process: at 2018-11-15 14:08:03 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1542290885']
2018-11-15 14:08:03 [DEBUG   ] spawn_process: at 2018-11-15 14:08:03 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1542290885']
2018-11-15 14:08:03 [DEBUG   ] spawn_process: at 2018-11-15 14:08:03 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1542290885']
2018-11-15 14:08:03 [DEBUG   ] spawn_process: at 2018-11-15 14:08:03 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1542290885']
2018-11-15 14:08:03 [INFO    ] Finished spawning TBN in 0.051 s
2018-11-15 14:08:17 [DEBUG   ] Got command RPT from MCS: ref #515081
2018-11-15 14:08:17 [DEBUG   ] summary = ERROR
2018-11-15 14:08:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515081  13 58437 50897097 A  ERRORERROR'
2018-11-15 14:08:17 [DEBUG   ] Got command RPT from MCS: ref #515082
2018-11-15 14:08:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 14:08:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515082  77 58437 50897301 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 14:08:17 [DEBUG   ] Got command RPT from MCS: ref #515083
2018-11-15 14:08:17 [DEBUG   ] summary = ERROR
2018-11-15 14:08:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515083  13 58437 50897493 A  ERRORERROR'
2018-11-15 14:08:17 [DEBUG   ] Got command RPT from MCS: ref #515085
2018-11-15 14:08:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 14:08:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515085  77 58437 50897697 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 14:08:17 [DEBUG   ] Got command RPT from MCS: ref #515087
2018-11-15 14:08:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 14:08:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515087  12 58437 50897901 A  ERRORB˜™š'
2018-11-15 14:08:23 [DEBUG   ] Finished updating ant stats in 0.470 seconds
2018-11-15 14:08:43 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 14:08:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:08:57 [WARNING ] (13, 1, 'bot')
2018-11-15 14:08:57 [WARNING ] (13, 1, 'bot')
2018-11-15 14:08:57 [WARNING ] (13, 1, 'bot')
2018-11-15 14:08:57 [WARNING ] (13, 1, 'bot')
2018-11-15 14:08:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:08:57 [DEBUG   ] Finished updating board flags in 2.188 seconds
2018-11-15 14:09:03 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-15 14:09:23 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 14:09:44 [DEBUG   ] Finished updating ant stats in 1.386 seconds
2018-11-15 14:09:56 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 14:09:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:09:57 [WARNING ] (13, 1, 'bot')
2018-11-15 14:09:57 [WARNING ] (13, 1, 'bot')
2018-11-15 14:09:57 [WARNING ] (13, 1, 'bot')
2018-11-15 14:09:57 [WARNING ] (13, 1, 'bot')
2018-11-15 14:09:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:09:57 [DEBUG   ] Finished updating board flags in 1.849 seconds
2018-11-15 14:10:04 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-15 14:10:24 [DEBUG   ] Finished updating ant stats in 1.195 seconds
2018-11-15 14:10:44 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-15 14:10:45 [DEBUG   ] Got command RPT from MCS: ref #515097
2018-11-15 14:10:45 [DEBUG   ] summary = ERROR
2018-11-15 14:10:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515097  13 58437 51045097 A  ERRORERROR'
2018-11-15 14:10:45 [DEBUG   ] Got command RPT from MCS: ref #515098
2018-11-15 14:10:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 14:10:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515098  77 58437 51045098 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 14:10:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:10:57 [WARNING ] (13, 1, 'bot')
2018-11-15 14:10:57 [WARNING ] (13, 1, 'bot')
2018-11-15 14:10:57 [WARNING ] (13, 1, 'bot')
2018-11-15 14:10:57 [WARNING ] (13, 1, 'bot')
2018-11-15 14:10:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:10:57 [DEBUG   ] Finished updating board flags in 1.812 seconds
2018-11-15 14:11:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 14:11:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 14:11:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 14:11:56 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 14:11:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:11:57 [WARNING ] (13, 1, 'bot')
2018-11-15 14:11:57 [WARNING ] (13, 1, 'bot')
2018-11-15 14:11:57 [WARNING ] (13, 1, 'bot')
2018-11-15 14:11:57 [WARNING ] (13, 1, 'bot')
2018-11-15 14:11:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:11:57 [DEBUG   ] Finished updating board flags in 1.784 seconds
2018-11-15 14:12:04 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-11-15 14:12:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 14:12:44 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-15 14:12:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:12:57 [WARNING ] (13, 1, 'bot')
2018-11-15 14:12:57 [WARNING ] (13, 1, 'bot')
2018-11-15 14:12:57 [WARNING ] (13, 1, 'bot')
2018-11-15 14:12:57 [WARNING ] (13, 1, 'bot')
2018-11-15 14:12:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:12:57 [DEBUG   ] Finished updating board flags in 1.617 seconds
2018-11-15 14:13:04 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-15 14:13:17 [DEBUG   ] Got command RPT from MCS: ref #515118
2018-11-15 14:13:17 [DEBUG   ] summary = ERROR
2018-11-15 14:13:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515118  13 58437 51197181 A  ERRORERROR'
2018-11-15 14:13:17 [DEBUG   ] Got command RPT from MCS: ref #515119
2018-11-15 14:13:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 14:13:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515119  77 58437 51197385 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 14:13:17 [DEBUG   ] Got command RPT from MCS: ref #515120
2018-11-15 14:13:17 [DEBUG   ] summary = ERROR
2018-11-15 14:13:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515120  13 58437 51197602 A  ERRORERROR'
2018-11-15 14:13:17 [DEBUG   ] Got command RPT from MCS: ref #515121
2018-11-15 14:13:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 14:13:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515121  77 58437 51197781 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 14:13:17 [DEBUG   ] Got command RPT from MCS: ref #515122
2018-11-15 14:13:17 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 14:13:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515122  12 58437 51197985 A  ERRORB—™š'
2018-11-15 14:13:24 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-15 14:13:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 14:13:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:13:57 [WARNING ] (13, 1, 'bot')
2018-11-15 14:13:57 [WARNING ] (13, 1, 'bot')
2018-11-15 14:13:57 [WARNING ] (13, 1, 'bot')
2018-11-15 14:13:57 [WARNING ] (13, 1, 'bot')
2018-11-15 14:13:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:13:57 [DEBUG   ] Finished updating board flags in 1.589 seconds
2018-11-15 14:14:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 14:14:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 14:14:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 14:14:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:14:57 [WARNING ] (13, 1, 'bot')
2018-11-15 14:14:57 [WARNING ] (13, 1, 'bot')
2018-11-15 14:14:57 [WARNING ] (13, 1, 'bot')
2018-11-15 14:14:57 [WARNING ] (13, 1, 'bot')
2018-11-15 14:14:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:14:57 [DEBUG   ] Finished updating board flags in 1.416 seconds
2018-11-15 14:15:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 14:15:24 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-15 14:15:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 14:15:45 [DEBUG   ] Got command RPT from MCS: ref #515127
2018-11-15 14:15:45 [DEBUG   ] summary = ERROR
2018-11-15 14:15:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515127  13 58437 51345101 A  ERRORERROR'
2018-11-15 14:15:45 [DEBUG   ] Got command RPT from MCS: ref #515128
2018-11-15 14:15:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 14:15:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515128  77 58437 51345102 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 14:15:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 14:15:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:15:57 [WARNING ] (13, 1, 'bot')
2018-11-15 14:15:57 [WARNING ] (13, 1, 'bot')
2018-11-15 14:15:57 [WARNING ] (13, 1, 'bot')
2018-11-15 14:15:57 [WARNING ] (13, 1, 'bot')
2018-11-15 14:15:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:15:57 [DEBUG   ] Finished updating board flags in 1.446 seconds
2018-11-15 14:16:04 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-15 14:16:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 14:16:44 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-15 14:16:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:16:57 [WARNING ] (13, 1, 'bot')
2018-11-15 14:16:57 [WARNING ] (13, 1, 'bot')
2018-11-15 14:16:57 [WARNING ] (13, 1, 'bot')
2018-11-15 14:16:57 [WARNING ] (13, 1, 'bot')
2018-11-15 14:16:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:16:57 [DEBUG   ] Finished updating board flags in 1.434 seconds
2018-11-15 14:17:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 14:17:24 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-15 14:17:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 14:17:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:17:57 [WARNING ] (13, 1, 'bot')
2018-11-15 14:17:57 [WARNING ] (13, 1, 'bot')
2018-11-15 14:17:57 [WARNING ] (13, 1, 'bot')
2018-11-15 14:17:57 [WARNING ] (13, 1, 'bot')
2018-11-15 14:17:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:17:57 [DEBUG   ] Finished updating board flags in 1.517 seconds
2018-11-15 14:18:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 14:18:17 [DEBUG   ] Got command RPT from MCS: ref #515150
2018-11-15 14:18:17 [DEBUG   ] summary = ERROR
2018-11-15 14:18:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515150  13 58437 51497261 A  ERRORERROR'
2018-11-15 14:18:17 [DEBUG   ] Got command RPT from MCS: ref #515151
2018-11-15 14:18:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 14:18:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515151  77 58437 51497469 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 14:18:17 [DEBUG   ] Got command RPT from MCS: ref #515152
2018-11-15 14:18:17 [DEBUG   ] summary = ERROR
2018-11-15 14:18:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515152  13 58437 51497669 A  ERRORERROR'
2018-11-15 14:18:17 [DEBUG   ] Got command RPT from MCS: ref #515154
2018-11-15 14:18:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 14:18:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515154  77 58437 51497873 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 14:18:18 [DEBUG   ] Got command RPT from MCS: ref #515155
2018-11-15 14:18:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 14:18:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515155  12 58437 51498065 A  ERRORB˜™š'
2018-11-15 14:18:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 14:18:44 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-15 14:18:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:18:58 [WARNING ] (13, 1, 'bot')
2018-11-15 14:18:58 [WARNING ] (13, 1, 'bot')
2018-11-15 14:18:58 [WARNING ] (13, 1, 'bot')
2018-11-15 14:18:58 [WARNING ] (13, 1, 'bot')
2018-11-15 14:18:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:18:58 [DEBUG   ] Finished updating board flags in 2.317 seconds
2018-11-15 14:19:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 14:19:24 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-15 14:19:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 14:19:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:19:58 [WARNING ] (13, 1, 'bot')
2018-11-15 14:19:58 [WARNING ] (13, 1, 'bot')
2018-11-15 14:19:58 [WARNING ] (13, 1, 'bot')
2018-11-15 14:19:58 [WARNING ] (13, 1, 'bot')
2018-11-15 14:19:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:19:58 [DEBUG   ] Finished updating board flags in 2.079 seconds
2018-11-15 14:20:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 14:20:24 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-15 14:20:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 14:20:45 [DEBUG   ] Got command RPT from MCS: ref #515164
2018-11-15 14:20:45 [DEBUG   ] summary = ERROR
2018-11-15 14:20:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515164  13 58437 51645101 A  ERRORERROR'
2018-11-15 14:20:45 [DEBUG   ] Got command RPT from MCS: ref #515165
2018-11-15 14:20:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 14:20:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515165  77 58437 51645102 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 14:20:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:20:58 [WARNING ] (13, 1, 'bot')
2018-11-15 14:20:58 [WARNING ] (13, 1, 'bot')
2018-11-15 14:20:58 [WARNING ] (13, 1, 'bot')
2018-11-15 14:20:58 [WARNING ] (13, 1, 'bot')
2018-11-15 14:20:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:20:58 [DEBUG   ] Finished updating board flags in 2.030 seconds
2018-11-15 14:21:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 14:21:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 14:21:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 14:21:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:21:58 [WARNING ] (13, 1, 'bot')
2018-11-15 14:21:58 [WARNING ] (13, 1, 'bot')
2018-11-15 14:21:58 [WARNING ] (13, 1, 'bot')
2018-11-15 14:21:58 [WARNING ] (13, 1, 'bot')
2018-11-15 14:21:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:21:58 [DEBUG   ] Finished updating board flags in 1.990 seconds
2018-11-15 14:22:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 14:22:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 14:22:44 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-15 14:22:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:22:58 [WARNING ] (13, 1, 'bot')
2018-11-15 14:22:58 [WARNING ] (13, 1, 'bot')
2018-11-15 14:22:58 [WARNING ] (13, 1, 'bot')
2018-11-15 14:22:58 [WARNING ] (13, 1, 'bot')
2018-11-15 14:22:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:22:58 [DEBUG   ] Finished updating board flags in 1.821 seconds
2018-11-15 14:23:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 14:23:17 [DEBUG   ] Got command RPT from MCS: ref #515192
2018-11-15 14:23:17 [DEBUG   ] summary = ERROR
2018-11-15 14:23:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515192  13 58437 51797353 A  ERRORERROR'
2018-11-15 14:23:17 [DEBUG   ] Got command RPT from MCS: ref #515193
2018-11-15 14:23:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 14:23:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515193  77 58437 51797557 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 14:23:17 [DEBUG   ] Got command RPT from MCS: ref #515194
2018-11-15 14:23:17 [DEBUG   ] summary = ERROR
2018-11-15 14:23:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515194  13 58437 51797749 A  ERRORERROR'
2018-11-15 14:23:17 [DEBUG   ] Got command RPT from MCS: ref #515195
2018-11-15 14:23:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 14:23:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515195  77 58437 51797953 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 14:23:18 [DEBUG   ] Got command RPT from MCS: ref #515196
2018-11-15 14:23:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 14:23:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515196  12 58437 51798157 A  ERRORB˜™š'
2018-11-15 14:23:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 14:23:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 14:23:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 14:23:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:23:58 [WARNING ] (13, 1, 'bot')
2018-11-15 14:23:58 [WARNING ] (13, 1, 'bot')
2018-11-15 14:23:58 [WARNING ] (13, 1, 'bot')
2018-11-15 14:23:58 [WARNING ] (13, 1, 'bot')
2018-11-15 14:23:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:23:58 [DEBUG   ] Finished updating board flags in 1.890 seconds
2018-11-15 14:24:04 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-15 14:24:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 14:24:44 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-15 14:24:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-15 14:24:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:24:58 [WARNING ] (13, 1, 'bot')
2018-11-15 14:24:58 [WARNING ] (13, 1, 'bot')
2018-11-15 14:24:58 [WARNING ] (13, 1, 'bot')
2018-11-15 14:24:58 [WARNING ] (13, 1, 'bot')
2018-11-15 14:24:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:24:58 [DEBUG   ] Finished updating board flags in 1.789 seconds
2018-11-15 14:25:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 14:25:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 14:25:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 14:25:45 [DEBUG   ] Got command RPT from MCS: ref #515201
2018-11-15 14:25:45 [DEBUG   ] summary = ERROR
2018-11-15 14:25:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515201  13 58437 51945105 A  ERRORERROR'
2018-11-15 14:25:45 [DEBUG   ] Got command RPT from MCS: ref #515202
2018-11-15 14:25:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 14:25:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515202  77 58437 51945106 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 14:25:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:25:58 [WARNING ] (13, 1, 'bot')
2018-11-15 14:25:58 [WARNING ] (13, 1, 'bot')
2018-11-15 14:25:58 [WARNING ] (13, 1, 'bot')
2018-11-15 14:25:58 [WARNING ] (13, 1, 'bot')
2018-11-15 14:25:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:25:58 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-11-15 14:26:04 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-15 14:26:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 14:26:44 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-15 14:26:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 14:26:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:26:58 [WARNING ] (13, 1, 'bot')
2018-11-15 14:26:58 [WARNING ] (13, 1, 'bot')
2018-11-15 14:26:58 [WARNING ] (13, 1, 'bot')
2018-11-15 14:26:58 [WARNING ] (13, 1, 'bot')
2018-11-15 14:26:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:26:58 [DEBUG   ] Finished updating board flags in 1.471 seconds
2018-11-15 14:27:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 14:27:24 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-15 14:27:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 14:27:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:27:58 [WARNING ] (13, 1, 'bot')
2018-11-15 14:27:58 [WARNING ] (13, 1, 'bot')
2018-11-15 14:27:58 [WARNING ] (13, 1, 'bot')
2018-11-15 14:27:58 [WARNING ] (13, 1, 'bot')
2018-11-15 14:27:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:27:58 [DEBUG   ] Finished updating board flags in 1.493 seconds
2018-11-15 14:28:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 14:28:17 [DEBUG   ] Got command RPT from MCS: ref #515224
2018-11-15 14:28:17 [DEBUG   ] summary = ERROR
2018-11-15 14:28:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515224  13 58437 52097441 A  ERRORERROR'
2018-11-15 14:28:17 [DEBUG   ] Got command RPT from MCS: ref #515225
2018-11-15 14:28:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 14:28:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515225  77 58437 52097645 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 14:28:17 [DEBUG   ] Got command RPT from MCS: ref #515226
2018-11-15 14:28:17 [DEBUG   ] summary = ERROR
2018-11-15 14:28:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515226  13 58437 52097837 A  ERRORERROR'
2018-11-15 14:28:18 [DEBUG   ] Got command RPT from MCS: ref #515228
2018-11-15 14:28:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 14:28:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515228  77 58437 52098041 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 14:28:18 [DEBUG   ] Got command RPT from MCS: ref #515229
2018-11-15 14:28:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 14:28:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515229  12 58437 52098245 A  ERRORB˜™š'
2018-11-15 14:28:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 14:28:44 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-15 14:28:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:28:58 [WARNING ] (13, 1, 'bot')
2018-11-15 14:28:58 [WARNING ] (13, 1, 'bot')
2018-11-15 14:28:58 [WARNING ] (13, 1, 'bot')
2018-11-15 14:28:58 [WARNING ] (13, 1, 'bot')
2018-11-15 14:28:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:28:58 [DEBUG   ] Finished updating board flags in 1.489 seconds
2018-11-15 14:29:04 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-15 14:29:25 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-15 14:29:45 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-15 14:29:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:29:58 [WARNING ] (13, 1, 'bot')
2018-11-15 14:29:58 [WARNING ] (13, 1, 'bot')
2018-11-15 14:29:58 [WARNING ] (13, 1, 'bot')
2018-11-15 14:29:58 [WARNING ] (13, 1, 'bot')
2018-11-15 14:29:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:29:58 [DEBUG   ] Finished updating board flags in 1.494 seconds
2018-11-15 14:30:05 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-15 14:30:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 14:30:45 [DEBUG   ] Got command RPT from MCS: ref #515238
2018-11-15 14:30:45 [DEBUG   ] summary = ERROR
2018-11-15 14:30:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515238  13 58437 52245105 A  ERRORERROR'
2018-11-15 14:30:45 [DEBUG   ] Got command RPT from MCS: ref #515239
2018-11-15 14:30:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 14:30:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515239  77 58437 52245106 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 14:30:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 14:30:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 14:30:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:30:59 [WARNING ] (13, 1, 'bot')
2018-11-15 14:30:59 [WARNING ] (13, 1, 'bot')
2018-11-15 14:30:59 [WARNING ] (13, 1, 'bot')
2018-11-15 14:30:59 [WARNING ] (13, 1, 'bot')
2018-11-15 14:30:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:30:59 [DEBUG   ] Finished updating board flags in 2.137 seconds
2018-11-15 14:31:05 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-15 14:31:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 14:31:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 14:31:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 14:31:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:31:59 [WARNING ] (13, 1, 'bot')
2018-11-15 14:31:59 [WARNING ] (13, 1, 'bot')
2018-11-15 14:31:59 [WARNING ] (13, 1, 'bot')
2018-11-15 14:31:59 [WARNING ] (13, 1, 'bot')
2018-11-15 14:31:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:31:59 [DEBUG   ] Finished updating board flags in 2.009 seconds
2018-11-15 14:32:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 14:32:25 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-15 14:32:45 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2018-11-15 14:32:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:32:59 [WARNING ] (13, 1, 'bot')
2018-11-15 14:32:59 [WARNING ] (13, 1, 'bot')
2018-11-15 14:32:59 [WARNING ] (13, 1, 'bot')
2018-11-15 14:32:59 [WARNING ] (13, 1, 'bot')
2018-11-15 14:32:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:32:59 [DEBUG   ] Finished updating board flags in 2.021 seconds
2018-11-15 14:33:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 14:33:17 [DEBUG   ] Got command RPT from MCS: ref #515259
2018-11-15 14:33:17 [DEBUG   ] summary = ERROR
2018-11-15 14:33:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515259  13 58437 52397529 A  ERRORERROR'
2018-11-15 14:33:17 [DEBUG   ] Got command RPT from MCS: ref #515260
2018-11-15 14:33:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 14:33:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515260  77 58437 52397733 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 14:33:17 [DEBUG   ] Got command RPT from MCS: ref #515261
2018-11-15 14:33:17 [DEBUG   ] summary = ERROR
2018-11-15 14:33:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515261  13 58437 52397925 A  ERRORERROR'
2018-11-15 14:33:18 [DEBUG   ] Got command RPT from MCS: ref #515262
2018-11-15 14:33:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 14:33:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515262  77 58437 52398129 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 14:33:18 [DEBUG   ] Got command RPT from MCS: ref #515263
2018-11-15 14:33:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 14:33:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515263  12 58437 52398333 A  ERRORB—™š'
2018-11-15 14:33:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 14:33:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 14:33:58 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 14:33:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:33:59 [WARNING ] (13, 1, 'bot')
2018-11-15 14:33:59 [WARNING ] (13, 1, 'bot')
2018-11-15 14:33:59 [WARNING ] (13, 1, 'bot')
2018-11-15 14:33:59 [WARNING ] (13, 1, 'bot')
2018-11-15 14:33:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:33:59 [DEBUG   ] Finished updating board flags in 1.963 seconds
2018-11-15 14:34:05 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-15 14:34:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 14:34:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 14:34:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:34:59 [WARNING ] (13, 1, 'bot')
2018-11-15 14:34:59 [WARNING ] (13, 1, 'bot')
2018-11-15 14:34:59 [WARNING ] (13, 1, 'bot')
2018-11-15 14:34:59 [WARNING ] (13, 1, 'bot')
2018-11-15 14:34:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:34:59 [DEBUG   ] Finished updating board flags in 1.875 seconds
2018-11-15 14:35:05 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-15 14:35:25 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-15 14:35:45 [DEBUG   ] Got command RPT from MCS: ref #515268
2018-11-15 14:35:45 [DEBUG   ] summary = ERROR
2018-11-15 14:35:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515268  13 58437 52545101 A  ERRORERROR'
2018-11-15 14:35:45 [DEBUG   ] Got command RPT from MCS: ref #515269
2018-11-15 14:35:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 14:35:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515269  77 58437 52545102 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 14:35:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 14:35:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:35:59 [WARNING ] (13, 1, 'bot')
2018-11-15 14:35:59 [WARNING ] (13, 1, 'bot')
2018-11-15 14:35:59 [WARNING ] (13, 1, 'bot')
2018-11-15 14:35:59 [WARNING ] (13, 1, 'bot')
2018-11-15 14:35:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:35:59 [DEBUG   ] Finished updating board flags in 1.815 seconds
2018-11-15 14:36:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 14:36:25 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-15 14:36:45 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-11-15 14:36:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 14:36:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:36:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-15 14:36:59 [WARNING ] (13, 1, 'bot')
2018-11-15 14:36:59 [WARNING ] (13, 1, 'bot')
2018-11-15 14:36:59 [WARNING ] (13, 1, 'bot')
2018-11-15 14:36:59 [WARNING ] (13, 1, 'bot')
2018-11-15 14:36:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:36:59 [DEBUG   ] Finished updating board flags in 1.708 seconds
2018-11-15 14:37:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 14:37:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 14:37:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 14:37:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:37:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-15 14:37:59 [WARNING ] (13, 1, 'bot')
2018-11-15 14:37:59 [WARNING ] (13, 1, 'bot')
2018-11-15 14:37:59 [WARNING ] (13, 1, 'bot')
2018-11-15 14:37:59 [WARNING ] (13, 1, 'bot')
2018-11-15 14:37:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:37:59 [DEBUG   ] Finished updating board flags in 1.621 seconds
2018-11-15 14:38:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 14:38:17 [DEBUG   ] Got command RPT from MCS: ref #515287
2018-11-15 14:38:17 [DEBUG   ] summary = ERROR
2018-11-15 14:38:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515287  13 58437 52697609 A  ERRORERROR'
2018-11-15 14:38:17 [DEBUG   ] Got command RPT from MCS: ref #515288
2018-11-15 14:38:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 14:38:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515288  77 58437 52697813 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 14:38:18 [DEBUG   ] Got command RPT from MCS: ref #515289
2018-11-15 14:38:18 [DEBUG   ] summary = ERROR
2018-11-15 14:38:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515289  13 58437 52698017 A  ERRORERROR'
2018-11-15 14:38:18 [DEBUG   ] Got command RPT from MCS: ref #515291
2018-11-15 14:38:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 14:38:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515291  77 58437 52698209 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 14:38:18 [DEBUG   ] Got command RPT from MCS: ref #515292
2018-11-15 14:38:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 14:38:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515292  12 58437 52698413 A  ERRORB˜™š'
2018-11-15 14:38:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 14:38:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 14:38:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:38:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-15 14:38:59 [WARNING ] (13, 1, 'bot')
2018-11-15 14:38:59 [WARNING ] (13, 1, 'bot')
2018-11-15 14:38:59 [WARNING ] (13, 1, 'bot')
2018-11-15 14:38:59 [WARNING ] (13, 1, 'bot')
2018-11-15 14:38:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:38:59 [DEBUG   ] Finished updating board flags in 1.621 seconds
2018-11-15 14:39:05 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-15 14:39:25 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-11-15 14:39:45 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 14:39:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:39:59 [WARNING ] (13, 1, 'bot')
2018-11-15 14:39:59 [WARNING ] (13, 1, 'bot')
2018-11-15 14:39:59 [WARNING ] (13, 1, 'bot')
2018-11-15 14:39:59 [WARNING ] (13, 1, 'bot')
2018-11-15 14:39:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:39:59 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-11-15 14:40:05 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-11-15 14:40:26 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-15 14:40:45 [DEBUG   ] Got command RPT from MCS: ref #515301
2018-11-15 14:40:45 [DEBUG   ] summary = ERROR
2018-11-15 14:40:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515301  13 58437 52845105 A  ERRORERROR'
2018-11-15 14:40:45 [DEBUG   ] Got command RPT from MCS: ref #515302
2018-11-15 14:40:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 14:40:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515302  77 58437 52845106 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 14:40:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 14:40:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:40:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 14:40:59 [WARNING ] (13, 1, 'bot')
2018-11-15 14:40:59 [WARNING ] (13, 1, 'bot')
2018-11-15 14:40:59 [WARNING ] (13, 1, 'bot')
2018-11-15 14:40:59 [WARNING ] (13, 1, 'bot')
2018-11-15 14:40:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:40:59 [DEBUG   ] Finished updating board flags in 1.549 seconds
2018-11-15 14:41:06 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-15 14:41:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 14:41:46 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-15 14:41:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:41:59 [WARNING ] (13, 1, 'bot')
2018-11-15 14:41:59 [WARNING ] (13, 1, 'bot')
2018-11-15 14:41:59 [WARNING ] (13, 1, 'bot')
2018-11-15 14:41:59 [WARNING ] (13, 1, 'bot')
2018-11-15 14:41:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:41:59 [DEBUG   ] Finished updating board flags in 1.450 seconds
2018-11-15 14:42:06 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-15 14:42:26 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-15 14:42:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 14:42:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 14:42:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:42:59 [WARNING ] (13, 1, 'bot')
2018-11-15 14:42:59 [WARNING ] (13, 1, 'bot')
2018-11-15 14:42:59 [WARNING ] (13, 1, 'bot')
2018-11-15 14:42:59 [WARNING ] (13, 1, 'bot')
2018-11-15 14:42:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:42:59 [DEBUG   ] Finished updating board flags in 1.520 seconds
2018-11-15 14:43:06 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-15 14:43:17 [DEBUG   ] Got command RPT from MCS: ref #515322
2018-11-15 14:43:17 [DEBUG   ] summary = ERROR
2018-11-15 14:43:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515322  13 58437 52997697 A  ERRORERROR'
2018-11-15 14:43:17 [DEBUG   ] Got command RPT from MCS: ref #515323
2018-11-15 14:43:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 14:43:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515323  77 58437 52997901 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 14:43:18 [DEBUG   ] Got command RPT from MCS: ref #515324
2018-11-15 14:43:18 [DEBUG   ] summary = ERROR
2018-11-15 14:43:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515324  13 58437 52998093 A  ERRORERROR'
2018-11-15 14:43:18 [DEBUG   ] Got command RPT from MCS: ref #515325
2018-11-15 14:43:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 14:43:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515325  77 58437 52998297 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 14:43:18 [DEBUG   ] Got command RPT from MCS: ref #515326
2018-11-15 14:43:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 14:43:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515326  12 58437 52998501 A  ERRORB˜™š'
2018-11-15 14:43:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 14:43:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 14:43:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:43:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 14:43:59 [WARNING ] (13, 1, 'bot')
2018-11-15 14:43:59 [WARNING ] (13, 1, 'bot')
2018-11-15 14:43:59 [WARNING ] (13, 1, 'bot')
2018-11-15 14:43:59 [WARNING ] (13, 1, 'bot')
2018-11-15 14:43:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:43:59 [DEBUG   ] Finished updating board flags in 1.535 seconds
2018-11-15 14:44:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 14:44:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 14:44:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 14:44:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:45:00 [WARNING ] (13, 1, 'bot')
2018-11-15 14:45:00 [WARNING ] (13, 1, 'bot')
2018-11-15 14:45:00 [WARNING ] (13, 1, 'bot')
2018-11-15 14:45:00 [WARNING ] (13, 1, 'bot')
2018-11-15 14:45:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:45:00 [DEBUG   ] Finished updating board flags in 2.218 seconds
2018-11-15 14:45:06 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-15 14:45:26 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-15 14:45:45 [DEBUG   ] Got command RPT from MCS: ref #515331
2018-11-15 14:45:45 [DEBUG   ] summary = ERROR
2018-11-15 14:45:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515331  13 58437 53145105 A  ERRORERROR'
2018-11-15 14:45:45 [DEBUG   ] Got command RPT from MCS: ref #515332
2018-11-15 14:45:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 14:45:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515332  77 58437 53145106 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 14:45:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 14:45:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:46:00 [WARNING ] (13, 1, 'bot')
2018-11-15 14:46:00 [WARNING ] (13, 1, 'bot')
2018-11-15 14:46:00 [WARNING ] (13, 1, 'bot')
2018-11-15 14:46:00 [WARNING ] (13, 1, 'bot')
2018-11-15 14:46:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:46:00 [DEBUG   ] Finished updating board flags in 2.088 seconds
2018-11-15 14:46:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 14:46:26 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-15 14:46:46 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-15 14:46:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:47:00 [WARNING ] (13, 1, 'bot')
2018-11-15 14:47:00 [WARNING ] (13, 1, 'bot')
2018-11-15 14:47:00 [WARNING ] (13, 1, 'bot')
2018-11-15 14:47:00 [WARNING ] (13, 1, 'bot')
2018-11-15 14:47:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:47:00 [DEBUG   ] Finished updating board flags in 2.034 seconds
2018-11-15 14:47:06 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-15 14:47:26 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 14:47:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 14:47:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:48:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-15 14:48:00 [WARNING ] (13, 1, 'bot')
2018-11-15 14:48:00 [WARNING ] (13, 1, 'bot')
2018-11-15 14:48:00 [WARNING ] (13, 1, 'bot')
2018-11-15 14:48:00 [WARNING ] (13, 1, 'bot')
2018-11-15 14:48:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:48:00 [DEBUG   ] Finished updating board flags in 1.964 seconds
2018-11-15 14:48:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 14:48:17 [DEBUG   ] Got command RPT from MCS: ref #515354
2018-11-15 14:48:17 [DEBUG   ] summary = ERROR
2018-11-15 14:48:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515354  13 58437 53297789 A  ERRORERROR'
2018-11-15 14:48:17 [DEBUG   ] Got command RPT from MCS: ref #515355
2018-11-15 14:48:17 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 14:48:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515355  77 58437 53297981 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 14:48:18 [DEBUG   ] Got command RPT from MCS: ref #515356
2018-11-15 14:48:18 [DEBUG   ] summary = ERROR
2018-11-15 14:48:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515356  13 58437 53298185 A  ERRORERROR'
2018-11-15 14:48:18 [DEBUG   ] Got command RPT from MCS: ref #515358
2018-11-15 14:48:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 14:48:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515358  77 58437 53298389 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 14:48:18 [DEBUG   ] Got command RPT from MCS: ref #515359
2018-11-15 14:48:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 14:48:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515359  12 58437 53298593 A  ERRORB—™š'
2018-11-15 14:48:26 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-15 14:48:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 14:48:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:49:00 [WARNING ] (13, 1, 'bot')
2018-11-15 14:49:00 [WARNING ] (13, 1, 'bot')
2018-11-15 14:49:00 [WARNING ] (13, 1, 'bot')
2018-11-15 14:49:00 [WARNING ] (13, 1, 'bot')
2018-11-15 14:49:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:49:00 [DEBUG   ] Finished updating board flags in 1.810 seconds
2018-11-15 14:49:06 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-15 14:49:26 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-15 14:49:46 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-15 14:49:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:50:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 14:50:00 [WARNING ] (13, 1, 'bot')
2018-11-15 14:50:00 [WARNING ] (13, 1, 'bot')
2018-11-15 14:50:00 [WARNING ] (13, 1, 'bot')
2018-11-15 14:50:00 [WARNING ] (13, 1, 'bot')
2018-11-15 14:50:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:50:00 [DEBUG   ] Finished updating board flags in 1.790 seconds
2018-11-15 14:50:06 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-11-15 14:50:27 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-11-15 14:50:45 [DEBUG   ] Got command RPT from MCS: ref #515368
2018-11-15 14:50:45 [DEBUG   ] summary = ERROR
2018-11-15 14:50:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515368  13 58437 53445113 A  ERRORERROR'
2018-11-15 14:50:45 [DEBUG   ] Got command RPT from MCS: ref #515369
2018-11-15 14:50:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 14:50:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515369  77 58437 53445114 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 14:50:47 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-15 14:50:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:51:00 [WARNING ] (13, 1, 'bot')
2018-11-15 14:51:00 [WARNING ] (13, 1, 'bot')
2018-11-15 14:51:00 [WARNING ] (13, 1, 'bot')
2018-11-15 14:51:00 [WARNING ] (13, 1, 'bot')
2018-11-15 14:51:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:51:00 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-11-15 14:51:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 14:51:27 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 14:51:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 14:51:59 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 14:51:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 14:51:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:52:00 [WARNING ] (13, 1, 'bot')
2018-11-15 14:52:00 [WARNING ] (13, 1, 'bot')
2018-11-15 14:52:00 [WARNING ] (13, 1, 'bot')
2018-11-15 14:52:00 [WARNING ] (13, 1, 'bot')
2018-11-15 14:52:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:52:00 [DEBUG   ] Finished updating board flags in 1.608 seconds
2018-11-15 14:52:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 14:52:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-15 14:52:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 14:52:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:53:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 14:53:00 [WARNING ] (13, 1, 'bot')
2018-11-15 14:53:00 [WARNING ] (13, 1, 'bot')
2018-11-15 14:53:00 [WARNING ] (13, 1, 'bot')
2018-11-15 14:53:00 [WARNING ] (13, 1, 'bot')
2018-11-15 14:53:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:53:00 [DEBUG   ] Finished updating board flags in 1.588 seconds
2018-11-15 14:53:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 14:53:17 [DEBUG   ] Got command RPT from MCS: ref #515385
2018-11-15 14:53:17 [DEBUG   ] summary = ERROR
2018-11-15 14:53:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515385  13 58437 53597869 A  ERRORERROR'
2018-11-15 14:53:18 [DEBUG   ] Got command RPT from MCS: ref #515386
2018-11-15 14:53:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 14:53:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515386  77 58437 53598073 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 14:53:18 [DEBUG   ] Got command RPT from MCS: ref #515387
2018-11-15 14:53:18 [DEBUG   ] summary = ERROR
2018-11-15 14:53:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515387  13 58437 53598277 A  ERRORERROR'
2018-11-15 14:53:18 [DEBUG   ] Got command RPT from MCS: ref #515388
2018-11-15 14:53:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 14:53:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515388  77 58437 53598469 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 14:53:18 [DEBUG   ] Got command RPT from MCS: ref #515389
2018-11-15 14:53:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 14:53:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515389  12 58437 53598673 A  ERRORB˜™š'
2018-11-15 14:53:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 14:53:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 14:53:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:54:00 [WARNING ] (13, 1, 'bot')
2018-11-15 14:54:00 [WARNING ] (13, 1, 'bot')
2018-11-15 14:54:00 [WARNING ] (13, 1, 'bot')
2018-11-15 14:54:00 [WARNING ] (13, 1, 'bot')
2018-11-15 14:54:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:54:00 [DEBUG   ] Finished updating board flags in 1.570 seconds
2018-11-15 14:54:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 14:54:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 14:54:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-15 14:55:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:55:00 [WARNING ] (13, 1, 'bot')
2018-11-15 14:55:00 [WARNING ] (13, 1, 'bot')
2018-11-15 14:55:00 [WARNING ] (13, 1, 'bot')
2018-11-15 14:55:00 [WARNING ] (13, 1, 'bot')
2018-11-15 14:55:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:55:00 [DEBUG   ] Finished updating board flags in 1.588 seconds
2018-11-15 14:55:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 14:55:27 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 14:55:45 [DEBUG   ] Got command RPT from MCS: ref #515394
2018-11-15 14:55:45 [DEBUG   ] summary = ERROR
2018-11-15 14:55:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515394  13 58437 53745109 A  ERRORERROR'
2018-11-15 14:55:45 [DEBUG   ] Got command RPT from MCS: ref #515395
2018-11-15 14:55:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 14:55:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515395  77 58437 53745110 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 14:55:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 14:56:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:56:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 14:56:01 [WARNING ] (13, 1, 'bot')
2018-11-15 14:56:01 [WARNING ] (13, 1, 'bot')
2018-11-15 14:56:01 [WARNING ] (13, 1, 'bot')
2018-11-15 14:56:01 [WARNING ] (13, 1, 'bot')
2018-11-15 14:56:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:56:01 [DEBUG   ] Finished updating board flags in 2.201 seconds
2018-11-15 14:56:07 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-15 14:56:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-15 14:56:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 14:57:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:57:01 [WARNING ] (13, 1, 'bot')
2018-11-15 14:57:01 [WARNING ] (13, 1, 'bot')
2018-11-15 14:57:01 [WARNING ] (13, 1, 'bot')
2018-11-15 14:57:01 [WARNING ] (13, 1, 'bot')
2018-11-15 14:57:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:57:01 [DEBUG   ] Finished updating board flags in 2.069 seconds
2018-11-15 14:57:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 14:57:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-15 14:57:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 14:58:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:58:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 14:58:01 [WARNING ] (13, 1, 'bot')
2018-11-15 14:58:01 [WARNING ] (13, 1, 'bot')
2018-11-15 14:58:01 [WARNING ] (13, 1, 'bot')
2018-11-15 14:58:01 [WARNING ] (13, 1, 'bot')
2018-11-15 14:58:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:58:01 [DEBUG   ] Finished updating board flags in 2.011 seconds
2018-11-15 14:58:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 14:58:17 [DEBUG   ] Got command RPT from MCS: ref #515417
2018-11-15 14:58:17 [DEBUG   ] summary = ERROR
2018-11-15 14:58:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515417  13 58437 53897953 A  ERRORERROR'
2018-11-15 14:58:18 [DEBUG   ] Got command RPT from MCS: ref #515418
2018-11-15 14:58:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 14:58:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515418  77 58437 53898157 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 14:58:18 [DEBUG   ] Got command RPT from MCS: ref #515419
2018-11-15 14:58:18 [DEBUG   ] summary = ERROR
2018-11-15 14:58:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515419  13 58437 53898361 A  ERRORERROR'
2018-11-15 14:58:18 [DEBUG   ] Got command RPT from MCS: ref #515421
2018-11-15 14:58:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 14:58:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515421  77 58437 53898553 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 14:58:18 [DEBUG   ] Got command RPT from MCS: ref #515423
2018-11-15 14:58:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 14:58:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515423  12 58437 53898757 A  ERRORB—™š'
2018-11-15 14:58:27 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 14:58:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-15 14:59:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 14:59:01 [WARNING ] (13, 1, 'bot')
2018-11-15 14:59:01 [WARNING ] (13, 1, 'bot')
2018-11-15 14:59:01 [WARNING ] (13, 1, 'bot')
2018-11-15 14:59:01 [WARNING ] (13, 1, 'bot')
2018-11-15 14:59:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 14:59:01 [DEBUG   ] Finished updating board flags in 1.985 seconds
2018-11-15 14:59:07 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-15 14:59:27 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 14:59:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 15:00:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 15:00:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:00:01 [WARNING ] (13, 1, 'bot')
2018-11-15 15:00:01 [WARNING ] (13, 1, 'bot')
2018-11-15 15:00:01 [WARNING ] (13, 1, 'bot')
2018-11-15 15:00:01 [WARNING ] (13, 1, 'bot')
2018-11-15 15:00:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:00:01 [DEBUG   ] Finished updating board flags in 1.806 seconds
2018-11-15 15:00:07 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-15 15:00:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 15:00:45 [DEBUG   ] Got command RPT from MCS: ref #515431
2018-11-15 15:00:45 [DEBUG   ] summary = ERROR
2018-11-15 15:00:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515431  13 58437 54045105 A  ERRORERROR'
2018-11-15 15:00:45 [DEBUG   ] Got command RPT from MCS: ref #515432
2018-11-15 15:00:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 15:00:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515432  77 58437 54045106 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 15:00:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 15:01:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 15:01:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:01:01 [WARNING ] (13, 1, 'bot')
2018-11-15 15:01:01 [WARNING ] (13, 1, 'bot')
2018-11-15 15:01:01 [WARNING ] (13, 1, 'bot')
2018-11-15 15:01:01 [WARNING ] (13, 1, 'bot')
2018-11-15 15:01:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:01:01 [DEBUG   ] Finished updating board flags in 1.907 seconds
2018-11-15 15:01:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 15:01:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-15 15:01:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 15:02:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:02:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-15 15:02:01 [WARNING ] (13, 1, 'bot')
2018-11-15 15:02:01 [WARNING ] (13, 1, 'bot')
2018-11-15 15:02:01 [WARNING ] (13, 1, 'bot')
2018-11-15 15:02:01 [WARNING ] (13, 1, 'bot')
2018-11-15 15:02:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:02:01 [DEBUG   ] Finished updating board flags in 1.810 seconds
2018-11-15 15:02:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 15:02:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 15:02:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 15:03:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:03:01 [WARNING ] (13, 1, 'bot')
2018-11-15 15:03:01 [WARNING ] (13, 1, 'bot')
2018-11-15 15:03:01 [WARNING ] (13, 1, 'bot')
2018-11-15 15:03:01 [WARNING ] (13, 1, 'bot')
2018-11-15 15:03:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:03:01 [DEBUG   ] Finished updating board flags in 1.674 seconds
2018-11-15 15:03:07 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-11-15 15:03:18 [DEBUG   ] Got command RPT from MCS: ref #515452
2018-11-15 15:03:18 [DEBUG   ] summary = ERROR
2018-11-15 15:03:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515452  13 58437 54198045 A  ERRORERROR'
2018-11-15 15:03:18 [DEBUG   ] Got command RPT from MCS: ref #515453
2018-11-15 15:03:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 15:03:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515453  77 58437 54198253 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 15:03:18 [DEBUG   ] Got command RPT from MCS: ref #515454
2018-11-15 15:03:18 [DEBUG   ] summary = ERROR
2018-11-15 15:03:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515454  13 58437 54198441 A  ERRORERROR'
2018-11-15 15:03:18 [DEBUG   ] Got command RPT from MCS: ref #515455
2018-11-15 15:03:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 15:03:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515455  77 58437 54198645 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 15:03:18 [DEBUG   ] Got command RPT from MCS: ref #515456
2018-11-15 15:03:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 15:03:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515456  12 58437 54198849 A  ERRORB˜™š'
2018-11-15 15:03:27 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-15 15:03:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 15:04:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:04:01 [WARNING ] (13, 1, 'bot')
2018-11-15 15:04:01 [WARNING ] (13, 1, 'bot')
2018-11-15 15:04:01 [WARNING ] (13, 1, 'bot')
2018-11-15 15:04:01 [WARNING ] (13, 1, 'bot')
2018-11-15 15:04:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:04:01 [DEBUG   ] Finished updating board flags in 1.633 seconds
2018-11-15 15:04:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 15:04:27 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-15 15:04:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 15:05:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:05:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-15 15:05:01 [WARNING ] (13, 1, 'bot')
2018-11-15 15:05:01 [WARNING ] (13, 1, 'bot')
2018-11-15 15:05:01 [WARNING ] (13, 1, 'bot')
2018-11-15 15:05:01 [WARNING ] (13, 1, 'bot')
2018-11-15 15:05:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:05:01 [DEBUG   ] Finished updating board flags in 1.574 seconds
2018-11-15 15:05:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 15:05:27 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-15 15:05:45 [DEBUG   ] Got command RPT from MCS: ref #515461
2018-11-15 15:05:45 [DEBUG   ] summary = ERROR
2018-11-15 15:05:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515461  13 58437 54345118 A  ERRORERROR'
2018-11-15 15:05:45 [DEBUG   ] Got command RPT from MCS: ref #515462
2018-11-15 15:05:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 15:05:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515462  77 58437 54345118 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 15:05:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-15 15:06:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 15:06:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:06:01 [WARNING ] (13, 1, 'bot')
2018-11-15 15:06:01 [WARNING ] (13, 1, 'bot')
2018-11-15 15:06:01 [WARNING ] (13, 1, 'bot')
2018-11-15 15:06:01 [WARNING ] (13, 1, 'bot')
2018-11-15 15:06:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:06:01 [DEBUG   ] Finished updating board flags in 1.426 seconds
2018-11-15 15:06:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 15:06:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 15:06:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-15 15:07:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:07:01 [WARNING ] (13, 1, 'bot')
2018-11-15 15:07:01 [WARNING ] (13, 1, 'bot')
2018-11-15 15:07:01 [WARNING ] (13, 1, 'bot')
2018-11-15 15:07:01 [WARNING ] (13, 1, 'bot')
2018-11-15 15:07:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:07:01 [DEBUG   ] Finished updating board flags in 1.434 seconds
2018-11-15 15:07:07 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-15 15:07:27 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 15:07:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 15:08:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:08:01 [WARNING ] (13, 1, 'bot')
2018-11-15 15:08:01 [WARNING ] (13, 1, 'bot')
2018-11-15 15:08:01 [WARNING ] (13, 1, 'bot')
2018-11-15 15:08:01 [WARNING ] (13, 1, 'bot')
2018-11-15 15:08:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:08:01 [DEBUG   ] Finished updating board flags in 1.585 seconds
2018-11-15 15:08:07 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-15 15:08:18 [DEBUG   ] Got command RPT from MCS: ref #515480
2018-11-15 15:08:18 [DEBUG   ] summary = ERROR
2018-11-15 15:08:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515480  13 58437 54498129 A  ERRORERROR'
2018-11-15 15:08:18 [DEBUG   ] Got command RPT from MCS: ref #515481
2018-11-15 15:08:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 15:08:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515481  77 58437 54498333 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 15:08:18 [DEBUG   ] Got command RPT from MCS: ref #515482
2018-11-15 15:08:18 [DEBUG   ] summary = ERROR
2018-11-15 15:08:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515482  13 58437 54498525 A  ERRORERROR'
2018-11-15 15:08:18 [DEBUG   ] Got command RPT from MCS: ref #515484
2018-11-15 15:08:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 15:08:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515484  77 58437 54498729 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 15:08:18 [DEBUG   ] Got command RPT from MCS: ref #515486
2018-11-15 15:08:18 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 15:08:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515486  12 58437 54498933 A  ERRORB—™š'
2018-11-15 15:08:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 15:08:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 15:09:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 15:09:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:09:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 15:09:02 [WARNING ] (13, 1, 'bot')
2018-11-15 15:09:02 [WARNING ] (13, 1, 'bot')
2018-11-15 15:09:02 [WARNING ] (13, 1, 'bot')
2018-11-15 15:09:02 [WARNING ] (13, 1, 'bot')
2018-11-15 15:09:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:09:02 [DEBUG   ] Finished updating board flags in 2.304 seconds
2018-11-15 15:09:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 15:09:27 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-15 15:09:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-15 15:10:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:10:02 [WARNING ] (13, 1, 'bot')
2018-11-15 15:10:02 [WARNING ] (13, 1, 'bot')
2018-11-15 15:10:02 [WARNING ] (13, 1, 'bot')
2018-11-15 15:10:02 [WARNING ] (13, 1, 'bot')
2018-11-15 15:10:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:10:02 [DEBUG   ] Finished updating board flags in 2.079 seconds
2018-11-15 15:10:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 15:10:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 15:10:45 [DEBUG   ] Got command RPT from MCS: ref #515494
2018-11-15 15:10:45 [DEBUG   ] summary = ERROR
2018-11-15 15:10:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515494  13 58437 54645117 A  ERRORERROR'
2018-11-15 15:10:45 [DEBUG   ] Got command RPT from MCS: ref #515495
2018-11-15 15:10:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 15:10:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515495  77 58437 54645118 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 15:10:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 15:11:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:11:02 [WARNING ] (13, 1, 'bot')
2018-11-15 15:11:02 [WARNING ] (13, 1, 'bot')
2018-11-15 15:11:02 [WARNING ] (13, 1, 'bot')
2018-11-15 15:11:02 [WARNING ] (13, 1, 'bot')
2018-11-15 15:11:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:11:02 [DEBUG   ] Finished updating board flags in 2.005 seconds
2018-11-15 15:11:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 15:11:27 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 15:11:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 15:12:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 15:12:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:12:02 [WARNING ] (13, 1, 'bot')
2018-11-15 15:12:02 [WARNING ] (13, 1, 'bot')
2018-11-15 15:12:02 [WARNING ] (13, 1, 'bot')
2018-11-15 15:12:02 [WARNING ] (13, 1, 'bot')
2018-11-15 15:12:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:12:02 [DEBUG   ] Finished updating board flags in 2.014 seconds
2018-11-15 15:12:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 15:12:27 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-15 15:12:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 15:13:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:13:02 [WARNING ] (13, 1, 'bot')
2018-11-15 15:13:02 [WARNING ] (13, 1, 'bot')
2018-11-15 15:13:02 [WARNING ] (13, 1, 'bot')
2018-11-15 15:13:02 [WARNING ] (13, 1, 'bot')
2018-11-15 15:13:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:13:02 [DEBUG   ] Finished updating board flags in 1.966 seconds
2018-11-15 15:13:07 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-15 15:13:18 [DEBUG   ] Got command RPT from MCS: ref #515515
2018-11-15 15:13:18 [DEBUG   ] summary = ERROR
2018-11-15 15:13:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515515  13 58437 54798209 A  ERRORERROR'
2018-11-15 15:13:18 [DEBUG   ] Got command RPT from MCS: ref #515516
2018-11-15 15:13:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 15:13:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515516  77 58437 54798413 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 15:13:18 [DEBUG   ] Got command RPT from MCS: ref #515517
2018-11-15 15:13:18 [DEBUG   ] summary = ERROR
2018-11-15 15:13:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515517  13 58437 54798617 A  ERRORERROR'
2018-11-15 15:13:18 [DEBUG   ] Got command RPT from MCS: ref #515518
2018-11-15 15:13:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 15:13:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515518  77 58437 54798821 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 15:13:19 [DEBUG   ] Got command RPT from MCS: ref #515519
2018-11-15 15:13:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 15:13:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515519  12 58437 54799013 A  ERRORB˜™š'
2018-11-15 15:13:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 15:13:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-15 15:14:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-15 15:14:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:14:02 [WARNING ] (13, 1, 'bot')
2018-11-15 15:14:02 [WARNING ] (13, 1, 'bot')
2018-11-15 15:14:02 [WARNING ] (13, 1, 'bot')
2018-11-15 15:14:02 [WARNING ] (13, 1, 'bot')
2018-11-15 15:14:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:14:02 [DEBUG   ] Finished updating board flags in 1.869 seconds
2018-11-15 15:14:07 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-15 15:14:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 15:14:47 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-15 15:15:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 15:15:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:15:02 [WARNING ] (13, 1, 'bot')
2018-11-15 15:15:02 [WARNING ] (13, 1, 'bot')
2018-11-15 15:15:02 [WARNING ] (13, 1, 'bot')
2018-11-15 15:15:02 [WARNING ] (13, 1, 'bot')
2018-11-15 15:15:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:15:02 [DEBUG   ] Finished updating board flags in 1.738 seconds
2018-11-15 15:15:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 15:15:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 15:15:45 [DEBUG   ] Got command RPT from MCS: ref #515524
2018-11-15 15:15:45 [DEBUG   ] summary = ERROR
2018-11-15 15:15:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515524  13 58437 54945117 A  ERRORERROR'
2018-11-15 15:15:45 [DEBUG   ] Got command RPT from MCS: ref #515525
2018-11-15 15:15:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 15:15:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515525  77 58437 54945118 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 15:15:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 15:16:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:16:02 [WARNING ] (13, 1, 'bot')
2018-11-15 15:16:02 [WARNING ] (13, 1, 'bot')
2018-11-15 15:16:02 [WARNING ] (13, 1, 'bot')
2018-11-15 15:16:02 [WARNING ] (13, 1, 'bot')
2018-11-15 15:16:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:16:02 [DEBUG   ] Finished updating board flags in 1.663 seconds
2018-11-15 15:16:07 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-15 15:16:27 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-15 15:16:47 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-15 15:17:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:17:02 [WARNING ] (13, 1, 'bot')
2018-11-15 15:17:02 [WARNING ] (13, 1, 'bot')
2018-11-15 15:17:02 [WARNING ] (13, 1, 'bot')
2018-11-15 15:17:02 [WARNING ] (13, 1, 'bot')
2018-11-15 15:17:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:17:02 [DEBUG   ] Finished updating board flags in 1.703 seconds
2018-11-15 15:17:07 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2018-11-15 15:17:27 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-15 15:17:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 15:18:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:18:02 [WARNING ] (13, 1, 'bot')
2018-11-15 15:18:02 [WARNING ] (13, 1, 'bot')
2018-11-15 15:18:02 [WARNING ] (13, 1, 'bot')
2018-11-15 15:18:02 [WARNING ] (13, 1, 'bot')
2018-11-15 15:18:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:18:02 [DEBUG   ] Finished updating board flags in 1.446 seconds
2018-11-15 15:18:07 [DEBUG   ] Finished updating ant stats in 0.587 seconds
2018-11-15 15:18:18 [DEBUG   ] Got command RPT from MCS: ref #515547
2018-11-15 15:18:18 [DEBUG   ] summary = ERROR
2018-11-15 15:18:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515547  13 58437 55098301 A  ERRORERROR'
2018-11-15 15:18:18 [DEBUG   ] Got command RPT from MCS: ref #515548
2018-11-15 15:18:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 15:18:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515548  77 58437 55098493 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 15:18:18 [DEBUG   ] Got command RPT from MCS: ref #515549
2018-11-15 15:18:18 [DEBUG   ] summary = ERROR
2018-11-15 15:18:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515549  13 58437 55098697 A  ERRORERROR'
2018-11-15 15:18:18 [DEBUG   ] Got command RPT from MCS: ref #515551
2018-11-15 15:18:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 15:18:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515551  77 58437 55098901 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 15:18:19 [DEBUG   ] Got command RPT from MCS: ref #515553
2018-11-15 15:18:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 15:18:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515553  12 58437 55099105 A  ERRORB˜™š'
2018-11-15 15:18:28 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-11-15 15:18:48 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-15 15:19:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:19:02 [WARNING ] (13, 1, 'bot')
2018-11-15 15:19:02 [WARNING ] (13, 1, 'bot')
2018-11-15 15:19:02 [WARNING ] (13, 1, 'bot')
2018-11-15 15:19:02 [WARNING ] (13, 1, 'bot')
2018-11-15 15:19:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:19:02 [DEBUG   ] Finished updating board flags in 1.443 seconds
2018-11-15 15:19:08 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-15 15:19:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 15:19:48 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-15 15:20:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:20:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 15:20:02 [WARNING ] (13, 1, 'bot')
2018-11-15 15:20:02 [WARNING ] (13, 1, 'bot')
2018-11-15 15:20:02 [WARNING ] (13, 1, 'bot')
2018-11-15 15:20:02 [WARNING ] (13, 1, 'bot')
2018-11-15 15:20:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:20:02 [DEBUG   ] Finished updating board flags in 1.440 seconds
2018-11-15 15:20:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 15:20:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 15:20:45 [DEBUG   ] Got command RPT from MCS: ref #515561
2018-11-15 15:20:45 [DEBUG   ] summary = ERROR
2018-11-15 15:20:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515561  13 58437 55245117 A  ERRORERROR'
2018-11-15 15:20:45 [DEBUG   ] Got command RPT from MCS: ref #515562
2018-11-15 15:20:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 15:20:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515562  77 58437 55245118 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 15:20:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 15:21:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:21:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 15:21:02 [WARNING ] (13, 1, 'bot')
2018-11-15 15:21:02 [WARNING ] (13, 1, 'bot')
2018-11-15 15:21:02 [WARNING ] (13, 1, 'bot')
2018-11-15 15:21:02 [WARNING ] (13, 1, 'bot')
2018-11-15 15:21:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:21:02 [DEBUG   ] Finished updating board flags in 1.436 seconds
2018-11-15 15:21:08 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-15 15:21:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 15:21:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 15:22:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 15:22:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:22:02 [WARNING ] (13, 1, 'bot')
2018-11-15 15:22:02 [WARNING ] (13, 1, 'bot')
2018-11-15 15:22:02 [WARNING ] (13, 1, 'bot')
2018-11-15 15:22:02 [WARNING ] (13, 1, 'bot')
2018-11-15 15:22:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:22:02 [DEBUG   ] Finished updating board flags in 1.493 seconds
2018-11-15 15:22:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 15:22:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 15:22:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 15:23:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:23:03 [WARNING ] (13, 1, 'bot')
2018-11-15 15:23:03 [WARNING ] (13, 1, 'bot')
2018-11-15 15:23:03 [WARNING ] (13, 1, 'bot')
2018-11-15 15:23:03 [WARNING ] (13, 1, 'bot')
2018-11-15 15:23:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:23:03 [DEBUG   ] Finished updating board flags in 2.273 seconds
2018-11-15 15:23:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 15:23:18 [DEBUG   ] Got command RPT from MCS: ref #515578
2018-11-15 15:23:18 [DEBUG   ] summary = ERROR
2018-11-15 15:23:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515578  13 58437 55398385 A  ERRORERROR'
2018-11-15 15:23:18 [DEBUG   ] Got command RPT from MCS: ref #515579
2018-11-15 15:23:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 15:23:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515579  77 58437 55398589 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 15:23:18 [DEBUG   ] Got command RPT from MCS: ref #515580
2018-11-15 15:23:18 [DEBUG   ] summary = ERROR
2018-11-15 15:23:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515580  13 58437 55398808 A  ERRORERROR'
2018-11-15 15:23:18 [DEBUG   ] Got command RPT from MCS: ref #515581
2018-11-15 15:23:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 15:23:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515581  77 58437 55398986 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 15:23:19 [DEBUG   ] Got command RPT from MCS: ref #515582
2018-11-15 15:23:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 15:23:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515582  12 58437 55399189 A  ERRORB™™š'
2018-11-15 15:23:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 15:23:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 15:24:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:24:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-15 15:24:03 [WARNING ] (13, 1, 'bot')
2018-11-15 15:24:03 [WARNING ] (13, 1, 'bot')
2018-11-15 15:24:03 [WARNING ] (13, 1, 'bot')
2018-11-15 15:24:03 [WARNING ] (13, 1, 'bot')
2018-11-15 15:24:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:24:03 [DEBUG   ] Finished updating board flags in 2.255 seconds
2018-11-15 15:24:08 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-15 15:24:28 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-15 15:24:48 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-15 15:25:00 [DEBUG   ] Got command RPT from MCS: ref #515587
2018-11-15 15:25:00 [DEBUG   ] summary = ERROR
2018-11-15 15:25:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515587  13 58437 55500909 A  ERRORERROR'
2018-11-15 15:25:00 [DEBUG   ] Got command RPT from MCS: ref #515588
2018-11-15 15:25:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 15:25:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515588  77 58437 55500910 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 15:25:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 15:25:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:25:03 [WARNING ] (13, 1, 'bot')
2018-11-15 15:25:03 [WARNING ] (13, 1, 'bot')
2018-11-15 15:25:03 [WARNING ] (13, 1, 'bot')
2018-11-15 15:25:03 [WARNING ] (13, 1, 'bot')
2018-11-15 15:25:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:25:03 [DEBUG   ] Finished updating board flags in 2.076 seconds
2018-11-15 15:25:05 [DEBUG   ] Got command INI from MCS: ref #515589
2018-11-15 15:25:05 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-11-15 15:25:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI   515589   8 58437 55505930 ABOOTING'
2018-11-15 15:25:08 [DEBUG   ] Finished updating ant stats in 0.832 seconds
2018-11-15 15:25:29 [INFO    ] -------------------
2018-11-15 15:25:29 [INFO    ]  LWA board status
2018-11-15 15:25:29 [INFO    ] -------------------
2018-11-15 15:25:29 [INFO    ] DP 1: 2 lwa27
2018-11-15 15:25:29 [INFO    ] DP 1: 3 lwa24
2018-11-15 15:25:29 [INFO    ] DP 1: 4 lwa23
2018-11-15 15:25:29 [INFO    ] DP 1: 5 lwa18
2018-11-15 15:25:29 [INFO    ] DP 1: 6 lwa10
2018-11-15 15:25:29 [INFO    ] DP 1: 7 lwa32
2018-11-15 15:25:29 [INFO    ] DP 1: 8 lwa11
2018-11-15 15:25:29 [INFO    ] DP 1: 9 lwa30
2018-11-15 15:25:29 [INFO    ] DP 1: 10 lwa12
2018-11-15 15:25:29 [INFO    ] DP 1: 11 lwa8
2018-11-15 15:25:29 [INFO    ] DP 1: 12 lwa13
2018-11-15 15:25:29 [INFO    ] DP 1: 13 lwa26
2018-11-15 15:25:29 [INFO    ] DP 1: 14 lwa14
2018-11-15 15:25:29 [INFO    ] DP 1: 16 lwa22
2018-11-15 15:25:29 [INFO    ] DP 1: 17 lwa20
2018-11-15 15:25:29 [INFO    ] DP 1: 18 lwa1
2018-11-15 15:25:29 [INFO    ] DP 1: 19 lwa5
2018-11-15 15:25:29 [INFO    ] DP 1: 20 lwa25
2018-11-15 15:25:29 [INFO    ] DP 1: 21 lwa35
2018-11-15 15:25:29 [INFO    ] DP 1: 22 lwa19
2018-11-15 15:25:29 [INFO    ] DP 1: 23 lwa21
2018-11-15 15:25:29 [INFO    ] DP 1: 24 lwa6
2018-11-15 15:25:29 [INFO    ] DP 1: 25 lwa7
2018-11-15 15:25:29 [INFO    ] DP 1: 26 lwa33
2018-11-15 15:25:29 [INFO    ] DP 1: 27 lwa15
2018-11-15 15:25:29 [INFO    ] DP 1: 28 lwa28
2018-11-15 15:25:29 [INFO    ] DP 2: 1 lwa16
2018-11-15 15:25:29 [INFO    ] DP 2: 15 lwa34
2018-11-15 15:25:29 [INFO    ] Total of 28 boards
2018-11-15 15:25:29 [INFO    ] Total of 260 stands
2018-11-15 15:25:29 [INFO    ] -------------------
2018-11-15 15:25:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-11-15 15:25:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-11-15 15:25:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-11-15 15:25:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-11-15 15:25:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-11-15 15:25:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-11-15 15:25:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-11-15 15:25:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-11-15 15:25:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-11-15 15:25:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-11-15 15:25:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-11-15 15:25:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-11-15 15:25:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-11-15 15:25:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-11-15 15:25:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-11-15 15:25:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-11-15 15:25:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-11-15 15:25:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-11-15 15:25:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-11-15 15:25:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-11-15 15:25:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-11-15 15:25:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-11-15 15:25:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-11-15 15:25:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-11-15 15:25:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-11-15 15:25:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-11-15 15:25:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-11-15 15:25:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-11-15 15:25:36 [DEBUG   ] 2018-11-15 15:25:36 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20670
2018-11-15 15:25:36 [DEBUG   ] 2018-11-15 15:25:36 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20671
2018-11-15 15:25:36 [DEBUG   ] 2018-11-15 15:25:36 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20672
2018-11-15 15:25:36 [DEBUG   ] 2018-11-15 15:25:36 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20673
2018-11-15 15:25:36 [DEBUG   ] 2018-11-15 15:25:36 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20674
2018-11-15 15:25:36 [DEBUG   ] 2018-11-15 15:25:36 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20675
2018-11-15 15:25:36 [DEBUG   ] 2018-11-15 15:25:36 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20676
2018-11-15 15:25:36 [DEBUG   ] 2018-11-15 15:25:36 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20677
2018-11-15 15:25:36 [DEBUG   ] 2018-11-15 15:25:36 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20678
2018-11-15 15:25:36 [DEBUG   ] 2018-11-15 15:25:36 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20679
2018-11-15 15:25:36 [DEBUG   ] 2018-11-15 15:25:36 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20680
2018-11-15 15:25:36 [DEBUG   ] 2018-11-15 15:25:36 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20681
2018-11-15 15:25:36 [DEBUG   ] 2018-11-15 15:25:36 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20682
2018-11-15 15:25:36 [DEBUG   ] 2018-11-15 15:25:36 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20683
2018-11-15 15:25:36 [DEBUG   ] 2018-11-15 15:25:36 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20684
2018-11-15 15:25:36 [DEBUG   ] 2018-11-15 15:25:36 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20685
2018-11-15 15:25:36 [DEBUG   ] 2018-11-15 15:25:36 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20686
2018-11-15 15:25:36 [DEBUG   ] 2018-11-15 15:25:36 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20687
2018-11-15 15:25:36 [DEBUG   ] 2018-11-15 15:25:36 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20688
2018-11-15 15:25:36 [DEBUG   ] 2018-11-15 15:25:36 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20689
2018-11-15 15:25:36 [DEBUG   ] 2018-11-15 15:25:36 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20690
2018-11-15 15:25:36 [DEBUG   ] 2018-11-15 15:25:36 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20691
2018-11-15 15:25:36 [DEBUG   ] 2018-11-15 15:25:36 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20692
2018-11-15 15:25:36 [DEBUG   ] 2018-11-15 15:25:36 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20693
2018-11-15 15:25:36 [DEBUG   ] 2018-11-15 15:25:36 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20694
2018-11-15 15:25:36 [DEBUG   ] 2018-11-15 15:25:36 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 20695
2018-11-15 15:25:45 [DEBUG   ] Got command RPT from MCS: ref #515590
2018-11-15 15:25:45 [DEBUG   ] summary = BOOTING
2018-11-15 15:25:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515590  15 58437 55545117 ABOOTINGBOOTING'
2018-11-15 15:25:45 [DEBUG   ] Got command RPT from MCS: ref #515591
2018-11-15 15:25:45 [DEBUG   ] info = Running INI sequence
2018-11-15 15:25:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515591  28 58437 55545118 ABOOTINGRunning INI sequence'
2018-11-15 15:25:48 [DEBUG   ] 2018-11-15 15:25:48 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20670 exited with status 0
2018-11-15 15:25:48 [DEBUG   ] 2018-11-15 15:25:48 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20671 exited with status 0
2018-11-15 15:25:48 [DEBUG   ] 2018-11-15 15:25:48 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20672 exited with status 0
2018-11-15 15:25:48 [DEBUG   ] 2018-11-15 15:25:48 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20673 exited with status 0
2018-11-15 15:25:48 [DEBUG   ] 2018-11-15 15:25:48 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20674 exited with status 0
2018-11-15 15:25:48 [DEBUG   ] 2018-11-15 15:25:48 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20675 exited with status 0
2018-11-15 15:25:48 [DEBUG   ] 2018-11-15 15:25:48 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20676 exited with status 0
2018-11-15 15:25:48 [DEBUG   ] 2018-11-15 15:25:48 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20677 exited with status 0
2018-11-15 15:25:48 [DEBUG   ] 2018-11-15 15:25:48 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20678 exited with status 0
2018-11-15 15:25:48 [DEBUG   ] 2018-11-15 15:25:48 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20679 exited with status 0
2018-11-15 15:25:48 [DEBUG   ] 2018-11-15 15:25:48 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20680 exited with status 0
2018-11-15 15:25:48 [DEBUG   ] 2018-11-15 15:25:48 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20681 exited with status 0
2018-11-15 15:25:48 [DEBUG   ] 2018-11-15 15:25:48 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20682 exited with status 0
2018-11-15 15:25:48 [DEBUG   ] 2018-11-15 15:25:48 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20683 exited with status 0
2018-11-15 15:25:48 [DEBUG   ] 2018-11-15 15:25:48 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20684 exited with status 0
2018-11-15 15:25:48 [DEBUG   ] 2018-11-15 15:25:48 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20685 exited with status 0
2018-11-15 15:25:48 [DEBUG   ] 2018-11-15 15:25:48 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20686 exited with status 0
2018-11-15 15:25:48 [DEBUG   ] 2018-11-15 15:25:48 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20687 exited with status 0
2018-11-15 15:25:48 [DEBUG   ] 2018-11-15 15:25:48 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20688 exited with status 0
2018-11-15 15:25:48 [DEBUG   ] 2018-11-15 15:25:48 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20689 exited with status 0
2018-11-15 15:25:48 [DEBUG   ] 2018-11-15 15:25:48 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20690 exited with status 0
2018-11-15 15:25:48 [DEBUG   ] 2018-11-15 15:25:48 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20691 exited with status 0
2018-11-15 15:25:48 [DEBUG   ] 2018-11-15 15:25:48 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20692 exited with status 0
2018-11-15 15:25:48 [DEBUG   ] 2018-11-15 15:25:48 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20693 exited with status 0
2018-11-15 15:25:48 [DEBUG   ] 2018-11-15 15:25:48 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20694 exited with status 0
2018-11-15 15:25:48 [DEBUG   ] 2018-11-15 15:25:48 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 20695 exited with status 0
2018-11-15 15:25:48 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-11-15 15:25:48 [DEBUG   ] spawn_process: at 2018-11-15 15:25:48 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-11-15 15:25:48 [DEBUG   ] spawn_process: at 2018-11-15 15:25:48 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-11-15 15:25:48 [DEBUG   ] spawn_process: at 2018-11-15 15:25:48 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-11-15 15:25:48 [DEBUG   ] spawn_process: at 2018-11-15 15:25:48 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-11-15 15:25:48 [DEBUG   ] spawn_process: at 2018-11-15 15:25:48 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-11-15 15:25:48 [DEBUG   ] spawn_process: at 2018-11-15 15:25:48 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-11-15 15:25:48 [DEBUG   ] spawn_process: at 2018-11-15 15:25:48 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-11-15 15:25:48 [DEBUG   ] spawn_process: at 2018-11-15 15:25:48 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-11-15 15:25:48 [DEBUG   ] spawn_process: at 2018-11-15 15:25:48 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-11-15 15:25:48 [DEBUG   ] spawn_process: at 2018-11-15 15:25:48 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-11-15 15:25:48 [DEBUG   ] spawn_process: at 2018-11-15 15:25:48 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-11-15 15:25:48 [DEBUG   ] spawn_process: at 2018-11-15 15:25:48 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-11-15 15:25:48 [DEBUG   ] spawn_process: at 2018-11-15 15:25:48 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-11-15 15:25:48 [DEBUG   ] spawn_process: at 2018-11-15 15:25:48 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-11-15 15:25:48 [DEBUG   ] spawn_process: at 2018-11-15 15:25:48 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-11-15 15:25:48 [DEBUG   ] spawn_process: at 2018-11-15 15:25:48 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-11-15 15:25:48 [DEBUG   ] spawn_process: at 2018-11-15 15:25:48 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-11-15 15:25:48 [DEBUG   ] spawn_process: at 2018-11-15 15:25:48 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-11-15 15:25:48 [DEBUG   ] spawn_process: at 2018-11-15 15:25:48 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-11-15 15:25:48 [DEBUG   ] spawn_process: at 2018-11-15 15:25:48 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-11-15 15:25:49 [DEBUG   ] spawn_process: at 2018-11-15 15:25:49 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-11-15 15:25:49 [DEBUG   ] spawn_process: at 2018-11-15 15:25:49 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-11-15 15:25:49 [DEBUG   ] spawn_process: at 2018-11-15 15:25:49 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-11-15 15:25:49 [DEBUG   ] spawn_process: at 2018-11-15 15:25:49 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-11-15 15:25:49 [DEBUG   ] spawn_process: at 2018-11-15 15:25:49 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-11-15 15:25:49 [DEBUG   ] spawn_process: at 2018-11-15 15:25:49 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-11-15 15:25:49 [DEBUG   ] 2018-11-15 15:25:49 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 20722
2018-11-15 15:25:49 [DEBUG   ] 2018-11-15 15:25:49 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 20723
2018-11-15 15:25:54 [DEBUG   ] 2018-11-15 15:25:54 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 20722 exited with status 0
2018-11-15 15:25:54 [DEBUG   ] 2018-11-15 15:25:54 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 20723 exited with status 0
2018-11-15 15:25:54 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-11-15 15:25:54 [DEBUG   ] spawn_process: at 2018-11-15 15:25:54 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-11-15 15:25:54 [DEBUG   ] spawn_process: at 2018-11-15 15:25:54 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-11-15 15:25:54 [INFO    ] Setting Beam 1 xbars
2018-11-15 15:25:54 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-11-15 15:25:54 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-11-15 15:25:54 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-11-15 15:25:54 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-11-15 15:25:55 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-11-15 15:25:55 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-11-15 15:25:55 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-11-15 15:25:55 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-11-15 15:25:55 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-11-15 15:25:55 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-11-15 15:25:55 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-11-15 15:25:55 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-11-15 15:25:55 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-11-15 15:25:56 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-11-15 15:25:56 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-11-15 15:25:56 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-11-15 15:25:56 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-11-15 15:25:56 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-11-15 15:25:56 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-11-15 15:25:56 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-11-15 15:25:56 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-11-15 15:25:56 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-11-15 15:25:57 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-11-15 15:25:57 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-11-15 15:25:57 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-11-15 15:25:57 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-11-15 15:25:57 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-11-15 15:25:57 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-11-15 15:25:57 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-11-15 15:25:57 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-11-15 15:25:57 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-11-15 15:25:58 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-11-15 15:25:58 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-11-15 15:25:58 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-11-15 15:25:58 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-11-15 15:25:58 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-11-15 15:25:58 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-11-15 15:25:58 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-11-15 15:25:58 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-11-15 15:25:58 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-11-15 15:25:59 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-11-15 15:25:59 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-11-15 15:25:59 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-11-15 15:25:59 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-11-15 15:25:59 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-11-15 15:25:59 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-11-15 15:25:59 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-11-15 15:25:59 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-11-15 15:25:59 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-11-15 15:26:00 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-11-15 15:26:00 [INFO    ] Setting Beam 2 xbars
2018-11-15 15:26:00 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-11-15 15:26:00 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-11-15 15:26:00 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-11-15 15:26:00 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-11-15 15:26:00 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-11-15 15:26:00 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-11-15 15:26:00 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-11-15 15:26:00 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-11-15 15:26:00 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-11-15 15:26:01 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-11-15 15:26:01 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-11-15 15:26:01 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-11-15 15:26:01 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-11-15 15:26:01 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-11-15 15:26:01 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-11-15 15:26:01 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-11-15 15:26:01 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-11-15 15:26:01 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-11-15 15:26:02 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-11-15 15:26:02 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-11-15 15:26:02 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-11-15 15:26:02 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-11-15 15:26:02 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-11-15 15:26:02 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-11-15 15:26:02 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-11-15 15:26:02 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-11-15 15:26:02 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-11-15 15:26:03 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-11-15 15:26:03 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-11-15 15:26:03 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-11-15 15:26:03 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-11-15 15:26:03 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-11-15 15:26:03 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-11-15 15:26:03 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-11-15 15:26:03 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-11-15 15:26:03 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-11-15 15:26:04 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-11-15 15:26:04 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-11-15 15:26:04 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-11-15 15:26:04 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-11-15 15:26:04 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-11-15 15:26:04 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-11-15 15:26:04 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-11-15 15:26:04 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-11-15 15:26:04 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-11-15 15:26:04 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-11-15 15:26:05 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-11-15 15:26:05 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-11-15 15:26:05 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-11-15 15:26:05 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-11-15 15:26:05 [INFO    ] Setting Beam 3 xbars
2018-11-15 15:26:05 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-11-15 15:26:05 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-11-15 15:26:05 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-11-15 15:26:05 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-11-15 15:26:05 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-11-15 15:26:06 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-11-15 15:26:06 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-11-15 15:26:06 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-11-15 15:26:06 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-11-15 15:26:06 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-11-15 15:26:06 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-11-15 15:26:06 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-11-15 15:26:06 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-11-15 15:26:06 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-11-15 15:26:07 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-11-15 15:26:07 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-11-15 15:26:07 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-11-15 15:26:07 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-11-15 15:26:07 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-11-15 15:26:07 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-11-15 15:26:07 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-11-15 15:26:07 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-11-15 15:26:07 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-11-15 15:26:08 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-11-15 15:26:08 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-11-15 15:26:08 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-11-15 15:26:08 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-11-15 15:26:08 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-11-15 15:26:08 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-11-15 15:26:08 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-11-15 15:26:08 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-11-15 15:26:08 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-11-15 15:26:09 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-11-15 15:26:09 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-11-15 15:26:09 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-11-15 15:26:09 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-11-15 15:26:09 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-11-15 15:26:09 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-11-15 15:26:09 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-11-15 15:26:09 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-11-15 15:26:09 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-11-15 15:26:10 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-11-15 15:26:10 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-11-15 15:26:10 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-11-15 15:26:10 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-11-15 15:26:10 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-11-15 15:26:10 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-11-15 15:26:10 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-11-15 15:26:10 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-11-15 15:26:10 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-11-15 15:26:11 [INFO    ] Setting Beam 4 xbars
2018-11-15 15:26:11 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-11-15 15:26:11 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-11-15 15:26:11 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-11-15 15:26:11 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-11-15 15:26:11 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-11-15 15:26:11 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-11-15 15:26:11 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-11-15 15:26:11 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-11-15 15:26:11 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-11-15 15:26:12 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-11-15 15:26:12 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-11-15 15:26:12 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-11-15 15:26:12 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-11-15 15:26:12 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-11-15 15:26:12 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-11-15 15:26:12 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-11-15 15:26:12 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-11-15 15:26:12 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-11-15 15:26:13 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-11-15 15:26:13 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-11-15 15:26:13 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-11-15 15:26:13 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-11-15 15:26:13 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-11-15 15:26:13 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-11-15 15:26:13 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-11-15 15:26:13 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-11-15 15:26:13 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-11-15 15:26:14 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-11-15 15:26:14 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-11-15 15:26:14 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-11-15 15:26:14 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-11-15 15:26:14 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-11-15 15:26:14 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-11-15 15:26:14 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-11-15 15:26:14 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-11-15 15:26:14 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-11-15 15:26:14 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-11-15 15:26:15 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-11-15 15:26:15 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-11-15 15:26:15 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-11-15 15:26:15 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-11-15 15:26:15 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-11-15 15:26:15 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-11-15 15:26:15 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-11-15 15:26:15 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-11-15 15:26:15 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-11-15 15:26:16 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-11-15 15:26:16 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-11-15 15:26:16 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-11-15 15:26:16 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-11-15 15:26:16 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-11-15 15:26:16 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-11-15 15:26:16 [INFO    ] All xbars set
2018-11-15 15:26:16 [INFO    ] Setting adder chain routing for all beams
2018-11-15 15:26:21 [INFO    ] Setting beam ids
2018-11-15 15:26:31 [INFO    ] Starting beam delay calibration
2018-11-15 15:26:43 [INFO    ] Beam 1 latency is 5736
2018-11-15 15:26:43 [INFO    ] Beam 2 latency is 5775
2018-11-15 15:26:43 [INFO    ] Beam 3 latency is 5752
2018-11-15 15:26:43 [INFO    ] Beam 4 latency is 5723
2018-11-15 15:26:43 [INFO    ] Stop calibration
2018-11-15 15:26:51 [INFO    ] Beam delay calibration successful
2018-11-15 15:26:51 [INFO    ] Calibration passed
2018-11-15 15:26:51 [DEBUG   ] spawn_process: at 2018-11-15 15:26:51 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-11-15 15:26:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-11-15 15:26:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-11-15 15:26:51 [DEBUG   ] spawn_process: at 2018-11-15 15:26:51 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-11-15 15:26:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-11-15 15:26:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-11-15 15:26:51 [DEBUG   ] spawn_process: at 2018-11-15 15:26:51 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-11-15 15:26:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-11-15 15:26:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-11-15 15:26:51 [DEBUG   ] spawn_process: at 2018-11-15 15:26:51 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-11-15 15:26:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-11-15 15:26:51 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-11-15 15:26:51 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-11-15 15:26:52 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 285 ms (1542295612.287 s) with PID 22297 and time 1542295613
2018-11-15 15:26:52 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-11-15 15:26:52 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 373 ms (1542295612.375 s) with PID 22300 and time 1542295613
2018-11-15 15:26:53 [DEBUG   ] Finished updating ant stats in 0.872 seconds
2018-11-15 15:26:53 [INFO    ] Started antennas statistics background thread
2018-11-15 15:26:53 [INFO    ] Started board flags background thread
2018-11-15 15:26:53 [INFO    ] Started BAM background thread
2018-11-15 15:26:53 [INFO    ] Finished the INI process (ref. #515589) in 107.568 s
2018-11-15 15:26:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:26:54 [WARNING ] (13, 1, 'bot')
2018-11-15 15:26:54 [WARNING ] (13, 1, 'bot')
2018-11-15 15:26:54 [WARNING ] (13, 1, 'bot')
2018-11-15 15:26:54 [WARNING ] (13, 1, 'bot')
2018-11-15 15:26:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:26:54 [DEBUG   ] Finished updating board flags in 1.062 seconds
2018-11-15 15:27:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 15:27:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 15:27:53 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-15 15:27:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:27:54 [WARNING ] (13, 1, 'bot')
2018-11-15 15:27:54 [WARNING ] (13, 1, 'bot')
2018-11-15 15:27:54 [WARNING ] (13, 1, 'bot')
2018-11-15 15:27:54 [WARNING ] (13, 1, 'bot')
2018-11-15 15:27:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:27:54 [DEBUG   ] Finished updating board flags in 0.987 seconds
2018-11-15 15:28:05 [DEBUG   ] Got command RPT from MCS: ref #515611
2018-11-15 15:28:05 [DEBUG   ] summary = ERROR
2018-11-15 15:28:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515611  13 58437 55685917 A  ERRORERROR'
2018-11-15 15:28:05 [DEBUG   ] Got command RPT from MCS: ref #515612
2018-11-15 15:28:05 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 15:28:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515612  77 58437 55685918 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 15:28:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 15:28:18 [DEBUG   ] Got command RPT from MCS: ref #515615
2018-11-15 15:28:18 [DEBUG   ] summary = ERROR
2018-11-15 15:28:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515615  13 58437 55698469 A  ERRORERROR'
2018-11-15 15:28:18 [DEBUG   ] Got command RPT from MCS: ref #515616
2018-11-15 15:28:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 15:28:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515616  77 58437 55698673 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 15:28:18 [DEBUG   ] Got command RPT from MCS: ref #515617
2018-11-15 15:28:18 [DEBUG   ] summary = ERROR
2018-11-15 15:28:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515617  13 58437 55698877 A  ERRORERROR'
2018-11-15 15:28:19 [DEBUG   ] Got command RPT from MCS: ref #515619
2018-11-15 15:28:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 15:28:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515619  77 58437 55699081 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 15:28:19 [DEBUG   ] Got command RPT from MCS: ref #515620
2018-11-15 15:28:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 15:28:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515620  12 58437 55699273 A  ERRORB˜™š'
2018-11-15 15:28:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 15:28:53 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-15 15:28:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:28:54 [WARNING ] (13, 1, 'bot')
2018-11-15 15:28:54 [WARNING ] (13, 1, 'bot')
2018-11-15 15:28:54 [WARNING ] (13, 1, 'bot')
2018-11-15 15:28:54 [WARNING ] (13, 1, 'bot')
2018-11-15 15:28:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:28:54 [DEBUG   ] Finished updating board flags in 1.272 seconds
2018-11-15 15:29:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 15:29:33 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-15 15:29:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 15:29:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:29:54 [WARNING ] (13, 1, 'bot')
2018-11-15 15:29:54 [WARNING ] (13, 1, 'bot')
2018-11-15 15:29:54 [WARNING ] (13, 1, 'bot')
2018-11-15 15:29:54 [WARNING ] (13, 1, 'bot')
2018-11-15 15:29:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:29:54 [DEBUG   ] Finished updating board flags in 1.186 seconds
2018-11-15 15:30:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 15:30:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 15:30:45 [DEBUG   ] Got command RPT from MCS: ref #515629
2018-11-15 15:30:45 [DEBUG   ] summary = ERROR
2018-11-15 15:30:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515629  13 58437 55845121 A  ERRORERROR'
2018-11-15 15:30:45 [DEBUG   ] Got command RPT from MCS: ref #515630
2018-11-15 15:30:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 15:30:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515630  77 58437 55845122 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 15:30:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 15:30:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:30:55 [WARNING ] (13, 1, 'bot')
2018-11-15 15:30:55 [WARNING ] (13, 1, 'bot')
2018-11-15 15:30:55 [WARNING ] (13, 1, 'bot')
2018-11-15 15:30:55 [WARNING ] (13, 1, 'bot')
2018-11-15 15:30:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:30:55 [DEBUG   ] Finished updating board flags in 1.568 seconds
2018-11-15 15:31:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 15:31:33 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-15 15:31:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 15:31:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:31:55 [WARNING ] (13, 1, 'bot')
2018-11-15 15:31:55 [WARNING ] (13, 1, 'bot')
2018-11-15 15:31:55 [WARNING ] (13, 1, 'bot')
2018-11-15 15:31:55 [WARNING ] (13, 1, 'bot')
2018-11-15 15:31:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:31:55 [DEBUG   ] Finished updating board flags in 1.465 seconds
2018-11-15 15:32:13 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-15 15:32:33 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-15 15:32:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 15:32:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:32:55 [WARNING ] (13, 1, 'bot')
2018-11-15 15:32:55 [WARNING ] (13, 1, 'bot')
2018-11-15 15:32:55 [WARNING ] (13, 1, 'bot')
2018-11-15 15:32:55 [WARNING ] (13, 1, 'bot')
2018-11-15 15:32:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:32:55 [DEBUG   ] Finished updating board flags in 1.408 seconds
2018-11-15 15:33:13 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-15 15:33:18 [DEBUG   ] Got command RPT from MCS: ref #515650
2018-11-15 15:33:18 [DEBUG   ] summary = ERROR
2018-11-15 15:33:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515650  13 58437 55998558 A  ERRORERROR'
2018-11-15 15:33:18 [DEBUG   ] Got command RPT from MCS: ref #515651
2018-11-15 15:33:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 15:33:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515651  77 58437 55998761 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 15:33:18 [DEBUG   ] Got command RPT from MCS: ref #515652
2018-11-15 15:33:18 [DEBUG   ] summary = ERROR
2018-11-15 15:33:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515652  13 58437 55998965 A  ERRORERROR'
2018-11-15 15:33:19 [DEBUG   ] Got command RPT from MCS: ref #515653
2018-11-15 15:33:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 15:33:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515653  77 58437 55999169 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 15:33:19 [DEBUG   ] Got command RPT from MCS: ref #515654
2018-11-15 15:33:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 15:33:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515654  12 58437 55999362 A  ERRORB—™š'
2018-11-15 15:33:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 15:33:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 15:33:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:33:55 [WARNING ] (13, 1, 'bot')
2018-11-15 15:33:55 [WARNING ] (13, 1, 'bot')
2018-11-15 15:33:55 [WARNING ] (13, 1, 'bot')
2018-11-15 15:33:55 [WARNING ] (13, 1, 'bot')
2018-11-15 15:33:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:33:55 [DEBUG   ] Finished updating board flags in 1.305 seconds
2018-11-15 15:34:13 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-15 15:34:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 15:34:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 15:34:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:34:55 [WARNING ] (13, 1, 'bot')
2018-11-15 15:34:55 [WARNING ] (13, 1, 'bot')
2018-11-15 15:34:55 [WARNING ] (13, 1, 'bot')
2018-11-15 15:34:55 [WARNING ] (13, 1, 'bot')
2018-11-15 15:34:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:34:55 [DEBUG   ] Finished updating board flags in 1.225 seconds
2018-11-15 15:35:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 15:35:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 15:35:45 [DEBUG   ] Got command RPT from MCS: ref #515659
2018-11-15 15:35:45 [DEBUG   ] summary = ERROR
2018-11-15 15:35:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515659  13 58437 56145121 A  ERRORERROR'
2018-11-15 15:35:45 [DEBUG   ] Got command RPT from MCS: ref #515660
2018-11-15 15:35:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 15:35:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515660  77 58437 56145122 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 15:35:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 15:35:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:35:55 [WARNING ] (13, 1, 'bot')
2018-11-15 15:35:55 [WARNING ] (13, 1, 'bot')
2018-11-15 15:35:55 [WARNING ] (13, 1, 'bot')
2018-11-15 15:35:55 [WARNING ] (13, 1, 'bot')
2018-11-15 15:35:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:35:55 [DEBUG   ] Finished updating board flags in 1.191 seconds
2018-11-15 15:36:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 15:36:33 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-15 15:36:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 15:36:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 15:36:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:36:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-15 15:36:55 [WARNING ] (13, 1, 'bot')
2018-11-15 15:36:55 [WARNING ] (13, 1, 'bot')
2018-11-15 15:36:55 [WARNING ] (13, 1, 'bot')
2018-11-15 15:36:55 [WARNING ] (13, 1, 'bot')
2018-11-15 15:36:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:36:55 [DEBUG   ] Finished updating board flags in 1.012 seconds
2018-11-15 15:37:13 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-15 15:37:33 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-15 15:37:53 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-15 15:37:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-15 15:37:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:37:55 [WARNING ] (13, 1, 'bot')
2018-11-15 15:37:55 [WARNING ] (13, 1, 'bot')
2018-11-15 15:37:55 [WARNING ] (13, 1, 'bot')
2018-11-15 15:37:55 [WARNING ] (13, 1, 'bot')
2018-11-15 15:37:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:37:55 [DEBUG   ] Finished updating board flags in 1.012 seconds
2018-11-15 15:38:13 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-15 15:38:18 [DEBUG   ] Got command RPT from MCS: ref #515678
2018-11-15 15:38:18 [DEBUG   ] summary = ERROR
2018-11-15 15:38:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515678  13 58437 56298641 A  ERRORERROR'
2018-11-15 15:38:18 [DEBUG   ] Got command RPT from MCS: ref #515679
2018-11-15 15:38:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 15:38:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515679  77 58437 56298845 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 15:38:19 [DEBUG   ] Got command RPT from MCS: ref #515680
2018-11-15 15:38:19 [DEBUG   ] summary = ERROR
2018-11-15 15:38:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515680  13 58437 56299049 A  ERRORERROR'
2018-11-15 15:38:19 [DEBUG   ] Got command RPT from MCS: ref #515682
2018-11-15 15:38:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 15:38:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515682  77 58437 56299253 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 15:38:19 [DEBUG   ] Got command RPT from MCS: ref #515683
2018-11-15 15:38:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 15:38:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515683  12 58437 56299445 A  ERRORB˜™š'
2018-11-15 15:38:33 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 15:38:53 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 15:38:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:38:56 [WARNING ] (13, 1, 'bot')
2018-11-15 15:38:56 [WARNING ] (13, 1, 'bot')
2018-11-15 15:38:56 [WARNING ] (13, 1, 'bot')
2018-11-15 15:38:56 [WARNING ] (13, 1, 'bot')
2018-11-15 15:38:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:38:56 [DEBUG   ] Finished updating board flags in 2.037 seconds
2018-11-15 15:39:13 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-15 15:39:33 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 15:39:53 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 15:39:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:39:55 [WARNING ] (13, 1, 'bot')
2018-11-15 15:39:55 [WARNING ] (13, 1, 'bot')
2018-11-15 15:39:55 [WARNING ] (13, 1, 'bot')
2018-11-15 15:39:55 [WARNING ] (13, 1, 'bot')
2018-11-15 15:39:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:39:55 [DEBUG   ] Finished updating board flags in 1.406 seconds
2018-11-15 15:40:13 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 15:40:33 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 15:40:45 [DEBUG   ] Got command RPT from MCS: ref #515692
2018-11-15 15:40:45 [DEBUG   ] summary = ERROR
2018-11-15 15:40:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515692  13 58437 56445121 A  ERRORERROR'
2018-11-15 15:40:45 [DEBUG   ] Got command RPT from MCS: ref #515693
2018-11-15 15:40:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 15:40:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515693  77 58437 56445122 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 15:40:53 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 15:40:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 15:40:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:40:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 15:40:55 [WARNING ] (13, 1, 'bot')
2018-11-15 15:40:55 [WARNING ] (13, 1, 'bot')
2018-11-15 15:40:55 [WARNING ] (13, 1, 'bot')
2018-11-15 15:40:55 [WARNING ] (13, 1, 'bot')
2018-11-15 15:40:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:40:55 [DEBUG   ] Finished updating board flags in 1.434 seconds
2018-11-15 15:41:13 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-15 15:41:33 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 15:41:53 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-15 15:41:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:41:55 [WARNING ] (13, 1, 'bot')
2018-11-15 15:41:55 [WARNING ] (13, 1, 'bot')
2018-11-15 15:41:55 [WARNING ] (13, 1, 'bot')
2018-11-15 15:41:55 [WARNING ] (13, 1, 'bot')
2018-11-15 15:41:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:41:55 [DEBUG   ] Finished updating board flags in 1.351 seconds
2018-11-15 15:42:13 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 15:42:33 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-15 15:42:53 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 15:42:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:42:55 [WARNING ] (13, 1, 'bot')
2018-11-15 15:42:55 [WARNING ] (13, 1, 'bot')
2018-11-15 15:42:55 [WARNING ] (13, 1, 'bot')
2018-11-15 15:42:55 [WARNING ] (13, 1, 'bot')
2018-11-15 15:42:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:42:55 [DEBUG   ] Finished updating board flags in 1.221 seconds
2018-11-15 15:43:13 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 15:43:18 [DEBUG   ] Got command RPT from MCS: ref #515713
2018-11-15 15:43:18 [DEBUG   ] summary = ERROR
2018-11-15 15:43:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515713  13 58437 56598729 A  ERRORERROR'
2018-11-15 15:43:18 [DEBUG   ] Got command RPT from MCS: ref #515714
2018-11-15 15:43:18 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 15:43:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515714  77 58437 56598933 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 15:43:19 [DEBUG   ] Got command RPT from MCS: ref #515715
2018-11-15 15:43:19 [DEBUG   ] summary = ERROR
2018-11-15 15:43:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515715  13 58437 56599137 A  ERRORERROR'
2018-11-15 15:43:19 [DEBUG   ] Got command RPT from MCS: ref #515716
2018-11-15 15:43:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 15:43:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515716  77 58437 56599329 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 15:43:19 [DEBUG   ] Got command RPT from MCS: ref #515717
2018-11-15 15:43:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 15:43:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515717  12 58437 56599533 A  ERRORB˜™š'
2018-11-15 15:43:33 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 15:43:53 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 15:43:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:43:56 [WARNING ] (13, 1, 'bot')
2018-11-15 15:43:56 [WARNING ] (13, 1, 'bot')
2018-11-15 15:43:56 [WARNING ] (13, 1, 'bot')
2018-11-15 15:43:56 [WARNING ] (13, 1, 'bot')
2018-11-15 15:43:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:43:56 [DEBUG   ] Finished updating board flags in 1.796 seconds
2018-11-15 15:44:13 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 15:44:33 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-15 15:44:53 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 15:44:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:44:56 [WARNING ] (13, 1, 'bot')
2018-11-15 15:44:56 [WARNING ] (13, 1, 'bot')
2018-11-15 15:44:56 [WARNING ] (13, 1, 'bot')
2018-11-15 15:44:56 [WARNING ] (13, 1, 'bot')
2018-11-15 15:44:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:44:56 [DEBUG   ] Finished updating board flags in 1.548 seconds
2018-11-15 15:45:13 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 15:45:33 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-15 15:45:45 [DEBUG   ] Got command RPT from MCS: ref #515722
2018-11-15 15:45:45 [DEBUG   ] summary = ERROR
2018-11-15 15:45:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515722  13 58437 56745125 A  ERRORERROR'
2018-11-15 15:45:45 [DEBUG   ] Got command RPT from MCS: ref #515723
2018-11-15 15:45:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 15:45:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515723  77 58437 56745126 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 15:45:53 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-15 15:45:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 15:45:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:45:56 [WARNING ] (13, 1, 'bot')
2018-11-15 15:45:56 [WARNING ] (13, 1, 'bot')
2018-11-15 15:45:56 [WARNING ] (13, 1, 'bot')
2018-11-15 15:45:56 [WARNING ] (13, 1, 'bot')
2018-11-15 15:45:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:45:56 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-11-15 15:46:00 [DEBUG   ] Got command DRX from MCS: ref #515743
2018-11-15 15:46:00 [INFO    ] sending drx command to lwa16
2018-11-15 15:46:00 [DEBUG   ] run_process: at 2018-11-15 15:46:00 running ['/usr/local/bin/lwa16', '/lwa/software/drx 1 1 35100000.0 7 9 0']
2018-11-15 15:46:00 [DEBUG   ] drx = exited with status True, code 0x00
2018-11-15 15:46:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   515743   8 58437 56760013 A  ERROR'
2018-11-15 15:46:00 [DEBUG   ] Got command DRX from MCS: ref #515744
2018-11-15 15:46:00 [INFO    ] sending drx command to lwa34
2018-11-15 15:46:00 [DEBUG   ] run_process: at 2018-11-15 15:46:00 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 1 64500000.0 7 9 0']
2018-11-15 15:46:00 [DEBUG   ] drx = exited with status True, code 0x00
2018-11-15 15:46:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   515744   8 58437 56760017 A  ERROR'
2018-11-15 15:46:00 [DEBUG   ] Got command DRX from MCS: ref #515745
2018-11-15 15:46:00 [INFO    ] sending drx command to lwa16
2018-11-15 15:46:00 [DEBUG   ] run_process: at 2018-11-15 15:46:00 running ['/usr/local/bin/lwa16', '/lwa/software/drx 1 2 49800000.0 7 9 0']
2018-11-15 15:46:00 [DEBUG   ] drx = exited with status True, code 0x00
2018-11-15 15:46:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   515745   8 58437 56760021 A  ERROR'
2018-11-15 15:46:00 [DEBUG   ] Got command DRX from MCS: ref #515746
2018-11-15 15:46:00 [INFO    ] sending drx command to lwa34
2018-11-15 15:46:00 [DEBUG   ] run_process: at 2018-11-15 15:46:00 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 2 79200000.0 7 9 0']
2018-11-15 15:46:00 [DEBUG   ] drx = exited with status True, code 0x00
2018-11-15 15:46:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   515746   8 58437 56760025 A  ERROR'
2018-11-15 15:46:00 [DEBUG   ] Got command BAM from MCS: ref #515748
2018-11-15 15:46:00 [INFO    ] Finished processing BAM request
2018-11-15 15:46:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:46:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515748   8 58437 56760029 A  ERROR'
2018-11-15 15:46:00 [DEBUG   ] Got command BAM from MCS: ref #515747
2018-11-15 15:46:00 [INFO    ] Finished processing BAM request
2018-11-15 15:46:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:46:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515747   8 58437 56760033 A  ERROR'
2018-11-15 15:46:00 [INFO    ] Finished starting DRX
2018-11-15 15:46:00 [INFO    ] Finished starting DRX
2018-11-15 15:46:00 [INFO    ] Finished starting DRX
2018-11-15 15:46:00 [INFO    ] Finished starting DRX
2018-11-15 15:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 15:46:00 [DEBUG   ] spawn_process: at 2018-11-15 15:46:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 15:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 15:46:00 [DEBUG   ] spawn_process: at 2018-11-15 15:46:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 15:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 15:46:00 [DEBUG   ] spawn_process: at 2018-11-15 15:46:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 15:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 15:46:00 [DEBUG   ] spawn_process: at 2018-11-15 15:46:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 15:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 15:46:00 [DEBUG   ] spawn_process: at 2018-11-15 15:46:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 15:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 15:46:00 [DEBUG   ] spawn_process: at 2018-11-15 15:46:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 15:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 15:46:00 [DEBUG   ] spawn_process: at 2018-11-15 15:46:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 15:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 15:46:00 [DEBUG   ] spawn_process: at 2018-11-15 15:46:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 15:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 15:46:00 [DEBUG   ] spawn_process: at 2018-11-15 15:46:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 15:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 15:46:00 [DEBUG   ] spawn_process: at 2018-11-15 15:46:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 15:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 15:46:00 [DEBUG   ] spawn_process: at 2018-11-15 15:46:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 15:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 15:46:00 [DEBUG   ] spawn_process: at 2018-11-15 15:46:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 15:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 15:46:00 [DEBUG   ] spawn_process: at 2018-11-15 15:46:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 15:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 15:46:00 [DEBUG   ] spawn_process: at 2018-11-15 15:46:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 15:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 15:46:00 [DEBUG   ] spawn_process: at 2018-11-15 15:46:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 15:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 15:46:00 [DEBUG   ] spawn_process: at 2018-11-15 15:46:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 15:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 15:46:00 [DEBUG   ] spawn_process: at 2018-11-15 15:46:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 15:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 15:46:00 [DEBUG   ] spawn_process: at 2018-11-15 15:46:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 15:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 15:46:00 [DEBUG   ] spawn_process: at 2018-11-15 15:46:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 15:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 15:46:00 [DEBUG   ] spawn_process: at 2018-11-15 15:46:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 15:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 15:46:00 [DEBUG   ] spawn_process: at 2018-11-15 15:46:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 15:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 15:46:00 [DEBUG   ] spawn_process: at 2018-11-15 15:46:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 15:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 15:46:00 [DEBUG   ] spawn_process: at 2018-11-15 15:46:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 15:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 15:46:00 [DEBUG   ] spawn_process: at 2018-11-15 15:46:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 15:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 15:46:00 [DEBUG   ] spawn_process: at 2018-11-15 15:46:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 15:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 15:46:00 [DEBUG   ] spawn_process: at 2018-11-15 15:46:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 15:46:13 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 15:46:26 [DEBUG   ] Got command BAM from MCS: ref #515751
2018-11-15 15:46:26 [INFO    ] Finished processing BAM request
2018-11-15 15:46:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:46:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515751   8 58437 56786025 A  ERROR'
2018-11-15 15:46:26 [DEBUG   ] Got command BAM from MCS: ref #515752
2018-11-15 15:46:26 [INFO    ] Finished processing BAM request
2018-11-15 15:46:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:46:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515752   8 58437 56786029 A  ERROR'
2018-11-15 15:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 15:46:26 [DEBUG   ] spawn_process: at 2018-11-15 15:46:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 15:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 15:46:26 [DEBUG   ] spawn_process: at 2018-11-15 15:46:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 15:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 15:46:26 [DEBUG   ] spawn_process: at 2018-11-15 15:46:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 15:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 15:46:26 [DEBUG   ] spawn_process: at 2018-11-15 15:46:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 15:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 15:46:26 [DEBUG   ] spawn_process: at 2018-11-15 15:46:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 15:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 15:46:26 [DEBUG   ] spawn_process: at 2018-11-15 15:46:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 15:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 15:46:26 [DEBUG   ] spawn_process: at 2018-11-15 15:46:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 15:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 15:46:26 [DEBUG   ] spawn_process: at 2018-11-15 15:46:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 15:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 15:46:26 [DEBUG   ] spawn_process: at 2018-11-15 15:46:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 15:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 15:46:26 [DEBUG   ] spawn_process: at 2018-11-15 15:46:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 15:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 15:46:26 [DEBUG   ] spawn_process: at 2018-11-15 15:46:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 15:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 15:46:26 [DEBUG   ] spawn_process: at 2018-11-15 15:46:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 15:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 15:46:26 [DEBUG   ] spawn_process: at 2018-11-15 15:46:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 15:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 15:46:26 [DEBUG   ] spawn_process: at 2018-11-15 15:46:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 15:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 15:46:26 [DEBUG   ] spawn_process: at 2018-11-15 15:46:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 15:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 15:46:26 [DEBUG   ] spawn_process: at 2018-11-15 15:46:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 15:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 15:46:26 [DEBUG   ] spawn_process: at 2018-11-15 15:46:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 15:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 15:46:26 [DEBUG   ] spawn_process: at 2018-11-15 15:46:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 15:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 15:46:26 [DEBUG   ] spawn_process: at 2018-11-15 15:46:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 15:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 15:46:26 [DEBUG   ] spawn_process: at 2018-11-15 15:46:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 15:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 15:46:26 [DEBUG   ] spawn_process: at 2018-11-15 15:46:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 15:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 15:46:26 [DEBUG   ] spawn_process: at 2018-11-15 15:46:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 15:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 15:46:26 [DEBUG   ] spawn_process: at 2018-11-15 15:46:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 15:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 15:46:26 [DEBUG   ] spawn_process: at 2018-11-15 15:46:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 15:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 15:46:26 [DEBUG   ] spawn_process: at 2018-11-15 15:46:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 15:46:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 15:46:26 [DEBUG   ] spawn_process: at 2018-11-15 15:46:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 15:46:33 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-15 15:46:52 [DEBUG   ] Got command BAM from MCS: ref #515754
2018-11-15 15:46:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:46:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515754   8 58437 56812033 A  ERROR'
2018-11-15 15:46:52 [DEBUG   ] Got command BAM from MCS: ref #515753
2018-11-15 15:46:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:46:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515753   8 58437 56812037 A  ERROR'
2018-11-15 15:46:52 [INFO    ] Finished processing BAM request
2018-11-15 15:46:52 [INFO    ] Finished processing BAM request
2018-11-15 15:46:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 15:46:52 [DEBUG   ] spawn_process: at 2018-11-15 15:46:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 15:46:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 15:46:52 [DEBUG   ] spawn_process: at 2018-11-15 15:46:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 15:46:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 15:46:52 [DEBUG   ] spawn_process: at 2018-11-15 15:46:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 15:46:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 15:46:52 [DEBUG   ] spawn_process: at 2018-11-15 15:46:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 15:46:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 15:46:52 [DEBUG   ] spawn_process: at 2018-11-15 15:46:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 15:46:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 15:46:52 [DEBUG   ] spawn_process: at 2018-11-15 15:46:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 15:46:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 15:46:52 [DEBUG   ] spawn_process: at 2018-11-15 15:46:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 15:46:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 15:46:52 [DEBUG   ] spawn_process: at 2018-11-15 15:46:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 15:46:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 15:46:52 [DEBUG   ] spawn_process: at 2018-11-15 15:46:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 15:46:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 15:46:52 [DEBUG   ] spawn_process: at 2018-11-15 15:46:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 15:46:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 15:46:52 [DEBUG   ] spawn_process: at 2018-11-15 15:46:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 15:46:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 15:46:52 [DEBUG   ] spawn_process: at 2018-11-15 15:46:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 15:46:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 15:46:52 [DEBUG   ] spawn_process: at 2018-11-15 15:46:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 15:46:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 15:46:52 [DEBUG   ] spawn_process: at 2018-11-15 15:46:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 15:46:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 15:46:52 [DEBUG   ] spawn_process: at 2018-11-15 15:46:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 15:46:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 15:46:52 [DEBUG   ] spawn_process: at 2018-11-15 15:46:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 15:46:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 15:46:52 [DEBUG   ] spawn_process: at 2018-11-15 15:46:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 15:46:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 15:46:52 [DEBUG   ] spawn_process: at 2018-11-15 15:46:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 15:46:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 15:46:52 [DEBUG   ] spawn_process: at 2018-11-15 15:46:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 15:46:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 15:46:52 [DEBUG   ] spawn_process: at 2018-11-15 15:46:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 15:46:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 15:46:52 [DEBUG   ] spawn_process: at 2018-11-15 15:46:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 15:46:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 15:46:52 [DEBUG   ] spawn_process: at 2018-11-15 15:46:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 15:46:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 15:46:52 [DEBUG   ] spawn_process: at 2018-11-15 15:46:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 15:46:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 15:46:52 [DEBUG   ] spawn_process: at 2018-11-15 15:46:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 15:46:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 15:46:52 [DEBUG   ] spawn_process: at 2018-11-15 15:46:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 15:46:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 15:46:52 [DEBUG   ] spawn_process: at 2018-11-15 15:46:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 15:46:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 15:46:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:46:56 [WARNING ] (13, 1, 'bot')
2018-11-15 15:46:56 [WARNING ] (13, 1, 'bot')
2018-11-15 15:46:56 [WARNING ] (13, 1, 'bot')
2018-11-15 15:46:56 [WARNING ] (13, 1, 'bot')
2018-11-15 15:46:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:46:56 [DEBUG   ] Finished updating board flags in 1.384 seconds
2018-11-15 15:47:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 15:47:18 [DEBUG   ] Got command BAM from MCS: ref #515756
2018-11-15 15:47:18 [INFO    ] Finished processing BAM request
2018-11-15 15:47:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:47:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515756   8 58437 56838029 A  ERROR'
2018-11-15 15:47:18 [DEBUG   ] Got command BAM from MCS: ref #515755
2018-11-15 15:47:18 [INFO    ] Finished processing BAM request
2018-11-15 15:47:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:47:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515755   8 58437 56838033 A  ERROR'
2018-11-15 15:47:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 15:47:18 [DEBUG   ] spawn_process: at 2018-11-15 15:47:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 15:47:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 15:47:18 [DEBUG   ] spawn_process: at 2018-11-15 15:47:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 15:47:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 15:47:18 [DEBUG   ] spawn_process: at 2018-11-15 15:47:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 15:47:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 15:47:18 [DEBUG   ] spawn_process: at 2018-11-15 15:47:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 15:47:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 15:47:18 [DEBUG   ] spawn_process: at 2018-11-15 15:47:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 15:47:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 15:47:18 [DEBUG   ] spawn_process: at 2018-11-15 15:47:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 15:47:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 15:47:18 [DEBUG   ] spawn_process: at 2018-11-15 15:47:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 15:47:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 15:47:18 [DEBUG   ] spawn_process: at 2018-11-15 15:47:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 15:47:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 15:47:18 [DEBUG   ] spawn_process: at 2018-11-15 15:47:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 15:47:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 15:47:18 [DEBUG   ] spawn_process: at 2018-11-15 15:47:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 15:47:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 15:47:18 [DEBUG   ] spawn_process: at 2018-11-15 15:47:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 15:47:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 15:47:18 [DEBUG   ] spawn_process: at 2018-11-15 15:47:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 15:47:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 15:47:18 [DEBUG   ] spawn_process: at 2018-11-15 15:47:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 15:47:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 15:47:18 [DEBUG   ] spawn_process: at 2018-11-15 15:47:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 15:47:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 15:47:18 [DEBUG   ] spawn_process: at 2018-11-15 15:47:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 15:47:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 15:47:18 [DEBUG   ] spawn_process: at 2018-11-15 15:47:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 15:47:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 15:47:18 [DEBUG   ] spawn_process: at 2018-11-15 15:47:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 15:47:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 15:47:18 [DEBUG   ] spawn_process: at 2018-11-15 15:47:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 15:47:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 15:47:18 [DEBUG   ] spawn_process: at 2018-11-15 15:47:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 15:47:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 15:47:18 [DEBUG   ] spawn_process: at 2018-11-15 15:47:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 15:47:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 15:47:18 [DEBUG   ] spawn_process: at 2018-11-15 15:47:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 15:47:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 15:47:18 [DEBUG   ] spawn_process: at 2018-11-15 15:47:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 15:47:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 15:47:18 [DEBUG   ] spawn_process: at 2018-11-15 15:47:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 15:47:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 15:47:18 [DEBUG   ] spawn_process: at 2018-11-15 15:47:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 15:47:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 15:47:18 [DEBUG   ] spawn_process: at 2018-11-15 15:47:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 15:47:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 15:47:18 [DEBUG   ] spawn_process: at 2018-11-15 15:47:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 15:47:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 15:47:44 [DEBUG   ] Got command BAM from MCS: ref #515761
2018-11-15 15:47:44 [INFO    ] Finished processing BAM request
2018-11-15 15:47:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:47:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515761   8 58437 56864029 A  ERROR'
2018-11-15 15:47:44 [DEBUG   ] Got command BAM from MCS: ref #515762
2018-11-15 15:47:44 [INFO    ] Finished processing BAM request
2018-11-15 15:47:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:47:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515762   8 58437 56864033 A  ERROR'
2018-11-15 15:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 15:47:44 [DEBUG   ] spawn_process: at 2018-11-15 15:47:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 15:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 15:47:44 [DEBUG   ] spawn_process: at 2018-11-15 15:47:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 15:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 15:47:44 [DEBUG   ] spawn_process: at 2018-11-15 15:47:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 15:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 15:47:44 [DEBUG   ] spawn_process: at 2018-11-15 15:47:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 15:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 15:47:44 [DEBUG   ] spawn_process: at 2018-11-15 15:47:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 15:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 15:47:44 [DEBUG   ] spawn_process: at 2018-11-15 15:47:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 15:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 15:47:44 [DEBUG   ] spawn_process: at 2018-11-15 15:47:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 15:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 15:47:44 [DEBUG   ] spawn_process: at 2018-11-15 15:47:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 15:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 15:47:44 [DEBUG   ] spawn_process: at 2018-11-15 15:47:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 15:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 15:47:44 [DEBUG   ] spawn_process: at 2018-11-15 15:47:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 15:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 15:47:44 [DEBUG   ] spawn_process: at 2018-11-15 15:47:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 15:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 15:47:44 [DEBUG   ] spawn_process: at 2018-11-15 15:47:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 15:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 15:47:44 [DEBUG   ] spawn_process: at 2018-11-15 15:47:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 15:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 15:47:44 [DEBUG   ] spawn_process: at 2018-11-15 15:47:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 15:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 15:47:44 [DEBUG   ] spawn_process: at 2018-11-15 15:47:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 15:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 15:47:44 [DEBUG   ] spawn_process: at 2018-11-15 15:47:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 15:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 15:47:44 [DEBUG   ] spawn_process: at 2018-11-15 15:47:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 15:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 15:47:44 [DEBUG   ] spawn_process: at 2018-11-15 15:47:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 15:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 15:47:44 [DEBUG   ] spawn_process: at 2018-11-15 15:47:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 15:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 15:47:44 [DEBUG   ] spawn_process: at 2018-11-15 15:47:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 15:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 15:47:44 [DEBUG   ] spawn_process: at 2018-11-15 15:47:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 15:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 15:47:44 [DEBUG   ] spawn_process: at 2018-11-15 15:47:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 15:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 15:47:44 [DEBUG   ] spawn_process: at 2018-11-15 15:47:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 15:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 15:47:44 [DEBUG   ] spawn_process: at 2018-11-15 15:47:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 15:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 15:47:44 [DEBUG   ] spawn_process: at 2018-11-15 15:47:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 15:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 15:47:44 [DEBUG   ] spawn_process: at 2018-11-15 15:47:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 15:47:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 15:47:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 15:47:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 15:47:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:47:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 15:47:56 [WARNING ] (13, 1, 'bot')
2018-11-15 15:47:56 [WARNING ] (13, 1, 'bot')
2018-11-15 15:47:56 [WARNING ] (13, 1, 'bot')
2018-11-15 15:47:56 [WARNING ] (13, 1, 'bot')
2018-11-15 15:47:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:47:56 [DEBUG   ] Finished updating board flags in 1.199 seconds
2018-11-15 15:48:10 [DEBUG   ] Got command BAM from MCS: ref #515764
2018-11-15 15:48:10 [INFO    ] Finished processing BAM request
2018-11-15 15:48:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:48:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515764   8 58437 56890029 A  ERROR'
2018-11-15 15:48:10 [DEBUG   ] Got command BAM from MCS: ref #515763
2018-11-15 15:48:10 [INFO    ] Finished processing BAM request
2018-11-15 15:48:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:48:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515763   8 58437 56890033 A  ERROR'
2018-11-15 15:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 15:48:10 [DEBUG   ] spawn_process: at 2018-11-15 15:48:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 15:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 15:48:10 [DEBUG   ] spawn_process: at 2018-11-15 15:48:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 15:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 15:48:10 [DEBUG   ] spawn_process: at 2018-11-15 15:48:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 15:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 15:48:10 [DEBUG   ] spawn_process: at 2018-11-15 15:48:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 15:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 15:48:10 [DEBUG   ] spawn_process: at 2018-11-15 15:48:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 15:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 15:48:10 [DEBUG   ] spawn_process: at 2018-11-15 15:48:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 15:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 15:48:10 [DEBUG   ] spawn_process: at 2018-11-15 15:48:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 15:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 15:48:10 [DEBUG   ] spawn_process: at 2018-11-15 15:48:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 15:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 15:48:10 [DEBUG   ] spawn_process: at 2018-11-15 15:48:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 15:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 15:48:10 [DEBUG   ] spawn_process: at 2018-11-15 15:48:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 15:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 15:48:10 [DEBUG   ] spawn_process: at 2018-11-15 15:48:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 15:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 15:48:10 [DEBUG   ] spawn_process: at 2018-11-15 15:48:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 15:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 15:48:10 [DEBUG   ] spawn_process: at 2018-11-15 15:48:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 15:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 15:48:10 [DEBUG   ] spawn_process: at 2018-11-15 15:48:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 15:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 15:48:10 [DEBUG   ] spawn_process: at 2018-11-15 15:48:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 15:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 15:48:10 [DEBUG   ] spawn_process: at 2018-11-15 15:48:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 15:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 15:48:10 [DEBUG   ] spawn_process: at 2018-11-15 15:48:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 15:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 15:48:10 [DEBUG   ] spawn_process: at 2018-11-15 15:48:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 15:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 15:48:10 [DEBUG   ] spawn_process: at 2018-11-15 15:48:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 15:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 15:48:10 [DEBUG   ] spawn_process: at 2018-11-15 15:48:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 15:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 15:48:10 [DEBUG   ] spawn_process: at 2018-11-15 15:48:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 15:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 15:48:10 [DEBUG   ] spawn_process: at 2018-11-15 15:48:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 15:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 15:48:10 [DEBUG   ] spawn_process: at 2018-11-15 15:48:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 15:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 15:48:10 [DEBUG   ] spawn_process: at 2018-11-15 15:48:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 15:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 15:48:10 [DEBUG   ] spawn_process: at 2018-11-15 15:48:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 15:48:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 15:48:10 [DEBUG   ] spawn_process: at 2018-11-15 15:48:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 15:48:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 15:48:18 [DEBUG   ] Got command RPT from MCS: ref #515767
2018-11-15 15:48:18 [DEBUG   ] summary = ERROR
2018-11-15 15:48:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515767  13 58437 56898813 A  ERRORERROR'
2018-11-15 15:48:19 [DEBUG   ] Got command RPT from MCS: ref #515768
2018-11-15 15:48:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 15:48:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515768  77 58437 56899017 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 15:48:19 [DEBUG   ] Got command RPT from MCS: ref #515769
2018-11-15 15:48:19 [DEBUG   ] summary = ERROR
2018-11-15 15:48:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515769  13 58437 56899221 A  ERRORERROR'
2018-11-15 15:48:19 [DEBUG   ] Got command RPT from MCS: ref #515771
2018-11-15 15:48:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 15:48:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515771  77 58437 56899425 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 15:48:19 [DEBUG   ] Got command RPT from MCS: ref #515772
2018-11-15 15:48:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 15:48:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515772  12 58437 56899638 A  ERRORBŸff'
2018-11-15 15:48:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 15:48:36 [DEBUG   ] Got command BAM from MCS: ref #515778
2018-11-15 15:48:36 [INFO    ] Finished processing BAM request
2018-11-15 15:48:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:48:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515778   8 58437 56916025 A  ERROR'
2018-11-15 15:48:36 [DEBUG   ] Got command BAM from MCS: ref #515777
2018-11-15 15:48:36 [INFO    ] Finished processing BAM request
2018-11-15 15:48:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:48:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515777   8 58437 56916033 A  ERROR'
2018-11-15 15:48:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 15:48:36 [DEBUG   ] spawn_process: at 2018-11-15 15:48:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 15:48:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 15:48:36 [DEBUG   ] spawn_process: at 2018-11-15 15:48:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 15:48:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 15:48:36 [DEBUG   ] spawn_process: at 2018-11-15 15:48:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 15:48:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 15:48:36 [DEBUG   ] spawn_process: at 2018-11-15 15:48:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 15:48:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 15:48:36 [DEBUG   ] spawn_process: at 2018-11-15 15:48:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 15:48:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 15:48:36 [DEBUG   ] spawn_process: at 2018-11-15 15:48:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 15:48:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 15:48:36 [DEBUG   ] spawn_process: at 2018-11-15 15:48:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 15:48:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 15:48:36 [DEBUG   ] spawn_process: at 2018-11-15 15:48:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 15:48:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 15:48:36 [DEBUG   ] spawn_process: at 2018-11-15 15:48:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 15:48:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 15:48:36 [DEBUG   ] spawn_process: at 2018-11-15 15:48:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 15:48:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 15:48:36 [DEBUG   ] spawn_process: at 2018-11-15 15:48:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 15:48:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 15:48:36 [DEBUG   ] spawn_process: at 2018-11-15 15:48:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 15:48:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 15:48:36 [DEBUG   ] spawn_process: at 2018-11-15 15:48:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 15:48:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 15:48:36 [DEBUG   ] spawn_process: at 2018-11-15 15:48:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 15:48:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 15:48:36 [DEBUG   ] spawn_process: at 2018-11-15 15:48:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 15:48:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 15:48:36 [DEBUG   ] spawn_process: at 2018-11-15 15:48:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 15:48:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 15:48:36 [DEBUG   ] spawn_process: at 2018-11-15 15:48:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 15:48:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 15:48:36 [DEBUG   ] spawn_process: at 2018-11-15 15:48:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 15:48:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 15:48:36 [DEBUG   ] spawn_process: at 2018-11-15 15:48:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 15:48:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 15:48:36 [DEBUG   ] spawn_process: at 2018-11-15 15:48:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 15:48:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 15:48:36 [DEBUG   ] spawn_process: at 2018-11-15 15:48:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 15:48:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 15:48:36 [DEBUG   ] spawn_process: at 2018-11-15 15:48:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 15:48:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 15:48:36 [DEBUG   ] spawn_process: at 2018-11-15 15:48:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 15:48:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 15:48:36 [DEBUG   ] spawn_process: at 2018-11-15 15:48:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 15:48:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 15:48:36 [DEBUG   ] spawn_process: at 2018-11-15 15:48:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 15:48:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 15:48:36 [DEBUG   ] spawn_process: at 2018-11-15 15:48:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 15:48:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 15:48:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-11-15 15:48:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:48:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-15 15:48:56 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-15 15:48:56 [WARNING ] (13, 1, 'bot')
2018-11-15 15:48:56 [WARNING ] (13, 1, 'bot')
2018-11-15 15:48:56 [WARNING ] (13, 1, 'bot')
2018-11-15 15:48:56 [WARNING ] (13, 1, 'bot')
2018-11-15 15:48:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:48:56 [DEBUG   ] Finished updating board flags in 1.031 seconds
2018-11-15 15:49:02 [DEBUG   ] Got command BAM from MCS: ref #515780
2018-11-15 15:49:02 [INFO    ] Finished processing BAM request
2018-11-15 15:49:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:49:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515780   8 58437 56942033 A  ERROR'
2018-11-15 15:49:02 [DEBUG   ] Got command BAM from MCS: ref #515779
2018-11-15 15:49:02 [INFO    ] Finished processing BAM request
2018-11-15 15:49:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:49:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515779   8 58437 56942037 A  ERROR'
2018-11-15 15:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 15:49:02 [DEBUG   ] spawn_process: at 2018-11-15 15:49:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 15:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 15:49:02 [DEBUG   ] spawn_process: at 2018-11-15 15:49:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 15:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 15:49:02 [DEBUG   ] spawn_process: at 2018-11-15 15:49:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 15:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 15:49:02 [DEBUG   ] spawn_process: at 2018-11-15 15:49:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 15:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 15:49:02 [DEBUG   ] spawn_process: at 2018-11-15 15:49:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 15:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 15:49:02 [DEBUG   ] spawn_process: at 2018-11-15 15:49:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 15:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 15:49:02 [DEBUG   ] spawn_process: at 2018-11-15 15:49:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 15:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 15:49:02 [DEBUG   ] spawn_process: at 2018-11-15 15:49:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 15:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 15:49:02 [DEBUG   ] spawn_process: at 2018-11-15 15:49:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 15:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 15:49:02 [DEBUG   ] spawn_process: at 2018-11-15 15:49:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 15:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 15:49:02 [DEBUG   ] spawn_process: at 2018-11-15 15:49:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 15:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 15:49:02 [DEBUG   ] spawn_process: at 2018-11-15 15:49:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 15:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 15:49:02 [DEBUG   ] spawn_process: at 2018-11-15 15:49:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 15:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 15:49:02 [DEBUG   ] spawn_process: at 2018-11-15 15:49:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 15:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 15:49:02 [DEBUG   ] spawn_process: at 2018-11-15 15:49:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 15:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 15:49:02 [DEBUG   ] spawn_process: at 2018-11-15 15:49:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 15:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 15:49:02 [DEBUG   ] spawn_process: at 2018-11-15 15:49:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 15:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 15:49:02 [DEBUG   ] spawn_process: at 2018-11-15 15:49:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 15:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 15:49:02 [DEBUG   ] spawn_process: at 2018-11-15 15:49:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 15:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 15:49:02 [DEBUG   ] spawn_process: at 2018-11-15 15:49:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 15:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 15:49:02 [DEBUG   ] spawn_process: at 2018-11-15 15:49:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 15:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 15:49:02 [DEBUG   ] spawn_process: at 2018-11-15 15:49:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 15:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 15:49:02 [DEBUG   ] spawn_process: at 2018-11-15 15:49:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 15:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 15:49:02 [DEBUG   ] spawn_process: at 2018-11-15 15:49:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 15:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 15:49:02 [DEBUG   ] spawn_process: at 2018-11-15 15:49:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 15:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 15:49:02 [DEBUG   ] spawn_process: at 2018-11-15 15:49:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 15:49:14 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 15:49:28 [DEBUG   ] Got command BAM from MCS: ref #515781
2018-11-15 15:49:28 [INFO    ] Finished processing BAM request
2018-11-15 15:49:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:49:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515781   8 58437 56968025 A  ERROR'
2018-11-15 15:49:28 [DEBUG   ] Got command BAM from MCS: ref #515782
2018-11-15 15:49:28 [INFO    ] Finished processing BAM request
2018-11-15 15:49:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:49:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515782   8 58437 56968029 A  ERROR'
2018-11-15 15:49:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 15:49:28 [DEBUG   ] spawn_process: at 2018-11-15 15:49:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 15:49:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 15:49:28 [DEBUG   ] spawn_process: at 2018-11-15 15:49:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 15:49:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 15:49:28 [DEBUG   ] spawn_process: at 2018-11-15 15:49:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 15:49:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 15:49:28 [DEBUG   ] spawn_process: at 2018-11-15 15:49:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 15:49:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 15:49:28 [DEBUG   ] spawn_process: at 2018-11-15 15:49:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 15:49:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 15:49:28 [DEBUG   ] spawn_process: at 2018-11-15 15:49:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 15:49:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 15:49:28 [DEBUG   ] spawn_process: at 2018-11-15 15:49:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 15:49:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 15:49:28 [DEBUG   ] spawn_process: at 2018-11-15 15:49:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 15:49:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 15:49:28 [DEBUG   ] spawn_process: at 2018-11-15 15:49:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 15:49:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 15:49:28 [DEBUG   ] spawn_process: at 2018-11-15 15:49:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 15:49:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 15:49:28 [DEBUG   ] spawn_process: at 2018-11-15 15:49:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 15:49:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 15:49:28 [DEBUG   ] spawn_process: at 2018-11-15 15:49:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 15:49:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 15:49:28 [DEBUG   ] spawn_process: at 2018-11-15 15:49:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 15:49:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 15:49:28 [DEBUG   ] spawn_process: at 2018-11-15 15:49:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 15:49:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 15:49:28 [DEBUG   ] spawn_process: at 2018-11-15 15:49:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 15:49:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 15:49:28 [DEBUG   ] spawn_process: at 2018-11-15 15:49:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 15:49:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 15:49:28 [DEBUG   ] spawn_process: at 2018-11-15 15:49:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 15:49:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 15:49:28 [DEBUG   ] spawn_process: at 2018-11-15 15:49:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 15:49:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 15:49:28 [DEBUG   ] spawn_process: at 2018-11-15 15:49:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 15:49:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 15:49:28 [DEBUG   ] spawn_process: at 2018-11-15 15:49:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 15:49:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 15:49:28 [DEBUG   ] spawn_process: at 2018-11-15 15:49:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 15:49:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 15:49:28 [DEBUG   ] spawn_process: at 2018-11-15 15:49:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 15:49:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 15:49:28 [DEBUG   ] spawn_process: at 2018-11-15 15:49:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 15:49:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 15:49:28 [DEBUG   ] spawn_process: at 2018-11-15 15:49:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 15:49:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 15:49:28 [DEBUG   ] spawn_process: at 2018-11-15 15:49:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 15:49:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 15:49:28 [DEBUG   ] spawn_process: at 2018-11-15 15:49:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 15:49:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 15:49:54 [DEBUG   ] Got command BAM from MCS: ref #515783
2018-11-15 15:49:54 [INFO    ] Finished processing BAM request
2018-11-15 15:49:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:49:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515783   8 58437 56994029 A  ERROR'
2018-11-15 15:49:54 [DEBUG   ] Got command BAM from MCS: ref #515784
2018-11-15 15:49:54 [INFO    ] Finished processing BAM request
2018-11-15 15:49:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:49:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515784   8 58437 56994033 A  ERROR'
2018-11-15 15:49:54 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2018-11-15 15:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 15:49:54 [DEBUG   ] spawn_process: at 2018-11-15 15:49:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 15:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 15:49:54 [DEBUG   ] spawn_process: at 2018-11-15 15:49:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 15:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 15:49:54 [DEBUG   ] spawn_process: at 2018-11-15 15:49:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 15:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 15:49:54 [DEBUG   ] spawn_process: at 2018-11-15 15:49:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 15:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 15:49:54 [DEBUG   ] spawn_process: at 2018-11-15 15:49:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 15:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 15:49:54 [DEBUG   ] spawn_process: at 2018-11-15 15:49:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 15:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 15:49:54 [DEBUG   ] spawn_process: at 2018-11-15 15:49:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 15:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 15:49:54 [DEBUG   ] spawn_process: at 2018-11-15 15:49:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 15:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 15:49:54 [DEBUG   ] spawn_process: at 2018-11-15 15:49:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 15:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 15:49:54 [DEBUG   ] spawn_process: at 2018-11-15 15:49:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 15:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 15:49:54 [DEBUG   ] spawn_process: at 2018-11-15 15:49:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 15:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 15:49:54 [DEBUG   ] spawn_process: at 2018-11-15 15:49:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 15:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 15:49:54 [DEBUG   ] spawn_process: at 2018-11-15 15:49:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 15:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 15:49:54 [DEBUG   ] spawn_process: at 2018-11-15 15:49:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 15:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 15:49:54 [DEBUG   ] spawn_process: at 2018-11-15 15:49:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 15:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 15:49:54 [DEBUG   ] spawn_process: at 2018-11-15 15:49:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 15:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 15:49:54 [DEBUG   ] spawn_process: at 2018-11-15 15:49:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 15:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 15:49:54 [DEBUG   ] spawn_process: at 2018-11-15 15:49:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 15:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 15:49:54 [DEBUG   ] spawn_process: at 2018-11-15 15:49:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 15:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 15:49:54 [DEBUG   ] spawn_process: at 2018-11-15 15:49:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 15:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 15:49:54 [DEBUG   ] spawn_process: at 2018-11-15 15:49:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 15:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 15:49:54 [DEBUG   ] spawn_process: at 2018-11-15 15:49:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 15:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 15:49:54 [DEBUG   ] spawn_process: at 2018-11-15 15:49:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 15:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 15:49:54 [DEBUG   ] spawn_process: at 2018-11-15 15:49:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 15:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 15:49:54 [DEBUG   ] spawn_process: at 2018-11-15 15:49:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 15:49:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 15:49:54 [DEBUG   ] spawn_process: at 2018-11-15 15:49:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 15:49:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 15:49:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-15 15:49:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 15:49:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2018-11-15 15:49:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:49:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 15:49:57 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-15 15:49:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 15:49:57 [WARNING ] (13, 1, 'bot')
2018-11-15 15:49:57 [WARNING ] (13, 1, 'bot')
2018-11-15 15:49:57 [WARNING ] (13, 1, 'bot')
2018-11-15 15:49:57 [WARNING ] (13, 1, 'bot')
2018-11-15 15:49:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:49:57 [DEBUG   ] Finished updating board flags in 1.998 seconds
2018-11-15 15:50:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 15:50:20 [DEBUG   ] Got command BAM from MCS: ref #515785
2018-11-15 15:50:20 [INFO    ] Finished processing BAM request
2018-11-15 15:50:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:50:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515785   8 58437 57020025 A  ERROR'
2018-11-15 15:50:20 [DEBUG   ] Got command BAM from MCS: ref #515786
2018-11-15 15:50:20 [INFO    ] Finished processing BAM request
2018-11-15 15:50:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:50:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515786   8 58437 57020029 A  ERROR'
2018-11-15 15:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 15:50:20 [DEBUG   ] spawn_process: at 2018-11-15 15:50:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 15:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 15:50:20 [DEBUG   ] spawn_process: at 2018-11-15 15:50:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 15:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 15:50:20 [DEBUG   ] spawn_process: at 2018-11-15 15:50:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 15:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 15:50:20 [DEBUG   ] spawn_process: at 2018-11-15 15:50:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 15:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 15:50:20 [DEBUG   ] spawn_process: at 2018-11-15 15:50:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 15:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 15:50:20 [DEBUG   ] spawn_process: at 2018-11-15 15:50:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 15:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 15:50:20 [DEBUG   ] spawn_process: at 2018-11-15 15:50:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 15:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 15:50:20 [DEBUG   ] spawn_process: at 2018-11-15 15:50:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 15:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 15:50:20 [DEBUG   ] spawn_process: at 2018-11-15 15:50:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 15:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 15:50:20 [DEBUG   ] spawn_process: at 2018-11-15 15:50:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 15:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 15:50:20 [DEBUG   ] spawn_process: at 2018-11-15 15:50:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 15:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 15:50:20 [DEBUG   ] spawn_process: at 2018-11-15 15:50:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 15:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 15:50:20 [DEBUG   ] spawn_process: at 2018-11-15 15:50:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 15:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 15:50:20 [DEBUG   ] spawn_process: at 2018-11-15 15:50:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 15:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 15:50:20 [DEBUG   ] spawn_process: at 2018-11-15 15:50:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 15:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 15:50:20 [DEBUG   ] spawn_process: at 2018-11-15 15:50:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 15:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 15:50:20 [DEBUG   ] spawn_process: at 2018-11-15 15:50:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 15:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 15:50:20 [DEBUG   ] spawn_process: at 2018-11-15 15:50:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 15:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 15:50:20 [DEBUG   ] spawn_process: at 2018-11-15 15:50:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 15:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 15:50:20 [DEBUG   ] spawn_process: at 2018-11-15 15:50:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 15:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 15:50:20 [DEBUG   ] spawn_process: at 2018-11-15 15:50:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 15:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 15:50:20 [DEBUG   ] spawn_process: at 2018-11-15 15:50:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 15:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 15:50:20 [DEBUG   ] spawn_process: at 2018-11-15 15:50:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 15:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 15:50:20 [DEBUG   ] spawn_process: at 2018-11-15 15:50:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 15:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 15:50:20 [DEBUG   ] spawn_process: at 2018-11-15 15:50:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 15:50:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 15:50:20 [DEBUG   ] spawn_process: at 2018-11-15 15:50:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 15:50:34 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2018-11-15 15:50:45 [DEBUG   ] Got command BAM from MCS: ref #515791
2018-11-15 15:50:45 [INFO    ] Finished processing BAM request
2018-11-15 15:50:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:50:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515791   8 58437 57045033 A  ERROR'
2018-11-15 15:50:45 [DEBUG   ] Got command BAM from MCS: ref #515792
2018-11-15 15:50:45 [INFO    ] Finished processing BAM request
2018-11-15 15:50:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:50:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515792   8 58437 57045037 A  ERROR'
2018-11-15 15:50:45 [DEBUG   ] Got command RPT from MCS: ref #515793
2018-11-15 15:50:45 [DEBUG   ] summary = ERROR
2018-11-15 15:50:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515793  13 58437 57045121 A  ERRORERROR'
2018-11-15 15:50:45 [DEBUG   ] Got command RPT from MCS: ref #515794
2018-11-15 15:50:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 15:50:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515794  77 58437 57045122 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 15:50:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 15:50:45 [DEBUG   ] spawn_process: at 2018-11-15 15:50:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 15:50:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 15:50:45 [DEBUG   ] spawn_process: at 2018-11-15 15:50:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 15:50:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 15:50:45 [DEBUG   ] spawn_process: at 2018-11-15 15:50:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 15:50:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 15:50:45 [DEBUG   ] spawn_process: at 2018-11-15 15:50:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 15:50:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 15:50:45 [DEBUG   ] spawn_process: at 2018-11-15 15:50:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 15:50:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 15:50:45 [DEBUG   ] spawn_process: at 2018-11-15 15:50:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 15:50:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 15:50:45 [DEBUG   ] spawn_process: at 2018-11-15 15:50:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 15:50:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 15:50:45 [DEBUG   ] spawn_process: at 2018-11-15 15:50:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 15:50:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 15:50:45 [DEBUG   ] spawn_process: at 2018-11-15 15:50:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 15:50:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 15:50:45 [DEBUG   ] spawn_process: at 2018-11-15 15:50:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 15:50:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 15:50:45 [DEBUG   ] spawn_process: at 2018-11-15 15:50:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 15:50:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 15:50:45 [DEBUG   ] spawn_process: at 2018-11-15 15:50:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 15:50:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 15:50:45 [DEBUG   ] spawn_process: at 2018-11-15 15:50:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 15:50:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 15:50:45 [DEBUG   ] spawn_process: at 2018-11-15 15:50:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 15:50:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 15:50:45 [DEBUG   ] spawn_process: at 2018-11-15 15:50:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 15:50:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 15:50:45 [DEBUG   ] spawn_process: at 2018-11-15 15:50:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 15:50:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 15:50:45 [DEBUG   ] spawn_process: at 2018-11-15 15:50:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 15:50:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 15:50:45 [DEBUG   ] spawn_process: at 2018-11-15 15:50:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 15:50:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 15:50:45 [DEBUG   ] spawn_process: at 2018-11-15 15:50:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 15:50:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 15:50:45 [DEBUG   ] spawn_process: at 2018-11-15 15:50:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 15:50:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 15:50:45 [DEBUG   ] spawn_process: at 2018-11-15 15:50:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 15:50:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 15:50:45 [DEBUG   ] spawn_process: at 2018-11-15 15:50:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 15:50:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 15:50:45 [DEBUG   ] spawn_process: at 2018-11-15 15:50:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 15:50:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 15:50:45 [DEBUG   ] spawn_process: at 2018-11-15 15:50:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 15:50:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 15:50:45 [DEBUG   ] spawn_process: at 2018-11-15 15:50:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 15:50:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 15:50:45 [DEBUG   ] spawn_process: at 2018-11-15 15:50:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 15:50:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 15:50:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2018-11-15 15:50:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:50:56 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 15:50:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 15:50:56 [WARNING ] (13, 1, 'bot')
2018-11-15 15:50:56 [WARNING ] (13, 1, 'bot')
2018-11-15 15:50:56 [WARNING ] (13, 1, 'bot')
2018-11-15 15:50:56 [WARNING ] (13, 1, 'bot')
2018-11-15 15:50:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:50:56 [DEBUG   ] Finished updating board flags in 1.255 seconds
2018-11-15 15:51:10 [DEBUG   ] Got command BAM from MCS: ref #515810
2018-11-15 15:51:10 [INFO    ] Finished processing BAM request
2018-11-15 15:51:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:51:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515810   8 58437 57070025 A  ERROR'
2018-11-15 15:51:10 [DEBUG   ] Got command BAM from MCS: ref #515811
2018-11-15 15:51:10 [INFO    ] Finished processing BAM request
2018-11-15 15:51:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:51:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515811   8 58437 57070029 A  ERROR'
2018-11-15 15:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 15:51:10 [DEBUG   ] spawn_process: at 2018-11-15 15:51:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 15:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 15:51:10 [DEBUG   ] spawn_process: at 2018-11-15 15:51:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 15:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 15:51:10 [DEBUG   ] spawn_process: at 2018-11-15 15:51:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 15:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 15:51:10 [DEBUG   ] spawn_process: at 2018-11-15 15:51:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 15:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 15:51:10 [DEBUG   ] spawn_process: at 2018-11-15 15:51:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 15:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 15:51:10 [DEBUG   ] spawn_process: at 2018-11-15 15:51:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 15:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 15:51:10 [DEBUG   ] spawn_process: at 2018-11-15 15:51:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 15:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 15:51:10 [DEBUG   ] spawn_process: at 2018-11-15 15:51:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 15:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 15:51:10 [DEBUG   ] spawn_process: at 2018-11-15 15:51:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 15:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 15:51:10 [DEBUG   ] spawn_process: at 2018-11-15 15:51:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 15:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 15:51:10 [DEBUG   ] spawn_process: at 2018-11-15 15:51:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 15:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 15:51:10 [DEBUG   ] spawn_process: at 2018-11-15 15:51:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 15:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 15:51:10 [DEBUG   ] spawn_process: at 2018-11-15 15:51:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 15:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 15:51:10 [DEBUG   ] spawn_process: at 2018-11-15 15:51:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 15:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 15:51:10 [DEBUG   ] spawn_process: at 2018-11-15 15:51:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 15:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 15:51:10 [DEBUG   ] spawn_process: at 2018-11-15 15:51:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 15:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 15:51:10 [DEBUG   ] spawn_process: at 2018-11-15 15:51:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 15:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 15:51:10 [DEBUG   ] spawn_process: at 2018-11-15 15:51:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 15:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 15:51:10 [DEBUG   ] spawn_process: at 2018-11-15 15:51:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 15:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 15:51:10 [DEBUG   ] spawn_process: at 2018-11-15 15:51:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 15:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 15:51:10 [DEBUG   ] spawn_process: at 2018-11-15 15:51:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 15:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 15:51:10 [DEBUG   ] spawn_process: at 2018-11-15 15:51:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 15:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 15:51:10 [DEBUG   ] spawn_process: at 2018-11-15 15:51:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 15:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 15:51:10 [DEBUG   ] spawn_process: at 2018-11-15 15:51:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 15:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 15:51:10 [DEBUG   ] spawn_process: at 2018-11-15 15:51:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 15:51:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 15:51:10 [DEBUG   ] spawn_process: at 2018-11-15 15:51:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 15:51:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 15:51:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 15:51:35 [DEBUG   ] Got command BAM from MCS: ref #515812
2018-11-15 15:51:35 [INFO    ] Finished processing BAM request
2018-11-15 15:51:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:51:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515812   8 58437 57095029 A  ERROR'
2018-11-15 15:51:35 [DEBUG   ] Got command BAM from MCS: ref #515813
2018-11-15 15:51:35 [INFO    ] Finished processing BAM request
2018-11-15 15:51:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:51:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515813   8 58437 57095033 A  ERROR'
2018-11-15 15:51:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 15:51:35 [DEBUG   ] spawn_process: at 2018-11-15 15:51:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 15:51:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 15:51:35 [DEBUG   ] spawn_process: at 2018-11-15 15:51:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 15:51:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 15:51:35 [DEBUG   ] spawn_process: at 2018-11-15 15:51:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 15:51:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 15:51:35 [DEBUG   ] spawn_process: at 2018-11-15 15:51:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 15:51:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 15:51:35 [DEBUG   ] spawn_process: at 2018-11-15 15:51:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 15:51:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 15:51:35 [DEBUG   ] spawn_process: at 2018-11-15 15:51:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 15:51:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 15:51:35 [DEBUG   ] spawn_process: at 2018-11-15 15:51:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 15:51:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 15:51:35 [DEBUG   ] spawn_process: at 2018-11-15 15:51:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 15:51:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 15:51:35 [DEBUG   ] spawn_process: at 2018-11-15 15:51:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 15:51:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 15:51:35 [DEBUG   ] spawn_process: at 2018-11-15 15:51:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 15:51:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 15:51:35 [DEBUG   ] spawn_process: at 2018-11-15 15:51:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 15:51:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 15:51:35 [DEBUG   ] spawn_process: at 2018-11-15 15:51:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 15:51:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 15:51:35 [DEBUG   ] spawn_process: at 2018-11-15 15:51:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 15:51:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 15:51:35 [DEBUG   ] spawn_process: at 2018-11-15 15:51:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 15:51:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 15:51:35 [DEBUG   ] spawn_process: at 2018-11-15 15:51:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 15:51:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 15:51:35 [DEBUG   ] spawn_process: at 2018-11-15 15:51:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 15:51:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 15:51:35 [DEBUG   ] spawn_process: at 2018-11-15 15:51:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 15:51:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 15:51:35 [DEBUG   ] spawn_process: at 2018-11-15 15:51:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 15:51:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 15:51:35 [DEBUG   ] spawn_process: at 2018-11-15 15:51:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 15:51:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 15:51:35 [DEBUG   ] spawn_process: at 2018-11-15 15:51:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 15:51:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 15:51:35 [DEBUG   ] spawn_process: at 2018-11-15 15:51:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 15:51:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 15:51:35 [DEBUG   ] spawn_process: at 2018-11-15 15:51:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 15:51:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 15:51:35 [DEBUG   ] spawn_process: at 2018-11-15 15:51:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 15:51:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 15:51:35 [DEBUG   ] spawn_process: at 2018-11-15 15:51:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 15:51:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 15:51:35 [DEBUG   ] spawn_process: at 2018-11-15 15:51:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 15:51:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 15:51:35 [DEBUG   ] spawn_process: at 2018-11-15 15:51:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 15:51:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 15:51:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:51:56 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 15:51:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 15:51:56 [WARNING ] (13, 1, 'bot')
2018-11-15 15:51:56 [WARNING ] (13, 1, 'bot')
2018-11-15 15:51:56 [WARNING ] (13, 1, 'bot')
2018-11-15 15:51:56 [WARNING ] (13, 1, 'bot')
2018-11-15 15:51:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:51:56 [DEBUG   ] Finished updating board flags in 1.188 seconds
2018-11-15 15:52:00 [DEBUG   ] Got command BAM from MCS: ref #515815
2018-11-15 15:52:00 [INFO    ] Finished processing BAM request
2018-11-15 15:52:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:52:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515815   8 58437 57120029 A  ERROR'
2018-11-15 15:52:00 [DEBUG   ] Got command BAM from MCS: ref #515814
2018-11-15 15:52:00 [INFO    ] Finished processing BAM request
2018-11-15 15:52:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:52:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515814   8 58437 57120033 A  ERROR'
2018-11-15 15:52:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 15:52:00 [DEBUG   ] spawn_process: at 2018-11-15 15:52:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 15:52:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 15:52:00 [DEBUG   ] spawn_process: at 2018-11-15 15:52:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 15:52:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 15:52:00 [DEBUG   ] spawn_process: at 2018-11-15 15:52:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 15:52:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 15:52:00 [DEBUG   ] spawn_process: at 2018-11-15 15:52:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 15:52:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 15:52:00 [DEBUG   ] spawn_process: at 2018-11-15 15:52:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 15:52:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 15:52:00 [DEBUG   ] spawn_process: at 2018-11-15 15:52:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 15:52:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 15:52:00 [DEBUG   ] spawn_process: at 2018-11-15 15:52:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 15:52:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 15:52:00 [DEBUG   ] spawn_process: at 2018-11-15 15:52:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 15:52:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 15:52:00 [DEBUG   ] spawn_process: at 2018-11-15 15:52:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 15:52:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 15:52:00 [DEBUG   ] spawn_process: at 2018-11-15 15:52:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 15:52:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 15:52:00 [DEBUG   ] spawn_process: at 2018-11-15 15:52:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 15:52:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 15:52:00 [DEBUG   ] spawn_process: at 2018-11-15 15:52:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 15:52:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 15:52:00 [DEBUG   ] spawn_process: at 2018-11-15 15:52:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 15:52:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 15:52:00 [DEBUG   ] spawn_process: at 2018-11-15 15:52:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 15:52:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 15:52:00 [DEBUG   ] spawn_process: at 2018-11-15 15:52:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 15:52:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 15:52:00 [DEBUG   ] spawn_process: at 2018-11-15 15:52:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 15:52:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 15:52:00 [DEBUG   ] spawn_process: at 2018-11-15 15:52:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 15:52:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 15:52:00 [DEBUG   ] spawn_process: at 2018-11-15 15:52:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 15:52:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 15:52:00 [DEBUG   ] spawn_process: at 2018-11-15 15:52:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 15:52:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 15:52:00 [DEBUG   ] spawn_process: at 2018-11-15 15:52:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 15:52:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 15:52:00 [DEBUG   ] spawn_process: at 2018-11-15 15:52:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 15:52:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 15:52:00 [DEBUG   ] spawn_process: at 2018-11-15 15:52:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 15:52:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 15:52:00 [DEBUG   ] spawn_process: at 2018-11-15 15:52:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 15:52:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 15:52:00 [DEBUG   ] spawn_process: at 2018-11-15 15:52:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 15:52:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 15:52:00 [DEBUG   ] spawn_process: at 2018-11-15 15:52:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 15:52:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 15:52:00 [DEBUG   ] spawn_process: at 2018-11-15 15:52:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 15:52:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 15:52:25 [DEBUG   ] Got command BAM from MCS: ref #515816
2018-11-15 15:52:25 [INFO    ] Finished processing BAM request
2018-11-15 15:52:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:52:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515816   8 58437 57145029 A  ERROR'
2018-11-15 15:52:25 [DEBUG   ] Got command BAM from MCS: ref #515817
2018-11-15 15:52:25 [INFO    ] Finished processing BAM request
2018-11-15 15:52:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:52:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515817   8 58437 57145033 A  ERROR'
2018-11-15 15:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 15:52:25 [DEBUG   ] spawn_process: at 2018-11-15 15:52:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 15:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 15:52:25 [DEBUG   ] spawn_process: at 2018-11-15 15:52:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 15:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 15:52:25 [DEBUG   ] spawn_process: at 2018-11-15 15:52:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 15:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 15:52:25 [DEBUG   ] spawn_process: at 2018-11-15 15:52:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 15:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 15:52:25 [DEBUG   ] spawn_process: at 2018-11-15 15:52:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 15:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 15:52:25 [DEBUG   ] spawn_process: at 2018-11-15 15:52:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 15:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 15:52:25 [DEBUG   ] spawn_process: at 2018-11-15 15:52:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 15:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 15:52:25 [DEBUG   ] spawn_process: at 2018-11-15 15:52:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 15:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 15:52:25 [DEBUG   ] spawn_process: at 2018-11-15 15:52:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 15:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 15:52:25 [DEBUG   ] spawn_process: at 2018-11-15 15:52:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 15:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 15:52:25 [DEBUG   ] spawn_process: at 2018-11-15 15:52:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 15:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 15:52:25 [DEBUG   ] spawn_process: at 2018-11-15 15:52:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 15:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 15:52:25 [DEBUG   ] spawn_process: at 2018-11-15 15:52:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 15:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 15:52:25 [DEBUG   ] spawn_process: at 2018-11-15 15:52:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 15:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 15:52:25 [DEBUG   ] spawn_process: at 2018-11-15 15:52:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 15:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 15:52:25 [DEBUG   ] spawn_process: at 2018-11-15 15:52:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 15:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 15:52:25 [DEBUG   ] spawn_process: at 2018-11-15 15:52:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 15:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 15:52:25 [DEBUG   ] spawn_process: at 2018-11-15 15:52:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 15:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 15:52:25 [DEBUG   ] spawn_process: at 2018-11-15 15:52:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 15:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 15:52:25 [DEBUG   ] spawn_process: at 2018-11-15 15:52:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 15:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 15:52:25 [DEBUG   ] spawn_process: at 2018-11-15 15:52:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 15:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 15:52:25 [DEBUG   ] spawn_process: at 2018-11-15 15:52:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 15:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 15:52:25 [DEBUG   ] spawn_process: at 2018-11-15 15:52:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 15:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 15:52:25 [DEBUG   ] spawn_process: at 2018-11-15 15:52:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 15:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 15:52:25 [DEBUG   ] spawn_process: at 2018-11-15 15:52:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 15:52:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 15:52:25 [DEBUG   ] spawn_process: at 2018-11-15 15:52:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 15:52:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 15:52:50 [DEBUG   ] Got command BAM from MCS: ref #515818
2018-11-15 15:52:50 [INFO    ] Finished processing BAM request
2018-11-15 15:52:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:52:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515818   8 58437 57170033 A  ERROR'
2018-11-15 15:52:50 [DEBUG   ] Got command BAM from MCS: ref #515819
2018-11-15 15:52:50 [INFO    ] Finished processing BAM request
2018-11-15 15:52:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:52:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515819   8 58437 57170037 A  ERROR'
2018-11-15 15:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 15:52:50 [DEBUG   ] spawn_process: at 2018-11-15 15:52:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 15:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 15:52:50 [DEBUG   ] spawn_process: at 2018-11-15 15:52:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 15:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 15:52:50 [DEBUG   ] spawn_process: at 2018-11-15 15:52:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 15:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 15:52:50 [DEBUG   ] spawn_process: at 2018-11-15 15:52:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 15:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 15:52:50 [DEBUG   ] spawn_process: at 2018-11-15 15:52:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 15:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 15:52:50 [DEBUG   ] spawn_process: at 2018-11-15 15:52:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 15:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 15:52:50 [DEBUG   ] spawn_process: at 2018-11-15 15:52:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 15:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 15:52:50 [DEBUG   ] spawn_process: at 2018-11-15 15:52:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 15:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 15:52:50 [DEBUG   ] spawn_process: at 2018-11-15 15:52:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 15:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 15:52:50 [DEBUG   ] spawn_process: at 2018-11-15 15:52:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 15:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 15:52:50 [DEBUG   ] spawn_process: at 2018-11-15 15:52:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 15:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 15:52:50 [DEBUG   ] spawn_process: at 2018-11-15 15:52:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 15:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 15:52:50 [DEBUG   ] spawn_process: at 2018-11-15 15:52:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 15:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 15:52:50 [DEBUG   ] spawn_process: at 2018-11-15 15:52:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 15:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 15:52:50 [DEBUG   ] spawn_process: at 2018-11-15 15:52:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 15:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 15:52:50 [DEBUG   ] spawn_process: at 2018-11-15 15:52:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 15:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 15:52:50 [DEBUG   ] spawn_process: at 2018-11-15 15:52:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 15:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 15:52:50 [DEBUG   ] spawn_process: at 2018-11-15 15:52:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 15:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 15:52:50 [DEBUG   ] spawn_process: at 2018-11-15 15:52:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 15:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 15:52:50 [DEBUG   ] spawn_process: at 2018-11-15 15:52:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 15:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 15:52:50 [DEBUG   ] spawn_process: at 2018-11-15 15:52:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 15:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 15:52:50 [DEBUG   ] spawn_process: at 2018-11-15 15:52:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 15:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 15:52:50 [DEBUG   ] spawn_process: at 2018-11-15 15:52:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 15:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 15:52:50 [DEBUG   ] spawn_process: at 2018-11-15 15:52:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 15:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 15:52:50 [DEBUG   ] spawn_process: at 2018-11-15 15:52:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 15:52:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 15:52:50 [DEBUG   ] spawn_process: at 2018-11-15 15:52:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 15:52:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 15:52:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 15:52:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 15:52:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:52:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-15 15:52:56 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 15:52:56 [WARNING ] (13, 1, 'bot')
2018-11-15 15:52:56 [WARNING ] (13, 1, 'bot')
2018-11-15 15:52:56 [WARNING ] (13, 1, 'bot')
2018-11-15 15:52:56 [WARNING ] (13, 1, 'bot')
2018-11-15 15:52:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:52:56 [DEBUG   ] Finished updating board flags in 1.054 seconds
2018-11-15 15:53:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 15:53:15 [DEBUG   ] Got command BAM from MCS: ref #515820
2018-11-15 15:53:15 [INFO    ] Finished processing BAM request
2018-11-15 15:53:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:53:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515820   8 58437 57195025 A  ERROR'
2018-11-15 15:53:15 [DEBUG   ] Got command BAM from MCS: ref #515821
2018-11-15 15:53:15 [INFO    ] Finished processing BAM request
2018-11-15 15:53:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:53:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515821   8 58437 57195029 A  ERROR'
2018-11-15 15:53:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 15:53:15 [DEBUG   ] spawn_process: at 2018-11-15 15:53:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 15:53:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 15:53:15 [DEBUG   ] spawn_process: at 2018-11-15 15:53:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 15:53:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 15:53:15 [DEBUG   ] spawn_process: at 2018-11-15 15:53:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 15:53:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 15:53:15 [DEBUG   ] spawn_process: at 2018-11-15 15:53:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 15:53:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 15:53:15 [DEBUG   ] spawn_process: at 2018-11-15 15:53:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 15:53:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 15:53:15 [DEBUG   ] spawn_process: at 2018-11-15 15:53:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 15:53:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 15:53:15 [DEBUG   ] spawn_process: at 2018-11-15 15:53:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 15:53:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 15:53:15 [DEBUG   ] spawn_process: at 2018-11-15 15:53:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 15:53:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 15:53:15 [DEBUG   ] spawn_process: at 2018-11-15 15:53:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 15:53:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 15:53:15 [DEBUG   ] spawn_process: at 2018-11-15 15:53:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 15:53:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 15:53:15 [DEBUG   ] spawn_process: at 2018-11-15 15:53:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 15:53:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 15:53:15 [DEBUG   ] spawn_process: at 2018-11-15 15:53:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 15:53:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 15:53:15 [DEBUG   ] spawn_process: at 2018-11-15 15:53:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 15:53:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 15:53:15 [DEBUG   ] spawn_process: at 2018-11-15 15:53:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 15:53:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 15:53:15 [DEBUG   ] spawn_process: at 2018-11-15 15:53:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 15:53:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 15:53:15 [DEBUG   ] spawn_process: at 2018-11-15 15:53:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 15:53:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 15:53:15 [DEBUG   ] spawn_process: at 2018-11-15 15:53:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 15:53:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 15:53:15 [DEBUG   ] spawn_process: at 2018-11-15 15:53:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 15:53:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 15:53:15 [DEBUG   ] spawn_process: at 2018-11-15 15:53:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 15:53:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 15:53:15 [DEBUG   ] spawn_process: at 2018-11-15 15:53:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 15:53:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 15:53:15 [DEBUG   ] spawn_process: at 2018-11-15 15:53:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 15:53:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 15:53:15 [DEBUG   ] spawn_process: at 2018-11-15 15:53:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 15:53:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 15:53:15 [DEBUG   ] spawn_process: at 2018-11-15 15:53:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 15:53:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 15:53:15 [DEBUG   ] spawn_process: at 2018-11-15 15:53:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 15:53:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 15:53:15 [DEBUG   ] spawn_process: at 2018-11-15 15:53:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 15:53:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 15:53:15 [DEBUG   ] spawn_process: at 2018-11-15 15:53:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 15:53:18 [DEBUG   ] Got command RPT from MCS: ref #515822
2018-11-15 15:53:18 [DEBUG   ] summary = ERROR
2018-11-15 15:53:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515822  13 58437 57198901 A  ERRORERROR'
2018-11-15 15:53:19 [DEBUG   ] Got command RPT from MCS: ref #515823
2018-11-15 15:53:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 15:53:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515823  77 58437 57199105 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 15:53:19 [DEBUG   ] Got command RPT from MCS: ref #515824
2018-11-15 15:53:19 [DEBUG   ] summary = ERROR
2018-11-15 15:53:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515824  13 58437 57199297 A  ERRORERROR'
2018-11-15 15:53:19 [DEBUG   ] Got command RPT from MCS: ref #515825
2018-11-15 15:53:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 15:53:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515825  77 58437 57199501 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 15:53:19 [DEBUG   ] Got command RPT from MCS: ref #515826
2018-11-15 15:53:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 15:53:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515826  12 58437 57199705 A  ERRORB¢ff'
2018-11-15 15:53:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 15:53:40 [DEBUG   ] Got command BAM from MCS: ref #515831
2018-11-15 15:53:40 [INFO    ] Finished processing BAM request
2018-11-15 15:53:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:53:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515831   8 58437 57220029 A  ERROR'
2018-11-15 15:53:40 [DEBUG   ] Got command BAM from MCS: ref #515832
2018-11-15 15:53:40 [INFO    ] Finished processing BAM request
2018-11-15 15:53:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:53:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515832   8 58437 57220033 A  ERROR'
2018-11-15 15:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 15:53:40 [DEBUG   ] spawn_process: at 2018-11-15 15:53:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 15:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 15:53:40 [DEBUG   ] spawn_process: at 2018-11-15 15:53:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 15:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 15:53:40 [DEBUG   ] spawn_process: at 2018-11-15 15:53:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 15:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 15:53:40 [DEBUG   ] spawn_process: at 2018-11-15 15:53:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 15:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 15:53:40 [DEBUG   ] spawn_process: at 2018-11-15 15:53:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 15:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 15:53:40 [DEBUG   ] spawn_process: at 2018-11-15 15:53:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 15:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 15:53:40 [DEBUG   ] spawn_process: at 2018-11-15 15:53:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 15:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 15:53:40 [DEBUG   ] spawn_process: at 2018-11-15 15:53:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 15:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 15:53:40 [DEBUG   ] spawn_process: at 2018-11-15 15:53:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 15:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 15:53:40 [DEBUG   ] spawn_process: at 2018-11-15 15:53:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 15:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 15:53:40 [DEBUG   ] spawn_process: at 2018-11-15 15:53:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 15:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 15:53:40 [DEBUG   ] spawn_process: at 2018-11-15 15:53:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 15:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 15:53:40 [DEBUG   ] spawn_process: at 2018-11-15 15:53:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 15:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 15:53:40 [DEBUG   ] spawn_process: at 2018-11-15 15:53:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 15:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 15:53:40 [DEBUG   ] spawn_process: at 2018-11-15 15:53:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 15:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 15:53:40 [DEBUG   ] spawn_process: at 2018-11-15 15:53:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 15:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 15:53:40 [DEBUG   ] spawn_process: at 2018-11-15 15:53:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 15:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 15:53:40 [DEBUG   ] spawn_process: at 2018-11-15 15:53:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 15:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 15:53:40 [DEBUG   ] spawn_process: at 2018-11-15 15:53:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 15:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 15:53:40 [DEBUG   ] spawn_process: at 2018-11-15 15:53:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 15:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 15:53:40 [DEBUG   ] spawn_process: at 2018-11-15 15:53:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 15:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 15:53:40 [DEBUG   ] spawn_process: at 2018-11-15 15:53:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 15:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 15:53:40 [DEBUG   ] spawn_process: at 2018-11-15 15:53:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 15:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 15:53:40 [DEBUG   ] spawn_process: at 2018-11-15 15:53:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 15:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 15:53:40 [DEBUG   ] spawn_process: at 2018-11-15 15:53:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 15:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 15:53:40 [DEBUG   ] spawn_process: at 2018-11-15 15:53:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 15:53:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 15:53:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-11-15 15:53:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:53:56 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 15:53:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 15:53:56 [WARNING ] (13, 1, 'bot')
2018-11-15 15:53:56 [WARNING ] (13, 1, 'bot')
2018-11-15 15:53:56 [WARNING ] (13, 1, 'bot')
2018-11-15 15:53:56 [WARNING ] (13, 1, 'bot')
2018-11-15 15:53:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:53:56 [DEBUG   ] Finished updating board flags in 0.933 seconds
2018-11-15 15:54:05 [DEBUG   ] Got command BAM from MCS: ref #515834
2018-11-15 15:54:05 [INFO    ] Finished processing BAM request
2018-11-15 15:54:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:54:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515834   8 58437 57245029 A  ERROR'
2018-11-15 15:54:05 [DEBUG   ] Got command BAM from MCS: ref #515833
2018-11-15 15:54:05 [INFO    ] Finished processing BAM request
2018-11-15 15:54:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:54:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515833   8 58437 57245033 A  ERROR'
2018-11-15 15:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 15:54:05 [DEBUG   ] spawn_process: at 2018-11-15 15:54:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 15:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 15:54:05 [DEBUG   ] spawn_process: at 2018-11-15 15:54:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 15:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 15:54:05 [DEBUG   ] spawn_process: at 2018-11-15 15:54:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 15:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 15:54:05 [DEBUG   ] spawn_process: at 2018-11-15 15:54:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 15:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 15:54:05 [DEBUG   ] spawn_process: at 2018-11-15 15:54:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 15:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 15:54:05 [DEBUG   ] spawn_process: at 2018-11-15 15:54:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 15:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 15:54:05 [DEBUG   ] spawn_process: at 2018-11-15 15:54:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 15:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 15:54:05 [DEBUG   ] spawn_process: at 2018-11-15 15:54:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 15:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 15:54:05 [DEBUG   ] spawn_process: at 2018-11-15 15:54:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 15:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 15:54:05 [DEBUG   ] spawn_process: at 2018-11-15 15:54:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 15:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 15:54:05 [DEBUG   ] spawn_process: at 2018-11-15 15:54:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 15:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 15:54:05 [DEBUG   ] spawn_process: at 2018-11-15 15:54:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 15:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 15:54:05 [DEBUG   ] spawn_process: at 2018-11-15 15:54:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 15:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 15:54:05 [DEBUG   ] spawn_process: at 2018-11-15 15:54:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 15:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 15:54:05 [DEBUG   ] spawn_process: at 2018-11-15 15:54:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 15:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 15:54:05 [DEBUG   ] spawn_process: at 2018-11-15 15:54:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 15:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 15:54:05 [DEBUG   ] spawn_process: at 2018-11-15 15:54:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 15:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 15:54:05 [DEBUG   ] spawn_process: at 2018-11-15 15:54:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 15:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 15:54:05 [DEBUG   ] spawn_process: at 2018-11-15 15:54:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 15:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 15:54:05 [DEBUG   ] spawn_process: at 2018-11-15 15:54:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 15:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 15:54:05 [DEBUG   ] spawn_process: at 2018-11-15 15:54:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 15:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 15:54:05 [DEBUG   ] spawn_process: at 2018-11-15 15:54:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 15:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 15:54:05 [DEBUG   ] spawn_process: at 2018-11-15 15:54:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 15:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 15:54:05 [DEBUG   ] spawn_process: at 2018-11-15 15:54:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 15:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 15:54:05 [DEBUG   ] spawn_process: at 2018-11-15 15:54:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 15:54:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 15:54:05 [DEBUG   ] spawn_process: at 2018-11-15 15:54:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 15:54:14 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-15 15:54:30 [DEBUG   ] Got command BAM from MCS: ref #515835
2018-11-15 15:54:30 [INFO    ] Finished processing BAM request
2018-11-15 15:54:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:54:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515835   8 58437 57270025 A  ERROR'
2018-11-15 15:54:30 [DEBUG   ] Got command BAM from MCS: ref #515836
2018-11-15 15:54:30 [INFO    ] Finished processing BAM request
2018-11-15 15:54:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:54:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515836   8 58437 57270029 A  ERROR'
2018-11-15 15:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 15:54:30 [DEBUG   ] spawn_process: at 2018-11-15 15:54:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 15:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 15:54:30 [DEBUG   ] spawn_process: at 2018-11-15 15:54:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 15:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 15:54:30 [DEBUG   ] spawn_process: at 2018-11-15 15:54:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 15:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 15:54:30 [DEBUG   ] spawn_process: at 2018-11-15 15:54:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 15:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 15:54:30 [DEBUG   ] spawn_process: at 2018-11-15 15:54:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 15:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 15:54:30 [DEBUG   ] spawn_process: at 2018-11-15 15:54:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 15:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 15:54:30 [DEBUG   ] spawn_process: at 2018-11-15 15:54:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 15:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 15:54:30 [DEBUG   ] spawn_process: at 2018-11-15 15:54:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 15:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 15:54:30 [DEBUG   ] spawn_process: at 2018-11-15 15:54:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 15:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 15:54:30 [DEBUG   ] spawn_process: at 2018-11-15 15:54:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 15:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 15:54:30 [DEBUG   ] spawn_process: at 2018-11-15 15:54:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 15:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 15:54:30 [DEBUG   ] spawn_process: at 2018-11-15 15:54:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 15:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 15:54:30 [DEBUG   ] spawn_process: at 2018-11-15 15:54:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 15:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 15:54:30 [DEBUG   ] spawn_process: at 2018-11-15 15:54:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 15:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 15:54:30 [DEBUG   ] spawn_process: at 2018-11-15 15:54:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 15:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 15:54:30 [DEBUG   ] spawn_process: at 2018-11-15 15:54:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 15:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 15:54:30 [DEBUG   ] spawn_process: at 2018-11-15 15:54:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 15:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 15:54:30 [DEBUG   ] spawn_process: at 2018-11-15 15:54:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 15:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 15:54:30 [DEBUG   ] spawn_process: at 2018-11-15 15:54:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 15:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 15:54:30 [DEBUG   ] spawn_process: at 2018-11-15 15:54:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 15:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 15:54:30 [DEBUG   ] spawn_process: at 2018-11-15 15:54:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 15:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 15:54:30 [DEBUG   ] spawn_process: at 2018-11-15 15:54:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 15:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 15:54:30 [DEBUG   ] spawn_process: at 2018-11-15 15:54:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 15:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 15:54:30 [DEBUG   ] spawn_process: at 2018-11-15 15:54:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 15:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 15:54:30 [DEBUG   ] spawn_process: at 2018-11-15 15:54:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 15:54:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 15:54:30 [DEBUG   ] spawn_process: at 2018-11-15 15:54:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 15:54:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 15:54:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 15:54:55 [DEBUG   ] Got command BAM from MCS: ref #515837
2018-11-15 15:54:55 [INFO    ] Finished processing BAM request
2018-11-15 15:54:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:54:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515837   8 58437 57295025 A  ERROR'
2018-11-15 15:54:55 [DEBUG   ] Got command BAM from MCS: ref #515838
2018-11-15 15:54:55 [INFO    ] Finished processing BAM request
2018-11-15 15:54:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:54:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515838   8 58437 57295029 A  ERROR'
2018-11-15 15:54:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 15:54:55 [DEBUG   ] spawn_process: at 2018-11-15 15:54:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 15:54:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 15:54:55 [DEBUG   ] spawn_process: at 2018-11-15 15:54:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 15:54:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 15:54:55 [DEBUG   ] spawn_process: at 2018-11-15 15:54:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 15:54:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 15:54:55 [DEBUG   ] spawn_process: at 2018-11-15 15:54:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 15:54:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 15:54:55 [DEBUG   ] spawn_process: at 2018-11-15 15:54:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 15:54:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 15:54:55 [DEBUG   ] spawn_process: at 2018-11-15 15:54:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 15:54:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 15:54:55 [DEBUG   ] spawn_process: at 2018-11-15 15:54:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 15:54:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 15:54:55 [DEBUG   ] spawn_process: at 2018-11-15 15:54:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 15:54:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 15:54:55 [DEBUG   ] spawn_process: at 2018-11-15 15:54:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 15:54:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 15:54:55 [DEBUG   ] spawn_process: at 2018-11-15 15:54:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 15:54:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 15:54:55 [DEBUG   ] spawn_process: at 2018-11-15 15:54:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 15:54:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 15:54:55 [DEBUG   ] spawn_process: at 2018-11-15 15:54:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 15:54:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 15:54:55 [DEBUG   ] spawn_process: at 2018-11-15 15:54:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 15:54:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 15:54:55 [DEBUG   ] spawn_process: at 2018-11-15 15:54:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 15:54:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 15:54:55 [DEBUG   ] spawn_process: at 2018-11-15 15:54:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 15:54:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 15:54:55 [DEBUG   ] spawn_process: at 2018-11-15 15:54:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 15:54:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 15:54:55 [DEBUG   ] spawn_process: at 2018-11-15 15:54:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 15:54:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 15:54:55 [DEBUG   ] spawn_process: at 2018-11-15 15:54:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 15:54:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 15:54:55 [DEBUG   ] spawn_process: at 2018-11-15 15:54:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 15:54:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 15:54:55 [DEBUG   ] spawn_process: at 2018-11-15 15:54:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 15:54:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 15:54:55 [DEBUG   ] spawn_process: at 2018-11-15 15:54:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 15:54:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 15:54:55 [DEBUG   ] spawn_process: at 2018-11-15 15:54:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 15:54:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 15:54:55 [DEBUG   ] spawn_process: at 2018-11-15 15:54:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 15:54:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 15:54:55 [DEBUG   ] spawn_process: at 2018-11-15 15:54:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 15:54:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 15:54:55 [DEBUG   ] spawn_process: at 2018-11-15 15:54:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 15:54:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 15:54:55 [DEBUG   ] spawn_process: at 2018-11-15 15:54:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 15:54:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:54:57 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 15:54:57 [WARNING ] (13, 1, 'bot')
2018-11-15 15:54:57 [WARNING ] (13, 1, 'bot')
2018-11-15 15:54:57 [WARNING ] (13, 1, 'bot')
2018-11-15 15:54:57 [WARNING ] (13, 1, 'bot')
2018-11-15 15:54:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:54:57 [DEBUG   ] Finished updating board flags in 1.353 seconds
2018-11-15 15:55:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 15:55:20 [DEBUG   ] Got command BAM from MCS: ref #515839
2018-11-15 15:55:20 [INFO    ] Finished processing BAM request
2018-11-15 15:55:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:55:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515839   8 58437 57320033 A  ERROR'
2018-11-15 15:55:20 [DEBUG   ] Got command BAM from MCS: ref #515840
2018-11-15 15:55:20 [INFO    ] Finished processing BAM request
2018-11-15 15:55:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:55:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515840   8 58437 57320037 A  ERROR'
2018-11-15 15:55:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 15:55:20 [DEBUG   ] spawn_process: at 2018-11-15 15:55:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 15:55:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 15:55:20 [DEBUG   ] spawn_process: at 2018-11-15 15:55:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 15:55:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 15:55:20 [DEBUG   ] spawn_process: at 2018-11-15 15:55:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 15:55:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 15:55:20 [DEBUG   ] spawn_process: at 2018-11-15 15:55:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 15:55:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 15:55:20 [DEBUG   ] spawn_process: at 2018-11-15 15:55:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 15:55:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 15:55:20 [DEBUG   ] spawn_process: at 2018-11-15 15:55:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 15:55:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 15:55:20 [DEBUG   ] spawn_process: at 2018-11-15 15:55:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 15:55:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 15:55:20 [DEBUG   ] spawn_process: at 2018-11-15 15:55:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 15:55:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 15:55:20 [DEBUG   ] spawn_process: at 2018-11-15 15:55:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 15:55:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 15:55:20 [DEBUG   ] spawn_process: at 2018-11-15 15:55:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 15:55:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 15:55:20 [DEBUG   ] spawn_process: at 2018-11-15 15:55:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 15:55:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 15:55:20 [DEBUG   ] spawn_process: at 2018-11-15 15:55:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 15:55:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 15:55:20 [DEBUG   ] spawn_process: at 2018-11-15 15:55:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 15:55:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 15:55:20 [DEBUG   ] spawn_process: at 2018-11-15 15:55:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 15:55:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 15:55:20 [DEBUG   ] spawn_process: at 2018-11-15 15:55:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 15:55:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 15:55:20 [DEBUG   ] spawn_process: at 2018-11-15 15:55:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 15:55:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 15:55:20 [DEBUG   ] spawn_process: at 2018-11-15 15:55:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 15:55:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 15:55:20 [DEBUG   ] spawn_process: at 2018-11-15 15:55:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 15:55:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 15:55:20 [DEBUG   ] spawn_process: at 2018-11-15 15:55:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 15:55:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 15:55:20 [DEBUG   ] spawn_process: at 2018-11-15 15:55:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 15:55:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 15:55:20 [DEBUG   ] spawn_process: at 2018-11-15 15:55:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 15:55:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 15:55:20 [DEBUG   ] spawn_process: at 2018-11-15 15:55:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 15:55:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 15:55:20 [DEBUG   ] spawn_process: at 2018-11-15 15:55:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 15:55:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 15:55:20 [DEBUG   ] spawn_process: at 2018-11-15 15:55:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 15:55:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 15:55:20 [DEBUG   ] spawn_process: at 2018-11-15 15:55:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 15:55:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 15:55:20 [DEBUG   ] spawn_process: at 2018-11-15 15:55:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 15:55:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 15:55:45 [DEBUG   ] Got command BAM from MCS: ref #515841
2018-11-15 15:55:45 [INFO    ] Finished processing BAM request
2018-11-15 15:55:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:55:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515841   8 58437 57345029 A  ERROR'
2018-11-15 15:55:45 [DEBUG   ] Got command BAM from MCS: ref #515842
2018-11-15 15:55:45 [INFO    ] Finished processing BAM request
2018-11-15 15:55:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:55:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515842   8 58437 57345033 A  ERROR'
2018-11-15 15:55:45 [DEBUG   ] Got command RPT from MCS: ref #515843
2018-11-15 15:55:45 [DEBUG   ] summary = ERROR
2018-11-15 15:55:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515843  13 58437 57345129 A  ERRORERROR'
2018-11-15 15:55:45 [DEBUG   ] Got command RPT from MCS: ref #515844
2018-11-15 15:55:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 15:55:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515844  77 58437 57345130 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 15:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 15:55:45 [DEBUG   ] spawn_process: at 2018-11-15 15:55:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 15:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 15:55:45 [DEBUG   ] spawn_process: at 2018-11-15 15:55:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 15:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 15:55:45 [DEBUG   ] spawn_process: at 2018-11-15 15:55:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 15:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 15:55:45 [DEBUG   ] spawn_process: at 2018-11-15 15:55:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 15:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 15:55:45 [DEBUG   ] spawn_process: at 2018-11-15 15:55:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 15:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 15:55:45 [DEBUG   ] spawn_process: at 2018-11-15 15:55:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 15:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 15:55:45 [DEBUG   ] spawn_process: at 2018-11-15 15:55:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 15:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 15:55:45 [DEBUG   ] spawn_process: at 2018-11-15 15:55:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 15:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 15:55:45 [DEBUG   ] spawn_process: at 2018-11-15 15:55:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 15:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 15:55:45 [DEBUG   ] spawn_process: at 2018-11-15 15:55:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 15:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 15:55:45 [DEBUG   ] spawn_process: at 2018-11-15 15:55:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 15:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 15:55:45 [DEBUG   ] spawn_process: at 2018-11-15 15:55:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 15:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 15:55:45 [DEBUG   ] spawn_process: at 2018-11-15 15:55:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 15:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 15:55:45 [DEBUG   ] spawn_process: at 2018-11-15 15:55:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 15:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 15:55:45 [DEBUG   ] spawn_process: at 2018-11-15 15:55:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 15:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 15:55:45 [DEBUG   ] spawn_process: at 2018-11-15 15:55:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 15:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 15:55:45 [DEBUG   ] spawn_process: at 2018-11-15 15:55:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 15:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 15:55:45 [DEBUG   ] spawn_process: at 2018-11-15 15:55:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 15:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 15:55:45 [DEBUG   ] spawn_process: at 2018-11-15 15:55:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 15:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 15:55:45 [DEBUG   ] spawn_process: at 2018-11-15 15:55:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 15:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 15:55:45 [DEBUG   ] spawn_process: at 2018-11-15 15:55:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 15:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 15:55:45 [DEBUG   ] spawn_process: at 2018-11-15 15:55:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 15:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 15:55:45 [DEBUG   ] spawn_process: at 2018-11-15 15:55:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 15:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 15:55:45 [DEBUG   ] spawn_process: at 2018-11-15 15:55:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 15:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 15:55:45 [DEBUG   ] spawn_process: at 2018-11-15 15:55:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 15:55:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 15:55:45 [DEBUG   ] spawn_process: at 2018-11-15 15:55:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 15:55:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 15:55:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 15:55:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:55:57 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 15:55:57 [WARNING ] (13, 1, 'bot')
2018-11-15 15:55:57 [WARNING ] (13, 1, 'bot')
2018-11-15 15:55:57 [WARNING ] (13, 1, 'bot')
2018-11-15 15:55:57 [WARNING ] (13, 1, 'bot')
2018-11-15 15:55:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:55:57 [DEBUG   ] Finished updating board flags in 1.199 seconds
2018-11-15 15:56:10 [DEBUG   ] Got command BAM from MCS: ref #515860
2018-11-15 15:56:10 [INFO    ] Finished processing BAM request
2018-11-15 15:56:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:56:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515860   8 58437 57370025 A  ERROR'
2018-11-15 15:56:10 [DEBUG   ] Got command BAM from MCS: ref #515861
2018-11-15 15:56:10 [INFO    ] Finished processing BAM request
2018-11-15 15:56:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:56:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515861   8 58437 57370029 A  ERROR'
2018-11-15 15:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 15:56:10 [DEBUG   ] spawn_process: at 2018-11-15 15:56:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 15:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 15:56:10 [DEBUG   ] spawn_process: at 2018-11-15 15:56:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 15:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 15:56:10 [DEBUG   ] spawn_process: at 2018-11-15 15:56:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 15:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 15:56:10 [DEBUG   ] spawn_process: at 2018-11-15 15:56:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 15:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 15:56:10 [DEBUG   ] spawn_process: at 2018-11-15 15:56:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 15:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 15:56:10 [DEBUG   ] spawn_process: at 2018-11-15 15:56:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 15:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 15:56:10 [DEBUG   ] spawn_process: at 2018-11-15 15:56:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 15:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 15:56:10 [DEBUG   ] spawn_process: at 2018-11-15 15:56:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 15:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 15:56:10 [DEBUG   ] spawn_process: at 2018-11-15 15:56:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 15:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 15:56:10 [DEBUG   ] spawn_process: at 2018-11-15 15:56:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 15:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 15:56:10 [DEBUG   ] spawn_process: at 2018-11-15 15:56:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 15:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 15:56:10 [DEBUG   ] spawn_process: at 2018-11-15 15:56:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 15:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 15:56:10 [DEBUG   ] spawn_process: at 2018-11-15 15:56:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 15:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 15:56:10 [DEBUG   ] spawn_process: at 2018-11-15 15:56:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 15:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 15:56:10 [DEBUG   ] spawn_process: at 2018-11-15 15:56:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 15:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 15:56:10 [DEBUG   ] spawn_process: at 2018-11-15 15:56:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 15:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 15:56:10 [DEBUG   ] spawn_process: at 2018-11-15 15:56:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 15:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 15:56:10 [DEBUG   ] spawn_process: at 2018-11-15 15:56:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 15:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 15:56:10 [DEBUG   ] spawn_process: at 2018-11-15 15:56:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 15:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 15:56:10 [DEBUG   ] spawn_process: at 2018-11-15 15:56:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 15:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 15:56:10 [DEBUG   ] spawn_process: at 2018-11-15 15:56:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 15:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 15:56:10 [DEBUG   ] spawn_process: at 2018-11-15 15:56:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 15:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 15:56:10 [DEBUG   ] spawn_process: at 2018-11-15 15:56:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 15:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 15:56:10 [DEBUG   ] spawn_process: at 2018-11-15 15:56:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 15:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 15:56:10 [DEBUG   ] spawn_process: at 2018-11-15 15:56:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 15:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 15:56:10 [DEBUG   ] spawn_process: at 2018-11-15 15:56:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 15:56:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 15:56:34 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-15 15:56:35 [DEBUG   ] Got command BAM from MCS: ref #515867
2018-11-15 15:56:35 [INFO    ] Finished processing BAM request
2018-11-15 15:56:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:56:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515867   8 58437 57395033 A  ERROR'
2018-11-15 15:56:35 [DEBUG   ] Got command BAM from MCS: ref #515866
2018-11-15 15:56:35 [INFO    ] Finished processing BAM request
2018-11-15 15:56:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:56:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515866   8 58437 57395037 A  ERROR'
2018-11-15 15:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 15:56:35 [DEBUG   ] spawn_process: at 2018-11-15 15:56:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 15:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 15:56:35 [DEBUG   ] spawn_process: at 2018-11-15 15:56:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 15:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 15:56:35 [DEBUG   ] spawn_process: at 2018-11-15 15:56:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 15:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 15:56:35 [DEBUG   ] spawn_process: at 2018-11-15 15:56:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 15:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 15:56:35 [DEBUG   ] spawn_process: at 2018-11-15 15:56:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 15:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 15:56:35 [DEBUG   ] spawn_process: at 2018-11-15 15:56:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 15:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 15:56:35 [DEBUG   ] spawn_process: at 2018-11-15 15:56:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 15:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 15:56:35 [DEBUG   ] spawn_process: at 2018-11-15 15:56:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 15:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 15:56:35 [DEBUG   ] spawn_process: at 2018-11-15 15:56:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 15:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 15:56:35 [DEBUG   ] spawn_process: at 2018-11-15 15:56:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 15:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 15:56:35 [DEBUG   ] spawn_process: at 2018-11-15 15:56:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 15:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 15:56:35 [DEBUG   ] spawn_process: at 2018-11-15 15:56:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 15:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 15:56:35 [DEBUG   ] spawn_process: at 2018-11-15 15:56:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 15:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 15:56:35 [DEBUG   ] spawn_process: at 2018-11-15 15:56:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 15:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 15:56:35 [DEBUG   ] spawn_process: at 2018-11-15 15:56:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 15:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 15:56:35 [DEBUG   ] spawn_process: at 2018-11-15 15:56:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 15:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 15:56:35 [DEBUG   ] spawn_process: at 2018-11-15 15:56:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 15:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 15:56:35 [DEBUG   ] spawn_process: at 2018-11-15 15:56:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 15:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 15:56:35 [DEBUG   ] spawn_process: at 2018-11-15 15:56:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 15:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 15:56:35 [DEBUG   ] spawn_process: at 2018-11-15 15:56:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 15:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 15:56:35 [DEBUG   ] spawn_process: at 2018-11-15 15:56:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 15:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 15:56:35 [DEBUG   ] spawn_process: at 2018-11-15 15:56:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 15:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 15:56:35 [DEBUG   ] spawn_process: at 2018-11-15 15:56:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 15:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 15:56:35 [DEBUG   ] spawn_process: at 2018-11-15 15:56:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 15:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 15:56:35 [DEBUG   ] spawn_process: at 2018-11-15 15:56:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 15:56:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 15:56:35 [DEBUG   ] spawn_process: at 2018-11-15 15:56:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 15:56:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 15:56:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 15:56:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:56:57 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 15:56:57 [WARNING ] (13, 1, 'bot')
2018-11-15 15:56:57 [WARNING ] (13, 1, 'bot')
2018-11-15 15:56:57 [WARNING ] (13, 1, 'bot')
2018-11-15 15:56:57 [WARNING ] (13, 1, 'bot')
2018-11-15 15:56:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:56:57 [DEBUG   ] Finished updating board flags in 1.022 seconds
2018-11-15 15:56:59 [DEBUG   ] Got command BAM from MCS: ref #515869
2018-11-15 15:56:59 [INFO    ] Finished processing BAM request
2018-11-15 15:56:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:56:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515869   8 58437 57419025 A  ERROR'
2018-11-15 15:56:59 [DEBUG   ] Got command BAM from MCS: ref #515868
2018-11-15 15:56:59 [INFO    ] Finished processing BAM request
2018-11-15 15:56:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:56:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515868   8 58437 57419029 A  ERROR'
2018-11-15 15:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 15:56:59 [DEBUG   ] spawn_process: at 2018-11-15 15:56:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 15:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 15:56:59 [DEBUG   ] spawn_process: at 2018-11-15 15:56:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 15:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 15:56:59 [DEBUG   ] spawn_process: at 2018-11-15 15:56:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 15:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 15:56:59 [DEBUG   ] spawn_process: at 2018-11-15 15:56:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 15:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 15:56:59 [DEBUG   ] spawn_process: at 2018-11-15 15:56:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 15:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 15:56:59 [DEBUG   ] spawn_process: at 2018-11-15 15:56:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 15:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 15:56:59 [DEBUG   ] spawn_process: at 2018-11-15 15:56:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 15:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 15:56:59 [DEBUG   ] spawn_process: at 2018-11-15 15:56:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 15:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 15:56:59 [DEBUG   ] spawn_process: at 2018-11-15 15:56:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 15:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 15:56:59 [DEBUG   ] spawn_process: at 2018-11-15 15:56:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 15:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 15:56:59 [DEBUG   ] spawn_process: at 2018-11-15 15:56:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 15:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 15:56:59 [DEBUG   ] spawn_process: at 2018-11-15 15:56:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 15:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 15:56:59 [DEBUG   ] spawn_process: at 2018-11-15 15:56:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 15:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 15:56:59 [DEBUG   ] spawn_process: at 2018-11-15 15:56:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 15:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 15:56:59 [DEBUG   ] spawn_process: at 2018-11-15 15:56:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 15:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 15:56:59 [DEBUG   ] spawn_process: at 2018-11-15 15:56:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 15:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 15:56:59 [DEBUG   ] spawn_process: at 2018-11-15 15:56:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 15:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 15:56:59 [DEBUG   ] spawn_process: at 2018-11-15 15:56:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 15:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 15:56:59 [DEBUG   ] spawn_process: at 2018-11-15 15:56:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 15:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 15:56:59 [DEBUG   ] spawn_process: at 2018-11-15 15:56:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 15:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 15:56:59 [DEBUG   ] spawn_process: at 2018-11-15 15:56:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 15:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 15:56:59 [DEBUG   ] spawn_process: at 2018-11-15 15:56:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 15:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 15:56:59 [DEBUG   ] spawn_process: at 2018-11-15 15:56:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 15:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 15:56:59 [DEBUG   ] spawn_process: at 2018-11-15 15:56:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 15:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 15:56:59 [DEBUG   ] spawn_process: at 2018-11-15 15:56:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 15:56:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 15:56:59 [DEBUG   ] spawn_process: at 2018-11-15 15:56:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 15:57:14 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 15:57:23 [DEBUG   ] Got command BAM from MCS: ref #515870
2018-11-15 15:57:23 [INFO    ] Finished processing BAM request
2018-11-15 15:57:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:57:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515870   8 58437 57443033 A  ERROR'
2018-11-15 15:57:23 [DEBUG   ] Got command BAM from MCS: ref #515871
2018-11-15 15:57:23 [INFO    ] Finished processing BAM request
2018-11-15 15:57:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:57:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515871   8 58437 57443037 A  ERROR'
2018-11-15 15:57:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 15:57:23 [DEBUG   ] spawn_process: at 2018-11-15 15:57:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 15:57:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 15:57:23 [DEBUG   ] spawn_process: at 2018-11-15 15:57:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 15:57:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 15:57:23 [DEBUG   ] spawn_process: at 2018-11-15 15:57:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 15:57:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 15:57:23 [DEBUG   ] spawn_process: at 2018-11-15 15:57:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 15:57:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 15:57:23 [DEBUG   ] spawn_process: at 2018-11-15 15:57:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 15:57:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 15:57:23 [DEBUG   ] spawn_process: at 2018-11-15 15:57:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 15:57:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 15:57:23 [DEBUG   ] spawn_process: at 2018-11-15 15:57:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 15:57:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 15:57:23 [DEBUG   ] spawn_process: at 2018-11-15 15:57:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 15:57:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 15:57:23 [DEBUG   ] spawn_process: at 2018-11-15 15:57:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 15:57:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 15:57:23 [DEBUG   ] spawn_process: at 2018-11-15 15:57:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 15:57:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 15:57:23 [DEBUG   ] spawn_process: at 2018-11-15 15:57:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 15:57:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 15:57:23 [DEBUG   ] spawn_process: at 2018-11-15 15:57:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 15:57:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 15:57:23 [DEBUG   ] spawn_process: at 2018-11-15 15:57:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 15:57:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 15:57:23 [DEBUG   ] spawn_process: at 2018-11-15 15:57:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 15:57:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 15:57:23 [DEBUG   ] spawn_process: at 2018-11-15 15:57:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 15:57:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 15:57:23 [DEBUG   ] spawn_process: at 2018-11-15 15:57:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 15:57:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 15:57:23 [DEBUG   ] spawn_process: at 2018-11-15 15:57:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 15:57:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 15:57:23 [DEBUG   ] spawn_process: at 2018-11-15 15:57:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 15:57:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 15:57:23 [DEBUG   ] spawn_process: at 2018-11-15 15:57:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 15:57:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 15:57:23 [DEBUG   ] spawn_process: at 2018-11-15 15:57:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 15:57:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 15:57:23 [DEBUG   ] spawn_process: at 2018-11-15 15:57:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 15:57:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 15:57:23 [DEBUG   ] spawn_process: at 2018-11-15 15:57:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 15:57:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 15:57:23 [DEBUG   ] spawn_process: at 2018-11-15 15:57:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 15:57:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 15:57:23 [DEBUG   ] spawn_process: at 2018-11-15 15:57:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 15:57:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 15:57:23 [DEBUG   ] spawn_process: at 2018-11-15 15:57:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 15:57:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 15:57:23 [DEBUG   ] spawn_process: at 2018-11-15 15:57:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 15:57:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 15:57:47 [DEBUG   ] Got command BAM from MCS: ref #515873
2018-11-15 15:57:47 [INFO    ] Finished processing BAM request
2018-11-15 15:57:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:57:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515873   8 58437 57467025 A  ERROR'
2018-11-15 15:57:47 [DEBUG   ] Got command BAM from MCS: ref #515872
2018-11-15 15:57:47 [INFO    ] Finished processing BAM request
2018-11-15 15:57:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:57:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515872   8 58437 57467029 A  ERROR'
2018-11-15 15:57:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 15:57:47 [DEBUG   ] spawn_process: at 2018-11-15 15:57:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 15:57:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 15:57:47 [DEBUG   ] spawn_process: at 2018-11-15 15:57:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 15:57:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 15:57:47 [DEBUG   ] spawn_process: at 2018-11-15 15:57:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 15:57:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 15:57:47 [DEBUG   ] spawn_process: at 2018-11-15 15:57:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 15:57:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 15:57:47 [DEBUG   ] spawn_process: at 2018-11-15 15:57:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 15:57:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 15:57:47 [DEBUG   ] spawn_process: at 2018-11-15 15:57:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 15:57:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 15:57:47 [DEBUG   ] spawn_process: at 2018-11-15 15:57:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 15:57:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 15:57:47 [DEBUG   ] spawn_process: at 2018-11-15 15:57:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 15:57:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 15:57:47 [DEBUG   ] spawn_process: at 2018-11-15 15:57:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 15:57:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 15:57:47 [DEBUG   ] spawn_process: at 2018-11-15 15:57:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 15:57:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 15:57:47 [DEBUG   ] spawn_process: at 2018-11-15 15:57:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 15:57:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 15:57:47 [DEBUG   ] spawn_process: at 2018-11-15 15:57:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 15:57:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 15:57:47 [DEBUG   ] spawn_process: at 2018-11-15 15:57:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 15:57:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 15:57:47 [DEBUG   ] spawn_process: at 2018-11-15 15:57:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 15:57:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 15:57:47 [DEBUG   ] spawn_process: at 2018-11-15 15:57:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 15:57:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 15:57:47 [DEBUG   ] spawn_process: at 2018-11-15 15:57:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 15:57:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 15:57:47 [DEBUG   ] spawn_process: at 2018-11-15 15:57:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 15:57:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 15:57:47 [DEBUG   ] spawn_process: at 2018-11-15 15:57:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 15:57:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 15:57:47 [DEBUG   ] spawn_process: at 2018-11-15 15:57:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 15:57:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 15:57:47 [DEBUG   ] spawn_process: at 2018-11-15 15:57:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 15:57:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 15:57:47 [DEBUG   ] spawn_process: at 2018-11-15 15:57:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 15:57:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 15:57:47 [DEBUG   ] spawn_process: at 2018-11-15 15:57:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 15:57:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 15:57:47 [DEBUG   ] spawn_process: at 2018-11-15 15:57:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 15:57:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 15:57:47 [DEBUG   ] spawn_process: at 2018-11-15 15:57:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 15:57:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 15:57:47 [DEBUG   ] spawn_process: at 2018-11-15 15:57:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 15:57:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 15:57:47 [DEBUG   ] spawn_process: at 2018-11-15 15:57:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 15:57:54 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 15:57:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 15:57:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:57:57 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 15:57:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 15:57:57 [WARNING ] (13, 1, 'bot')
2018-11-15 15:57:57 [WARNING ] (13, 1, 'bot')
2018-11-15 15:57:57 [WARNING ] (13, 1, 'bot')
2018-11-15 15:57:57 [WARNING ] (13, 1, 'bot')
2018-11-15 15:57:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:57:57 [DEBUG   ] Finished updating board flags in 0.984 seconds
2018-11-15 15:58:11 [DEBUG   ] Got command BAM from MCS: ref #515876
2018-11-15 15:58:11 [INFO    ] Finished processing BAM request
2018-11-15 15:58:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:58:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515876   8 58437 57491033 A  ERROR'
2018-11-15 15:58:11 [DEBUG   ] Got command BAM from MCS: ref #515877
2018-11-15 15:58:11 [INFO    ] Finished processing BAM request
2018-11-15 15:58:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:58:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515877   8 58437 57491037 A  ERROR'
2018-11-15 15:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 15:58:11 [DEBUG   ] spawn_process: at 2018-11-15 15:58:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 15:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 15:58:11 [DEBUG   ] spawn_process: at 2018-11-15 15:58:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 15:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 15:58:11 [DEBUG   ] spawn_process: at 2018-11-15 15:58:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 15:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 15:58:11 [DEBUG   ] spawn_process: at 2018-11-15 15:58:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 15:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 15:58:11 [DEBUG   ] spawn_process: at 2018-11-15 15:58:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 15:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 15:58:11 [DEBUG   ] spawn_process: at 2018-11-15 15:58:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 15:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 15:58:11 [DEBUG   ] spawn_process: at 2018-11-15 15:58:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 15:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 15:58:11 [DEBUG   ] spawn_process: at 2018-11-15 15:58:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 15:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 15:58:11 [DEBUG   ] spawn_process: at 2018-11-15 15:58:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 15:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 15:58:11 [DEBUG   ] spawn_process: at 2018-11-15 15:58:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 15:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 15:58:11 [DEBUG   ] spawn_process: at 2018-11-15 15:58:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 15:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 15:58:11 [DEBUG   ] spawn_process: at 2018-11-15 15:58:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 15:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 15:58:11 [DEBUG   ] spawn_process: at 2018-11-15 15:58:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 15:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 15:58:11 [DEBUG   ] spawn_process: at 2018-11-15 15:58:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 15:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 15:58:11 [DEBUG   ] spawn_process: at 2018-11-15 15:58:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 15:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 15:58:11 [DEBUG   ] spawn_process: at 2018-11-15 15:58:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 15:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 15:58:11 [DEBUG   ] spawn_process: at 2018-11-15 15:58:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 15:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 15:58:11 [DEBUG   ] spawn_process: at 2018-11-15 15:58:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 15:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 15:58:11 [DEBUG   ] spawn_process: at 2018-11-15 15:58:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 15:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 15:58:11 [DEBUG   ] spawn_process: at 2018-11-15 15:58:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 15:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 15:58:11 [DEBUG   ] spawn_process: at 2018-11-15 15:58:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 15:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 15:58:11 [DEBUG   ] spawn_process: at 2018-11-15 15:58:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 15:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 15:58:11 [DEBUG   ] spawn_process: at 2018-11-15 15:58:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 15:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 15:58:11 [DEBUG   ] spawn_process: at 2018-11-15 15:58:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 15:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 15:58:11 [DEBUG   ] spawn_process: at 2018-11-15 15:58:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 15:58:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 15:58:11 [DEBUG   ] spawn_process: at 2018-11-15 15:58:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 15:58:14 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-15 15:58:18 [DEBUG   ] Got command RPT from MCS: ref #515878
2018-11-15 15:58:18 [DEBUG   ] summary = ERROR
2018-11-15 15:58:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515878  13 58437 57498985 A  ERRORERROR'
2018-11-15 15:58:19 [DEBUG   ] Got command RPT from MCS: ref #515879
2018-11-15 15:58:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 15:58:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515879  77 58437 57499198 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 15:58:19 [DEBUG   ] Got command RPT from MCS: ref #515880
2018-11-15 15:58:19 [DEBUG   ] summary = ERROR
2018-11-15 15:58:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515880  13 58437 57499389 A  ERRORERROR'
2018-11-15 15:58:19 [DEBUG   ] Got command RPT from MCS: ref #515882
2018-11-15 15:58:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 15:58:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515882  77 58437 57499593 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 15:58:19 [DEBUG   ] Got command RPT from MCS: ref #515883
2018-11-15 15:58:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 15:58:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515883  12 58437 57499797 A  ERRORB¢ff'
2018-11-15 15:58:35 [DEBUG   ] Got command BAM from MCS: ref #515889
2018-11-15 15:58:35 [INFO    ] Finished processing BAM request
2018-11-15 15:58:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:58:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515889   8 58437 57515029 A  ERROR'
2018-11-15 15:58:35 [DEBUG   ] Got command BAM from MCS: ref #515888
2018-11-15 15:58:35 [INFO    ] Finished processing BAM request
2018-11-15 15:58:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:58:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515888   8 58437 57515033 A  ERROR'
2018-11-15 15:58:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 15:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 15:58:35 [DEBUG   ] spawn_process: at 2018-11-15 15:58:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 15:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 15:58:35 [DEBUG   ] spawn_process: at 2018-11-15 15:58:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 15:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 15:58:35 [DEBUG   ] spawn_process: at 2018-11-15 15:58:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 15:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 15:58:35 [DEBUG   ] spawn_process: at 2018-11-15 15:58:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 15:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 15:58:35 [DEBUG   ] spawn_process: at 2018-11-15 15:58:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 15:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 15:58:35 [DEBUG   ] spawn_process: at 2018-11-15 15:58:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 15:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 15:58:35 [DEBUG   ] spawn_process: at 2018-11-15 15:58:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 15:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 15:58:35 [DEBUG   ] spawn_process: at 2018-11-15 15:58:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 15:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 15:58:35 [DEBUG   ] spawn_process: at 2018-11-15 15:58:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 15:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 15:58:35 [DEBUG   ] spawn_process: at 2018-11-15 15:58:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 15:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 15:58:35 [DEBUG   ] spawn_process: at 2018-11-15 15:58:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 15:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 15:58:35 [DEBUG   ] spawn_process: at 2018-11-15 15:58:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 15:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 15:58:35 [DEBUG   ] spawn_process: at 2018-11-15 15:58:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 15:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 15:58:35 [DEBUG   ] spawn_process: at 2018-11-15 15:58:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 15:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 15:58:35 [DEBUG   ] spawn_process: at 2018-11-15 15:58:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 15:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 15:58:35 [DEBUG   ] spawn_process: at 2018-11-15 15:58:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 15:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 15:58:35 [DEBUG   ] spawn_process: at 2018-11-15 15:58:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 15:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 15:58:35 [DEBUG   ] spawn_process: at 2018-11-15 15:58:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 15:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 15:58:35 [DEBUG   ] spawn_process: at 2018-11-15 15:58:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 15:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 15:58:35 [DEBUG   ] spawn_process: at 2018-11-15 15:58:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 15:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 15:58:35 [DEBUG   ] spawn_process: at 2018-11-15 15:58:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 15:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 15:58:35 [DEBUG   ] spawn_process: at 2018-11-15 15:58:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 15:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 15:58:35 [DEBUG   ] spawn_process: at 2018-11-15 15:58:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 15:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 15:58:35 [DEBUG   ] spawn_process: at 2018-11-15 15:58:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 15:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 15:58:35 [DEBUG   ] spawn_process: at 2018-11-15 15:58:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 15:58:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 15:58:35 [DEBUG   ] spawn_process: at 2018-11-15 15:58:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 15:58:55 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-15 15:58:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-11-15 15:58:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:58:57 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 15:58:57 [WARNING ] (13, 1, 'bot')
2018-11-15 15:58:57 [WARNING ] (13, 1, 'bot')
2018-11-15 15:58:57 [WARNING ] (13, 1, 'bot')
2018-11-15 15:58:57 [WARNING ] (13, 1, 'bot')
2018-11-15 15:58:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:58:57 [DEBUG   ] Finished updating board flags in 1.278 seconds
2018-11-15 15:58:59 [DEBUG   ] Got command BAM from MCS: ref #515890
2018-11-15 15:58:59 [INFO    ] Finished processing BAM request
2018-11-15 15:58:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:58:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515890   8 58437 57539025 A  ERROR'
2018-11-15 15:58:59 [DEBUG   ] Got command BAM from MCS: ref #515891
2018-11-15 15:58:59 [INFO    ] Finished processing BAM request
2018-11-15 15:58:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:58:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515891   8 58437 57539029 A  ERROR'
2018-11-15 15:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 15:58:59 [DEBUG   ] spawn_process: at 2018-11-15 15:58:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 15:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 15:58:59 [DEBUG   ] spawn_process: at 2018-11-15 15:58:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 15:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 15:58:59 [DEBUG   ] spawn_process: at 2018-11-15 15:58:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 15:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 15:58:59 [DEBUG   ] spawn_process: at 2018-11-15 15:58:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 15:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 15:58:59 [DEBUG   ] spawn_process: at 2018-11-15 15:58:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 15:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 15:58:59 [DEBUG   ] spawn_process: at 2018-11-15 15:58:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 15:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 15:58:59 [DEBUG   ] spawn_process: at 2018-11-15 15:58:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 15:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 15:58:59 [DEBUG   ] spawn_process: at 2018-11-15 15:58:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 15:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 15:58:59 [DEBUG   ] spawn_process: at 2018-11-15 15:58:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 15:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 15:58:59 [DEBUG   ] spawn_process: at 2018-11-15 15:58:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 15:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 15:58:59 [DEBUG   ] spawn_process: at 2018-11-15 15:58:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 15:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 15:58:59 [DEBUG   ] spawn_process: at 2018-11-15 15:58:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 15:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 15:58:59 [DEBUG   ] spawn_process: at 2018-11-15 15:58:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 15:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 15:58:59 [DEBUG   ] spawn_process: at 2018-11-15 15:58:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 15:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 15:58:59 [DEBUG   ] spawn_process: at 2018-11-15 15:58:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 15:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 15:58:59 [DEBUG   ] spawn_process: at 2018-11-15 15:58:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 15:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 15:58:59 [DEBUG   ] spawn_process: at 2018-11-15 15:58:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 15:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 15:58:59 [DEBUG   ] spawn_process: at 2018-11-15 15:58:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 15:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 15:58:59 [DEBUG   ] spawn_process: at 2018-11-15 15:58:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 15:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 15:58:59 [DEBUG   ] spawn_process: at 2018-11-15 15:58:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 15:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 15:58:59 [DEBUG   ] spawn_process: at 2018-11-15 15:58:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 15:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 15:58:59 [DEBUG   ] spawn_process: at 2018-11-15 15:58:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 15:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 15:58:59 [DEBUG   ] spawn_process: at 2018-11-15 15:58:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 15:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 15:58:59 [DEBUG   ] spawn_process: at 2018-11-15 15:58:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 15:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 15:58:59 [DEBUG   ] spawn_process: at 2018-11-15 15:58:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 15:58:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 15:58:59 [DEBUG   ] spawn_process: at 2018-11-15 15:58:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 15:59:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 15:59:23 [DEBUG   ] Got command BAM from MCS: ref #515893
2018-11-15 15:59:23 [INFO    ] Finished processing BAM request
2018-11-15 15:59:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:59:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515893   8 58437 57563025 A  ERROR'
2018-11-15 15:59:23 [DEBUG   ] Got command BAM from MCS: ref #515892
2018-11-15 15:59:23 [INFO    ] Finished processing BAM request
2018-11-15 15:59:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:59:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515892   8 58437 57563029 A  ERROR'
2018-11-15 15:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 15:59:23 [DEBUG   ] spawn_process: at 2018-11-15 15:59:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 15:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 15:59:23 [DEBUG   ] spawn_process: at 2018-11-15 15:59:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 15:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 15:59:23 [DEBUG   ] spawn_process: at 2018-11-15 15:59:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 15:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 15:59:23 [DEBUG   ] spawn_process: at 2018-11-15 15:59:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 15:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 15:59:23 [DEBUG   ] spawn_process: at 2018-11-15 15:59:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 15:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 15:59:23 [DEBUG   ] spawn_process: at 2018-11-15 15:59:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 15:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 15:59:23 [DEBUG   ] spawn_process: at 2018-11-15 15:59:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 15:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 15:59:23 [DEBUG   ] spawn_process: at 2018-11-15 15:59:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 15:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 15:59:23 [DEBUG   ] spawn_process: at 2018-11-15 15:59:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 15:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 15:59:23 [DEBUG   ] spawn_process: at 2018-11-15 15:59:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 15:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 15:59:23 [DEBUG   ] spawn_process: at 2018-11-15 15:59:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 15:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 15:59:23 [DEBUG   ] spawn_process: at 2018-11-15 15:59:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 15:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 15:59:23 [DEBUG   ] spawn_process: at 2018-11-15 15:59:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 15:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 15:59:23 [DEBUG   ] spawn_process: at 2018-11-15 15:59:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 15:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 15:59:23 [DEBUG   ] spawn_process: at 2018-11-15 15:59:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 15:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 15:59:23 [DEBUG   ] spawn_process: at 2018-11-15 15:59:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 15:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 15:59:23 [DEBUG   ] spawn_process: at 2018-11-15 15:59:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 15:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 15:59:23 [DEBUG   ] spawn_process: at 2018-11-15 15:59:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 15:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 15:59:23 [DEBUG   ] spawn_process: at 2018-11-15 15:59:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 15:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 15:59:23 [DEBUG   ] spawn_process: at 2018-11-15 15:59:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 15:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 15:59:23 [DEBUG   ] spawn_process: at 2018-11-15 15:59:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 15:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 15:59:23 [DEBUG   ] spawn_process: at 2018-11-15 15:59:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 15:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 15:59:23 [DEBUG   ] spawn_process: at 2018-11-15 15:59:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 15:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 15:59:23 [DEBUG   ] spawn_process: at 2018-11-15 15:59:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 15:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 15:59:23 [DEBUG   ] spawn_process: at 2018-11-15 15:59:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 15:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 15:59:23 [DEBUG   ] spawn_process: at 2018-11-15 15:59:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 15:59:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 15:59:47 [DEBUG   ] Got command BAM from MCS: ref #515898
2018-11-15 15:59:47 [INFO    ] Finished processing BAM request
2018-11-15 15:59:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:59:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515898   8 58437 57587033 A  ERROR'
2018-11-15 15:59:47 [DEBUG   ] Got command BAM from MCS: ref #515899
2018-11-15 15:59:47 [INFO    ] Finished processing BAM request
2018-11-15 15:59:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 15:59:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515899   8 58437 57587037 A  ERROR'
2018-11-15 15:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 15:59:47 [DEBUG   ] spawn_process: at 2018-11-15 15:59:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 15:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 15:59:47 [DEBUG   ] spawn_process: at 2018-11-15 15:59:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 15:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 15:59:47 [DEBUG   ] spawn_process: at 2018-11-15 15:59:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 15:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 15:59:47 [DEBUG   ] spawn_process: at 2018-11-15 15:59:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 15:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 15:59:47 [DEBUG   ] spawn_process: at 2018-11-15 15:59:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 15:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 15:59:47 [DEBUG   ] spawn_process: at 2018-11-15 15:59:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 15:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 15:59:47 [DEBUG   ] spawn_process: at 2018-11-15 15:59:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 15:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 15:59:47 [DEBUG   ] spawn_process: at 2018-11-15 15:59:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 15:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 15:59:47 [DEBUG   ] spawn_process: at 2018-11-15 15:59:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 15:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 15:59:47 [DEBUG   ] spawn_process: at 2018-11-15 15:59:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 15:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 15:59:47 [DEBUG   ] spawn_process: at 2018-11-15 15:59:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 15:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 15:59:47 [DEBUG   ] spawn_process: at 2018-11-15 15:59:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 15:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 15:59:47 [DEBUG   ] spawn_process: at 2018-11-15 15:59:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 15:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 15:59:47 [DEBUG   ] spawn_process: at 2018-11-15 15:59:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 15:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 15:59:47 [DEBUG   ] spawn_process: at 2018-11-15 15:59:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 15:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 15:59:47 [DEBUG   ] spawn_process: at 2018-11-15 15:59:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 15:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 15:59:47 [DEBUG   ] spawn_process: at 2018-11-15 15:59:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 15:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 15:59:47 [DEBUG   ] spawn_process: at 2018-11-15 15:59:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 15:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 15:59:47 [DEBUG   ] spawn_process: at 2018-11-15 15:59:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 15:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 15:59:47 [DEBUG   ] spawn_process: at 2018-11-15 15:59:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 15:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 15:59:47 [DEBUG   ] spawn_process: at 2018-11-15 15:59:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 15:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 15:59:47 [DEBUG   ] spawn_process: at 2018-11-15 15:59:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 15:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 15:59:47 [DEBUG   ] spawn_process: at 2018-11-15 15:59:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 15:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 15:59:47 [DEBUG   ] spawn_process: at 2018-11-15 15:59:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 15:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 15:59:47 [DEBUG   ] spawn_process: at 2018-11-15 15:59:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 15:59:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 15:59:47 [DEBUG   ] spawn_process: at 2018-11-15 15:59:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 15:59:55 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-15 15:59:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 15:59:57 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-15 15:59:57 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-15 15:59:57 [WARNING ] (13, 1, 'bot')
2018-11-15 15:59:57 [WARNING ] (13, 1, 'bot')
2018-11-15 15:59:57 [WARNING ] (13, 1, 'bot')
2018-11-15 15:59:57 [WARNING ] (13, 1, 'bot')
2018-11-15 15:59:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 15:59:57 [DEBUG   ] Finished updating board flags in 1.165 seconds
2018-11-15 16:00:11 [DEBUG   ] Got command BAM from MCS: ref #515901
2018-11-15 16:00:11 [INFO    ] Finished processing BAM request
2018-11-15 16:00:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:00:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515901   8 58437 57611029 A  ERROR'
2018-11-15 16:00:11 [DEBUG   ] Got command BAM from MCS: ref #515900
2018-11-15 16:00:11 [INFO    ] Finished processing BAM request
2018-11-15 16:00:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:00:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515900   8 58437 57611033 A  ERROR'
2018-11-15 16:00:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 16:00:11 [DEBUG   ] spawn_process: at 2018-11-15 16:00:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 16:00:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 16:00:11 [DEBUG   ] spawn_process: at 2018-11-15 16:00:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 16:00:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 16:00:11 [DEBUG   ] spawn_process: at 2018-11-15 16:00:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 16:00:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 16:00:11 [DEBUG   ] spawn_process: at 2018-11-15 16:00:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 16:00:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 16:00:11 [DEBUG   ] spawn_process: at 2018-11-15 16:00:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 16:00:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 16:00:11 [DEBUG   ] spawn_process: at 2018-11-15 16:00:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 16:00:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 16:00:11 [DEBUG   ] spawn_process: at 2018-11-15 16:00:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 16:00:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 16:00:11 [DEBUG   ] spawn_process: at 2018-11-15 16:00:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 16:00:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 16:00:11 [DEBUG   ] spawn_process: at 2018-11-15 16:00:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 16:00:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 16:00:11 [DEBUG   ] spawn_process: at 2018-11-15 16:00:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 16:00:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 16:00:11 [DEBUG   ] spawn_process: at 2018-11-15 16:00:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 16:00:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 16:00:11 [DEBUG   ] spawn_process: at 2018-11-15 16:00:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 16:00:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 16:00:11 [DEBUG   ] spawn_process: at 2018-11-15 16:00:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 16:00:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 16:00:11 [DEBUG   ] spawn_process: at 2018-11-15 16:00:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 16:00:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 16:00:11 [DEBUG   ] spawn_process: at 2018-11-15 16:00:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 16:00:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 16:00:11 [DEBUG   ] spawn_process: at 2018-11-15 16:00:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 16:00:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 16:00:11 [DEBUG   ] spawn_process: at 2018-11-15 16:00:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 16:00:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 16:00:11 [DEBUG   ] spawn_process: at 2018-11-15 16:00:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 16:00:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 16:00:11 [DEBUG   ] spawn_process: at 2018-11-15 16:00:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 16:00:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 16:00:11 [DEBUG   ] spawn_process: at 2018-11-15 16:00:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 16:00:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 16:00:11 [DEBUG   ] spawn_process: at 2018-11-15 16:00:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 16:00:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 16:00:11 [DEBUG   ] spawn_process: at 2018-11-15 16:00:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 16:00:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 16:00:11 [DEBUG   ] spawn_process: at 2018-11-15 16:00:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 16:00:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 16:00:11 [DEBUG   ] spawn_process: at 2018-11-15 16:00:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 16:00:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 16:00:11 [DEBUG   ] spawn_process: at 2018-11-15 16:00:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 16:00:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 16:00:11 [DEBUG   ] spawn_process: at 2018-11-15 16:00:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 16:00:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 16:00:35 [DEBUG   ] Got command BAM from MCS: ref #515903
2018-11-15 16:00:35 [INFO    ] Finished processing BAM request
2018-11-15 16:00:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:00:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515903   8 58437 57635033 A  ERROR'
2018-11-15 16:00:35 [DEBUG   ] Got command BAM from MCS: ref #515902
2018-11-15 16:00:35 [INFO    ] Finished processing BAM request
2018-11-15 16:00:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:00:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515902   8 58437 57635037 A  ERROR'
2018-11-15 16:00:35 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-15 16:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 16:00:35 [DEBUG   ] spawn_process: at 2018-11-15 16:00:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 16:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 16:00:35 [DEBUG   ] spawn_process: at 2018-11-15 16:00:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 16:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 16:00:35 [DEBUG   ] spawn_process: at 2018-11-15 16:00:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 16:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 16:00:35 [DEBUG   ] spawn_process: at 2018-11-15 16:00:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 16:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 16:00:35 [DEBUG   ] spawn_process: at 2018-11-15 16:00:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 16:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 16:00:35 [DEBUG   ] spawn_process: at 2018-11-15 16:00:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 16:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 16:00:35 [DEBUG   ] spawn_process: at 2018-11-15 16:00:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 16:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 16:00:35 [DEBUG   ] spawn_process: at 2018-11-15 16:00:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 16:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 16:00:35 [DEBUG   ] spawn_process: at 2018-11-15 16:00:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 16:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 16:00:35 [DEBUG   ] spawn_process: at 2018-11-15 16:00:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 16:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 16:00:35 [DEBUG   ] spawn_process: at 2018-11-15 16:00:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 16:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 16:00:35 [DEBUG   ] spawn_process: at 2018-11-15 16:00:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 16:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 16:00:35 [DEBUG   ] spawn_process: at 2018-11-15 16:00:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 16:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 16:00:35 [DEBUG   ] spawn_process: at 2018-11-15 16:00:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 16:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 16:00:35 [DEBUG   ] spawn_process: at 2018-11-15 16:00:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 16:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 16:00:35 [DEBUG   ] spawn_process: at 2018-11-15 16:00:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 16:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 16:00:35 [DEBUG   ] spawn_process: at 2018-11-15 16:00:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 16:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 16:00:35 [DEBUG   ] spawn_process: at 2018-11-15 16:00:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 16:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 16:00:35 [DEBUG   ] spawn_process: at 2018-11-15 16:00:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 16:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 16:00:35 [DEBUG   ] spawn_process: at 2018-11-15 16:00:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 16:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 16:00:35 [DEBUG   ] spawn_process: at 2018-11-15 16:00:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 16:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 16:00:35 [DEBUG   ] spawn_process: at 2018-11-15 16:00:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 16:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 16:00:35 [DEBUG   ] spawn_process: at 2018-11-15 16:00:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 16:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 16:00:35 [DEBUG   ] spawn_process: at 2018-11-15 16:00:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 16:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 16:00:35 [DEBUG   ] spawn_process: at 2018-11-15 16:00:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 16:00:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 16:00:35 [DEBUG   ] spawn_process: at 2018-11-15 16:00:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 16:00:45 [DEBUG   ] Got command RPT from MCS: ref #515904
2018-11-15 16:00:45 [DEBUG   ] summary = ERROR
2018-11-15 16:00:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515904  13 58437 57645121 A  ERRORERROR'
2018-11-15 16:00:45 [DEBUG   ] Got command RPT from MCS: ref #515905
2018-11-15 16:00:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 16:00:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515905  77 58437 57645122 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 16:00:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 16:00:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-15 16:00:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:00:57 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-15 16:00:57 [WARNING ] (13, 1, 'bot')
2018-11-15 16:00:57 [WARNING ] (13, 1, 'bot')
2018-11-15 16:00:57 [WARNING ] (13, 1, 'bot')
2018-11-15 16:00:57 [WARNING ] (13, 1, 'bot')
2018-11-15 16:00:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:00:57 [DEBUG   ] Finished updating board flags in 1.029 seconds
2018-11-15 16:00:59 [DEBUG   ] Got command BAM from MCS: ref #515922
2018-11-15 16:00:59 [INFO    ] Finished processing BAM request
2018-11-15 16:00:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:00:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515922   8 58437 57659029 A  ERROR'
2018-11-15 16:00:59 [DEBUG   ] Got command BAM from MCS: ref #515921
2018-11-15 16:00:59 [INFO    ] Finished processing BAM request
2018-11-15 16:00:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:00:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515921   8 58437 57659033 A  ERROR'
2018-11-15 16:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 16:00:59 [DEBUG   ] spawn_process: at 2018-11-15 16:00:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 16:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 16:00:59 [DEBUG   ] spawn_process: at 2018-11-15 16:00:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 16:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 16:00:59 [DEBUG   ] spawn_process: at 2018-11-15 16:00:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 16:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 16:00:59 [DEBUG   ] spawn_process: at 2018-11-15 16:00:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 16:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 16:00:59 [DEBUG   ] spawn_process: at 2018-11-15 16:00:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 16:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 16:00:59 [DEBUG   ] spawn_process: at 2018-11-15 16:00:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 16:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 16:00:59 [DEBUG   ] spawn_process: at 2018-11-15 16:00:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 16:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 16:00:59 [DEBUG   ] spawn_process: at 2018-11-15 16:00:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 16:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 16:00:59 [DEBUG   ] spawn_process: at 2018-11-15 16:00:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 16:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 16:00:59 [DEBUG   ] spawn_process: at 2018-11-15 16:00:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 16:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 16:00:59 [DEBUG   ] spawn_process: at 2018-11-15 16:00:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 16:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 16:00:59 [DEBUG   ] spawn_process: at 2018-11-15 16:00:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 16:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 16:00:59 [DEBUG   ] spawn_process: at 2018-11-15 16:00:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 16:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 16:00:59 [DEBUG   ] spawn_process: at 2018-11-15 16:00:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 16:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 16:00:59 [DEBUG   ] spawn_process: at 2018-11-15 16:00:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 16:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 16:00:59 [DEBUG   ] spawn_process: at 2018-11-15 16:00:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 16:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 16:00:59 [DEBUG   ] spawn_process: at 2018-11-15 16:00:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 16:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 16:00:59 [DEBUG   ] spawn_process: at 2018-11-15 16:00:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 16:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 16:00:59 [DEBUG   ] spawn_process: at 2018-11-15 16:00:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 16:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 16:00:59 [DEBUG   ] spawn_process: at 2018-11-15 16:00:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 16:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 16:00:59 [DEBUG   ] spawn_process: at 2018-11-15 16:00:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 16:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 16:00:59 [DEBUG   ] spawn_process: at 2018-11-15 16:00:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 16:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 16:00:59 [DEBUG   ] spawn_process: at 2018-11-15 16:00:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 16:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 16:00:59 [DEBUG   ] spawn_process: at 2018-11-15 16:00:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 16:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 16:00:59 [DEBUG   ] spawn_process: at 2018-11-15 16:00:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 16:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 16:00:59 [DEBUG   ] spawn_process: at 2018-11-15 16:00:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 16:01:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 16:01:23 [DEBUG   ] Got command BAM from MCS: ref #515924
2018-11-15 16:01:23 [INFO    ] Finished processing BAM request
2018-11-15 16:01:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:01:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515924   8 58437 57683033 A  ERROR'
2018-11-15 16:01:23 [DEBUG   ] Got command BAM from MCS: ref #515923
2018-11-15 16:01:23 [INFO    ] Finished processing BAM request
2018-11-15 16:01:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:01:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515923   8 58437 57683037 A  ERROR'
2018-11-15 16:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 16:01:23 [DEBUG   ] spawn_process: at 2018-11-15 16:01:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 16:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 16:01:23 [DEBUG   ] spawn_process: at 2018-11-15 16:01:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 16:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 16:01:23 [DEBUG   ] spawn_process: at 2018-11-15 16:01:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 16:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 16:01:23 [DEBUG   ] spawn_process: at 2018-11-15 16:01:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 16:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 16:01:23 [DEBUG   ] spawn_process: at 2018-11-15 16:01:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 16:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 16:01:23 [DEBUG   ] spawn_process: at 2018-11-15 16:01:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 16:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 16:01:23 [DEBUG   ] spawn_process: at 2018-11-15 16:01:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 16:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 16:01:23 [DEBUG   ] spawn_process: at 2018-11-15 16:01:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 16:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 16:01:23 [DEBUG   ] spawn_process: at 2018-11-15 16:01:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 16:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 16:01:23 [DEBUG   ] spawn_process: at 2018-11-15 16:01:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 16:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 16:01:23 [DEBUG   ] spawn_process: at 2018-11-15 16:01:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 16:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 16:01:23 [DEBUG   ] spawn_process: at 2018-11-15 16:01:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 16:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 16:01:23 [DEBUG   ] spawn_process: at 2018-11-15 16:01:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 16:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 16:01:23 [DEBUG   ] spawn_process: at 2018-11-15 16:01:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 16:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 16:01:23 [DEBUG   ] spawn_process: at 2018-11-15 16:01:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 16:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 16:01:23 [DEBUG   ] spawn_process: at 2018-11-15 16:01:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 16:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 16:01:23 [DEBUG   ] spawn_process: at 2018-11-15 16:01:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 16:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 16:01:23 [DEBUG   ] spawn_process: at 2018-11-15 16:01:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 16:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 16:01:23 [DEBUG   ] spawn_process: at 2018-11-15 16:01:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 16:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 16:01:23 [DEBUG   ] spawn_process: at 2018-11-15 16:01:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 16:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 16:01:23 [DEBUG   ] spawn_process: at 2018-11-15 16:01:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 16:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 16:01:23 [DEBUG   ] spawn_process: at 2018-11-15 16:01:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 16:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 16:01:23 [DEBUG   ] spawn_process: at 2018-11-15 16:01:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 16:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 16:01:23 [DEBUG   ] spawn_process: at 2018-11-15 16:01:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 16:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 16:01:23 [DEBUG   ] spawn_process: at 2018-11-15 16:01:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 16:01:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 16:01:23 [DEBUG   ] spawn_process: at 2018-11-15 16:01:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 16:01:35 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-15 16:01:47 [DEBUG   ] Got command BAM from MCS: ref #515926
2018-11-15 16:01:47 [INFO    ] Finished processing BAM request
2018-11-15 16:01:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:01:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515926   8 58437 57707025 A  ERROR'
2018-11-15 16:01:47 [DEBUG   ] Got command BAM from MCS: ref #515925
2018-11-15 16:01:47 [INFO    ] Finished processing BAM request
2018-11-15 16:01:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:01:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515925   8 58437 57707029 A  ERROR'
2018-11-15 16:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 16:01:47 [DEBUG   ] spawn_process: at 2018-11-15 16:01:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 16:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 16:01:47 [DEBUG   ] spawn_process: at 2018-11-15 16:01:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 16:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 16:01:47 [DEBUG   ] spawn_process: at 2018-11-15 16:01:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 16:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 16:01:47 [DEBUG   ] spawn_process: at 2018-11-15 16:01:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 16:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 16:01:47 [DEBUG   ] spawn_process: at 2018-11-15 16:01:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 16:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 16:01:47 [DEBUG   ] spawn_process: at 2018-11-15 16:01:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 16:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 16:01:47 [DEBUG   ] spawn_process: at 2018-11-15 16:01:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 16:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 16:01:47 [DEBUG   ] spawn_process: at 2018-11-15 16:01:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 16:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 16:01:47 [DEBUG   ] spawn_process: at 2018-11-15 16:01:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 16:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 16:01:47 [DEBUG   ] spawn_process: at 2018-11-15 16:01:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 16:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 16:01:47 [DEBUG   ] spawn_process: at 2018-11-15 16:01:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 16:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 16:01:47 [DEBUG   ] spawn_process: at 2018-11-15 16:01:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 16:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 16:01:47 [DEBUG   ] spawn_process: at 2018-11-15 16:01:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 16:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 16:01:47 [DEBUG   ] spawn_process: at 2018-11-15 16:01:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 16:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 16:01:47 [DEBUG   ] spawn_process: at 2018-11-15 16:01:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 16:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 16:01:47 [DEBUG   ] spawn_process: at 2018-11-15 16:01:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 16:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 16:01:47 [DEBUG   ] spawn_process: at 2018-11-15 16:01:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 16:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 16:01:47 [DEBUG   ] spawn_process: at 2018-11-15 16:01:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 16:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 16:01:47 [DEBUG   ] spawn_process: at 2018-11-15 16:01:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 16:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 16:01:47 [DEBUG   ] spawn_process: at 2018-11-15 16:01:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 16:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 16:01:47 [DEBUG   ] spawn_process: at 2018-11-15 16:01:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 16:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 16:01:47 [DEBUG   ] spawn_process: at 2018-11-15 16:01:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 16:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 16:01:47 [DEBUG   ] spawn_process: at 2018-11-15 16:01:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 16:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 16:01:47 [DEBUG   ] spawn_process: at 2018-11-15 16:01:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 16:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 16:01:47 [DEBUG   ] spawn_process: at 2018-11-15 16:01:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 16:01:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 16:01:47 [DEBUG   ] spawn_process: at 2018-11-15 16:01:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 16:01:55 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-15 16:01:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 16:01:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 16:01:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:01:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-11-15 16:01:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 16:01:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-15 16:01:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 16:01:58 [WARNING ] (13, 1, 'bot')
2018-11-15 16:01:58 [WARNING ] (13, 1, 'bot')
2018-11-15 16:01:58 [WARNING ] (13, 1, 'bot')
2018-11-15 16:01:58 [WARNING ] (13, 1, 'bot')
2018-11-15 16:01:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:01:58 [DEBUG   ] Finished updating board flags in 1.611 seconds
2018-11-15 16:02:11 [DEBUG   ] Got command BAM from MCS: ref #515928
2018-11-15 16:02:11 [INFO    ] Finished processing BAM request
2018-11-15 16:02:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:02:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515928   8 58437 57731033 A  ERROR'
2018-11-15 16:02:11 [DEBUG   ] Got command BAM from MCS: ref #515927
2018-11-15 16:02:11 [INFO    ] Finished processing BAM request
2018-11-15 16:02:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:02:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515927   8 58437 57731037 A  ERROR'
2018-11-15 16:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 16:02:11 [DEBUG   ] spawn_process: at 2018-11-15 16:02:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 16:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 16:02:11 [DEBUG   ] spawn_process: at 2018-11-15 16:02:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 16:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 16:02:11 [DEBUG   ] spawn_process: at 2018-11-15 16:02:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 16:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 16:02:11 [DEBUG   ] spawn_process: at 2018-11-15 16:02:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 16:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 16:02:11 [DEBUG   ] spawn_process: at 2018-11-15 16:02:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 16:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 16:02:11 [DEBUG   ] spawn_process: at 2018-11-15 16:02:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 16:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 16:02:11 [DEBUG   ] spawn_process: at 2018-11-15 16:02:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 16:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 16:02:11 [DEBUG   ] spawn_process: at 2018-11-15 16:02:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 16:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 16:02:11 [DEBUG   ] spawn_process: at 2018-11-15 16:02:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 16:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 16:02:11 [DEBUG   ] spawn_process: at 2018-11-15 16:02:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 16:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 16:02:11 [DEBUG   ] spawn_process: at 2018-11-15 16:02:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 16:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 16:02:11 [DEBUG   ] spawn_process: at 2018-11-15 16:02:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 16:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 16:02:11 [DEBUG   ] spawn_process: at 2018-11-15 16:02:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 16:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 16:02:11 [DEBUG   ] spawn_process: at 2018-11-15 16:02:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 16:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 16:02:11 [DEBUG   ] spawn_process: at 2018-11-15 16:02:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 16:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 16:02:11 [DEBUG   ] spawn_process: at 2018-11-15 16:02:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 16:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 16:02:11 [DEBUG   ] spawn_process: at 2018-11-15 16:02:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 16:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 16:02:11 [DEBUG   ] spawn_process: at 2018-11-15 16:02:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 16:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 16:02:11 [DEBUG   ] spawn_process: at 2018-11-15 16:02:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 16:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 16:02:11 [DEBUG   ] spawn_process: at 2018-11-15 16:02:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 16:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 16:02:11 [DEBUG   ] spawn_process: at 2018-11-15 16:02:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 16:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 16:02:11 [DEBUG   ] spawn_process: at 2018-11-15 16:02:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 16:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 16:02:11 [DEBUG   ] spawn_process: at 2018-11-15 16:02:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 16:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 16:02:11 [DEBUG   ] spawn_process: at 2018-11-15 16:02:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 16:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 16:02:11 [DEBUG   ] spawn_process: at 2018-11-15 16:02:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 16:02:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 16:02:11 [DEBUG   ] spawn_process: at 2018-11-15 16:02:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 16:02:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 16:02:35 [DEBUG   ] Got command BAM from MCS: ref #515933
2018-11-15 16:02:35 [INFO    ] Finished processing BAM request
2018-11-15 16:02:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515933   8 58437 57755029 A  ERROR'
2018-11-15 16:02:35 [DEBUG   ] Got command BAM from MCS: ref #515934
2018-11-15 16:02:35 [INFO    ] Finished processing BAM request
2018-11-15 16:02:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:02:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515934   8 58437 57755033 A  ERROR'
2018-11-15 16:02:35 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-15 16:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 16:02:35 [DEBUG   ] spawn_process: at 2018-11-15 16:02:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 16:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 16:02:35 [DEBUG   ] spawn_process: at 2018-11-15 16:02:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 16:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 16:02:35 [DEBUG   ] spawn_process: at 2018-11-15 16:02:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 16:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 16:02:35 [DEBUG   ] spawn_process: at 2018-11-15 16:02:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 16:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 16:02:35 [DEBUG   ] spawn_process: at 2018-11-15 16:02:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 16:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 16:02:35 [DEBUG   ] spawn_process: at 2018-11-15 16:02:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 16:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 16:02:35 [DEBUG   ] spawn_process: at 2018-11-15 16:02:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 16:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 16:02:35 [DEBUG   ] spawn_process: at 2018-11-15 16:02:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 16:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 16:02:35 [DEBUG   ] spawn_process: at 2018-11-15 16:02:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 16:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 16:02:35 [DEBUG   ] spawn_process: at 2018-11-15 16:02:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 16:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 16:02:35 [DEBUG   ] spawn_process: at 2018-11-15 16:02:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 16:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 16:02:35 [DEBUG   ] spawn_process: at 2018-11-15 16:02:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 16:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 16:02:35 [DEBUG   ] spawn_process: at 2018-11-15 16:02:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 16:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 16:02:35 [DEBUG   ] spawn_process: at 2018-11-15 16:02:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 16:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 16:02:35 [DEBUG   ] spawn_process: at 2018-11-15 16:02:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 16:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 16:02:35 [DEBUG   ] spawn_process: at 2018-11-15 16:02:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 16:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 16:02:35 [DEBUG   ] spawn_process: at 2018-11-15 16:02:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 16:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 16:02:35 [DEBUG   ] spawn_process: at 2018-11-15 16:02:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 16:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 16:02:35 [DEBUG   ] spawn_process: at 2018-11-15 16:02:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 16:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 16:02:35 [DEBUG   ] spawn_process: at 2018-11-15 16:02:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 16:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 16:02:35 [DEBUG   ] spawn_process: at 2018-11-15 16:02:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 16:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 16:02:35 [DEBUG   ] spawn_process: at 2018-11-15 16:02:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 16:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 16:02:35 [DEBUG   ] spawn_process: at 2018-11-15 16:02:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 16:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 16:02:35 [DEBUG   ] spawn_process: at 2018-11-15 16:02:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 16:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 16:02:35 [DEBUG   ] spawn_process: at 2018-11-15 16:02:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 16:02:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 16:02:35 [DEBUG   ] spawn_process: at 2018-11-15 16:02:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 16:02:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 16:02:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-11-15 16:02:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 16:02:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:02:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 16:02:58 [WARNING ] (13, 1, 'bot')
2018-11-15 16:02:58 [WARNING ] (13, 1, 'bot')
2018-11-15 16:02:58 [WARNING ] (13, 1, 'bot')
2018-11-15 16:02:58 [WARNING ] (13, 1, 'bot')
2018-11-15 16:02:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:02:58 [DEBUG   ] Finished updating board flags in 1.534 seconds
2018-11-15 16:02:59 [DEBUG   ] Got command BAM from MCS: ref #515935
2018-11-15 16:02:59 [INFO    ] Finished processing BAM request
2018-11-15 16:02:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:02:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515935   8 58437 57779025 A  ERROR'
2018-11-15 16:02:59 [DEBUG   ] Got command BAM from MCS: ref #515936
2018-11-15 16:02:59 [INFO    ] Finished processing BAM request
2018-11-15 16:02:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:02:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515936   8 58437 57779029 A  ERROR'
2018-11-15 16:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 16:02:59 [DEBUG   ] spawn_process: at 2018-11-15 16:02:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 16:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 16:02:59 [DEBUG   ] spawn_process: at 2018-11-15 16:02:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 16:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 16:02:59 [DEBUG   ] spawn_process: at 2018-11-15 16:02:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 16:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 16:02:59 [DEBUG   ] spawn_process: at 2018-11-15 16:02:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 16:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 16:02:59 [DEBUG   ] spawn_process: at 2018-11-15 16:02:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 16:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 16:02:59 [DEBUG   ] spawn_process: at 2018-11-15 16:02:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 16:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 16:02:59 [DEBUG   ] spawn_process: at 2018-11-15 16:02:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 16:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 16:02:59 [DEBUG   ] spawn_process: at 2018-11-15 16:02:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 16:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 16:02:59 [DEBUG   ] spawn_process: at 2018-11-15 16:02:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 16:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 16:02:59 [DEBUG   ] spawn_process: at 2018-11-15 16:02:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 16:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 16:02:59 [DEBUG   ] spawn_process: at 2018-11-15 16:02:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 16:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 16:02:59 [DEBUG   ] spawn_process: at 2018-11-15 16:02:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 16:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 16:02:59 [DEBUG   ] spawn_process: at 2018-11-15 16:02:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 16:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 16:02:59 [DEBUG   ] spawn_process: at 2018-11-15 16:02:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 16:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 16:02:59 [DEBUG   ] spawn_process: at 2018-11-15 16:02:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 16:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 16:02:59 [DEBUG   ] spawn_process: at 2018-11-15 16:02:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 16:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 16:02:59 [DEBUG   ] spawn_process: at 2018-11-15 16:02:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 16:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 16:02:59 [DEBUG   ] spawn_process: at 2018-11-15 16:02:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 16:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 16:02:59 [DEBUG   ] spawn_process: at 2018-11-15 16:02:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 16:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 16:02:59 [DEBUG   ] spawn_process: at 2018-11-15 16:02:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 16:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 16:02:59 [DEBUG   ] spawn_process: at 2018-11-15 16:02:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 16:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 16:02:59 [DEBUG   ] spawn_process: at 2018-11-15 16:02:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 16:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 16:02:59 [DEBUG   ] spawn_process: at 2018-11-15 16:02:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 16:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 16:02:59 [DEBUG   ] spawn_process: at 2018-11-15 16:02:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 16:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 16:02:59 [DEBUG   ] spawn_process: at 2018-11-15 16:02:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 16:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 16:02:59 [DEBUG   ] spawn_process: at 2018-11-15 16:02:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 16:03:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 16:03:19 [DEBUG   ] Got command RPT from MCS: ref #515937
2018-11-15 16:03:19 [DEBUG   ] summary = ERROR
2018-11-15 16:03:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515937  13 58437 57799073 A  ERRORERROR'
2018-11-15 16:03:19 [DEBUG   ] Got command RPT from MCS: ref #515938
2018-11-15 16:03:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 16:03:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515938  77 58437 57799277 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 16:03:19 [DEBUG   ] Got command RPT from MCS: ref #515939
2018-11-15 16:03:19 [DEBUG   ] summary = ERROR
2018-11-15 16:03:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515939  13 58437 57799481 A  ERRORERROR'
2018-11-15 16:03:19 [DEBUG   ] Got command RPT from MCS: ref #515940
2018-11-15 16:03:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 16:03:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515940  77 58437 57799673 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 16:03:19 [DEBUG   ] Got command RPT from MCS: ref #515941
2018-11-15 16:03:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 16:03:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515941  12 58437 57799877 A  ERRORB¢ff'
2018-11-15 16:03:23 [DEBUG   ] Got command BAM from MCS: ref #515942
2018-11-15 16:03:23 [INFO    ] Finished processing BAM request
2018-11-15 16:03:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:03:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515942   8 58437 57803025 A  ERROR'
2018-11-15 16:03:23 [DEBUG   ] Got command BAM from MCS: ref #515943
2018-11-15 16:03:23 [INFO    ] Finished processing BAM request
2018-11-15 16:03:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:03:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515943   8 58437 57803029 A  ERROR'
2018-11-15 16:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 16:03:23 [DEBUG   ] spawn_process: at 2018-11-15 16:03:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 16:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 16:03:23 [DEBUG   ] spawn_process: at 2018-11-15 16:03:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 16:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 16:03:23 [DEBUG   ] spawn_process: at 2018-11-15 16:03:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 16:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 16:03:23 [DEBUG   ] spawn_process: at 2018-11-15 16:03:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 16:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 16:03:23 [DEBUG   ] spawn_process: at 2018-11-15 16:03:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 16:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 16:03:23 [DEBUG   ] spawn_process: at 2018-11-15 16:03:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 16:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 16:03:23 [DEBUG   ] spawn_process: at 2018-11-15 16:03:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 16:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 16:03:23 [DEBUG   ] spawn_process: at 2018-11-15 16:03:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 16:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 16:03:23 [DEBUG   ] spawn_process: at 2018-11-15 16:03:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 16:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 16:03:23 [DEBUG   ] spawn_process: at 2018-11-15 16:03:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 16:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 16:03:23 [DEBUG   ] spawn_process: at 2018-11-15 16:03:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 16:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 16:03:23 [DEBUG   ] spawn_process: at 2018-11-15 16:03:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 16:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 16:03:23 [DEBUG   ] spawn_process: at 2018-11-15 16:03:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 16:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 16:03:23 [DEBUG   ] spawn_process: at 2018-11-15 16:03:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 16:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 16:03:23 [DEBUG   ] spawn_process: at 2018-11-15 16:03:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 16:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 16:03:23 [DEBUG   ] spawn_process: at 2018-11-15 16:03:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 16:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 16:03:23 [DEBUG   ] spawn_process: at 2018-11-15 16:03:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 16:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 16:03:23 [DEBUG   ] spawn_process: at 2018-11-15 16:03:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 16:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 16:03:23 [DEBUG   ] spawn_process: at 2018-11-15 16:03:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 16:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 16:03:23 [DEBUG   ] spawn_process: at 2018-11-15 16:03:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 16:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 16:03:23 [DEBUG   ] spawn_process: at 2018-11-15 16:03:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 16:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 16:03:23 [DEBUG   ] spawn_process: at 2018-11-15 16:03:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 16:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 16:03:23 [DEBUG   ] spawn_process: at 2018-11-15 16:03:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 16:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 16:03:23 [DEBUG   ] spawn_process: at 2018-11-15 16:03:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 16:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 16:03:23 [DEBUG   ] spawn_process: at 2018-11-15 16:03:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 16:03:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 16:03:23 [DEBUG   ] spawn_process: at 2018-11-15 16:03:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 16:03:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 16:03:47 [DEBUG   ] Got command BAM from MCS: ref #515945
2018-11-15 16:03:47 [INFO    ] Finished processing BAM request
2018-11-15 16:03:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:03:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515945   8 58437 57827025 A  ERROR'
2018-11-15 16:03:47 [DEBUG   ] Got command BAM from MCS: ref #515944
2018-11-15 16:03:47 [INFO    ] Finished processing BAM request
2018-11-15 16:03:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:03:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515944   8 58437 57827029 A  ERROR'
2018-11-15 16:03:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 16:03:47 [DEBUG   ] spawn_process: at 2018-11-15 16:03:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 16:03:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 16:03:47 [DEBUG   ] spawn_process: at 2018-11-15 16:03:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 16:03:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 16:03:47 [DEBUG   ] spawn_process: at 2018-11-15 16:03:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 16:03:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 16:03:47 [DEBUG   ] spawn_process: at 2018-11-15 16:03:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 16:03:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 16:03:47 [DEBUG   ] spawn_process: at 2018-11-15 16:03:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 16:03:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 16:03:47 [DEBUG   ] spawn_process: at 2018-11-15 16:03:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 16:03:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 16:03:47 [DEBUG   ] spawn_process: at 2018-11-15 16:03:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 16:03:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 16:03:47 [DEBUG   ] spawn_process: at 2018-11-15 16:03:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 16:03:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 16:03:47 [DEBUG   ] spawn_process: at 2018-11-15 16:03:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 16:03:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 16:03:47 [DEBUG   ] spawn_process: at 2018-11-15 16:03:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 16:03:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 16:03:47 [DEBUG   ] spawn_process: at 2018-11-15 16:03:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 16:03:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 16:03:47 [DEBUG   ] spawn_process: at 2018-11-15 16:03:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 16:03:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 16:03:47 [DEBUG   ] spawn_process: at 2018-11-15 16:03:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 16:03:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 16:03:47 [DEBUG   ] spawn_process: at 2018-11-15 16:03:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 16:03:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 16:03:47 [DEBUG   ] spawn_process: at 2018-11-15 16:03:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 16:03:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 16:03:47 [DEBUG   ] spawn_process: at 2018-11-15 16:03:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 16:03:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 16:03:47 [DEBUG   ] spawn_process: at 2018-11-15 16:03:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 16:03:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 16:03:47 [DEBUG   ] spawn_process: at 2018-11-15 16:03:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 16:03:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 16:03:47 [DEBUG   ] spawn_process: at 2018-11-15 16:03:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 16:03:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 16:03:47 [DEBUG   ] spawn_process: at 2018-11-15 16:03:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 16:03:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 16:03:47 [DEBUG   ] spawn_process: at 2018-11-15 16:03:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 16:03:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 16:03:47 [DEBUG   ] spawn_process: at 2018-11-15 16:03:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 16:03:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 16:03:47 [DEBUG   ] spawn_process: at 2018-11-15 16:03:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 16:03:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 16:03:47 [DEBUG   ] spawn_process: at 2018-11-15 16:03:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 16:03:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 16:03:47 [DEBUG   ] spawn_process: at 2018-11-15 16:03:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 16:03:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 16:03:47 [DEBUG   ] spawn_process: at 2018-11-15 16:03:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 16:03:55 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-15 16:03:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:03:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 16:03:58 [WARNING ] (13, 1, 'bot')
2018-11-15 16:03:58 [WARNING ] (13, 1, 'bot')
2018-11-15 16:03:58 [WARNING ] (13, 1, 'bot')
2018-11-15 16:03:58 [WARNING ] (13, 1, 'bot')
2018-11-15 16:03:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:03:58 [DEBUG   ] Finished updating board flags in 1.400 seconds
2018-11-15 16:04:10 [DEBUG   ] Got command BAM from MCS: ref #515946
2018-11-15 16:04:10 [INFO    ] Finished processing BAM request
2018-11-15 16:04:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:04:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515946   8 58437 57850033 A  ERROR'
2018-11-15 16:04:10 [DEBUG   ] Got command BAM from MCS: ref #515947
2018-11-15 16:04:10 [INFO    ] Finished processing BAM request
2018-11-15 16:04:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:04:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515947   8 58437 57850037 A  ERROR'
2018-11-15 16:04:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 16:04:10 [DEBUG   ] spawn_process: at 2018-11-15 16:04:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 16:04:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 16:04:10 [DEBUG   ] spawn_process: at 2018-11-15 16:04:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 16:04:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 16:04:10 [DEBUG   ] spawn_process: at 2018-11-15 16:04:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 16:04:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 16:04:10 [DEBUG   ] spawn_process: at 2018-11-15 16:04:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 16:04:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 16:04:10 [DEBUG   ] spawn_process: at 2018-11-15 16:04:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 16:04:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 16:04:10 [DEBUG   ] spawn_process: at 2018-11-15 16:04:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 16:04:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 16:04:10 [DEBUG   ] spawn_process: at 2018-11-15 16:04:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 16:04:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 16:04:10 [DEBUG   ] spawn_process: at 2018-11-15 16:04:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 16:04:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 16:04:10 [DEBUG   ] spawn_process: at 2018-11-15 16:04:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 16:04:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 16:04:10 [DEBUG   ] spawn_process: at 2018-11-15 16:04:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 16:04:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 16:04:10 [DEBUG   ] spawn_process: at 2018-11-15 16:04:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 16:04:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 16:04:10 [DEBUG   ] spawn_process: at 2018-11-15 16:04:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 16:04:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 16:04:10 [DEBUG   ] spawn_process: at 2018-11-15 16:04:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 16:04:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 16:04:10 [DEBUG   ] spawn_process: at 2018-11-15 16:04:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 16:04:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 16:04:10 [DEBUG   ] spawn_process: at 2018-11-15 16:04:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 16:04:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 16:04:10 [DEBUG   ] spawn_process: at 2018-11-15 16:04:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 16:04:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 16:04:10 [DEBUG   ] spawn_process: at 2018-11-15 16:04:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 16:04:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 16:04:10 [DEBUG   ] spawn_process: at 2018-11-15 16:04:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 16:04:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 16:04:10 [DEBUG   ] spawn_process: at 2018-11-15 16:04:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 16:04:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 16:04:10 [DEBUG   ] spawn_process: at 2018-11-15 16:04:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 16:04:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 16:04:10 [DEBUG   ] spawn_process: at 2018-11-15 16:04:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 16:04:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 16:04:10 [DEBUG   ] spawn_process: at 2018-11-15 16:04:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 16:04:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 16:04:10 [DEBUG   ] spawn_process: at 2018-11-15 16:04:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 16:04:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 16:04:10 [DEBUG   ] spawn_process: at 2018-11-15 16:04:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 16:04:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 16:04:10 [DEBUG   ] spawn_process: at 2018-11-15 16:04:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 16:04:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 16:04:10 [DEBUG   ] spawn_process: at 2018-11-15 16:04:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 16:04:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 16:04:33 [DEBUG   ] Got command BAM from MCS: ref #515949
2018-11-15 16:04:33 [INFO    ] Finished processing BAM request
2018-11-15 16:04:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:04:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515949   8 58437 57873025 A  ERROR'
2018-11-15 16:04:33 [DEBUG   ] Got command BAM from MCS: ref #515948
2018-11-15 16:04:33 [INFO    ] Finished processing BAM request
2018-11-15 16:04:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:04:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515948   8 58437 57873029 A  ERROR'
2018-11-15 16:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 16:04:33 [DEBUG   ] spawn_process: at 2018-11-15 16:04:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 16:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 16:04:33 [DEBUG   ] spawn_process: at 2018-11-15 16:04:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 16:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 16:04:33 [DEBUG   ] spawn_process: at 2018-11-15 16:04:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 16:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 16:04:33 [DEBUG   ] spawn_process: at 2018-11-15 16:04:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 16:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 16:04:33 [DEBUG   ] spawn_process: at 2018-11-15 16:04:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 16:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 16:04:33 [DEBUG   ] spawn_process: at 2018-11-15 16:04:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 16:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 16:04:33 [DEBUG   ] spawn_process: at 2018-11-15 16:04:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 16:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 16:04:33 [DEBUG   ] spawn_process: at 2018-11-15 16:04:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 16:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 16:04:33 [DEBUG   ] spawn_process: at 2018-11-15 16:04:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 16:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 16:04:33 [DEBUG   ] spawn_process: at 2018-11-15 16:04:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 16:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 16:04:33 [DEBUG   ] spawn_process: at 2018-11-15 16:04:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 16:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 16:04:33 [DEBUG   ] spawn_process: at 2018-11-15 16:04:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 16:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 16:04:33 [DEBUG   ] spawn_process: at 2018-11-15 16:04:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 16:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 16:04:33 [DEBUG   ] spawn_process: at 2018-11-15 16:04:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 16:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 16:04:33 [DEBUG   ] spawn_process: at 2018-11-15 16:04:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 16:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 16:04:33 [DEBUG   ] spawn_process: at 2018-11-15 16:04:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 16:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 16:04:33 [DEBUG   ] spawn_process: at 2018-11-15 16:04:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 16:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 16:04:33 [DEBUG   ] spawn_process: at 2018-11-15 16:04:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 16:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 16:04:33 [DEBUG   ] spawn_process: at 2018-11-15 16:04:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 16:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 16:04:33 [DEBUG   ] spawn_process: at 2018-11-15 16:04:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 16:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 16:04:33 [DEBUG   ] spawn_process: at 2018-11-15 16:04:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 16:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 16:04:33 [DEBUG   ] spawn_process: at 2018-11-15 16:04:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 16:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 16:04:33 [DEBUG   ] spawn_process: at 2018-11-15 16:04:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 16:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 16:04:33 [DEBUG   ] spawn_process: at 2018-11-15 16:04:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 16:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 16:04:33 [DEBUG   ] spawn_process: at 2018-11-15 16:04:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 16:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 16:04:33 [DEBUG   ] spawn_process: at 2018-11-15 16:04:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 16:04:35 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-15 16:04:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 16:04:56 [DEBUG   ] Got command BAM from MCS: ref #515950
2018-11-15 16:04:56 [INFO    ] Finished processing BAM request
2018-11-15 16:04:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:04:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515950   8 58437 57896033 A  ERROR'
2018-11-15 16:04:56 [DEBUG   ] Got command BAM from MCS: ref #515951
2018-11-15 16:04:56 [INFO    ] Finished processing BAM request
2018-11-15 16:04:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:04:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515951   8 58437 57896037 A  ERROR'
2018-11-15 16:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 16:04:56 [DEBUG   ] spawn_process: at 2018-11-15 16:04:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 16:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 16:04:56 [DEBUG   ] spawn_process: at 2018-11-15 16:04:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 16:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 16:04:56 [DEBUG   ] spawn_process: at 2018-11-15 16:04:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 16:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 16:04:56 [DEBUG   ] spawn_process: at 2018-11-15 16:04:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 16:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 16:04:56 [DEBUG   ] spawn_process: at 2018-11-15 16:04:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 16:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 16:04:56 [DEBUG   ] spawn_process: at 2018-11-15 16:04:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 16:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 16:04:56 [DEBUG   ] spawn_process: at 2018-11-15 16:04:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 16:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 16:04:56 [DEBUG   ] spawn_process: at 2018-11-15 16:04:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 16:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 16:04:56 [DEBUG   ] spawn_process: at 2018-11-15 16:04:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 16:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 16:04:56 [DEBUG   ] spawn_process: at 2018-11-15 16:04:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 16:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 16:04:56 [DEBUG   ] spawn_process: at 2018-11-15 16:04:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 16:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 16:04:56 [DEBUG   ] spawn_process: at 2018-11-15 16:04:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 16:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 16:04:56 [DEBUG   ] spawn_process: at 2018-11-15 16:04:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 16:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 16:04:56 [DEBUG   ] spawn_process: at 2018-11-15 16:04:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 16:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 16:04:56 [DEBUG   ] spawn_process: at 2018-11-15 16:04:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 16:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 16:04:56 [DEBUG   ] spawn_process: at 2018-11-15 16:04:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 16:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 16:04:56 [DEBUG   ] spawn_process: at 2018-11-15 16:04:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 16:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 16:04:56 [DEBUG   ] spawn_process: at 2018-11-15 16:04:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 16:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 16:04:56 [DEBUG   ] spawn_process: at 2018-11-15 16:04:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 16:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 16:04:56 [DEBUG   ] spawn_process: at 2018-11-15 16:04:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 16:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 16:04:56 [DEBUG   ] spawn_process: at 2018-11-15 16:04:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 16:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 16:04:56 [DEBUG   ] spawn_process: at 2018-11-15 16:04:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 16:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 16:04:56 [DEBUG   ] spawn_process: at 2018-11-15 16:04:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 16:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 16:04:56 [DEBUG   ] spawn_process: at 2018-11-15 16:04:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 16:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 16:04:56 [DEBUG   ] spawn_process: at 2018-11-15 16:04:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 16:04:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 16:04:56 [DEBUG   ] spawn_process: at 2018-11-15 16:04:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 16:04:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 16:04:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:04:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 16:04:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 16:04:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 16:04:58 [WARNING ] (13, 1, 'bot')
2018-11-15 16:04:58 [WARNING ] (13, 1, 'bot')
2018-11-15 16:04:58 [WARNING ] (13, 1, 'bot')
2018-11-15 16:04:58 [WARNING ] (13, 1, 'bot')
2018-11-15 16:04:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:04:58 [DEBUG   ] Finished updating board flags in 1.203 seconds
2018-11-15 16:05:15 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-15 16:05:19 [DEBUG   ] Got command BAM from MCS: ref #515952
2018-11-15 16:05:19 [INFO    ] Finished processing BAM request
2018-11-15 16:05:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:05:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515952   8 58437 57919033 A  ERROR'
2018-11-15 16:05:19 [DEBUG   ] Got command BAM from MCS: ref #515953
2018-11-15 16:05:19 [INFO    ] Finished processing BAM request
2018-11-15 16:05:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:05:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515953   8 58437 57919037 A  ERROR'
2018-11-15 16:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 16:05:19 [DEBUG   ] spawn_process: at 2018-11-15 16:05:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 16:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 16:05:19 [DEBUG   ] spawn_process: at 2018-11-15 16:05:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 16:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 16:05:19 [DEBUG   ] spawn_process: at 2018-11-15 16:05:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 16:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 16:05:19 [DEBUG   ] spawn_process: at 2018-11-15 16:05:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 16:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 16:05:19 [DEBUG   ] spawn_process: at 2018-11-15 16:05:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 16:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 16:05:19 [DEBUG   ] spawn_process: at 2018-11-15 16:05:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 16:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 16:05:19 [DEBUG   ] spawn_process: at 2018-11-15 16:05:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 16:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 16:05:19 [DEBUG   ] spawn_process: at 2018-11-15 16:05:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 16:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 16:05:19 [DEBUG   ] spawn_process: at 2018-11-15 16:05:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 16:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 16:05:19 [DEBUG   ] spawn_process: at 2018-11-15 16:05:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 16:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 16:05:19 [DEBUG   ] spawn_process: at 2018-11-15 16:05:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 16:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 16:05:19 [DEBUG   ] spawn_process: at 2018-11-15 16:05:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 16:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 16:05:19 [DEBUG   ] spawn_process: at 2018-11-15 16:05:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 16:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 16:05:19 [DEBUG   ] spawn_process: at 2018-11-15 16:05:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 16:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 16:05:19 [DEBUG   ] spawn_process: at 2018-11-15 16:05:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 16:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 16:05:19 [DEBUG   ] spawn_process: at 2018-11-15 16:05:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 16:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 16:05:19 [DEBUG   ] spawn_process: at 2018-11-15 16:05:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 16:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 16:05:19 [DEBUG   ] spawn_process: at 2018-11-15 16:05:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 16:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 16:05:19 [DEBUG   ] spawn_process: at 2018-11-15 16:05:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 16:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 16:05:19 [DEBUG   ] spawn_process: at 2018-11-15 16:05:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 16:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 16:05:19 [DEBUG   ] spawn_process: at 2018-11-15 16:05:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 16:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 16:05:19 [DEBUG   ] spawn_process: at 2018-11-15 16:05:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 16:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 16:05:19 [DEBUG   ] spawn_process: at 2018-11-15 16:05:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 16:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 16:05:19 [DEBUG   ] spawn_process: at 2018-11-15 16:05:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 16:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 16:05:19 [DEBUG   ] spawn_process: at 2018-11-15 16:05:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 16:05:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 16:05:19 [DEBUG   ] spawn_process: at 2018-11-15 16:05:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 16:05:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 16:05:42 [DEBUG   ] Got command BAM from MCS: ref #515959
2018-11-15 16:05:42 [INFO    ] Finished processing BAM request
2018-11-15 16:05:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:05:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515959   8 58437 57942025 A  ERROR'
2018-11-15 16:05:42 [DEBUG   ] Got command BAM from MCS: ref #515958
2018-11-15 16:05:42 [INFO    ] Finished processing BAM request
2018-11-15 16:05:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:05:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515958   8 58437 57942029 A  ERROR'
2018-11-15 16:05:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 16:05:42 [DEBUG   ] spawn_process: at 2018-11-15 16:05:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 16:05:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 16:05:42 [DEBUG   ] spawn_process: at 2018-11-15 16:05:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 16:05:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 16:05:42 [DEBUG   ] spawn_process: at 2018-11-15 16:05:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 16:05:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 16:05:42 [DEBUG   ] spawn_process: at 2018-11-15 16:05:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 16:05:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 16:05:42 [DEBUG   ] spawn_process: at 2018-11-15 16:05:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 16:05:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 16:05:42 [DEBUG   ] spawn_process: at 2018-11-15 16:05:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 16:05:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 16:05:42 [DEBUG   ] spawn_process: at 2018-11-15 16:05:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 16:05:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 16:05:42 [DEBUG   ] spawn_process: at 2018-11-15 16:05:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 16:05:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 16:05:42 [DEBUG   ] spawn_process: at 2018-11-15 16:05:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 16:05:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 16:05:42 [DEBUG   ] spawn_process: at 2018-11-15 16:05:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 16:05:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 16:05:42 [DEBUG   ] spawn_process: at 2018-11-15 16:05:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 16:05:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 16:05:42 [DEBUG   ] spawn_process: at 2018-11-15 16:05:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 16:05:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 16:05:42 [DEBUG   ] spawn_process: at 2018-11-15 16:05:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 16:05:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 16:05:42 [DEBUG   ] spawn_process: at 2018-11-15 16:05:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 16:05:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 16:05:42 [DEBUG   ] spawn_process: at 2018-11-15 16:05:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 16:05:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 16:05:42 [DEBUG   ] spawn_process: at 2018-11-15 16:05:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 16:05:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 16:05:42 [DEBUG   ] spawn_process: at 2018-11-15 16:05:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 16:05:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 16:05:42 [DEBUG   ] spawn_process: at 2018-11-15 16:05:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 16:05:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 16:05:42 [DEBUG   ] spawn_process: at 2018-11-15 16:05:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 16:05:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 16:05:42 [DEBUG   ] spawn_process: at 2018-11-15 16:05:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 16:05:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 16:05:42 [DEBUG   ] spawn_process: at 2018-11-15 16:05:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 16:05:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 16:05:42 [DEBUG   ] spawn_process: at 2018-11-15 16:05:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 16:05:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 16:05:42 [DEBUG   ] spawn_process: at 2018-11-15 16:05:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 16:05:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 16:05:42 [DEBUG   ] spawn_process: at 2018-11-15 16:05:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 16:05:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 16:05:42 [DEBUG   ] spawn_process: at 2018-11-15 16:05:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 16:05:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 16:05:42 [DEBUG   ] spawn_process: at 2018-11-15 16:05:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 16:05:45 [DEBUG   ] Got command RPT from MCS: ref #515960
2018-11-15 16:05:45 [DEBUG   ] summary = ERROR
2018-11-15 16:05:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515960  13 58437 57945125 A  ERRORERROR'
2018-11-15 16:05:45 [DEBUG   ] Got command RPT from MCS: ref #515961
2018-11-15 16:05:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 16:05:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515961  77 58437 57945126 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 16:05:55 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-15 16:05:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 16:05:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:05:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-11-15 16:05:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 16:05:58 [WARNING ] (13, 1, 'bot')
2018-11-15 16:05:58 [WARNING ] (13, 1, 'bot')
2018-11-15 16:05:58 [WARNING ] (13, 1, 'bot')
2018-11-15 16:05:58 [WARNING ] (13, 1, 'bot')
2018-11-15 16:05:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:05:58 [DEBUG   ] Finished updating board flags in 1.197 seconds
2018-11-15 16:06:05 [DEBUG   ] Got command BAM from MCS: ref #515978
2018-11-15 16:06:05 [INFO    ] Finished processing BAM request
2018-11-15 16:06:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515978   8 58437 57965033 A  ERROR'
2018-11-15 16:06:05 [DEBUG   ] Got command BAM from MCS: ref #515977
2018-11-15 16:06:05 [INFO    ] Finished processing BAM request
2018-11-15 16:06:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:06:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515977   8 58437 57965037 A  ERROR'
2018-11-15 16:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 16:06:05 [DEBUG   ] spawn_process: at 2018-11-15 16:06:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 16:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 16:06:05 [DEBUG   ] spawn_process: at 2018-11-15 16:06:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 16:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 16:06:05 [DEBUG   ] spawn_process: at 2018-11-15 16:06:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 16:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 16:06:05 [DEBUG   ] spawn_process: at 2018-11-15 16:06:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 16:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 16:06:05 [DEBUG   ] spawn_process: at 2018-11-15 16:06:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 16:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 16:06:05 [DEBUG   ] spawn_process: at 2018-11-15 16:06:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 16:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 16:06:05 [DEBUG   ] spawn_process: at 2018-11-15 16:06:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 16:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 16:06:05 [DEBUG   ] spawn_process: at 2018-11-15 16:06:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 16:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 16:06:05 [DEBUG   ] spawn_process: at 2018-11-15 16:06:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 16:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 16:06:05 [DEBUG   ] spawn_process: at 2018-11-15 16:06:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 16:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 16:06:05 [DEBUG   ] spawn_process: at 2018-11-15 16:06:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 16:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 16:06:05 [DEBUG   ] spawn_process: at 2018-11-15 16:06:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 16:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 16:06:05 [DEBUG   ] spawn_process: at 2018-11-15 16:06:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 16:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 16:06:05 [DEBUG   ] spawn_process: at 2018-11-15 16:06:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 16:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 16:06:05 [DEBUG   ] spawn_process: at 2018-11-15 16:06:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 16:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 16:06:05 [DEBUG   ] spawn_process: at 2018-11-15 16:06:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 16:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 16:06:05 [DEBUG   ] spawn_process: at 2018-11-15 16:06:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 16:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 16:06:05 [DEBUG   ] spawn_process: at 2018-11-15 16:06:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 16:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 16:06:05 [DEBUG   ] spawn_process: at 2018-11-15 16:06:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 16:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 16:06:05 [DEBUG   ] spawn_process: at 2018-11-15 16:06:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 16:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 16:06:05 [DEBUG   ] spawn_process: at 2018-11-15 16:06:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 16:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 16:06:05 [DEBUG   ] spawn_process: at 2018-11-15 16:06:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 16:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 16:06:05 [DEBUG   ] spawn_process: at 2018-11-15 16:06:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 16:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 16:06:05 [DEBUG   ] spawn_process: at 2018-11-15 16:06:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 16:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 16:06:05 [DEBUG   ] spawn_process: at 2018-11-15 16:06:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 16:06:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 16:06:05 [DEBUG   ] spawn_process: at 2018-11-15 16:06:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 16:06:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 16:06:28 [DEBUG   ] Got command BAM from MCS: ref #515980
2018-11-15 16:06:28 [INFO    ] Finished processing BAM request
2018-11-15 16:06:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:06:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515980   8 58437 57988069 A  ERROR'
2018-11-15 16:06:28 [DEBUG   ] Got command BAM from MCS: ref #515979
2018-11-15 16:06:28 [INFO    ] Finished processing BAM request
2018-11-15 16:06:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:06:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515979   8 58437 57988073 A  ERROR'
2018-11-15 16:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 16:06:28 [DEBUG   ] spawn_process: at 2018-11-15 16:06:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 16:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 16:06:28 [DEBUG   ] spawn_process: at 2018-11-15 16:06:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 16:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 16:06:28 [DEBUG   ] spawn_process: at 2018-11-15 16:06:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 16:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 16:06:28 [DEBUG   ] spawn_process: at 2018-11-15 16:06:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 16:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 16:06:28 [DEBUG   ] spawn_process: at 2018-11-15 16:06:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 16:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 16:06:28 [DEBUG   ] spawn_process: at 2018-11-15 16:06:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 16:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 16:06:28 [DEBUG   ] spawn_process: at 2018-11-15 16:06:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 16:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 16:06:28 [DEBUG   ] spawn_process: at 2018-11-15 16:06:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 16:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 16:06:28 [DEBUG   ] spawn_process: at 2018-11-15 16:06:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 16:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 16:06:28 [DEBUG   ] spawn_process: at 2018-11-15 16:06:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 16:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 16:06:28 [DEBUG   ] spawn_process: at 2018-11-15 16:06:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 16:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 16:06:28 [DEBUG   ] spawn_process: at 2018-11-15 16:06:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 16:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 16:06:28 [DEBUG   ] spawn_process: at 2018-11-15 16:06:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 16:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 16:06:28 [DEBUG   ] spawn_process: at 2018-11-15 16:06:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 16:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 16:06:28 [DEBUG   ] spawn_process: at 2018-11-15 16:06:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 16:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 16:06:28 [DEBUG   ] spawn_process: at 2018-11-15 16:06:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 16:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 16:06:28 [DEBUG   ] spawn_process: at 2018-11-15 16:06:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 16:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 16:06:28 [DEBUG   ] spawn_process: at 2018-11-15 16:06:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 16:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 16:06:28 [DEBUG   ] spawn_process: at 2018-11-15 16:06:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 16:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 16:06:28 [DEBUG   ] spawn_process: at 2018-11-15 16:06:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 16:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 16:06:28 [DEBUG   ] spawn_process: at 2018-11-15 16:06:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 16:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 16:06:28 [DEBUG   ] spawn_process: at 2018-11-15 16:06:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 16:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 16:06:28 [DEBUG   ] spawn_process: at 2018-11-15 16:06:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 16:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 16:06:28 [DEBUG   ] spawn_process: at 2018-11-15 16:06:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 16:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 16:06:28 [DEBUG   ] spawn_process: at 2018-11-15 16:06:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 16:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 16:06:28 [DEBUG   ] spawn_process: at 2018-11-15 16:06:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 16:06:35 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-15 16:06:51 [DEBUG   ] Got command BAM from MCS: ref #515982
2018-11-15 16:06:51 [INFO    ] Finished processing BAM request
2018-11-15 16:06:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:06:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515982   8 58437 58011029 A  ERROR'
2018-11-15 16:06:51 [DEBUG   ] Got command BAM from MCS: ref #515981
2018-11-15 16:06:51 [INFO    ] Finished processing BAM request
2018-11-15 16:06:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:06:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515981   8 58437 58011033 A  ERROR'
2018-11-15 16:06:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 16:06:51 [DEBUG   ] spawn_process: at 2018-11-15 16:06:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 16:06:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 16:06:52 [DEBUG   ] spawn_process: at 2018-11-15 16:06:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 16:06:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 16:06:52 [DEBUG   ] spawn_process: at 2018-11-15 16:06:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 16:06:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 16:06:52 [DEBUG   ] spawn_process: at 2018-11-15 16:06:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 16:06:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 16:06:52 [DEBUG   ] spawn_process: at 2018-11-15 16:06:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 16:06:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 16:06:52 [DEBUG   ] spawn_process: at 2018-11-15 16:06:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 16:06:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 16:06:52 [DEBUG   ] spawn_process: at 2018-11-15 16:06:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 16:06:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 16:06:52 [DEBUG   ] spawn_process: at 2018-11-15 16:06:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 16:06:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 16:06:52 [DEBUG   ] spawn_process: at 2018-11-15 16:06:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 16:06:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 16:06:52 [DEBUG   ] spawn_process: at 2018-11-15 16:06:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 16:06:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 16:06:52 [DEBUG   ] spawn_process: at 2018-11-15 16:06:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 16:06:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 16:06:52 [DEBUG   ] spawn_process: at 2018-11-15 16:06:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 16:06:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 16:06:52 [DEBUG   ] spawn_process: at 2018-11-15 16:06:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 16:06:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 16:06:52 [DEBUG   ] spawn_process: at 2018-11-15 16:06:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 16:06:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 16:06:52 [DEBUG   ] spawn_process: at 2018-11-15 16:06:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 16:06:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 16:06:52 [DEBUG   ] spawn_process: at 2018-11-15 16:06:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 16:06:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 16:06:52 [DEBUG   ] spawn_process: at 2018-11-15 16:06:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 16:06:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 16:06:52 [DEBUG   ] spawn_process: at 2018-11-15 16:06:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 16:06:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 16:06:52 [DEBUG   ] spawn_process: at 2018-11-15 16:06:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 16:06:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 16:06:52 [DEBUG   ] spawn_process: at 2018-11-15 16:06:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 16:06:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 16:06:52 [DEBUG   ] spawn_process: at 2018-11-15 16:06:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 16:06:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 16:06:52 [DEBUG   ] spawn_process: at 2018-11-15 16:06:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 16:06:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 16:06:52 [DEBUG   ] spawn_process: at 2018-11-15 16:06:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 16:06:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 16:06:52 [DEBUG   ] spawn_process: at 2018-11-15 16:06:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 16:06:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 16:06:52 [DEBUG   ] spawn_process: at 2018-11-15 16:06:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 16:06:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 16:06:52 [DEBUG   ] spawn_process: at 2018-11-15 16:06:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 16:06:55 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-15 16:06:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 16:06:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:06:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 16:06:58 [WARNING ] (13, 1, 'bot')
2018-11-15 16:06:58 [WARNING ] (13, 1, 'bot')
2018-11-15 16:06:58 [WARNING ] (13, 1, 'bot')
2018-11-15 16:06:58 [WARNING ] (13, 1, 'bot')
2018-11-15 16:06:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:06:58 [DEBUG   ] Finished updating board flags in 1.012 seconds
2018-11-15 16:07:14 [DEBUG   ] Got command BAM from MCS: ref #515984
2018-11-15 16:07:14 [INFO    ] Finished processing BAM request
2018-11-15 16:07:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:07:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515984   8 58437 58034033 A  ERROR'
2018-11-15 16:07:14 [DEBUG   ] Got command BAM from MCS: ref #515983
2018-11-15 16:07:14 [INFO    ] Finished processing BAM request
2018-11-15 16:07:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:07:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515983   8 58437 58034037 A  ERROR'
2018-11-15 16:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 16:07:14 [DEBUG   ] spawn_process: at 2018-11-15 16:07:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 16:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 16:07:14 [DEBUG   ] spawn_process: at 2018-11-15 16:07:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 16:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 16:07:14 [DEBUG   ] spawn_process: at 2018-11-15 16:07:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 16:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 16:07:14 [DEBUG   ] spawn_process: at 2018-11-15 16:07:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 16:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 16:07:14 [DEBUG   ] spawn_process: at 2018-11-15 16:07:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 16:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 16:07:14 [DEBUG   ] spawn_process: at 2018-11-15 16:07:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 16:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 16:07:14 [DEBUG   ] spawn_process: at 2018-11-15 16:07:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 16:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 16:07:14 [DEBUG   ] spawn_process: at 2018-11-15 16:07:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 16:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 16:07:14 [DEBUG   ] spawn_process: at 2018-11-15 16:07:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 16:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 16:07:14 [DEBUG   ] spawn_process: at 2018-11-15 16:07:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 16:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 16:07:14 [DEBUG   ] spawn_process: at 2018-11-15 16:07:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 16:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 16:07:14 [DEBUG   ] spawn_process: at 2018-11-15 16:07:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 16:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 16:07:14 [DEBUG   ] spawn_process: at 2018-11-15 16:07:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 16:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 16:07:14 [DEBUG   ] spawn_process: at 2018-11-15 16:07:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 16:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 16:07:14 [DEBUG   ] spawn_process: at 2018-11-15 16:07:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 16:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 16:07:14 [DEBUG   ] spawn_process: at 2018-11-15 16:07:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 16:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 16:07:14 [DEBUG   ] spawn_process: at 2018-11-15 16:07:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 16:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 16:07:14 [DEBUG   ] spawn_process: at 2018-11-15 16:07:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 16:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 16:07:14 [DEBUG   ] spawn_process: at 2018-11-15 16:07:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 16:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 16:07:14 [DEBUG   ] spawn_process: at 2018-11-15 16:07:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 16:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 16:07:14 [DEBUG   ] spawn_process: at 2018-11-15 16:07:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 16:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 16:07:14 [DEBUG   ] spawn_process: at 2018-11-15 16:07:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 16:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 16:07:14 [DEBUG   ] spawn_process: at 2018-11-15 16:07:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 16:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 16:07:14 [DEBUG   ] spawn_process: at 2018-11-15 16:07:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 16:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 16:07:14 [DEBUG   ] spawn_process: at 2018-11-15 16:07:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 16:07:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 16:07:14 [DEBUG   ] spawn_process: at 2018-11-15 16:07:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 16:07:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 16:07:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 16:07:37 [DEBUG   ] Got command BAM from MCS: ref #515986
2018-11-15 16:07:37 [INFO    ] Finished processing BAM request
2018-11-15 16:07:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:07:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515986   8 58437 58057025 A  ERROR'
2018-11-15 16:07:37 [DEBUG   ] Got command BAM from MCS: ref #515985
2018-11-15 16:07:37 [INFO    ] Finished processing BAM request
2018-11-15 16:07:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:07:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515985   8 58437 58057029 A  ERROR'
2018-11-15 16:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 16:07:37 [DEBUG   ] spawn_process: at 2018-11-15 16:07:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 16:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 16:07:37 [DEBUG   ] spawn_process: at 2018-11-15 16:07:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 16:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 16:07:37 [DEBUG   ] spawn_process: at 2018-11-15 16:07:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 16:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 16:07:37 [DEBUG   ] spawn_process: at 2018-11-15 16:07:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 16:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 16:07:37 [DEBUG   ] spawn_process: at 2018-11-15 16:07:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 16:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 16:07:37 [DEBUG   ] spawn_process: at 2018-11-15 16:07:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 16:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 16:07:37 [DEBUG   ] spawn_process: at 2018-11-15 16:07:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 16:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 16:07:37 [DEBUG   ] spawn_process: at 2018-11-15 16:07:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 16:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 16:07:37 [DEBUG   ] spawn_process: at 2018-11-15 16:07:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 16:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 16:07:37 [DEBUG   ] spawn_process: at 2018-11-15 16:07:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 16:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 16:07:37 [DEBUG   ] spawn_process: at 2018-11-15 16:07:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 16:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 16:07:37 [DEBUG   ] spawn_process: at 2018-11-15 16:07:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 16:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 16:07:37 [DEBUG   ] spawn_process: at 2018-11-15 16:07:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 16:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 16:07:37 [DEBUG   ] spawn_process: at 2018-11-15 16:07:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 16:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 16:07:37 [DEBUG   ] spawn_process: at 2018-11-15 16:07:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 16:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 16:07:37 [DEBUG   ] spawn_process: at 2018-11-15 16:07:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 16:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 16:07:37 [DEBUG   ] spawn_process: at 2018-11-15 16:07:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 16:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 16:07:37 [DEBUG   ] spawn_process: at 2018-11-15 16:07:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 16:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 16:07:37 [DEBUG   ] spawn_process: at 2018-11-15 16:07:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 16:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 16:07:37 [DEBUG   ] spawn_process: at 2018-11-15 16:07:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 16:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 16:07:37 [DEBUG   ] spawn_process: at 2018-11-15 16:07:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 16:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 16:07:37 [DEBUG   ] spawn_process: at 2018-11-15 16:07:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 16:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 16:07:37 [DEBUG   ] spawn_process: at 2018-11-15 16:07:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 16:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 16:07:37 [DEBUG   ] spawn_process: at 2018-11-15 16:07:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 16:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 16:07:37 [DEBUG   ] spawn_process: at 2018-11-15 16:07:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 16:07:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 16:07:37 [DEBUG   ] spawn_process: at 2018-11-15 16:07:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 16:07:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 16:07:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-15 16:07:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 16:07:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:07:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 16:07:58 [WARNING ] (13, 1, 'bot')
2018-11-15 16:07:58 [WARNING ] (13, 1, 'bot')
2018-11-15 16:07:58 [WARNING ] (13, 1, 'bot')
2018-11-15 16:07:58 [WARNING ] (13, 1, 'bot')
2018-11-15 16:07:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:07:58 [DEBUG   ] Finished updating board flags in 0.998 seconds
2018-11-15 16:08:00 [DEBUG   ] Got command BAM from MCS: ref #515988
2018-11-15 16:08:00 [INFO    ] Finished processing BAM request
2018-11-15 16:08:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:08:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515988   8 58437 58080029 A  ERROR'
2018-11-15 16:08:00 [DEBUG   ] Got command BAM from MCS: ref #515987
2018-11-15 16:08:00 [INFO    ] Finished processing BAM request
2018-11-15 16:08:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:08:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   515987   8 58437 58080033 A  ERROR'
2018-11-15 16:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 16:08:00 [DEBUG   ] spawn_process: at 2018-11-15 16:08:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 16:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 16:08:00 [DEBUG   ] spawn_process: at 2018-11-15 16:08:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 16:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 16:08:00 [DEBUG   ] spawn_process: at 2018-11-15 16:08:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 16:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 16:08:00 [DEBUG   ] spawn_process: at 2018-11-15 16:08:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 16:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 16:08:00 [DEBUG   ] spawn_process: at 2018-11-15 16:08:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 16:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 16:08:00 [DEBUG   ] spawn_process: at 2018-11-15 16:08:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 16:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 16:08:00 [DEBUG   ] spawn_process: at 2018-11-15 16:08:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 16:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 16:08:00 [DEBUG   ] spawn_process: at 2018-11-15 16:08:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 16:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 16:08:00 [DEBUG   ] spawn_process: at 2018-11-15 16:08:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 16:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 16:08:00 [DEBUG   ] spawn_process: at 2018-11-15 16:08:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 16:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 16:08:00 [DEBUG   ] spawn_process: at 2018-11-15 16:08:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 16:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 16:08:00 [DEBUG   ] spawn_process: at 2018-11-15 16:08:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 16:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 16:08:00 [DEBUG   ] spawn_process: at 2018-11-15 16:08:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 16:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 16:08:00 [DEBUG   ] spawn_process: at 2018-11-15 16:08:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 16:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 16:08:00 [DEBUG   ] spawn_process: at 2018-11-15 16:08:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 16:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 16:08:00 [DEBUG   ] spawn_process: at 2018-11-15 16:08:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 16:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 16:08:00 [DEBUG   ] spawn_process: at 2018-11-15 16:08:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 16:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 16:08:00 [DEBUG   ] spawn_process: at 2018-11-15 16:08:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 16:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 16:08:00 [DEBUG   ] spawn_process: at 2018-11-15 16:08:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 16:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 16:08:00 [DEBUG   ] spawn_process: at 2018-11-15 16:08:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 16:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 16:08:00 [DEBUG   ] spawn_process: at 2018-11-15 16:08:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 16:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 16:08:00 [DEBUG   ] spawn_process: at 2018-11-15 16:08:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 16:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 16:08:00 [DEBUG   ] spawn_process: at 2018-11-15 16:08:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 16:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 16:08:00 [DEBUG   ] spawn_process: at 2018-11-15 16:08:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 16:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 16:08:00 [DEBUG   ] spawn_process: at 2018-11-15 16:08:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 16:08:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 16:08:00 [DEBUG   ] spawn_process: at 2018-11-15 16:08:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 16:08:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 16:08:19 [DEBUG   ] Got command RPT from MCS: ref #515991
2018-11-15 16:08:19 [DEBUG   ] summary = ERROR
2018-11-15 16:08:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515991  13 58437 58099161 A  ERRORERROR'
2018-11-15 16:08:19 [DEBUG   ] Got command RPT from MCS: ref #515992
2018-11-15 16:08:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 16:08:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515992  77 58437 58099365 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 16:08:19 [DEBUG   ] Got command RPT from MCS: ref #515993
2018-11-15 16:08:19 [DEBUG   ] summary = ERROR
2018-11-15 16:08:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515993  13 58437 58099557 A  ERRORERROR'
2018-11-15 16:08:19 [DEBUG   ] Got command RPT from MCS: ref #515995
2018-11-15 16:08:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 16:08:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515995  77 58437 58099761 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 16:08:19 [DEBUG   ] Got command RPT from MCS: ref #515996
2018-11-15 16:08:19 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 16:08:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   515996  12 58437 58099965 A  ERRORB£ff'
2018-11-15 16:08:23 [DEBUG   ] Got command BAM from MCS: ref #516001
2018-11-15 16:08:23 [INFO    ] Finished processing BAM request
2018-11-15 16:08:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:08:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516001   8 58437 58103029 A  ERROR'
2018-11-15 16:08:23 [DEBUG   ] Got command BAM from MCS: ref #516002
2018-11-15 16:08:23 [INFO    ] Finished processing BAM request
2018-11-15 16:08:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:08:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516002   8 58437 58103033 A  ERROR'
2018-11-15 16:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 16:08:23 [DEBUG   ] spawn_process: at 2018-11-15 16:08:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 16:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 16:08:23 [DEBUG   ] spawn_process: at 2018-11-15 16:08:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 16:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 16:08:23 [DEBUG   ] spawn_process: at 2018-11-15 16:08:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 16:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 16:08:23 [DEBUG   ] spawn_process: at 2018-11-15 16:08:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 16:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 16:08:23 [DEBUG   ] spawn_process: at 2018-11-15 16:08:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 16:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 16:08:23 [DEBUG   ] spawn_process: at 2018-11-15 16:08:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 16:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 16:08:23 [DEBUG   ] spawn_process: at 2018-11-15 16:08:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 16:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 16:08:23 [DEBUG   ] spawn_process: at 2018-11-15 16:08:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 16:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 16:08:23 [DEBUG   ] spawn_process: at 2018-11-15 16:08:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 16:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 16:08:23 [DEBUG   ] spawn_process: at 2018-11-15 16:08:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 16:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 16:08:23 [DEBUG   ] spawn_process: at 2018-11-15 16:08:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 16:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 16:08:23 [DEBUG   ] spawn_process: at 2018-11-15 16:08:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 16:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 16:08:23 [DEBUG   ] spawn_process: at 2018-11-15 16:08:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 16:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 16:08:23 [DEBUG   ] spawn_process: at 2018-11-15 16:08:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 16:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 16:08:23 [DEBUG   ] spawn_process: at 2018-11-15 16:08:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 16:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 16:08:23 [DEBUG   ] spawn_process: at 2018-11-15 16:08:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 16:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 16:08:23 [DEBUG   ] spawn_process: at 2018-11-15 16:08:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 16:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 16:08:23 [DEBUG   ] spawn_process: at 2018-11-15 16:08:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 16:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 16:08:23 [DEBUG   ] spawn_process: at 2018-11-15 16:08:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 16:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 16:08:23 [DEBUG   ] spawn_process: at 2018-11-15 16:08:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 16:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 16:08:23 [DEBUG   ] spawn_process: at 2018-11-15 16:08:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 16:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 16:08:23 [DEBUG   ] spawn_process: at 2018-11-15 16:08:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 16:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 16:08:23 [DEBUG   ] spawn_process: at 2018-11-15 16:08:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 16:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 16:08:23 [DEBUG   ] spawn_process: at 2018-11-15 16:08:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 16:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 16:08:23 [DEBUG   ] spawn_process: at 2018-11-15 16:08:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 16:08:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 16:08:23 [DEBUG   ] spawn_process: at 2018-11-15 16:08:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 16:08:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 16:08:46 [DEBUG   ] Got command BAM from MCS: ref #516008
2018-11-15 16:08:46 [INFO    ] Finished processing BAM request
2018-11-15 16:08:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:08:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516008   8 58437 58126029 A  ERROR'
2018-11-15 16:08:46 [DEBUG   ] Got command BAM from MCS: ref #516007
2018-11-15 16:08:46 [INFO    ] Finished processing BAM request
2018-11-15 16:08:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:08:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516007   8 58437 58126033 A  ERROR'
2018-11-15 16:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 16:08:46 [DEBUG   ] spawn_process: at 2018-11-15 16:08:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 16:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 16:08:46 [DEBUG   ] spawn_process: at 2018-11-15 16:08:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 16:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 16:08:46 [DEBUG   ] spawn_process: at 2018-11-15 16:08:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 16:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 16:08:46 [DEBUG   ] spawn_process: at 2018-11-15 16:08:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 16:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 16:08:46 [DEBUG   ] spawn_process: at 2018-11-15 16:08:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 16:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 16:08:46 [DEBUG   ] spawn_process: at 2018-11-15 16:08:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 16:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 16:08:46 [DEBUG   ] spawn_process: at 2018-11-15 16:08:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 16:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 16:08:46 [DEBUG   ] spawn_process: at 2018-11-15 16:08:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 16:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 16:08:46 [DEBUG   ] spawn_process: at 2018-11-15 16:08:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 16:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 16:08:46 [DEBUG   ] spawn_process: at 2018-11-15 16:08:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 16:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 16:08:46 [DEBUG   ] spawn_process: at 2018-11-15 16:08:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 16:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 16:08:46 [DEBUG   ] spawn_process: at 2018-11-15 16:08:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 16:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 16:08:46 [DEBUG   ] spawn_process: at 2018-11-15 16:08:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 16:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 16:08:46 [DEBUG   ] spawn_process: at 2018-11-15 16:08:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 16:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 16:08:46 [DEBUG   ] spawn_process: at 2018-11-15 16:08:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 16:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 16:08:46 [DEBUG   ] spawn_process: at 2018-11-15 16:08:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 16:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 16:08:46 [DEBUG   ] spawn_process: at 2018-11-15 16:08:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 16:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 16:08:46 [DEBUG   ] spawn_process: at 2018-11-15 16:08:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 16:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 16:08:46 [DEBUG   ] spawn_process: at 2018-11-15 16:08:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 16:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 16:08:46 [DEBUG   ] spawn_process: at 2018-11-15 16:08:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 16:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 16:08:46 [DEBUG   ] spawn_process: at 2018-11-15 16:08:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 16:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 16:08:46 [DEBUG   ] spawn_process: at 2018-11-15 16:08:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 16:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 16:08:46 [DEBUG   ] spawn_process: at 2018-11-15 16:08:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 16:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 16:08:46 [DEBUG   ] spawn_process: at 2018-11-15 16:08:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 16:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 16:08:46 [DEBUG   ] spawn_process: at 2018-11-15 16:08:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 16:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 16:08:46 [DEBUG   ] spawn_process: at 2018-11-15 16:08:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 16:08:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 16:08:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 16:08:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:08:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-15 16:08:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 16:08:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 16:08:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 16:08:58 [WARNING ] (13, 1, 'bot')
2018-11-15 16:08:58 [WARNING ] (13, 1, 'bot')
2018-11-15 16:08:58 [WARNING ] (13, 1, 'bot')
2018-11-15 16:08:58 [WARNING ] (13, 1, 'bot')
2018-11-15 16:08:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:08:58 [DEBUG   ] Finished updating board flags in 1.270 seconds
2018-11-15 16:09:09 [DEBUG   ] Got command BAM from MCS: ref #516010
2018-11-15 16:09:09 [INFO    ] Finished processing BAM request
2018-11-15 16:09:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:09:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516010   8 58437 58149033 A  ERROR'
2018-11-15 16:09:09 [DEBUG   ] Got command BAM from MCS: ref #516009
2018-11-15 16:09:09 [INFO    ] Finished processing BAM request
2018-11-15 16:09:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:09:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516009   8 58437 58149037 A  ERROR'
2018-11-15 16:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 16:09:09 [DEBUG   ] spawn_process: at 2018-11-15 16:09:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 16:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 16:09:09 [DEBUG   ] spawn_process: at 2018-11-15 16:09:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 16:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 16:09:09 [DEBUG   ] spawn_process: at 2018-11-15 16:09:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 16:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 16:09:09 [DEBUG   ] spawn_process: at 2018-11-15 16:09:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 16:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 16:09:09 [DEBUG   ] spawn_process: at 2018-11-15 16:09:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 16:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 16:09:09 [DEBUG   ] spawn_process: at 2018-11-15 16:09:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 16:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 16:09:09 [DEBUG   ] spawn_process: at 2018-11-15 16:09:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 16:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 16:09:09 [DEBUG   ] spawn_process: at 2018-11-15 16:09:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 16:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 16:09:09 [DEBUG   ] spawn_process: at 2018-11-15 16:09:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 16:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 16:09:09 [DEBUG   ] spawn_process: at 2018-11-15 16:09:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 16:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 16:09:09 [DEBUG   ] spawn_process: at 2018-11-15 16:09:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 16:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 16:09:09 [DEBUG   ] spawn_process: at 2018-11-15 16:09:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 16:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 16:09:09 [DEBUG   ] spawn_process: at 2018-11-15 16:09:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 16:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 16:09:09 [DEBUG   ] spawn_process: at 2018-11-15 16:09:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 16:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 16:09:09 [DEBUG   ] spawn_process: at 2018-11-15 16:09:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 16:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 16:09:09 [DEBUG   ] spawn_process: at 2018-11-15 16:09:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 16:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 16:09:09 [DEBUG   ] spawn_process: at 2018-11-15 16:09:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 16:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 16:09:09 [DEBUG   ] spawn_process: at 2018-11-15 16:09:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 16:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 16:09:09 [DEBUG   ] spawn_process: at 2018-11-15 16:09:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 16:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 16:09:09 [DEBUG   ] spawn_process: at 2018-11-15 16:09:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 16:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 16:09:09 [DEBUG   ] spawn_process: at 2018-11-15 16:09:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 16:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 16:09:09 [DEBUG   ] spawn_process: at 2018-11-15 16:09:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 16:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 16:09:09 [DEBUG   ] spawn_process: at 2018-11-15 16:09:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 16:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 16:09:09 [DEBUG   ] spawn_process: at 2018-11-15 16:09:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 16:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 16:09:09 [DEBUG   ] spawn_process: at 2018-11-15 16:09:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 16:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 16:09:09 [DEBUG   ] spawn_process: at 2018-11-15 16:09:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 16:09:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 16:09:32 [DEBUG   ] Got command BAM from MCS: ref #516012
2018-11-15 16:09:32 [INFO    ] Finished processing BAM request
2018-11-15 16:09:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:09:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516012   8 58437 58172029 A  ERROR'
2018-11-15 16:09:32 [DEBUG   ] Got command BAM from MCS: ref #516011
2018-11-15 16:09:32 [INFO    ] Finished processing BAM request
2018-11-15 16:09:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:09:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516011   8 58437 58172033 A  ERROR'
2018-11-15 16:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 16:09:32 [DEBUG   ] spawn_process: at 2018-11-15 16:09:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 16:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 16:09:32 [DEBUG   ] spawn_process: at 2018-11-15 16:09:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 16:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 16:09:32 [DEBUG   ] spawn_process: at 2018-11-15 16:09:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 16:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 16:09:32 [DEBUG   ] spawn_process: at 2018-11-15 16:09:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 16:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 16:09:32 [DEBUG   ] spawn_process: at 2018-11-15 16:09:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 16:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 16:09:32 [DEBUG   ] spawn_process: at 2018-11-15 16:09:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 16:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 16:09:32 [DEBUG   ] spawn_process: at 2018-11-15 16:09:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 16:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 16:09:32 [DEBUG   ] spawn_process: at 2018-11-15 16:09:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 16:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 16:09:32 [DEBUG   ] spawn_process: at 2018-11-15 16:09:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 16:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 16:09:32 [DEBUG   ] spawn_process: at 2018-11-15 16:09:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 16:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 16:09:32 [DEBUG   ] spawn_process: at 2018-11-15 16:09:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 16:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 16:09:32 [DEBUG   ] spawn_process: at 2018-11-15 16:09:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 16:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 16:09:32 [DEBUG   ] spawn_process: at 2018-11-15 16:09:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 16:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 16:09:32 [DEBUG   ] spawn_process: at 2018-11-15 16:09:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 16:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 16:09:32 [DEBUG   ] spawn_process: at 2018-11-15 16:09:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 16:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 16:09:32 [DEBUG   ] spawn_process: at 2018-11-15 16:09:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 16:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 16:09:32 [DEBUG   ] spawn_process: at 2018-11-15 16:09:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 16:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 16:09:32 [DEBUG   ] spawn_process: at 2018-11-15 16:09:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 16:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 16:09:32 [DEBUG   ] spawn_process: at 2018-11-15 16:09:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 16:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 16:09:32 [DEBUG   ] spawn_process: at 2018-11-15 16:09:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 16:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 16:09:32 [DEBUG   ] spawn_process: at 2018-11-15 16:09:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 16:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 16:09:32 [DEBUG   ] spawn_process: at 2018-11-15 16:09:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 16:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 16:09:32 [DEBUG   ] spawn_process: at 2018-11-15 16:09:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 16:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 16:09:32 [DEBUG   ] spawn_process: at 2018-11-15 16:09:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 16:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 16:09:32 [DEBUG   ] spawn_process: at 2018-11-15 16:09:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 16:09:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 16:09:32 [DEBUG   ] spawn_process: at 2018-11-15 16:09:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 16:09:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 16:09:55 [DEBUG   ] Got command BAM from MCS: ref #516013
2018-11-15 16:09:55 [INFO    ] Finished processing BAM request
2018-11-15 16:09:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:09:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516013   8 58437 58195029 A  ERROR'
2018-11-15 16:09:55 [DEBUG   ] Got command BAM from MCS: ref #516014
2018-11-15 16:09:55 [INFO    ] Finished processing BAM request
2018-11-15 16:09:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:09:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516014   8 58437 58195033 A  ERROR'
2018-11-15 16:09:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 16:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 16:09:55 [DEBUG   ] spawn_process: at 2018-11-15 16:09:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 16:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 16:09:55 [DEBUG   ] spawn_process: at 2018-11-15 16:09:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 16:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 16:09:55 [DEBUG   ] spawn_process: at 2018-11-15 16:09:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 16:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 16:09:55 [DEBUG   ] spawn_process: at 2018-11-15 16:09:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 16:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 16:09:55 [DEBUG   ] spawn_process: at 2018-11-15 16:09:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 16:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 16:09:55 [DEBUG   ] spawn_process: at 2018-11-15 16:09:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 16:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 16:09:55 [DEBUG   ] spawn_process: at 2018-11-15 16:09:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 16:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 16:09:55 [DEBUG   ] spawn_process: at 2018-11-15 16:09:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 16:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 16:09:55 [DEBUG   ] spawn_process: at 2018-11-15 16:09:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 16:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 16:09:55 [DEBUG   ] spawn_process: at 2018-11-15 16:09:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 16:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 16:09:55 [DEBUG   ] spawn_process: at 2018-11-15 16:09:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 16:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 16:09:55 [DEBUG   ] spawn_process: at 2018-11-15 16:09:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 16:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 16:09:55 [DEBUG   ] spawn_process: at 2018-11-15 16:09:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 16:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 16:09:55 [DEBUG   ] spawn_process: at 2018-11-15 16:09:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 16:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 16:09:55 [DEBUG   ] spawn_process: at 2018-11-15 16:09:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 16:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 16:09:55 [DEBUG   ] spawn_process: at 2018-11-15 16:09:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 16:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 16:09:55 [DEBUG   ] spawn_process: at 2018-11-15 16:09:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 16:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 16:09:55 [DEBUG   ] spawn_process: at 2018-11-15 16:09:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 16:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 16:09:55 [DEBUG   ] spawn_process: at 2018-11-15 16:09:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 16:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 16:09:55 [DEBUG   ] spawn_process: at 2018-11-15 16:09:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 16:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 16:09:55 [DEBUG   ] spawn_process: at 2018-11-15 16:09:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 16:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 16:09:55 [DEBUG   ] spawn_process: at 2018-11-15 16:09:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 16:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 16:09:55 [DEBUG   ] spawn_process: at 2018-11-15 16:09:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 16:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 16:09:55 [DEBUG   ] spawn_process: at 2018-11-15 16:09:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 16:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 16:09:55 [DEBUG   ] spawn_process: at 2018-11-15 16:09:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 16:09:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 16:09:55 [DEBUG   ] spawn_process: at 2018-11-15 16:09:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 16:09:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 16:09:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 16:09:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:09:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 16:09:58 [WARNING ] (13, 1, 'bot')
2018-11-15 16:09:58 [WARNING ] (13, 1, 'bot')
2018-11-15 16:09:58 [WARNING ] (13, 1, 'bot')
2018-11-15 16:09:58 [WARNING ] (13, 1, 'bot')
2018-11-15 16:09:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:09:58 [DEBUG   ] Finished updating board flags in 1.209 seconds
2018-11-15 16:10:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 16:10:18 [DEBUG   ] Got command BAM from MCS: ref #516015
2018-11-15 16:10:18 [INFO    ] Finished processing BAM request
2018-11-15 16:10:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:10:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516015   8 58437 58218033 A  ERROR'
2018-11-15 16:10:18 [DEBUG   ] Got command BAM from MCS: ref #516016
2018-11-15 16:10:18 [INFO    ] Finished processing BAM request
2018-11-15 16:10:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:10:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516016   8 58437 58218037 A  ERROR'
2018-11-15 16:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 16:10:18 [DEBUG   ] spawn_process: at 2018-11-15 16:10:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 16:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 16:10:18 [DEBUG   ] spawn_process: at 2018-11-15 16:10:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 16:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 16:10:18 [DEBUG   ] spawn_process: at 2018-11-15 16:10:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 16:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 16:10:18 [DEBUG   ] spawn_process: at 2018-11-15 16:10:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 16:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 16:10:18 [DEBUG   ] spawn_process: at 2018-11-15 16:10:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 16:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 16:10:18 [DEBUG   ] spawn_process: at 2018-11-15 16:10:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 16:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 16:10:18 [DEBUG   ] spawn_process: at 2018-11-15 16:10:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 16:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 16:10:18 [DEBUG   ] spawn_process: at 2018-11-15 16:10:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 16:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 16:10:18 [DEBUG   ] spawn_process: at 2018-11-15 16:10:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 16:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 16:10:18 [DEBUG   ] spawn_process: at 2018-11-15 16:10:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 16:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 16:10:18 [DEBUG   ] spawn_process: at 2018-11-15 16:10:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 16:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 16:10:18 [DEBUG   ] spawn_process: at 2018-11-15 16:10:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 16:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 16:10:18 [DEBUG   ] spawn_process: at 2018-11-15 16:10:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 16:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 16:10:18 [DEBUG   ] spawn_process: at 2018-11-15 16:10:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 16:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 16:10:18 [DEBUG   ] spawn_process: at 2018-11-15 16:10:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 16:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 16:10:18 [DEBUG   ] spawn_process: at 2018-11-15 16:10:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 16:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 16:10:18 [DEBUG   ] spawn_process: at 2018-11-15 16:10:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 16:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 16:10:18 [DEBUG   ] spawn_process: at 2018-11-15 16:10:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 16:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 16:10:18 [DEBUG   ] spawn_process: at 2018-11-15 16:10:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 16:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 16:10:18 [DEBUG   ] spawn_process: at 2018-11-15 16:10:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 16:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 16:10:18 [DEBUG   ] spawn_process: at 2018-11-15 16:10:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 16:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 16:10:18 [DEBUG   ] spawn_process: at 2018-11-15 16:10:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 16:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 16:10:18 [DEBUG   ] spawn_process: at 2018-11-15 16:10:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 16:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 16:10:18 [DEBUG   ] spawn_process: at 2018-11-15 16:10:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 16:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 16:10:18 [DEBUG   ] spawn_process: at 2018-11-15 16:10:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 16:10:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 16:10:18 [DEBUG   ] spawn_process: at 2018-11-15 16:10:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 16:10:35 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-15 16:10:41 [DEBUG   ] Got command BAM from MCS: ref #516018
2018-11-15 16:10:41 [INFO    ] Finished processing BAM request
2018-11-15 16:10:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:10:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516018   8 58437 58241029 A  ERROR'
2018-11-15 16:10:41 [DEBUG   ] Got command BAM from MCS: ref #516017
2018-11-15 16:10:41 [INFO    ] Finished processing BAM request
2018-11-15 16:10:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:10:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516017   8 58437 58241033 A  ERROR'
2018-11-15 16:10:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 16:10:41 [DEBUG   ] spawn_process: at 2018-11-15 16:10:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 16:10:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 16:10:41 [DEBUG   ] spawn_process: at 2018-11-15 16:10:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 16:10:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 16:10:41 [DEBUG   ] spawn_process: at 2018-11-15 16:10:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 16:10:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 16:10:41 [DEBUG   ] spawn_process: at 2018-11-15 16:10:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 16:10:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 16:10:41 [DEBUG   ] spawn_process: at 2018-11-15 16:10:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 16:10:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 16:10:41 [DEBUG   ] spawn_process: at 2018-11-15 16:10:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 16:10:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 16:10:41 [DEBUG   ] spawn_process: at 2018-11-15 16:10:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 16:10:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 16:10:41 [DEBUG   ] spawn_process: at 2018-11-15 16:10:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 16:10:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 16:10:41 [DEBUG   ] spawn_process: at 2018-11-15 16:10:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 16:10:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 16:10:41 [DEBUG   ] spawn_process: at 2018-11-15 16:10:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 16:10:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 16:10:41 [DEBUG   ] spawn_process: at 2018-11-15 16:10:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 16:10:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 16:10:41 [DEBUG   ] spawn_process: at 2018-11-15 16:10:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 16:10:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 16:10:41 [DEBUG   ] spawn_process: at 2018-11-15 16:10:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 16:10:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 16:10:41 [DEBUG   ] spawn_process: at 2018-11-15 16:10:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 16:10:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 16:10:41 [DEBUG   ] spawn_process: at 2018-11-15 16:10:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 16:10:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 16:10:41 [DEBUG   ] spawn_process: at 2018-11-15 16:10:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 16:10:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 16:10:41 [DEBUG   ] spawn_process: at 2018-11-15 16:10:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 16:10:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 16:10:41 [DEBUG   ] spawn_process: at 2018-11-15 16:10:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 16:10:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 16:10:41 [DEBUG   ] spawn_process: at 2018-11-15 16:10:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 16:10:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 16:10:41 [DEBUG   ] spawn_process: at 2018-11-15 16:10:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 16:10:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 16:10:41 [DEBUG   ] spawn_process: at 2018-11-15 16:10:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 16:10:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 16:10:41 [DEBUG   ] spawn_process: at 2018-11-15 16:10:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 16:10:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 16:10:41 [DEBUG   ] spawn_process: at 2018-11-15 16:10:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 16:10:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 16:10:41 [DEBUG   ] spawn_process: at 2018-11-15 16:10:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 16:10:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 16:10:41 [DEBUG   ] spawn_process: at 2018-11-15 16:10:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 16:10:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 16:10:41 [DEBUG   ] spawn_process: at 2018-11-15 16:10:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 16:10:45 [DEBUG   ] Got command RPT from MCS: ref #516019
2018-11-15 16:10:45 [DEBUG   ] summary = ERROR
2018-11-15 16:10:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516019  13 58437 58245129 A  ERRORERROR'
2018-11-15 16:10:45 [DEBUG   ] Got command RPT from MCS: ref #516020
2018-11-15 16:10:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 16:10:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516020  77 58437 58245130 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 16:10:55 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-15 16:10:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-15 16:10:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:10:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 16:10:58 [WARNING ] (13, 1, 'bot')
2018-11-15 16:10:58 [WARNING ] (13, 1, 'bot')
2018-11-15 16:10:58 [WARNING ] (13, 1, 'bot')
2018-11-15 16:10:58 [WARNING ] (13, 1, 'bot')
2018-11-15 16:10:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:10:58 [DEBUG   ] Finished updating board flags in 1.180 seconds
2018-11-15 16:11:04 [DEBUG   ] Got command BAM from MCS: ref #516037
2018-11-15 16:11:04 [INFO    ] Finished processing BAM request
2018-11-15 16:11:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:11:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516037   8 58437 58264029 A  ERROR'
2018-11-15 16:11:04 [DEBUG   ] Got command BAM from MCS: ref #516036
2018-11-15 16:11:04 [INFO    ] Finished processing BAM request
2018-11-15 16:11:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:11:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516036   8 58437 58264033 A  ERROR'
2018-11-15 16:11:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 16:11:04 [DEBUG   ] spawn_process: at 2018-11-15 16:11:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 16:11:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 16:11:04 [DEBUG   ] spawn_process: at 2018-11-15 16:11:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 16:11:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 16:11:04 [DEBUG   ] spawn_process: at 2018-11-15 16:11:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 16:11:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 16:11:04 [DEBUG   ] spawn_process: at 2018-11-15 16:11:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 16:11:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 16:11:04 [DEBUG   ] spawn_process: at 2018-11-15 16:11:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 16:11:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 16:11:04 [DEBUG   ] spawn_process: at 2018-11-15 16:11:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 16:11:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 16:11:04 [DEBUG   ] spawn_process: at 2018-11-15 16:11:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 16:11:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 16:11:04 [DEBUG   ] spawn_process: at 2018-11-15 16:11:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 16:11:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 16:11:04 [DEBUG   ] spawn_process: at 2018-11-15 16:11:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 16:11:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 16:11:04 [DEBUG   ] spawn_process: at 2018-11-15 16:11:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 16:11:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 16:11:04 [DEBUG   ] spawn_process: at 2018-11-15 16:11:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 16:11:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 16:11:04 [DEBUG   ] spawn_process: at 2018-11-15 16:11:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 16:11:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 16:11:04 [DEBUG   ] spawn_process: at 2018-11-15 16:11:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 16:11:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 16:11:04 [DEBUG   ] spawn_process: at 2018-11-15 16:11:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 16:11:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 16:11:04 [DEBUG   ] spawn_process: at 2018-11-15 16:11:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 16:11:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 16:11:04 [DEBUG   ] spawn_process: at 2018-11-15 16:11:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 16:11:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 16:11:04 [DEBUG   ] spawn_process: at 2018-11-15 16:11:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 16:11:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 16:11:04 [DEBUG   ] spawn_process: at 2018-11-15 16:11:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 16:11:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 16:11:04 [DEBUG   ] spawn_process: at 2018-11-15 16:11:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 16:11:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 16:11:04 [DEBUG   ] spawn_process: at 2018-11-15 16:11:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 16:11:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 16:11:04 [DEBUG   ] spawn_process: at 2018-11-15 16:11:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 16:11:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 16:11:04 [DEBUG   ] spawn_process: at 2018-11-15 16:11:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 16:11:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 16:11:04 [DEBUG   ] spawn_process: at 2018-11-15 16:11:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 16:11:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 16:11:04 [DEBUG   ] spawn_process: at 2018-11-15 16:11:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 16:11:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 16:11:04 [DEBUG   ] spawn_process: at 2018-11-15 16:11:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 16:11:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 16:11:04 [DEBUG   ] spawn_process: at 2018-11-15 16:11:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 16:11:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 16:11:27 [DEBUG   ] Got command BAM from MCS: ref #516043
2018-11-15 16:11:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:11:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516043   8 58437 58287025 A  ERROR'
2018-11-15 16:11:27 [DEBUG   ] Got command BAM from MCS: ref #516042
2018-11-15 16:11:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:11:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516042   8 58437 58287029 A  ERROR'
2018-11-15 16:11:27 [INFO    ] Finished processing BAM request
2018-11-15 16:11:27 [INFO    ] Finished processing BAM request
2018-11-15 16:11:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 16:11:27 [DEBUG   ] spawn_process: at 2018-11-15 16:11:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 16:11:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 16:11:27 [DEBUG   ] spawn_process: at 2018-11-15 16:11:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 16:11:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 16:11:27 [DEBUG   ] spawn_process: at 2018-11-15 16:11:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 16:11:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 16:11:27 [DEBUG   ] spawn_process: at 2018-11-15 16:11:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 16:11:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 16:11:27 [DEBUG   ] spawn_process: at 2018-11-15 16:11:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 16:11:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 16:11:27 [DEBUG   ] spawn_process: at 2018-11-15 16:11:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 16:11:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 16:11:27 [DEBUG   ] spawn_process: at 2018-11-15 16:11:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 16:11:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 16:11:27 [DEBUG   ] spawn_process: at 2018-11-15 16:11:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 16:11:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 16:11:27 [DEBUG   ] spawn_process: at 2018-11-15 16:11:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 16:11:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 16:11:27 [DEBUG   ] spawn_process: at 2018-11-15 16:11:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 16:11:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 16:11:27 [DEBUG   ] spawn_process: at 2018-11-15 16:11:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 16:11:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 16:11:27 [DEBUG   ] spawn_process: at 2018-11-15 16:11:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 16:11:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 16:11:27 [DEBUG   ] spawn_process: at 2018-11-15 16:11:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 16:11:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 16:11:27 [DEBUG   ] spawn_process: at 2018-11-15 16:11:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 16:11:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 16:11:27 [DEBUG   ] spawn_process: at 2018-11-15 16:11:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 16:11:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 16:11:27 [DEBUG   ] spawn_process: at 2018-11-15 16:11:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 16:11:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 16:11:27 [DEBUG   ] spawn_process: at 2018-11-15 16:11:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 16:11:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 16:11:27 [DEBUG   ] spawn_process: at 2018-11-15 16:11:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 16:11:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 16:11:27 [DEBUG   ] spawn_process: at 2018-11-15 16:11:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 16:11:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 16:11:27 [DEBUG   ] spawn_process: at 2018-11-15 16:11:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 16:11:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 16:11:27 [DEBUG   ] spawn_process: at 2018-11-15 16:11:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 16:11:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 16:11:27 [DEBUG   ] spawn_process: at 2018-11-15 16:11:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 16:11:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 16:11:27 [DEBUG   ] spawn_process: at 2018-11-15 16:11:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 16:11:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 16:11:27 [DEBUG   ] spawn_process: at 2018-11-15 16:11:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 16:11:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 16:11:27 [DEBUG   ] spawn_process: at 2018-11-15 16:11:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 16:11:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 16:11:27 [DEBUG   ] spawn_process: at 2018-11-15 16:11:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 16:11:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 16:11:50 [DEBUG   ] Got command BAM from MCS: ref #516044
2018-11-15 16:11:50 [INFO    ] Finished processing BAM request
2018-11-15 16:11:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:11:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516044   8 58437 58310025 A  ERROR'
2018-11-15 16:11:50 [DEBUG   ] Got command BAM from MCS: ref #516045
2018-11-15 16:11:50 [INFO    ] Finished processing BAM request
2018-11-15 16:11:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:11:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516045   8 58437 58310029 A  ERROR'
2018-11-15 16:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 16:11:50 [DEBUG   ] spawn_process: at 2018-11-15 16:11:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 16:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 16:11:50 [DEBUG   ] spawn_process: at 2018-11-15 16:11:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 16:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 16:11:50 [DEBUG   ] spawn_process: at 2018-11-15 16:11:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 16:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 16:11:50 [DEBUG   ] spawn_process: at 2018-11-15 16:11:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 16:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 16:11:50 [DEBUG   ] spawn_process: at 2018-11-15 16:11:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 16:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 16:11:50 [DEBUG   ] spawn_process: at 2018-11-15 16:11:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 16:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 16:11:50 [DEBUG   ] spawn_process: at 2018-11-15 16:11:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 16:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 16:11:50 [DEBUG   ] spawn_process: at 2018-11-15 16:11:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 16:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 16:11:50 [DEBUG   ] spawn_process: at 2018-11-15 16:11:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 16:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 16:11:50 [DEBUG   ] spawn_process: at 2018-11-15 16:11:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 16:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 16:11:50 [DEBUG   ] spawn_process: at 2018-11-15 16:11:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 16:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 16:11:50 [DEBUG   ] spawn_process: at 2018-11-15 16:11:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 16:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 16:11:50 [DEBUG   ] spawn_process: at 2018-11-15 16:11:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 16:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 16:11:50 [DEBUG   ] spawn_process: at 2018-11-15 16:11:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 16:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 16:11:50 [DEBUG   ] spawn_process: at 2018-11-15 16:11:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 16:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 16:11:50 [DEBUG   ] spawn_process: at 2018-11-15 16:11:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 16:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 16:11:50 [DEBUG   ] spawn_process: at 2018-11-15 16:11:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 16:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 16:11:50 [DEBUG   ] spawn_process: at 2018-11-15 16:11:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 16:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 16:11:50 [DEBUG   ] spawn_process: at 2018-11-15 16:11:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 16:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 16:11:50 [DEBUG   ] spawn_process: at 2018-11-15 16:11:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 16:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 16:11:50 [DEBUG   ] spawn_process: at 2018-11-15 16:11:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 16:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 16:11:50 [DEBUG   ] spawn_process: at 2018-11-15 16:11:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 16:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 16:11:50 [DEBUG   ] spawn_process: at 2018-11-15 16:11:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 16:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 16:11:50 [DEBUG   ] spawn_process: at 2018-11-15 16:11:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 16:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 16:11:50 [DEBUG   ] spawn_process: at 2018-11-15 16:11:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 16:11:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 16:11:50 [DEBUG   ] spawn_process: at 2018-11-15 16:11:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 16:11:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 16:11:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 16:11:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:11:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-15 16:11:58 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-15 16:11:58 [WARNING ] (13, 1, 'bot')
2018-11-15 16:11:58 [WARNING ] (13, 1, 'bot')
2018-11-15 16:11:58 [WARNING ] (13, 1, 'bot')
2018-11-15 16:11:58 [WARNING ] (13, 1, 'bot')
2018-11-15 16:11:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:11:58 [DEBUG   ] Finished updating board flags in 1.023 seconds
2018-11-15 16:12:13 [DEBUG   ] Got command BAM from MCS: ref #516047
2018-11-15 16:12:13 [INFO    ] Finished processing BAM request
2018-11-15 16:12:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:12:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516047   8 58437 58333025 A  ERROR'
2018-11-15 16:12:13 [DEBUG   ] Got command BAM from MCS: ref #516046
2018-11-15 16:12:13 [INFO    ] Finished processing BAM request
2018-11-15 16:12:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:12:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516046   8 58437 58333029 A  ERROR'
2018-11-15 16:12:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 16:12:13 [DEBUG   ] spawn_process: at 2018-11-15 16:12:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 16:12:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 16:12:13 [DEBUG   ] spawn_process: at 2018-11-15 16:12:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 16:12:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 16:12:13 [DEBUG   ] spawn_process: at 2018-11-15 16:12:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 16:12:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 16:12:13 [DEBUG   ] spawn_process: at 2018-11-15 16:12:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 16:12:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 16:12:13 [DEBUG   ] spawn_process: at 2018-11-15 16:12:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 16:12:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 16:12:13 [DEBUG   ] spawn_process: at 2018-11-15 16:12:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 16:12:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 16:12:13 [DEBUG   ] spawn_process: at 2018-11-15 16:12:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 16:12:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 16:12:13 [DEBUG   ] spawn_process: at 2018-11-15 16:12:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 16:12:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 16:12:13 [DEBUG   ] spawn_process: at 2018-11-15 16:12:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 16:12:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 16:12:13 [DEBUG   ] spawn_process: at 2018-11-15 16:12:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 16:12:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 16:12:13 [DEBUG   ] spawn_process: at 2018-11-15 16:12:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 16:12:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 16:12:13 [DEBUG   ] spawn_process: at 2018-11-15 16:12:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 16:12:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 16:12:13 [DEBUG   ] spawn_process: at 2018-11-15 16:12:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 16:12:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 16:12:13 [DEBUG   ] spawn_process: at 2018-11-15 16:12:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 16:12:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 16:12:13 [DEBUG   ] spawn_process: at 2018-11-15 16:12:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 16:12:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 16:12:13 [DEBUG   ] spawn_process: at 2018-11-15 16:12:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 16:12:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 16:12:13 [DEBUG   ] spawn_process: at 2018-11-15 16:12:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 16:12:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 16:12:13 [DEBUG   ] spawn_process: at 2018-11-15 16:12:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 16:12:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 16:12:13 [DEBUG   ] spawn_process: at 2018-11-15 16:12:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 16:12:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 16:12:13 [DEBUG   ] spawn_process: at 2018-11-15 16:12:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 16:12:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 16:12:13 [DEBUG   ] spawn_process: at 2018-11-15 16:12:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 16:12:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 16:12:13 [DEBUG   ] spawn_process: at 2018-11-15 16:12:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 16:12:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 16:12:13 [DEBUG   ] spawn_process: at 2018-11-15 16:12:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 16:12:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 16:12:13 [DEBUG   ] spawn_process: at 2018-11-15 16:12:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 16:12:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 16:12:13 [DEBUG   ] spawn_process: at 2018-11-15 16:12:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 16:12:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 16:12:13 [DEBUG   ] spawn_process: at 2018-11-15 16:12:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 16:12:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 16:12:35 [DEBUG   ] Got command BAM from MCS: ref #516049
2018-11-15 16:12:35 [INFO    ] Finished processing BAM request
2018-11-15 16:12:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516049   8 58437 58355029 A  ERROR'
2018-11-15 16:12:35 [DEBUG   ] Got command BAM from MCS: ref #516048
2018-11-15 16:12:35 [INFO    ] Finished processing BAM request
2018-11-15 16:12:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:12:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516048   8 58437 58355033 A  ERROR'
2018-11-15 16:12:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 16:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 16:12:35 [DEBUG   ] spawn_process: at 2018-11-15 16:12:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 16:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 16:12:35 [DEBUG   ] spawn_process: at 2018-11-15 16:12:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 16:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 16:12:35 [DEBUG   ] spawn_process: at 2018-11-15 16:12:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 16:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 16:12:35 [DEBUG   ] spawn_process: at 2018-11-15 16:12:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 16:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 16:12:35 [DEBUG   ] spawn_process: at 2018-11-15 16:12:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 16:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 16:12:35 [DEBUG   ] spawn_process: at 2018-11-15 16:12:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 16:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 16:12:35 [DEBUG   ] spawn_process: at 2018-11-15 16:12:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 16:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 16:12:35 [DEBUG   ] spawn_process: at 2018-11-15 16:12:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 16:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 16:12:35 [DEBUG   ] spawn_process: at 2018-11-15 16:12:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 16:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 16:12:35 [DEBUG   ] spawn_process: at 2018-11-15 16:12:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 16:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 16:12:35 [DEBUG   ] spawn_process: at 2018-11-15 16:12:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 16:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 16:12:35 [DEBUG   ] spawn_process: at 2018-11-15 16:12:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 16:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 16:12:35 [DEBUG   ] spawn_process: at 2018-11-15 16:12:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 16:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 16:12:35 [DEBUG   ] spawn_process: at 2018-11-15 16:12:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 16:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 16:12:35 [DEBUG   ] spawn_process: at 2018-11-15 16:12:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 16:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 16:12:35 [DEBUG   ] spawn_process: at 2018-11-15 16:12:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 16:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 16:12:35 [DEBUG   ] spawn_process: at 2018-11-15 16:12:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 16:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 16:12:35 [DEBUG   ] spawn_process: at 2018-11-15 16:12:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 16:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 16:12:35 [DEBUG   ] spawn_process: at 2018-11-15 16:12:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 16:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 16:12:35 [DEBUG   ] spawn_process: at 2018-11-15 16:12:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 16:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 16:12:35 [DEBUG   ] spawn_process: at 2018-11-15 16:12:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 16:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 16:12:35 [DEBUG   ] spawn_process: at 2018-11-15 16:12:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 16:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 16:12:35 [DEBUG   ] spawn_process: at 2018-11-15 16:12:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 16:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 16:12:35 [DEBUG   ] spawn_process: at 2018-11-15 16:12:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 16:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 16:12:35 [DEBUG   ] spawn_process: at 2018-11-15 16:12:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 16:12:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 16:12:35 [DEBUG   ] spawn_process: at 2018-11-15 16:12:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 16:12:55 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-15 16:12:57 [DEBUG   ] Got command BAM from MCS: ref #516051
2018-11-15 16:12:57 [INFO    ] Finished processing BAM request
2018-11-15 16:12:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:12:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516051   8 58437 58377033 A  ERROR'
2018-11-15 16:12:57 [DEBUG   ] Got command BAM from MCS: ref #516050
2018-11-15 16:12:57 [INFO    ] Finished processing BAM request
2018-11-15 16:12:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:12:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516050   8 58437 58377037 A  ERROR'
2018-11-15 16:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 16:12:57 [DEBUG   ] spawn_process: at 2018-11-15 16:12:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 16:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 16:12:57 [DEBUG   ] spawn_process: at 2018-11-15 16:12:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 16:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 16:12:57 [DEBUG   ] spawn_process: at 2018-11-15 16:12:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 16:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 16:12:57 [DEBUG   ] spawn_process: at 2018-11-15 16:12:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 16:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 16:12:57 [DEBUG   ] spawn_process: at 2018-11-15 16:12:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 16:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 16:12:57 [DEBUG   ] spawn_process: at 2018-11-15 16:12:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 16:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 16:12:57 [DEBUG   ] spawn_process: at 2018-11-15 16:12:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 16:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 16:12:57 [DEBUG   ] spawn_process: at 2018-11-15 16:12:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 16:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 16:12:57 [DEBUG   ] spawn_process: at 2018-11-15 16:12:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 16:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 16:12:57 [DEBUG   ] spawn_process: at 2018-11-15 16:12:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 16:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 16:12:57 [DEBUG   ] spawn_process: at 2018-11-15 16:12:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 16:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 16:12:57 [DEBUG   ] spawn_process: at 2018-11-15 16:12:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 16:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 16:12:57 [DEBUG   ] spawn_process: at 2018-11-15 16:12:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 16:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 16:12:57 [DEBUG   ] spawn_process: at 2018-11-15 16:12:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 16:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 16:12:57 [DEBUG   ] spawn_process: at 2018-11-15 16:12:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 16:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 16:12:57 [DEBUG   ] spawn_process: at 2018-11-15 16:12:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 16:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 16:12:57 [DEBUG   ] spawn_process: at 2018-11-15 16:12:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 16:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 16:12:57 [DEBUG   ] spawn_process: at 2018-11-15 16:12:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 16:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 16:12:57 [DEBUG   ] spawn_process: at 2018-11-15 16:12:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 16:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 16:12:57 [DEBUG   ] spawn_process: at 2018-11-15 16:12:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 16:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 16:12:57 [DEBUG   ] spawn_process: at 2018-11-15 16:12:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 16:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 16:12:57 [DEBUG   ] spawn_process: at 2018-11-15 16:12:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 16:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 16:12:57 [DEBUG   ] spawn_process: at 2018-11-15 16:12:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 16:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 16:12:57 [DEBUG   ] spawn_process: at 2018-11-15 16:12:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 16:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 16:12:57 [DEBUG   ] spawn_process: at 2018-11-15 16:12:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 16:12:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 16:12:57 [DEBUG   ] spawn_process: at 2018-11-15 16:12:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 16:12:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:12:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 16:12:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 16:12:58 [WARNING ] (13, 1, 'bot')
2018-11-15 16:12:58 [WARNING ] (13, 1, 'bot')
2018-11-15 16:12:58 [WARNING ] (13, 1, 'bot')
2018-11-15 16:12:58 [WARNING ] (13, 1, 'bot')
2018-11-15 16:12:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:12:58 [DEBUG   ] Finished updating board flags in 1.008 seconds
2018-11-15 16:13:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 16:13:19 [DEBUG   ] Got command BAM from MCS: ref #516052
2018-11-15 16:13:19 [INFO    ] Finished processing BAM request
2018-11-15 16:13:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:13:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516052   8 58437 58399033 A  ERROR'
2018-11-15 16:13:19 [DEBUG   ] Got command BAM from MCS: ref #516053
2018-11-15 16:13:19 [INFO    ] Finished processing BAM request
2018-11-15 16:13:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:13:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516053   8 58437 58399037 A  ERROR'
2018-11-15 16:13:19 [DEBUG   ] Got command RPT from MCS: ref #516054
2018-11-15 16:13:19 [DEBUG   ] summary = ERROR
2018-11-15 16:13:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516054  13 58437 58399241 A  ERRORERROR'
2018-11-15 16:13:19 [DEBUG   ] Got command RPT from MCS: ref #516055
2018-11-15 16:13:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 16:13:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516055  77 58437 58399445 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 16:13:19 [DEBUG   ] Got command RPT from MCS: ref #516056
2018-11-15 16:13:19 [DEBUG   ] summary = ERROR
2018-11-15 16:13:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516056  13 58437 58399649 A  ERRORERROR'
2018-11-15 16:13:19 [DEBUG   ] Got command RPT from MCS: ref #516057
2018-11-15 16:13:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 16:13:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516057  77 58437 58399853 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 16:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 16:13:19 [DEBUG   ] spawn_process: at 2018-11-15 16:13:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 16:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 16:13:19 [DEBUG   ] spawn_process: at 2018-11-15 16:13:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 16:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 16:13:19 [DEBUG   ] spawn_process: at 2018-11-15 16:13:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 16:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 16:13:19 [DEBUG   ] spawn_process: at 2018-11-15 16:13:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 16:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 16:13:19 [DEBUG   ] spawn_process: at 2018-11-15 16:13:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 16:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 16:13:19 [DEBUG   ] spawn_process: at 2018-11-15 16:13:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 16:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 16:13:19 [DEBUG   ] spawn_process: at 2018-11-15 16:13:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 16:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 16:13:19 [DEBUG   ] spawn_process: at 2018-11-15 16:13:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 16:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 16:13:19 [DEBUG   ] spawn_process: at 2018-11-15 16:13:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 16:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 16:13:19 [DEBUG   ] spawn_process: at 2018-11-15 16:13:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 16:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 16:13:19 [DEBUG   ] spawn_process: at 2018-11-15 16:13:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 16:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 16:13:19 [DEBUG   ] spawn_process: at 2018-11-15 16:13:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 16:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 16:13:19 [DEBUG   ] spawn_process: at 2018-11-15 16:13:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 16:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 16:13:19 [DEBUG   ] spawn_process: at 2018-11-15 16:13:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 16:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 16:13:19 [DEBUG   ] spawn_process: at 2018-11-15 16:13:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 16:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 16:13:19 [DEBUG   ] spawn_process: at 2018-11-15 16:13:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 16:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 16:13:19 [DEBUG   ] spawn_process: at 2018-11-15 16:13:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 16:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 16:13:19 [DEBUG   ] spawn_process: at 2018-11-15 16:13:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 16:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 16:13:19 [DEBUG   ] spawn_process: at 2018-11-15 16:13:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 16:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 16:13:19 [DEBUG   ] spawn_process: at 2018-11-15 16:13:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 16:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 16:13:19 [DEBUG   ] spawn_process: at 2018-11-15 16:13:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 16:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 16:13:19 [DEBUG   ] spawn_process: at 2018-11-15 16:13:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 16:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 16:13:19 [DEBUG   ] spawn_process: at 2018-11-15 16:13:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 16:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 16:13:19 [DEBUG   ] spawn_process: at 2018-11-15 16:13:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 16:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 16:13:19 [DEBUG   ] spawn_process: at 2018-11-15 16:13:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 16:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 16:13:19 [DEBUG   ] spawn_process: at 2018-11-15 16:13:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 16:13:20 [DEBUG   ] Got command RPT from MCS: ref #516058
2018-11-15 16:13:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 16:13:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516058  12 58437 58400045 A  ERRORB¢ff'
2018-11-15 16:13:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 16:13:41 [DEBUG   ] Got command BAM from MCS: ref #516059
2018-11-15 16:13:41 [INFO    ] Finished processing BAM request
2018-11-15 16:13:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:13:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516059   8 58437 58421033 A  ERROR'
2018-11-15 16:13:41 [DEBUG   ] Got command BAM from MCS: ref #516060
2018-11-15 16:13:41 [INFO    ] Finished processing BAM request
2018-11-15 16:13:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:13:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516060   8 58437 58421037 A  ERROR'
2018-11-15 16:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 16:13:41 [DEBUG   ] spawn_process: at 2018-11-15 16:13:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 16:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 16:13:41 [DEBUG   ] spawn_process: at 2018-11-15 16:13:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 16:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 16:13:41 [DEBUG   ] spawn_process: at 2018-11-15 16:13:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 16:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 16:13:41 [DEBUG   ] spawn_process: at 2018-11-15 16:13:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 16:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 16:13:41 [DEBUG   ] spawn_process: at 2018-11-15 16:13:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 16:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 16:13:41 [DEBUG   ] spawn_process: at 2018-11-15 16:13:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 16:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 16:13:41 [DEBUG   ] spawn_process: at 2018-11-15 16:13:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 16:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 16:13:41 [DEBUG   ] spawn_process: at 2018-11-15 16:13:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 16:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 16:13:41 [DEBUG   ] spawn_process: at 2018-11-15 16:13:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 16:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 16:13:41 [DEBUG   ] spawn_process: at 2018-11-15 16:13:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 16:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 16:13:41 [DEBUG   ] spawn_process: at 2018-11-15 16:13:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 16:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 16:13:41 [DEBUG   ] spawn_process: at 2018-11-15 16:13:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 16:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 16:13:41 [DEBUG   ] spawn_process: at 2018-11-15 16:13:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 16:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 16:13:41 [DEBUG   ] spawn_process: at 2018-11-15 16:13:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 16:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 16:13:41 [DEBUG   ] spawn_process: at 2018-11-15 16:13:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 16:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 16:13:41 [DEBUG   ] spawn_process: at 2018-11-15 16:13:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 16:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 16:13:41 [DEBUG   ] spawn_process: at 2018-11-15 16:13:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 16:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 16:13:41 [DEBUG   ] spawn_process: at 2018-11-15 16:13:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 16:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 16:13:41 [DEBUG   ] spawn_process: at 2018-11-15 16:13:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 16:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 16:13:41 [DEBUG   ] spawn_process: at 2018-11-15 16:13:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 16:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 16:13:41 [DEBUG   ] spawn_process: at 2018-11-15 16:13:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 16:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 16:13:41 [DEBUG   ] spawn_process: at 2018-11-15 16:13:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 16:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 16:13:41 [DEBUG   ] spawn_process: at 2018-11-15 16:13:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 16:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 16:13:41 [DEBUG   ] spawn_process: at 2018-11-15 16:13:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 16:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 16:13:41 [DEBUG   ] spawn_process: at 2018-11-15 16:13:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 16:13:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 16:13:41 [DEBUG   ] spawn_process: at 2018-11-15 16:13:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 16:13:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 16:13:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 16:13:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 16:13:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:13:59 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-15 16:13:59 [WARNING ] (13, 1, 'bot')
2018-11-15 16:13:59 [WARNING ] (13, 1, 'bot')
2018-11-15 16:13:59 [WARNING ] (13, 1, 'bot')
2018-11-15 16:13:59 [WARNING ] (13, 1, 'bot')
2018-11-15 16:13:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:13:59 [DEBUG   ] Finished updating board flags in 1.607 seconds
2018-11-15 16:14:03 [DEBUG   ] Got command BAM from MCS: ref #516061
2018-11-15 16:14:03 [INFO    ] Finished processing BAM request
2018-11-15 16:14:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:14:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516061   8 58437 58443033 A  ERROR'
2018-11-15 16:14:03 [DEBUG   ] Got command BAM from MCS: ref #516062
2018-11-15 16:14:03 [INFO    ] Finished processing BAM request
2018-11-15 16:14:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:14:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516062   8 58437 58443037 A  ERROR'
2018-11-15 16:14:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 16:14:03 [DEBUG   ] spawn_process: at 2018-11-15 16:14:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 16:14:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 16:14:03 [DEBUG   ] spawn_process: at 2018-11-15 16:14:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 16:14:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 16:14:03 [DEBUG   ] spawn_process: at 2018-11-15 16:14:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 16:14:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 16:14:03 [DEBUG   ] spawn_process: at 2018-11-15 16:14:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 16:14:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 16:14:03 [DEBUG   ] spawn_process: at 2018-11-15 16:14:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 16:14:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 16:14:03 [DEBUG   ] spawn_process: at 2018-11-15 16:14:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 16:14:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 16:14:03 [DEBUG   ] spawn_process: at 2018-11-15 16:14:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 16:14:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 16:14:03 [DEBUG   ] spawn_process: at 2018-11-15 16:14:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 16:14:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 16:14:03 [DEBUG   ] spawn_process: at 2018-11-15 16:14:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 16:14:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 16:14:03 [DEBUG   ] spawn_process: at 2018-11-15 16:14:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 16:14:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 16:14:03 [DEBUG   ] spawn_process: at 2018-11-15 16:14:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 16:14:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 16:14:03 [DEBUG   ] spawn_process: at 2018-11-15 16:14:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 16:14:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 16:14:03 [DEBUG   ] spawn_process: at 2018-11-15 16:14:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 16:14:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 16:14:03 [DEBUG   ] spawn_process: at 2018-11-15 16:14:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 16:14:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 16:14:03 [DEBUG   ] spawn_process: at 2018-11-15 16:14:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 16:14:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 16:14:03 [DEBUG   ] spawn_process: at 2018-11-15 16:14:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 16:14:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 16:14:03 [DEBUG   ] spawn_process: at 2018-11-15 16:14:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 16:14:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 16:14:03 [DEBUG   ] spawn_process: at 2018-11-15 16:14:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 16:14:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 16:14:03 [DEBUG   ] spawn_process: at 2018-11-15 16:14:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 16:14:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 16:14:03 [DEBUG   ] spawn_process: at 2018-11-15 16:14:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 16:14:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 16:14:03 [DEBUG   ] spawn_process: at 2018-11-15 16:14:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 16:14:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 16:14:03 [DEBUG   ] spawn_process: at 2018-11-15 16:14:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 16:14:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 16:14:03 [DEBUG   ] spawn_process: at 2018-11-15 16:14:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 16:14:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 16:14:03 [DEBUG   ] spawn_process: at 2018-11-15 16:14:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 16:14:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 16:14:03 [DEBUG   ] spawn_process: at 2018-11-15 16:14:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 16:14:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 16:14:03 [DEBUG   ] spawn_process: at 2018-11-15 16:14:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 16:14:15 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-15 16:14:25 [DEBUG   ] Got command BAM from MCS: ref #516068
2018-11-15 16:14:25 [INFO    ] Finished processing BAM request
2018-11-15 16:14:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:14:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516068   8 58437 58465029 A  ERROR'
2018-11-15 16:14:25 [DEBUG   ] Got command BAM from MCS: ref #516067
2018-11-15 16:14:25 [INFO    ] Finished processing BAM request
2018-11-15 16:14:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:14:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516067   8 58437 58465033 A  ERROR'
2018-11-15 16:14:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 16:14:25 [DEBUG   ] spawn_process: at 2018-11-15 16:14:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 16:14:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 16:14:25 [DEBUG   ] spawn_process: at 2018-11-15 16:14:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 16:14:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 16:14:25 [DEBUG   ] spawn_process: at 2018-11-15 16:14:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 16:14:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 16:14:25 [DEBUG   ] spawn_process: at 2018-11-15 16:14:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 16:14:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 16:14:25 [DEBUG   ] spawn_process: at 2018-11-15 16:14:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 16:14:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 16:14:25 [DEBUG   ] spawn_process: at 2018-11-15 16:14:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 16:14:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 16:14:25 [DEBUG   ] spawn_process: at 2018-11-15 16:14:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 16:14:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 16:14:25 [DEBUG   ] spawn_process: at 2018-11-15 16:14:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 16:14:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 16:14:25 [DEBUG   ] spawn_process: at 2018-11-15 16:14:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 16:14:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 16:14:25 [DEBUG   ] spawn_process: at 2018-11-15 16:14:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 16:14:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 16:14:25 [DEBUG   ] spawn_process: at 2018-11-15 16:14:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 16:14:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 16:14:25 [DEBUG   ] spawn_process: at 2018-11-15 16:14:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 16:14:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 16:14:25 [DEBUG   ] spawn_process: at 2018-11-15 16:14:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 16:14:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 16:14:25 [DEBUG   ] spawn_process: at 2018-11-15 16:14:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 16:14:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 16:14:25 [DEBUG   ] spawn_process: at 2018-11-15 16:14:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 16:14:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 16:14:25 [DEBUG   ] spawn_process: at 2018-11-15 16:14:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 16:14:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 16:14:25 [DEBUG   ] spawn_process: at 2018-11-15 16:14:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 16:14:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 16:14:25 [DEBUG   ] spawn_process: at 2018-11-15 16:14:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 16:14:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 16:14:25 [DEBUG   ] spawn_process: at 2018-11-15 16:14:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 16:14:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 16:14:25 [DEBUG   ] spawn_process: at 2018-11-15 16:14:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 16:14:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 16:14:25 [DEBUG   ] spawn_process: at 2018-11-15 16:14:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 16:14:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 16:14:25 [DEBUG   ] spawn_process: at 2018-11-15 16:14:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 16:14:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 16:14:25 [DEBUG   ] spawn_process: at 2018-11-15 16:14:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 16:14:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 16:14:25 [DEBUG   ] spawn_process: at 2018-11-15 16:14:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 16:14:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 16:14:25 [DEBUG   ] spawn_process: at 2018-11-15 16:14:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 16:14:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 16:14:25 [DEBUG   ] spawn_process: at 2018-11-15 16:14:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 16:14:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 16:14:47 [DEBUG   ] Got command BAM from MCS: ref #516070
2018-11-15 16:14:47 [INFO    ] Finished processing BAM request
2018-11-15 16:14:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:14:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516070   8 58437 58487029 A  ERROR'
2018-11-15 16:14:47 [DEBUG   ] Got command BAM from MCS: ref #516069
2018-11-15 16:14:47 [INFO    ] Finished processing BAM request
2018-11-15 16:14:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:14:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516069   8 58437 58487033 A  ERROR'
2018-11-15 16:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 16:14:47 [DEBUG   ] spawn_process: at 2018-11-15 16:14:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 16:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 16:14:47 [DEBUG   ] spawn_process: at 2018-11-15 16:14:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 16:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 16:14:47 [DEBUG   ] spawn_process: at 2018-11-15 16:14:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 16:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 16:14:47 [DEBUG   ] spawn_process: at 2018-11-15 16:14:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 16:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 16:14:47 [DEBUG   ] spawn_process: at 2018-11-15 16:14:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 16:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 16:14:47 [DEBUG   ] spawn_process: at 2018-11-15 16:14:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 16:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 16:14:47 [DEBUG   ] spawn_process: at 2018-11-15 16:14:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 16:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 16:14:47 [DEBUG   ] spawn_process: at 2018-11-15 16:14:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 16:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 16:14:47 [DEBUG   ] spawn_process: at 2018-11-15 16:14:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 16:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 16:14:47 [DEBUG   ] spawn_process: at 2018-11-15 16:14:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 16:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 16:14:47 [DEBUG   ] spawn_process: at 2018-11-15 16:14:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 16:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 16:14:47 [DEBUG   ] spawn_process: at 2018-11-15 16:14:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 16:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 16:14:47 [DEBUG   ] spawn_process: at 2018-11-15 16:14:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 16:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 16:14:47 [DEBUG   ] spawn_process: at 2018-11-15 16:14:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 16:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 16:14:47 [DEBUG   ] spawn_process: at 2018-11-15 16:14:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 16:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 16:14:47 [DEBUG   ] spawn_process: at 2018-11-15 16:14:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 16:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 16:14:47 [DEBUG   ] spawn_process: at 2018-11-15 16:14:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 16:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 16:14:47 [DEBUG   ] spawn_process: at 2018-11-15 16:14:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 16:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 16:14:47 [DEBUG   ] spawn_process: at 2018-11-15 16:14:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 16:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 16:14:47 [DEBUG   ] spawn_process: at 2018-11-15 16:14:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 16:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 16:14:47 [DEBUG   ] spawn_process: at 2018-11-15 16:14:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 16:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 16:14:47 [DEBUG   ] spawn_process: at 2018-11-15 16:14:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 16:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 16:14:47 [DEBUG   ] spawn_process: at 2018-11-15 16:14:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 16:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 16:14:47 [DEBUG   ] spawn_process: at 2018-11-15 16:14:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 16:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 16:14:47 [DEBUG   ] spawn_process: at 2018-11-15 16:14:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 16:14:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 16:14:47 [DEBUG   ] spawn_process: at 2018-11-15 16:14:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 16:14:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-15 16:14:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-15 16:14:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:14:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 16:14:58 [WARNING ] (13, 1, 'bot')
2018-11-15 16:14:58 [WARNING ] (13, 1, 'bot')
2018-11-15 16:14:58 [WARNING ] (13, 1, 'bot')
2018-11-15 16:14:58 [WARNING ] (13, 1, 'bot')
2018-11-15 16:14:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:14:58 [DEBUG   ] Finished updating board flags in 0.953 seconds
2018-11-15 16:15:09 [DEBUG   ] Got command BAM from MCS: ref #516072
2018-11-15 16:15:09 [INFO    ] Finished processing BAM request
2018-11-15 16:15:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:15:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516072   8 58437 58509033 A  ERROR'
2018-11-15 16:15:09 [DEBUG   ] Got command BAM from MCS: ref #516071
2018-11-15 16:15:09 [INFO    ] Finished processing BAM request
2018-11-15 16:15:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:15:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516071   8 58437 58509037 A  ERROR'
2018-11-15 16:15:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 16:15:09 [DEBUG   ] spawn_process: at 2018-11-15 16:15:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 16:15:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 16:15:09 [DEBUG   ] spawn_process: at 2018-11-15 16:15:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 16:15:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 16:15:09 [DEBUG   ] spawn_process: at 2018-11-15 16:15:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 16:15:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 16:15:09 [DEBUG   ] spawn_process: at 2018-11-15 16:15:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 16:15:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 16:15:09 [DEBUG   ] spawn_process: at 2018-11-15 16:15:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 16:15:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 16:15:09 [DEBUG   ] spawn_process: at 2018-11-15 16:15:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 16:15:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 16:15:09 [DEBUG   ] spawn_process: at 2018-11-15 16:15:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 16:15:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 16:15:09 [DEBUG   ] spawn_process: at 2018-11-15 16:15:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 16:15:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 16:15:09 [DEBUG   ] spawn_process: at 2018-11-15 16:15:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 16:15:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 16:15:09 [DEBUG   ] spawn_process: at 2018-11-15 16:15:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 16:15:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 16:15:09 [DEBUG   ] spawn_process: at 2018-11-15 16:15:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 16:15:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 16:15:09 [DEBUG   ] spawn_process: at 2018-11-15 16:15:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 16:15:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 16:15:09 [DEBUG   ] spawn_process: at 2018-11-15 16:15:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 16:15:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 16:15:09 [DEBUG   ] spawn_process: at 2018-11-15 16:15:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 16:15:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 16:15:09 [DEBUG   ] spawn_process: at 2018-11-15 16:15:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 16:15:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 16:15:09 [DEBUG   ] spawn_process: at 2018-11-15 16:15:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 16:15:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 16:15:09 [DEBUG   ] spawn_process: at 2018-11-15 16:15:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 16:15:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 16:15:09 [DEBUG   ] spawn_process: at 2018-11-15 16:15:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 16:15:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 16:15:09 [DEBUG   ] spawn_process: at 2018-11-15 16:15:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 16:15:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 16:15:09 [DEBUG   ] spawn_process: at 2018-11-15 16:15:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 16:15:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 16:15:09 [DEBUG   ] spawn_process: at 2018-11-15 16:15:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 16:15:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 16:15:09 [DEBUG   ] spawn_process: at 2018-11-15 16:15:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 16:15:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 16:15:09 [DEBUG   ] spawn_process: at 2018-11-15 16:15:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 16:15:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 16:15:09 [DEBUG   ] spawn_process: at 2018-11-15 16:15:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 16:15:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 16:15:09 [DEBUG   ] spawn_process: at 2018-11-15 16:15:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 16:15:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 16:15:09 [DEBUG   ] spawn_process: at 2018-11-15 16:15:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 16:15:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 16:15:31 [DEBUG   ] Got command BAM from MCS: ref #516074
2018-11-15 16:15:31 [INFO    ] Finished processing BAM request
2018-11-15 16:15:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:15:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516074   8 58437 58531033 A  ERROR'
2018-11-15 16:15:31 [DEBUG   ] Got command BAM from MCS: ref #516073
2018-11-15 16:15:31 [INFO    ] Finished processing BAM request
2018-11-15 16:15:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:15:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516073   8 58437 58531037 A  ERROR'
2018-11-15 16:15:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 16:15:31 [DEBUG   ] spawn_process: at 2018-11-15 16:15:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 16:15:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 16:15:31 [DEBUG   ] spawn_process: at 2018-11-15 16:15:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 16:15:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 16:15:31 [DEBUG   ] spawn_process: at 2018-11-15 16:15:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 16:15:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 16:15:31 [DEBUG   ] spawn_process: at 2018-11-15 16:15:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 16:15:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 16:15:31 [DEBUG   ] spawn_process: at 2018-11-15 16:15:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 16:15:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 16:15:31 [DEBUG   ] spawn_process: at 2018-11-15 16:15:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 16:15:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 16:15:31 [DEBUG   ] spawn_process: at 2018-11-15 16:15:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 16:15:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 16:15:31 [DEBUG   ] spawn_process: at 2018-11-15 16:15:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 16:15:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 16:15:31 [DEBUG   ] spawn_process: at 2018-11-15 16:15:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 16:15:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 16:15:31 [DEBUG   ] spawn_process: at 2018-11-15 16:15:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 16:15:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 16:15:31 [DEBUG   ] spawn_process: at 2018-11-15 16:15:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 16:15:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 16:15:31 [DEBUG   ] spawn_process: at 2018-11-15 16:15:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 16:15:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 16:15:31 [DEBUG   ] spawn_process: at 2018-11-15 16:15:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 16:15:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 16:15:31 [DEBUG   ] spawn_process: at 2018-11-15 16:15:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 16:15:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 16:15:31 [DEBUG   ] spawn_process: at 2018-11-15 16:15:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 16:15:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 16:15:31 [DEBUG   ] spawn_process: at 2018-11-15 16:15:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 16:15:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 16:15:31 [DEBUG   ] spawn_process: at 2018-11-15 16:15:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 16:15:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 16:15:31 [DEBUG   ] spawn_process: at 2018-11-15 16:15:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 16:15:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 16:15:31 [DEBUG   ] spawn_process: at 2018-11-15 16:15:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 16:15:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 16:15:31 [DEBUG   ] spawn_process: at 2018-11-15 16:15:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 16:15:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 16:15:31 [DEBUG   ] spawn_process: at 2018-11-15 16:15:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 16:15:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 16:15:31 [DEBUG   ] spawn_process: at 2018-11-15 16:15:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 16:15:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 16:15:31 [DEBUG   ] spawn_process: at 2018-11-15 16:15:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 16:15:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 16:15:31 [DEBUG   ] spawn_process: at 2018-11-15 16:15:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 16:15:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 16:15:31 [DEBUG   ] spawn_process: at 2018-11-15 16:15:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 16:15:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 16:15:31 [DEBUG   ] spawn_process: at 2018-11-15 16:15:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 16:15:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 16:15:45 [DEBUG   ] Got command RPT from MCS: ref #516075
2018-11-15 16:15:45 [DEBUG   ] summary = ERROR
2018-11-15 16:15:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516075  13 58437 58545133 A  ERRORERROR'
2018-11-15 16:15:45 [DEBUG   ] Got command RPT from MCS: ref #516076
2018-11-15 16:15:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 16:15:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516076  77 58437 58545134 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 16:15:53 [DEBUG   ] Got command BAM from MCS: ref #516093
2018-11-15 16:15:53 [INFO    ] Finished processing BAM request
2018-11-15 16:15:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:15:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516093   8 58437 58553025 A  ERROR'
2018-11-15 16:15:53 [DEBUG   ] Got command BAM from MCS: ref #516092
2018-11-15 16:15:53 [INFO    ] Finished processing BAM request
2018-11-15 16:15:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:15:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516092   8 58437 58553029 A  ERROR'
2018-11-15 16:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 16:15:53 [DEBUG   ] spawn_process: at 2018-11-15 16:15:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 16:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 16:15:53 [DEBUG   ] spawn_process: at 2018-11-15 16:15:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 16:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 16:15:53 [DEBUG   ] spawn_process: at 2018-11-15 16:15:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 16:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 16:15:53 [DEBUG   ] spawn_process: at 2018-11-15 16:15:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 16:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 16:15:53 [DEBUG   ] spawn_process: at 2018-11-15 16:15:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 16:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 16:15:53 [DEBUG   ] spawn_process: at 2018-11-15 16:15:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 16:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 16:15:53 [DEBUG   ] spawn_process: at 2018-11-15 16:15:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 16:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 16:15:53 [DEBUG   ] spawn_process: at 2018-11-15 16:15:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 16:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 16:15:53 [DEBUG   ] spawn_process: at 2018-11-15 16:15:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 16:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 16:15:53 [DEBUG   ] spawn_process: at 2018-11-15 16:15:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 16:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 16:15:53 [DEBUG   ] spawn_process: at 2018-11-15 16:15:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 16:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 16:15:53 [DEBUG   ] spawn_process: at 2018-11-15 16:15:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 16:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 16:15:53 [DEBUG   ] spawn_process: at 2018-11-15 16:15:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 16:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 16:15:53 [DEBUG   ] spawn_process: at 2018-11-15 16:15:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 16:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 16:15:53 [DEBUG   ] spawn_process: at 2018-11-15 16:15:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 16:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 16:15:53 [DEBUG   ] spawn_process: at 2018-11-15 16:15:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 16:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 16:15:53 [DEBUG   ] spawn_process: at 2018-11-15 16:15:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 16:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 16:15:53 [DEBUG   ] spawn_process: at 2018-11-15 16:15:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 16:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 16:15:53 [DEBUG   ] spawn_process: at 2018-11-15 16:15:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 16:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 16:15:53 [DEBUG   ] spawn_process: at 2018-11-15 16:15:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 16:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 16:15:53 [DEBUG   ] spawn_process: at 2018-11-15 16:15:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 16:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 16:15:53 [DEBUG   ] spawn_process: at 2018-11-15 16:15:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 16:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 16:15:53 [DEBUG   ] spawn_process: at 2018-11-15 16:15:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 16:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 16:15:53 [DEBUG   ] spawn_process: at 2018-11-15 16:15:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 16:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 16:15:53 [DEBUG   ] spawn_process: at 2018-11-15 16:15:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 16:15:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 16:15:53 [DEBUG   ] spawn_process: at 2018-11-15 16:15:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 16:15:55 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-15 16:15:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-11-15 16:15:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:15:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 16:15:59 [WARNING ] (13, 1, 'bot')
2018-11-15 16:15:59 [WARNING ] (13, 1, 'bot')
2018-11-15 16:15:59 [WARNING ] (13, 1, 'bot')
2018-11-15 16:15:59 [WARNING ] (13, 1, 'bot')
2018-11-15 16:15:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:15:59 [DEBUG   ] Finished updating board flags in 1.368 seconds
2018-11-15 16:16:15 [DEBUG   ] Got command BAM from MCS: ref #516094
2018-11-15 16:16:15 [INFO    ] Finished processing BAM request
2018-11-15 16:16:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:16:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516094   8 58437 58575025 A  ERROR'
2018-11-15 16:16:15 [DEBUG   ] Got command BAM from MCS: ref #516095
2018-11-15 16:16:15 [INFO    ] Finished processing BAM request
2018-11-15 16:16:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:16:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516095   8 58437 58575029 A  ERROR'
2018-11-15 16:16:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 16:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 16:16:15 [DEBUG   ] spawn_process: at 2018-11-15 16:16:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 16:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 16:16:15 [DEBUG   ] spawn_process: at 2018-11-15 16:16:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 16:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 16:16:15 [DEBUG   ] spawn_process: at 2018-11-15 16:16:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 16:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 16:16:15 [DEBUG   ] spawn_process: at 2018-11-15 16:16:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 16:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 16:16:15 [DEBUG   ] spawn_process: at 2018-11-15 16:16:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 16:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 16:16:15 [DEBUG   ] spawn_process: at 2018-11-15 16:16:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 16:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 16:16:15 [DEBUG   ] spawn_process: at 2018-11-15 16:16:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 16:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 16:16:15 [DEBUG   ] spawn_process: at 2018-11-15 16:16:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 16:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 16:16:15 [DEBUG   ] spawn_process: at 2018-11-15 16:16:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 16:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 16:16:15 [DEBUG   ] spawn_process: at 2018-11-15 16:16:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 16:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 16:16:15 [DEBUG   ] spawn_process: at 2018-11-15 16:16:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 16:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 16:16:15 [DEBUG   ] spawn_process: at 2018-11-15 16:16:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 16:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 16:16:15 [DEBUG   ] spawn_process: at 2018-11-15 16:16:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 16:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 16:16:15 [DEBUG   ] spawn_process: at 2018-11-15 16:16:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 16:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 16:16:15 [DEBUG   ] spawn_process: at 2018-11-15 16:16:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 16:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 16:16:15 [DEBUG   ] spawn_process: at 2018-11-15 16:16:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 16:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 16:16:15 [DEBUG   ] spawn_process: at 2018-11-15 16:16:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 16:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 16:16:15 [DEBUG   ] spawn_process: at 2018-11-15 16:16:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 16:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 16:16:15 [DEBUG   ] spawn_process: at 2018-11-15 16:16:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 16:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 16:16:15 [DEBUG   ] spawn_process: at 2018-11-15 16:16:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 16:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 16:16:15 [DEBUG   ] spawn_process: at 2018-11-15 16:16:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 16:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 16:16:15 [DEBUG   ] spawn_process: at 2018-11-15 16:16:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 16:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 16:16:15 [DEBUG   ] spawn_process: at 2018-11-15 16:16:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 16:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 16:16:15 [DEBUG   ] spawn_process: at 2018-11-15 16:16:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 16:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 16:16:15 [DEBUG   ] spawn_process: at 2018-11-15 16:16:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 16:16:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 16:16:15 [DEBUG   ] spawn_process: at 2018-11-15 16:16:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 16:16:35 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-15 16:16:37 [DEBUG   ] Got command BAM from MCS: ref #516097
2018-11-15 16:16:37 [INFO    ] Finished processing BAM request
2018-11-15 16:16:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:16:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516097   8 58437 58597025 A  ERROR'
2018-11-15 16:16:37 [DEBUG   ] Got command BAM from MCS: ref #516096
2018-11-15 16:16:37 [INFO    ] Finished processing BAM request
2018-11-15 16:16:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:16:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516096   8 58437 58597029 A  ERROR'
2018-11-15 16:16:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 16:16:37 [DEBUG   ] spawn_process: at 2018-11-15 16:16:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 16:16:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 16:16:37 [DEBUG   ] spawn_process: at 2018-11-15 16:16:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 16:16:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 16:16:37 [DEBUG   ] spawn_process: at 2018-11-15 16:16:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 16:16:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 16:16:37 [DEBUG   ] spawn_process: at 2018-11-15 16:16:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 16:16:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 16:16:37 [DEBUG   ] spawn_process: at 2018-11-15 16:16:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 16:16:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 16:16:37 [DEBUG   ] spawn_process: at 2018-11-15 16:16:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 16:16:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 16:16:37 [DEBUG   ] spawn_process: at 2018-11-15 16:16:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 16:16:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 16:16:37 [DEBUG   ] spawn_process: at 2018-11-15 16:16:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 16:16:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 16:16:37 [DEBUG   ] spawn_process: at 2018-11-15 16:16:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 16:16:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 16:16:37 [DEBUG   ] spawn_process: at 2018-11-15 16:16:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 16:16:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 16:16:37 [DEBUG   ] spawn_process: at 2018-11-15 16:16:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 16:16:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 16:16:37 [DEBUG   ] spawn_process: at 2018-11-15 16:16:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 16:16:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 16:16:37 [DEBUG   ] spawn_process: at 2018-11-15 16:16:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 16:16:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 16:16:37 [DEBUG   ] spawn_process: at 2018-11-15 16:16:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 16:16:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 16:16:37 [DEBUG   ] spawn_process: at 2018-11-15 16:16:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 16:16:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 16:16:37 [DEBUG   ] spawn_process: at 2018-11-15 16:16:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 16:16:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 16:16:37 [DEBUG   ] spawn_process: at 2018-11-15 16:16:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 16:16:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 16:16:37 [DEBUG   ] spawn_process: at 2018-11-15 16:16:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 16:16:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 16:16:37 [DEBUG   ] spawn_process: at 2018-11-15 16:16:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 16:16:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 16:16:37 [DEBUG   ] spawn_process: at 2018-11-15 16:16:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 16:16:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 16:16:37 [DEBUG   ] spawn_process: at 2018-11-15 16:16:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 16:16:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 16:16:37 [DEBUG   ] spawn_process: at 2018-11-15 16:16:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 16:16:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 16:16:37 [DEBUG   ] spawn_process: at 2018-11-15 16:16:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 16:16:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 16:16:37 [DEBUG   ] spawn_process: at 2018-11-15 16:16:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 16:16:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 16:16:37 [DEBUG   ] spawn_process: at 2018-11-15 16:16:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 16:16:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 16:16:37 [DEBUG   ] spawn_process: at 2018-11-15 16:16:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 16:16:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 16:16:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 16:16:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:16:59 [DEBUG   ] Got command BAM from MCS: ref #516098
2018-11-15 16:16:59 [INFO    ] Finished processing BAM request
2018-11-15 16:16:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:16:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516098   8 58437 58619029 A  ERROR'
2018-11-15 16:16:59 [DEBUG   ] Got command BAM from MCS: ref #516099
2018-11-15 16:16:59 [INFO    ] Finished processing BAM request
2018-11-15 16:16:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:16:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516099   8 58437 58619033 A  ERROR'
2018-11-15 16:16:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 16:16:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 16:16:59 [WARNING ] (13, 1, 'bot')
2018-11-15 16:16:59 [WARNING ] (13, 1, 'bot')
2018-11-15 16:16:59 [WARNING ] (13, 1, 'bot')
2018-11-15 16:16:59 [WARNING ] (13, 1, 'bot')
2018-11-15 16:16:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:16:59 [DEBUG   ] Finished updating board flags in 1.188 seconds
2018-11-15 16:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 16:16:59 [DEBUG   ] spawn_process: at 2018-11-15 16:16:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 16:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 16:16:59 [DEBUG   ] spawn_process: at 2018-11-15 16:16:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 16:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 16:16:59 [DEBUG   ] spawn_process: at 2018-11-15 16:16:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 16:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 16:16:59 [DEBUG   ] spawn_process: at 2018-11-15 16:16:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 16:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 16:16:59 [DEBUG   ] spawn_process: at 2018-11-15 16:16:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 16:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 16:16:59 [DEBUG   ] spawn_process: at 2018-11-15 16:16:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 16:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 16:16:59 [DEBUG   ] spawn_process: at 2018-11-15 16:16:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 16:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 16:16:59 [DEBUG   ] spawn_process: at 2018-11-15 16:16:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 16:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 16:16:59 [DEBUG   ] spawn_process: at 2018-11-15 16:16:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 16:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 16:16:59 [DEBUG   ] spawn_process: at 2018-11-15 16:16:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 16:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 16:16:59 [DEBUG   ] spawn_process: at 2018-11-15 16:16:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 16:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 16:16:59 [DEBUG   ] spawn_process: at 2018-11-15 16:16:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 16:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 16:16:59 [DEBUG   ] spawn_process: at 2018-11-15 16:16:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 16:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 16:16:59 [DEBUG   ] spawn_process: at 2018-11-15 16:16:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 16:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 16:16:59 [DEBUG   ] spawn_process: at 2018-11-15 16:16:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 16:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 16:16:59 [DEBUG   ] spawn_process: at 2018-11-15 16:16:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 16:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 16:16:59 [DEBUG   ] spawn_process: at 2018-11-15 16:16:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 16:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 16:16:59 [DEBUG   ] spawn_process: at 2018-11-15 16:16:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 16:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 16:16:59 [DEBUG   ] spawn_process: at 2018-11-15 16:16:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 16:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 16:16:59 [DEBUG   ] spawn_process: at 2018-11-15 16:16:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 16:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 16:16:59 [DEBUG   ] spawn_process: at 2018-11-15 16:16:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 16:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 16:16:59 [DEBUG   ] spawn_process: at 2018-11-15 16:16:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 16:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 16:16:59 [DEBUG   ] spawn_process: at 2018-11-15 16:16:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 16:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 16:16:59 [DEBUG   ] spawn_process: at 2018-11-15 16:16:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 16:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 16:16:59 [DEBUG   ] spawn_process: at 2018-11-15 16:16:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 16:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 16:16:59 [DEBUG   ] spawn_process: at 2018-11-15 16:16:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 16:17:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 16:17:21 [DEBUG   ] Got command BAM from MCS: ref #516101
2018-11-15 16:17:21 [INFO    ] Finished processing BAM request
2018-11-15 16:17:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:17:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516101   8 58437 58641025 A  ERROR'
2018-11-15 16:17:21 [DEBUG   ] Got command BAM from MCS: ref #516100
2018-11-15 16:17:21 [INFO    ] Finished processing BAM request
2018-11-15 16:17:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:17:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516100   8 58437 58641029 A  ERROR'
2018-11-15 16:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 16:17:21 [DEBUG   ] spawn_process: at 2018-11-15 16:17:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 16:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 16:17:21 [DEBUG   ] spawn_process: at 2018-11-15 16:17:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 16:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 16:17:21 [DEBUG   ] spawn_process: at 2018-11-15 16:17:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 16:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 16:17:21 [DEBUG   ] spawn_process: at 2018-11-15 16:17:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 16:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 16:17:21 [DEBUG   ] spawn_process: at 2018-11-15 16:17:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 16:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 16:17:21 [DEBUG   ] spawn_process: at 2018-11-15 16:17:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 16:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 16:17:21 [DEBUG   ] spawn_process: at 2018-11-15 16:17:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 16:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 16:17:21 [DEBUG   ] spawn_process: at 2018-11-15 16:17:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 16:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 16:17:21 [DEBUG   ] spawn_process: at 2018-11-15 16:17:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 16:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 16:17:21 [DEBUG   ] spawn_process: at 2018-11-15 16:17:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 16:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 16:17:21 [DEBUG   ] spawn_process: at 2018-11-15 16:17:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 16:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 16:17:21 [DEBUG   ] spawn_process: at 2018-11-15 16:17:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 16:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 16:17:21 [DEBUG   ] spawn_process: at 2018-11-15 16:17:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 16:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 16:17:21 [DEBUG   ] spawn_process: at 2018-11-15 16:17:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 16:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 16:17:21 [DEBUG   ] spawn_process: at 2018-11-15 16:17:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 16:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 16:17:21 [DEBUG   ] spawn_process: at 2018-11-15 16:17:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 16:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 16:17:21 [DEBUG   ] spawn_process: at 2018-11-15 16:17:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 16:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 16:17:21 [DEBUG   ] spawn_process: at 2018-11-15 16:17:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 16:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 16:17:21 [DEBUG   ] spawn_process: at 2018-11-15 16:17:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 16:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 16:17:21 [DEBUG   ] spawn_process: at 2018-11-15 16:17:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 16:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 16:17:21 [DEBUG   ] spawn_process: at 2018-11-15 16:17:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 16:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 16:17:21 [DEBUG   ] spawn_process: at 2018-11-15 16:17:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 16:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 16:17:21 [DEBUG   ] spawn_process: at 2018-11-15 16:17:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 16:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 16:17:21 [DEBUG   ] spawn_process: at 2018-11-15 16:17:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 16:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 16:17:21 [DEBUG   ] spawn_process: at 2018-11-15 16:17:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 16:17:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 16:17:21 [DEBUG   ] spawn_process: at 2018-11-15 16:17:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 16:17:35 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-15 16:17:43 [DEBUG   ] Got command BAM from MCS: ref #516106
2018-11-15 16:17:43 [INFO    ] Finished processing BAM request
2018-11-15 16:17:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:17:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516106   8 58437 58663029 A  ERROR'
2018-11-15 16:17:43 [DEBUG   ] Got command BAM from MCS: ref #516107
2018-11-15 16:17:43 [INFO    ] Finished processing BAM request
2018-11-15 16:17:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:17:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516107   8 58437 58663033 A  ERROR'
2018-11-15 16:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 16:17:43 [DEBUG   ] spawn_process: at 2018-11-15 16:17:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 16:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 16:17:43 [DEBUG   ] spawn_process: at 2018-11-15 16:17:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 16:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 16:17:43 [DEBUG   ] spawn_process: at 2018-11-15 16:17:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 16:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 16:17:43 [DEBUG   ] spawn_process: at 2018-11-15 16:17:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 16:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 16:17:43 [DEBUG   ] spawn_process: at 2018-11-15 16:17:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 16:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 16:17:43 [DEBUG   ] spawn_process: at 2018-11-15 16:17:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 16:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 16:17:43 [DEBUG   ] spawn_process: at 2018-11-15 16:17:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 16:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 16:17:43 [DEBUG   ] spawn_process: at 2018-11-15 16:17:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 16:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 16:17:43 [DEBUG   ] spawn_process: at 2018-11-15 16:17:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 16:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 16:17:43 [DEBUG   ] spawn_process: at 2018-11-15 16:17:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 16:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 16:17:43 [DEBUG   ] spawn_process: at 2018-11-15 16:17:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 16:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 16:17:43 [DEBUG   ] spawn_process: at 2018-11-15 16:17:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 16:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 16:17:43 [DEBUG   ] spawn_process: at 2018-11-15 16:17:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 16:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 16:17:43 [DEBUG   ] spawn_process: at 2018-11-15 16:17:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 16:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 16:17:43 [DEBUG   ] spawn_process: at 2018-11-15 16:17:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 16:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 16:17:43 [DEBUG   ] spawn_process: at 2018-11-15 16:17:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 16:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 16:17:43 [DEBUG   ] spawn_process: at 2018-11-15 16:17:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 16:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 16:17:43 [DEBUG   ] spawn_process: at 2018-11-15 16:17:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 16:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 16:17:43 [DEBUG   ] spawn_process: at 2018-11-15 16:17:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 16:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 16:17:43 [DEBUG   ] spawn_process: at 2018-11-15 16:17:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 16:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 16:17:43 [DEBUG   ] spawn_process: at 2018-11-15 16:17:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 16:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 16:17:43 [DEBUG   ] spawn_process: at 2018-11-15 16:17:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 16:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 16:17:43 [DEBUG   ] spawn_process: at 2018-11-15 16:17:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 16:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 16:17:43 [DEBUG   ] spawn_process: at 2018-11-15 16:17:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 16:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 16:17:43 [DEBUG   ] spawn_process: at 2018-11-15 16:17:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 16:17:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 16:17:43 [DEBUG   ] spawn_process: at 2018-11-15 16:17:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 16:17:55 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-15 16:17:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 16:17:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:17:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 16:17:59 [WARNING ] (13, 1, 'bot')
2018-11-15 16:17:59 [WARNING ] (13, 1, 'bot')
2018-11-15 16:17:59 [WARNING ] (13, 1, 'bot')
2018-11-15 16:17:59 [WARNING ] (13, 1, 'bot')
2018-11-15 16:17:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:17:59 [DEBUG   ] Finished updating board flags in 1.013 seconds
2018-11-15 16:18:05 [DEBUG   ] Got command BAM from MCS: ref #516109
2018-11-15 16:18:05 [INFO    ] Finished processing BAM request
2018-11-15 16:18:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:18:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516109   8 58437 58685033 A  ERROR'
2018-11-15 16:18:05 [DEBUG   ] Got command BAM from MCS: ref #516108
2018-11-15 16:18:05 [INFO    ] Finished processing BAM request
2018-11-15 16:18:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:18:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516108   8 58437 58685037 A  ERROR'
2018-11-15 16:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 16:18:05 [DEBUG   ] spawn_process: at 2018-11-15 16:18:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 16:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 16:18:05 [DEBUG   ] spawn_process: at 2018-11-15 16:18:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 16:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 16:18:05 [DEBUG   ] spawn_process: at 2018-11-15 16:18:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 16:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 16:18:05 [DEBUG   ] spawn_process: at 2018-11-15 16:18:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 16:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 16:18:05 [DEBUG   ] spawn_process: at 2018-11-15 16:18:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 16:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 16:18:05 [DEBUG   ] spawn_process: at 2018-11-15 16:18:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 16:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 16:18:05 [DEBUG   ] spawn_process: at 2018-11-15 16:18:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 16:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 16:18:05 [DEBUG   ] spawn_process: at 2018-11-15 16:18:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 16:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 16:18:05 [DEBUG   ] spawn_process: at 2018-11-15 16:18:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 16:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 16:18:05 [DEBUG   ] spawn_process: at 2018-11-15 16:18:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 16:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 16:18:05 [DEBUG   ] spawn_process: at 2018-11-15 16:18:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 16:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 16:18:05 [DEBUG   ] spawn_process: at 2018-11-15 16:18:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 16:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 16:18:05 [DEBUG   ] spawn_process: at 2018-11-15 16:18:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 16:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 16:18:05 [DEBUG   ] spawn_process: at 2018-11-15 16:18:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 16:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 16:18:05 [DEBUG   ] spawn_process: at 2018-11-15 16:18:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 16:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 16:18:05 [DEBUG   ] spawn_process: at 2018-11-15 16:18:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 16:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 16:18:05 [DEBUG   ] spawn_process: at 2018-11-15 16:18:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 16:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 16:18:05 [DEBUG   ] spawn_process: at 2018-11-15 16:18:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 16:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 16:18:05 [DEBUG   ] spawn_process: at 2018-11-15 16:18:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 16:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 16:18:05 [DEBUG   ] spawn_process: at 2018-11-15 16:18:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 16:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 16:18:05 [DEBUG   ] spawn_process: at 2018-11-15 16:18:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 16:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 16:18:05 [DEBUG   ] spawn_process: at 2018-11-15 16:18:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 16:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 16:18:05 [DEBUG   ] spawn_process: at 2018-11-15 16:18:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 16:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 16:18:05 [DEBUG   ] spawn_process: at 2018-11-15 16:18:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 16:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 16:18:05 [DEBUG   ] spawn_process: at 2018-11-15 16:18:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 16:18:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 16:18:05 [DEBUG   ] spawn_process: at 2018-11-15 16:18:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 16:18:15 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-15 16:18:19 [DEBUG   ] Got command RPT from MCS: ref #516112
2018-11-15 16:18:19 [DEBUG   ] summary = ERROR
2018-11-15 16:18:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516112  13 58437 58699333 A  ERRORERROR'
2018-11-15 16:18:19 [DEBUG   ] Got command RPT from MCS: ref #516113
2018-11-15 16:18:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 16:18:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516113  77 58437 58699537 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 16:18:19 [DEBUG   ] Got command RPT from MCS: ref #516114
2018-11-15 16:18:19 [DEBUG   ] summary = ERROR
2018-11-15 16:18:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516114  13 58437 58699729 A  ERRORERROR'
2018-11-15 16:18:19 [DEBUG   ] Got command RPT from MCS: ref #516116
2018-11-15 16:18:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 16:18:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516116  77 58437 58699933 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 16:18:20 [DEBUG   ] Got command RPT from MCS: ref #516117
2018-11-15 16:18:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 16:18:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516117  12 58437 58700137 A  ERRORB¢ff'
2018-11-15 16:18:27 [DEBUG   ] Got command BAM from MCS: ref #516123
2018-11-15 16:18:27 [INFO    ] Finished processing BAM request
2018-11-15 16:18:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:18:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516123   8 58437 58707029 A  ERROR'
2018-11-15 16:18:27 [DEBUG   ] Got command BAM from MCS: ref #516122
2018-11-15 16:18:27 [INFO    ] Finished processing BAM request
2018-11-15 16:18:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:18:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516122   8 58437 58707033 A  ERROR'
2018-11-15 16:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 16:18:27 [DEBUG   ] spawn_process: at 2018-11-15 16:18:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 16:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 16:18:27 [DEBUG   ] spawn_process: at 2018-11-15 16:18:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 16:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 16:18:27 [DEBUG   ] spawn_process: at 2018-11-15 16:18:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 16:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 16:18:27 [DEBUG   ] spawn_process: at 2018-11-15 16:18:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 16:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 16:18:27 [DEBUG   ] spawn_process: at 2018-11-15 16:18:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 16:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 16:18:27 [DEBUG   ] spawn_process: at 2018-11-15 16:18:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 16:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 16:18:27 [DEBUG   ] spawn_process: at 2018-11-15 16:18:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 16:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 16:18:27 [DEBUG   ] spawn_process: at 2018-11-15 16:18:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 16:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 16:18:27 [DEBUG   ] spawn_process: at 2018-11-15 16:18:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 16:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 16:18:27 [DEBUG   ] spawn_process: at 2018-11-15 16:18:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 16:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 16:18:27 [DEBUG   ] spawn_process: at 2018-11-15 16:18:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 16:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 16:18:27 [DEBUG   ] spawn_process: at 2018-11-15 16:18:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 16:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 16:18:27 [DEBUG   ] spawn_process: at 2018-11-15 16:18:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 16:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 16:18:27 [DEBUG   ] spawn_process: at 2018-11-15 16:18:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 16:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 16:18:27 [DEBUG   ] spawn_process: at 2018-11-15 16:18:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 16:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 16:18:27 [DEBUG   ] spawn_process: at 2018-11-15 16:18:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 16:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 16:18:27 [DEBUG   ] spawn_process: at 2018-11-15 16:18:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 16:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 16:18:27 [DEBUG   ] spawn_process: at 2018-11-15 16:18:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 16:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 16:18:27 [DEBUG   ] spawn_process: at 2018-11-15 16:18:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 16:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 16:18:27 [DEBUG   ] spawn_process: at 2018-11-15 16:18:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 16:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 16:18:27 [DEBUG   ] spawn_process: at 2018-11-15 16:18:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 16:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 16:18:27 [DEBUG   ] spawn_process: at 2018-11-15 16:18:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 16:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 16:18:27 [DEBUG   ] spawn_process: at 2018-11-15 16:18:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 16:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 16:18:27 [DEBUG   ] spawn_process: at 2018-11-15 16:18:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 16:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 16:18:27 [DEBUG   ] spawn_process: at 2018-11-15 16:18:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 16:18:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 16:18:27 [DEBUG   ] spawn_process: at 2018-11-15 16:18:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 16:18:35 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 16:18:49 [DEBUG   ] Got command BAM from MCS: ref #516124
2018-11-15 16:18:49 [INFO    ] Finished processing BAM request
2018-11-15 16:18:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:18:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516124   8 58437 58729033 A  ERROR'
2018-11-15 16:18:49 [DEBUG   ] Got command BAM from MCS: ref #516125
2018-11-15 16:18:49 [INFO    ] Finished processing BAM request
2018-11-15 16:18:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:18:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516125   8 58437 58729037 A  ERROR'
2018-11-15 16:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 16:18:49 [DEBUG   ] spawn_process: at 2018-11-15 16:18:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 16:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 16:18:49 [DEBUG   ] spawn_process: at 2018-11-15 16:18:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 16:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 16:18:49 [DEBUG   ] spawn_process: at 2018-11-15 16:18:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 16:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 16:18:49 [DEBUG   ] spawn_process: at 2018-11-15 16:18:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 16:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 16:18:49 [DEBUG   ] spawn_process: at 2018-11-15 16:18:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 16:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 16:18:49 [DEBUG   ] spawn_process: at 2018-11-15 16:18:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 16:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 16:18:49 [DEBUG   ] spawn_process: at 2018-11-15 16:18:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 16:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 16:18:49 [DEBUG   ] spawn_process: at 2018-11-15 16:18:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 16:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 16:18:49 [DEBUG   ] spawn_process: at 2018-11-15 16:18:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 16:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 16:18:49 [DEBUG   ] spawn_process: at 2018-11-15 16:18:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 16:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 16:18:49 [DEBUG   ] spawn_process: at 2018-11-15 16:18:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 16:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 16:18:49 [DEBUG   ] spawn_process: at 2018-11-15 16:18:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 16:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 16:18:49 [DEBUG   ] spawn_process: at 2018-11-15 16:18:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 16:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 16:18:49 [DEBUG   ] spawn_process: at 2018-11-15 16:18:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 16:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 16:18:49 [DEBUG   ] spawn_process: at 2018-11-15 16:18:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 16:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 16:18:49 [DEBUG   ] spawn_process: at 2018-11-15 16:18:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 16:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 16:18:49 [DEBUG   ] spawn_process: at 2018-11-15 16:18:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 16:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 16:18:49 [DEBUG   ] spawn_process: at 2018-11-15 16:18:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 16:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 16:18:49 [DEBUG   ] spawn_process: at 2018-11-15 16:18:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 16:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 16:18:49 [DEBUG   ] spawn_process: at 2018-11-15 16:18:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 16:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 16:18:49 [DEBUG   ] spawn_process: at 2018-11-15 16:18:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 16:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 16:18:49 [DEBUG   ] spawn_process: at 2018-11-15 16:18:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 16:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 16:18:49 [DEBUG   ] spawn_process: at 2018-11-15 16:18:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 16:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 16:18:49 [DEBUG   ] spawn_process: at 2018-11-15 16:18:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 16:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 16:18:49 [DEBUG   ] spawn_process: at 2018-11-15 16:18:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 16:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 16:18:49 [DEBUG   ] spawn_process: at 2018-11-15 16:18:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 16:18:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 16:18:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 16:18:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:18:59 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 16:18:59 [WARNING ] (13, 1, 'bot')
2018-11-15 16:18:59 [WARNING ] (13, 1, 'bot')
2018-11-15 16:18:59 [WARNING ] (13, 1, 'bot')
2018-11-15 16:18:59 [WARNING ] (13, 1, 'bot')
2018-11-15 16:18:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:18:59 [DEBUG   ] Finished updating board flags in 0.996 seconds
2018-11-15 16:19:11 [DEBUG   ] Got command BAM from MCS: ref #516127
2018-11-15 16:19:11 [INFO    ] Finished processing BAM request
2018-11-15 16:19:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:19:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516127   8 58437 58751033 A  ERROR'
2018-11-15 16:19:11 [DEBUG   ] Got command BAM from MCS: ref #516126
2018-11-15 16:19:11 [INFO    ] Finished processing BAM request
2018-11-15 16:19:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:19:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516126   8 58437 58751037 A  ERROR'
2018-11-15 16:19:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 16:19:11 [DEBUG   ] spawn_process: at 2018-11-15 16:19:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 16:19:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 16:19:11 [DEBUG   ] spawn_process: at 2018-11-15 16:19:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 16:19:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 16:19:11 [DEBUG   ] spawn_process: at 2018-11-15 16:19:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 16:19:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 16:19:11 [DEBUG   ] spawn_process: at 2018-11-15 16:19:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 16:19:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 16:19:11 [DEBUG   ] spawn_process: at 2018-11-15 16:19:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 16:19:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 16:19:11 [DEBUG   ] spawn_process: at 2018-11-15 16:19:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 16:19:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 16:19:11 [DEBUG   ] spawn_process: at 2018-11-15 16:19:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 16:19:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 16:19:11 [DEBUG   ] spawn_process: at 2018-11-15 16:19:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 16:19:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 16:19:11 [DEBUG   ] spawn_process: at 2018-11-15 16:19:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 16:19:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 16:19:11 [DEBUG   ] spawn_process: at 2018-11-15 16:19:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 16:19:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 16:19:11 [DEBUG   ] spawn_process: at 2018-11-15 16:19:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 16:19:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 16:19:11 [DEBUG   ] spawn_process: at 2018-11-15 16:19:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 16:19:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 16:19:11 [DEBUG   ] spawn_process: at 2018-11-15 16:19:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 16:19:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 16:19:11 [DEBUG   ] spawn_process: at 2018-11-15 16:19:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 16:19:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 16:19:11 [DEBUG   ] spawn_process: at 2018-11-15 16:19:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 16:19:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 16:19:11 [DEBUG   ] spawn_process: at 2018-11-15 16:19:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 16:19:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 16:19:11 [DEBUG   ] spawn_process: at 2018-11-15 16:19:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 16:19:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 16:19:11 [DEBUG   ] spawn_process: at 2018-11-15 16:19:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 16:19:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 16:19:11 [DEBUG   ] spawn_process: at 2018-11-15 16:19:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 16:19:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 16:19:11 [DEBUG   ] spawn_process: at 2018-11-15 16:19:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 16:19:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 16:19:11 [DEBUG   ] spawn_process: at 2018-11-15 16:19:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 16:19:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 16:19:11 [DEBUG   ] spawn_process: at 2018-11-15 16:19:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 16:19:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 16:19:11 [DEBUG   ] spawn_process: at 2018-11-15 16:19:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 16:19:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 16:19:11 [DEBUG   ] spawn_process: at 2018-11-15 16:19:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 16:19:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 16:19:11 [DEBUG   ] spawn_process: at 2018-11-15 16:19:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 16:19:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 16:19:11 [DEBUG   ] spawn_process: at 2018-11-15 16:19:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 16:19:15 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 16:19:33 [DEBUG   ] Got command BAM from MCS: ref #516129
2018-11-15 16:19:33 [INFO    ] Finished processing BAM request
2018-11-15 16:19:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:19:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516129   8 58437 58773033 A  ERROR'
2018-11-15 16:19:33 [DEBUG   ] Got command BAM from MCS: ref #516128
2018-11-15 16:19:33 [INFO    ] Finished processing BAM request
2018-11-15 16:19:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:19:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516128   8 58437 58773037 A  ERROR'
2018-11-15 16:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 16:19:33 [DEBUG   ] spawn_process: at 2018-11-15 16:19:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 16:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 16:19:33 [DEBUG   ] spawn_process: at 2018-11-15 16:19:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 16:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 16:19:33 [DEBUG   ] spawn_process: at 2018-11-15 16:19:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 16:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 16:19:33 [DEBUG   ] spawn_process: at 2018-11-15 16:19:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 16:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 16:19:33 [DEBUG   ] spawn_process: at 2018-11-15 16:19:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 16:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 16:19:33 [DEBUG   ] spawn_process: at 2018-11-15 16:19:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 16:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 16:19:33 [DEBUG   ] spawn_process: at 2018-11-15 16:19:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 16:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 16:19:33 [DEBUG   ] spawn_process: at 2018-11-15 16:19:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 16:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 16:19:33 [DEBUG   ] spawn_process: at 2018-11-15 16:19:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 16:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 16:19:33 [DEBUG   ] spawn_process: at 2018-11-15 16:19:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 16:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 16:19:33 [DEBUG   ] spawn_process: at 2018-11-15 16:19:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 16:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 16:19:33 [DEBUG   ] spawn_process: at 2018-11-15 16:19:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 16:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 16:19:33 [DEBUG   ] spawn_process: at 2018-11-15 16:19:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 16:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 16:19:33 [DEBUG   ] spawn_process: at 2018-11-15 16:19:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 16:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 16:19:33 [DEBUG   ] spawn_process: at 2018-11-15 16:19:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 16:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 16:19:33 [DEBUG   ] spawn_process: at 2018-11-15 16:19:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 16:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 16:19:33 [DEBUG   ] spawn_process: at 2018-11-15 16:19:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 16:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 16:19:33 [DEBUG   ] spawn_process: at 2018-11-15 16:19:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 16:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 16:19:33 [DEBUG   ] spawn_process: at 2018-11-15 16:19:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 16:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 16:19:33 [DEBUG   ] spawn_process: at 2018-11-15 16:19:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 16:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 16:19:33 [DEBUG   ] spawn_process: at 2018-11-15 16:19:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 16:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 16:19:33 [DEBUG   ] spawn_process: at 2018-11-15 16:19:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 16:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 16:19:33 [DEBUG   ] spawn_process: at 2018-11-15 16:19:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 16:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 16:19:33 [DEBUG   ] spawn_process: at 2018-11-15 16:19:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 16:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 16:19:33 [DEBUG   ] spawn_process: at 2018-11-15 16:19:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 16:19:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 16:19:33 [DEBUG   ] spawn_process: at 2018-11-15 16:19:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 16:19:35 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-15 16:19:55 [DEBUG   ] Got command BAM from MCS: ref #516131
2018-11-15 16:19:55 [INFO    ] Finished processing BAM request
2018-11-15 16:19:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:19:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516131   8 58437 58795026 A  ERROR'
2018-11-15 16:19:55 [DEBUG   ] Got command BAM from MCS: ref #516130
2018-11-15 16:19:55 [INFO    ] Finished processing BAM request
2018-11-15 16:19:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:19:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516130   8 58437 58795030 A  ERROR'
2018-11-15 16:19:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 16:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 16:19:55 [DEBUG   ] spawn_process: at 2018-11-15 16:19:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 16:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 16:19:55 [DEBUG   ] spawn_process: at 2018-11-15 16:19:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 16:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 16:19:55 [DEBUG   ] spawn_process: at 2018-11-15 16:19:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 16:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 16:19:55 [DEBUG   ] spawn_process: at 2018-11-15 16:19:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 16:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 16:19:55 [DEBUG   ] spawn_process: at 2018-11-15 16:19:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 16:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 16:19:55 [DEBUG   ] spawn_process: at 2018-11-15 16:19:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 16:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 16:19:55 [DEBUG   ] spawn_process: at 2018-11-15 16:19:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 16:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 16:19:55 [DEBUG   ] spawn_process: at 2018-11-15 16:19:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 16:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 16:19:55 [DEBUG   ] spawn_process: at 2018-11-15 16:19:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 16:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 16:19:55 [DEBUG   ] spawn_process: at 2018-11-15 16:19:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 16:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 16:19:55 [DEBUG   ] spawn_process: at 2018-11-15 16:19:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 16:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 16:19:55 [DEBUG   ] spawn_process: at 2018-11-15 16:19:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 16:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 16:19:55 [DEBUG   ] spawn_process: at 2018-11-15 16:19:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 16:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 16:19:55 [DEBUG   ] spawn_process: at 2018-11-15 16:19:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 16:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 16:19:55 [DEBUG   ] spawn_process: at 2018-11-15 16:19:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 16:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 16:19:55 [DEBUG   ] spawn_process: at 2018-11-15 16:19:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 16:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 16:19:55 [DEBUG   ] spawn_process: at 2018-11-15 16:19:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 16:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 16:19:55 [DEBUG   ] spawn_process: at 2018-11-15 16:19:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 16:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 16:19:55 [DEBUG   ] spawn_process: at 2018-11-15 16:19:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 16:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 16:19:55 [DEBUG   ] spawn_process: at 2018-11-15 16:19:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 16:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 16:19:55 [DEBUG   ] spawn_process: at 2018-11-15 16:19:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 16:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 16:19:55 [DEBUG   ] spawn_process: at 2018-11-15 16:19:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 16:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 16:19:55 [DEBUG   ] spawn_process: at 2018-11-15 16:19:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 16:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 16:19:55 [DEBUG   ] spawn_process: at 2018-11-15 16:19:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 16:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 16:19:55 [DEBUG   ] spawn_process: at 2018-11-15 16:19:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 16:19:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 16:19:55 [DEBUG   ] spawn_process: at 2018-11-15 16:19:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 16:19:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-11-15 16:19:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:19:59 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 16:19:59 [WARNING ] (13, 1, 'bot')
2018-11-15 16:19:59 [WARNING ] (13, 1, 'bot')
2018-11-15 16:19:59 [WARNING ] (13, 1, 'bot')
2018-11-15 16:19:59 [WARNING ] (13, 1, 'bot')
2018-11-15 16:19:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:19:59 [DEBUG   ] Finished updating board flags in 1.252 seconds
2018-11-15 16:20:15 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-15 16:20:17 [DEBUG   ] Got command BAM from MCS: ref #516132
2018-11-15 16:20:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:20:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516132   8 58437 58817030 A  ERROR'
2018-11-15 16:20:17 [DEBUG   ] Got command BAM from MCS: ref #516133
2018-11-15 16:20:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:20:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516133   8 58437 58817034 A  ERROR'
2018-11-15 16:20:17 [INFO    ] Finished processing BAM request
2018-11-15 16:20:17 [INFO    ] Finished processing BAM request
2018-11-15 16:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 16:20:17 [DEBUG   ] spawn_process: at 2018-11-15 16:20:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 16:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 16:20:17 [DEBUG   ] spawn_process: at 2018-11-15 16:20:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 16:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 16:20:17 [DEBUG   ] spawn_process: at 2018-11-15 16:20:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 16:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 16:20:17 [DEBUG   ] spawn_process: at 2018-11-15 16:20:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 16:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 16:20:17 [DEBUG   ] spawn_process: at 2018-11-15 16:20:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 16:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 16:20:17 [DEBUG   ] spawn_process: at 2018-11-15 16:20:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 16:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 16:20:17 [DEBUG   ] spawn_process: at 2018-11-15 16:20:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 16:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 16:20:17 [DEBUG   ] spawn_process: at 2018-11-15 16:20:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 16:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 16:20:17 [DEBUG   ] spawn_process: at 2018-11-15 16:20:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 16:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 16:20:17 [DEBUG   ] spawn_process: at 2018-11-15 16:20:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 16:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 16:20:17 [DEBUG   ] spawn_process: at 2018-11-15 16:20:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 16:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 16:20:17 [DEBUG   ] spawn_process: at 2018-11-15 16:20:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 16:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 16:20:17 [DEBUG   ] spawn_process: at 2018-11-15 16:20:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 16:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 16:20:17 [DEBUG   ] spawn_process: at 2018-11-15 16:20:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 16:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 16:20:17 [DEBUG   ] spawn_process: at 2018-11-15 16:20:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 16:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 16:20:17 [DEBUG   ] spawn_process: at 2018-11-15 16:20:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 16:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 16:20:17 [DEBUG   ] spawn_process: at 2018-11-15 16:20:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 16:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 16:20:17 [DEBUG   ] spawn_process: at 2018-11-15 16:20:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 16:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 16:20:17 [DEBUG   ] spawn_process: at 2018-11-15 16:20:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 16:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 16:20:17 [DEBUG   ] spawn_process: at 2018-11-15 16:20:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 16:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 16:20:17 [DEBUG   ] spawn_process: at 2018-11-15 16:20:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 16:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 16:20:17 [DEBUG   ] spawn_process: at 2018-11-15 16:20:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 16:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 16:20:17 [DEBUG   ] spawn_process: at 2018-11-15 16:20:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 16:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 16:20:17 [DEBUG   ] spawn_process: at 2018-11-15 16:20:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 16:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 16:20:17 [DEBUG   ] spawn_process: at 2018-11-15 16:20:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 16:20:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 16:20:17 [DEBUG   ] spawn_process: at 2018-11-15 16:20:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 16:20:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 16:20:39 [DEBUG   ] Got command BAM from MCS: ref #516139
2018-11-15 16:20:39 [INFO    ] Finished processing BAM request
2018-11-15 16:20:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:20:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516139   8 58437 58839034 A  ERROR'
2018-11-15 16:20:39 [DEBUG   ] Got command BAM from MCS: ref #516138
2018-11-15 16:20:39 [INFO    ] Finished processing BAM request
2018-11-15 16:20:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:20:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516138   8 58437 58839038 A  ERROR'
2018-11-15 16:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 16:20:39 [DEBUG   ] spawn_process: at 2018-11-15 16:20:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 16:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 16:20:39 [DEBUG   ] spawn_process: at 2018-11-15 16:20:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 16:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 16:20:39 [DEBUG   ] spawn_process: at 2018-11-15 16:20:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 16:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 16:20:39 [DEBUG   ] spawn_process: at 2018-11-15 16:20:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 16:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 16:20:39 [DEBUG   ] spawn_process: at 2018-11-15 16:20:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 16:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 16:20:39 [DEBUG   ] spawn_process: at 2018-11-15 16:20:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 16:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 16:20:39 [DEBUG   ] spawn_process: at 2018-11-15 16:20:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 16:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 16:20:39 [DEBUG   ] spawn_process: at 2018-11-15 16:20:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 16:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 16:20:39 [DEBUG   ] spawn_process: at 2018-11-15 16:20:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 16:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 16:20:39 [DEBUG   ] spawn_process: at 2018-11-15 16:20:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 16:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 16:20:39 [DEBUG   ] spawn_process: at 2018-11-15 16:20:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 16:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 16:20:39 [DEBUG   ] spawn_process: at 2018-11-15 16:20:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 16:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 16:20:39 [DEBUG   ] spawn_process: at 2018-11-15 16:20:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 16:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 16:20:39 [DEBUG   ] spawn_process: at 2018-11-15 16:20:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 16:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 16:20:39 [DEBUG   ] spawn_process: at 2018-11-15 16:20:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 16:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 16:20:39 [DEBUG   ] spawn_process: at 2018-11-15 16:20:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 16:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 16:20:39 [DEBUG   ] spawn_process: at 2018-11-15 16:20:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 16:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 16:20:39 [DEBUG   ] spawn_process: at 2018-11-15 16:20:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 16:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 16:20:39 [DEBUG   ] spawn_process: at 2018-11-15 16:20:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 16:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 16:20:39 [DEBUG   ] spawn_process: at 2018-11-15 16:20:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 16:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 16:20:39 [DEBUG   ] spawn_process: at 2018-11-15 16:20:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 16:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 16:20:39 [DEBUG   ] spawn_process: at 2018-11-15 16:20:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 16:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 16:20:39 [DEBUG   ] spawn_process: at 2018-11-15 16:20:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 16:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 16:20:39 [DEBUG   ] spawn_process: at 2018-11-15 16:20:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 16:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 16:20:39 [DEBUG   ] spawn_process: at 2018-11-15 16:20:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 16:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 16:20:39 [DEBUG   ] spawn_process: at 2018-11-15 16:20:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 16:20:45 [DEBUG   ] Got command RPT from MCS: ref #516140
2018-11-15 16:20:45 [DEBUG   ] summary = ERROR
2018-11-15 16:20:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516140  13 58437 58845133 A  ERRORERROR'
2018-11-15 16:20:45 [DEBUG   ] Got command RPT from MCS: ref #516141
2018-11-15 16:20:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 16:20:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516141  77 58437 58845134 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 16:20:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 16:20:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 16:20:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:20:59 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 16:20:59 [WARNING ] (13, 1, 'bot')
2018-11-15 16:20:59 [WARNING ] (13, 1, 'bot')
2018-11-15 16:20:59 [WARNING ] (13, 1, 'bot')
2018-11-15 16:20:59 [WARNING ] (13, 1, 'bot')
2018-11-15 16:20:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:20:59 [DEBUG   ] Finished updating board flags in 1.213 seconds
2018-11-15 16:21:01 [DEBUG   ] Got command BAM from MCS: ref #516158
2018-11-15 16:21:01 [INFO    ] Finished processing BAM request
2018-11-15 16:21:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:21:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516158   8 58437 58861026 A  ERROR'
2018-11-15 16:21:01 [DEBUG   ] Got command BAM from MCS: ref #516157
2018-11-15 16:21:01 [INFO    ] Finished processing BAM request
2018-11-15 16:21:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:21:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516157   8 58437 58861030 A  ERROR'
2018-11-15 16:21:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 16:21:01 [DEBUG   ] spawn_process: at 2018-11-15 16:21:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 16:21:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 16:21:01 [DEBUG   ] spawn_process: at 2018-11-15 16:21:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 16:21:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 16:21:01 [DEBUG   ] spawn_process: at 2018-11-15 16:21:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 16:21:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 16:21:01 [DEBUG   ] spawn_process: at 2018-11-15 16:21:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 16:21:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 16:21:01 [DEBUG   ] spawn_process: at 2018-11-15 16:21:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 16:21:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 16:21:01 [DEBUG   ] spawn_process: at 2018-11-15 16:21:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 16:21:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 16:21:01 [DEBUG   ] spawn_process: at 2018-11-15 16:21:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 16:21:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 16:21:01 [DEBUG   ] spawn_process: at 2018-11-15 16:21:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 16:21:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 16:21:01 [DEBUG   ] spawn_process: at 2018-11-15 16:21:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 16:21:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 16:21:01 [DEBUG   ] spawn_process: at 2018-11-15 16:21:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 16:21:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 16:21:01 [DEBUG   ] spawn_process: at 2018-11-15 16:21:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 16:21:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 16:21:01 [DEBUG   ] spawn_process: at 2018-11-15 16:21:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 16:21:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 16:21:01 [DEBUG   ] spawn_process: at 2018-11-15 16:21:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 16:21:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 16:21:01 [DEBUG   ] spawn_process: at 2018-11-15 16:21:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 16:21:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 16:21:01 [DEBUG   ] spawn_process: at 2018-11-15 16:21:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 16:21:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 16:21:01 [DEBUG   ] spawn_process: at 2018-11-15 16:21:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 16:21:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 16:21:01 [DEBUG   ] spawn_process: at 2018-11-15 16:21:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 16:21:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 16:21:01 [DEBUG   ] spawn_process: at 2018-11-15 16:21:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 16:21:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 16:21:01 [DEBUG   ] spawn_process: at 2018-11-15 16:21:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 16:21:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 16:21:01 [DEBUG   ] spawn_process: at 2018-11-15 16:21:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 16:21:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 16:21:01 [DEBUG   ] spawn_process: at 2018-11-15 16:21:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 16:21:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 16:21:01 [DEBUG   ] spawn_process: at 2018-11-15 16:21:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 16:21:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 16:21:01 [DEBUG   ] spawn_process: at 2018-11-15 16:21:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 16:21:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 16:21:01 [DEBUG   ] spawn_process: at 2018-11-15 16:21:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 16:21:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 16:21:01 [DEBUG   ] spawn_process: at 2018-11-15 16:21:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 16:21:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 16:21:01 [DEBUG   ] spawn_process: at 2018-11-15 16:21:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 16:21:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 16:21:23 [DEBUG   ] Got command BAM from MCS: ref #516159
2018-11-15 16:21:23 [INFO    ] Finished processing BAM request
2018-11-15 16:21:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:21:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516159   8 58437 58883033 A  ERROR'
2018-11-15 16:21:23 [DEBUG   ] Got command BAM from MCS: ref #516160
2018-11-15 16:21:23 [INFO    ] Finished processing BAM request
2018-11-15 16:21:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:21:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516160   8 58437 58883037 A  ERROR'
2018-11-15 16:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 16:21:23 [DEBUG   ] spawn_process: at 2018-11-15 16:21:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 16:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 16:21:23 [DEBUG   ] spawn_process: at 2018-11-15 16:21:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 16:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 16:21:23 [DEBUG   ] spawn_process: at 2018-11-15 16:21:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 16:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 16:21:23 [DEBUG   ] spawn_process: at 2018-11-15 16:21:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 16:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 16:21:23 [DEBUG   ] spawn_process: at 2018-11-15 16:21:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 16:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 16:21:23 [DEBUG   ] spawn_process: at 2018-11-15 16:21:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 16:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 16:21:23 [DEBUG   ] spawn_process: at 2018-11-15 16:21:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 16:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 16:21:23 [DEBUG   ] spawn_process: at 2018-11-15 16:21:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 16:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 16:21:23 [DEBUG   ] spawn_process: at 2018-11-15 16:21:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 16:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 16:21:23 [DEBUG   ] spawn_process: at 2018-11-15 16:21:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 16:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 16:21:23 [DEBUG   ] spawn_process: at 2018-11-15 16:21:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 16:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 16:21:23 [DEBUG   ] spawn_process: at 2018-11-15 16:21:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 16:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 16:21:23 [DEBUG   ] spawn_process: at 2018-11-15 16:21:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 16:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 16:21:23 [DEBUG   ] spawn_process: at 2018-11-15 16:21:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 16:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 16:21:23 [DEBUG   ] spawn_process: at 2018-11-15 16:21:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 16:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 16:21:23 [DEBUG   ] spawn_process: at 2018-11-15 16:21:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 16:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 16:21:23 [DEBUG   ] spawn_process: at 2018-11-15 16:21:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 16:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 16:21:23 [DEBUG   ] spawn_process: at 2018-11-15 16:21:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 16:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 16:21:23 [DEBUG   ] spawn_process: at 2018-11-15 16:21:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 16:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 16:21:23 [DEBUG   ] spawn_process: at 2018-11-15 16:21:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 16:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 16:21:23 [DEBUG   ] spawn_process: at 2018-11-15 16:21:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 16:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 16:21:23 [DEBUG   ] spawn_process: at 2018-11-15 16:21:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 16:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 16:21:23 [DEBUG   ] spawn_process: at 2018-11-15 16:21:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 16:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 16:21:23 [DEBUG   ] spawn_process: at 2018-11-15 16:21:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 16:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 16:21:23 [DEBUG   ] spawn_process: at 2018-11-15 16:21:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 16:21:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 16:21:23 [DEBUG   ] spawn_process: at 2018-11-15 16:21:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 16:21:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 16:21:45 [DEBUG   ] Got command BAM from MCS: ref #516162
2018-11-15 16:21:45 [INFO    ] Finished processing BAM request
2018-11-15 16:21:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:21:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516162   8 58437 58905029 A  ERROR'
2018-11-15 16:21:45 [DEBUG   ] Got command BAM from MCS: ref #516161
2018-11-15 16:21:45 [INFO    ] Finished processing BAM request
2018-11-15 16:21:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:21:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516161   8 58437 58905033 A  ERROR'
2018-11-15 16:21:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 16:21:45 [DEBUG   ] spawn_process: at 2018-11-15 16:21:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 16:21:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 16:21:45 [DEBUG   ] spawn_process: at 2018-11-15 16:21:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 16:21:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 16:21:45 [DEBUG   ] spawn_process: at 2018-11-15 16:21:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 16:21:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 16:21:45 [DEBUG   ] spawn_process: at 2018-11-15 16:21:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 16:21:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 16:21:45 [DEBUG   ] spawn_process: at 2018-11-15 16:21:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 16:21:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 16:21:45 [DEBUG   ] spawn_process: at 2018-11-15 16:21:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 16:21:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 16:21:45 [DEBUG   ] spawn_process: at 2018-11-15 16:21:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 16:21:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 16:21:45 [DEBUG   ] spawn_process: at 2018-11-15 16:21:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 16:21:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 16:21:45 [DEBUG   ] spawn_process: at 2018-11-15 16:21:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 16:21:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 16:21:45 [DEBUG   ] spawn_process: at 2018-11-15 16:21:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 16:21:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 16:21:45 [DEBUG   ] spawn_process: at 2018-11-15 16:21:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 16:21:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 16:21:45 [DEBUG   ] spawn_process: at 2018-11-15 16:21:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 16:21:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 16:21:45 [DEBUG   ] spawn_process: at 2018-11-15 16:21:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 16:21:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 16:21:45 [DEBUG   ] spawn_process: at 2018-11-15 16:21:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 16:21:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 16:21:45 [DEBUG   ] spawn_process: at 2018-11-15 16:21:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 16:21:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 16:21:45 [DEBUG   ] spawn_process: at 2018-11-15 16:21:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 16:21:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 16:21:45 [DEBUG   ] spawn_process: at 2018-11-15 16:21:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 16:21:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 16:21:45 [DEBUG   ] spawn_process: at 2018-11-15 16:21:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 16:21:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 16:21:45 [DEBUG   ] spawn_process: at 2018-11-15 16:21:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 16:21:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 16:21:45 [DEBUG   ] spawn_process: at 2018-11-15 16:21:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 16:21:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 16:21:45 [DEBUG   ] spawn_process: at 2018-11-15 16:21:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 16:21:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 16:21:45 [DEBUG   ] spawn_process: at 2018-11-15 16:21:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 16:21:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 16:21:45 [DEBUG   ] spawn_process: at 2018-11-15 16:21:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 16:21:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 16:21:45 [DEBUG   ] spawn_process: at 2018-11-15 16:21:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 16:21:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 16:21:45 [DEBUG   ] spawn_process: at 2018-11-15 16:21:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 16:21:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 16:21:45 [DEBUG   ] spawn_process: at 2018-11-15 16:21:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 16:21:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 16:21:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 16:21:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 16:21:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:21:59 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 16:21:59 [WARNING ] (13, 1, 'bot')
2018-11-15 16:21:59 [WARNING ] (13, 1, 'bot')
2018-11-15 16:21:59 [WARNING ] (13, 1, 'bot')
2018-11-15 16:21:59 [WARNING ] (13, 1, 'bot')
2018-11-15 16:21:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:21:59 [DEBUG   ] Finished updating board flags in 1.180 seconds
2018-11-15 16:22:07 [DEBUG   ] Got command BAM from MCS: ref #516163
2018-11-15 16:22:07 [INFO    ] Finished processing BAM request
2018-11-15 16:22:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:22:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516163   8 58437 58927033 A  ERROR'
2018-11-15 16:22:07 [DEBUG   ] Got command BAM from MCS: ref #516164
2018-11-15 16:22:07 [INFO    ] Finished processing BAM request
2018-11-15 16:22:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:22:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516164   8 58437 58927037 A  ERROR'
2018-11-15 16:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 16:22:07 [DEBUG   ] spawn_process: at 2018-11-15 16:22:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 16:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 16:22:07 [DEBUG   ] spawn_process: at 2018-11-15 16:22:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 16:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 16:22:07 [DEBUG   ] spawn_process: at 2018-11-15 16:22:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 16:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 16:22:07 [DEBUG   ] spawn_process: at 2018-11-15 16:22:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 16:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 16:22:07 [DEBUG   ] spawn_process: at 2018-11-15 16:22:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 16:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 16:22:07 [DEBUG   ] spawn_process: at 2018-11-15 16:22:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 16:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 16:22:07 [DEBUG   ] spawn_process: at 2018-11-15 16:22:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 16:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 16:22:07 [DEBUG   ] spawn_process: at 2018-11-15 16:22:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 16:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 16:22:07 [DEBUG   ] spawn_process: at 2018-11-15 16:22:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 16:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 16:22:07 [DEBUG   ] spawn_process: at 2018-11-15 16:22:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 16:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 16:22:07 [DEBUG   ] spawn_process: at 2018-11-15 16:22:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 16:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 16:22:07 [DEBUG   ] spawn_process: at 2018-11-15 16:22:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 16:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 16:22:07 [DEBUG   ] spawn_process: at 2018-11-15 16:22:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 16:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 16:22:07 [DEBUG   ] spawn_process: at 2018-11-15 16:22:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 16:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 16:22:07 [DEBUG   ] spawn_process: at 2018-11-15 16:22:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 16:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 16:22:07 [DEBUG   ] spawn_process: at 2018-11-15 16:22:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 16:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 16:22:07 [DEBUG   ] spawn_process: at 2018-11-15 16:22:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 16:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 16:22:07 [DEBUG   ] spawn_process: at 2018-11-15 16:22:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 16:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 16:22:07 [DEBUG   ] spawn_process: at 2018-11-15 16:22:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 16:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 16:22:07 [DEBUG   ] spawn_process: at 2018-11-15 16:22:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 16:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 16:22:07 [DEBUG   ] spawn_process: at 2018-11-15 16:22:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 16:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 16:22:07 [DEBUG   ] spawn_process: at 2018-11-15 16:22:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 16:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 16:22:07 [DEBUG   ] spawn_process: at 2018-11-15 16:22:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 16:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 16:22:07 [DEBUG   ] spawn_process: at 2018-11-15 16:22:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 16:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 16:22:07 [DEBUG   ] spawn_process: at 2018-11-15 16:22:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 16:22:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 16:22:07 [DEBUG   ] spawn_process: at 2018-11-15 16:22:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 16:22:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 16:22:29 [DEBUG   ] Got command BAM from MCS: ref #516165
2018-11-15 16:22:29 [INFO    ] Finished processing BAM request
2018-11-15 16:22:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:22:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516165   8 58437 58949029 A  ERROR'
2018-11-15 16:22:29 [DEBUG   ] Got command BAM from MCS: ref #516166
2018-11-15 16:22:29 [INFO    ] Finished processing BAM request
2018-11-15 16:22:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:22:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516166   8 58437 58949033 A  ERROR'
2018-11-15 16:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 16:22:29 [DEBUG   ] spawn_process: at 2018-11-15 16:22:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 16:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 16:22:29 [DEBUG   ] spawn_process: at 2018-11-15 16:22:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 16:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 16:22:29 [DEBUG   ] spawn_process: at 2018-11-15 16:22:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 16:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 16:22:29 [DEBUG   ] spawn_process: at 2018-11-15 16:22:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 16:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 16:22:29 [DEBUG   ] spawn_process: at 2018-11-15 16:22:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 16:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 16:22:29 [DEBUG   ] spawn_process: at 2018-11-15 16:22:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 16:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 16:22:29 [DEBUG   ] spawn_process: at 2018-11-15 16:22:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 16:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 16:22:29 [DEBUG   ] spawn_process: at 2018-11-15 16:22:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 16:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 16:22:29 [DEBUG   ] spawn_process: at 2018-11-15 16:22:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 16:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 16:22:29 [DEBUG   ] spawn_process: at 2018-11-15 16:22:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 16:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 16:22:29 [DEBUG   ] spawn_process: at 2018-11-15 16:22:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 16:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 16:22:29 [DEBUG   ] spawn_process: at 2018-11-15 16:22:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 16:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 16:22:29 [DEBUG   ] spawn_process: at 2018-11-15 16:22:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 16:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 16:22:29 [DEBUG   ] spawn_process: at 2018-11-15 16:22:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 16:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 16:22:29 [DEBUG   ] spawn_process: at 2018-11-15 16:22:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 16:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 16:22:29 [DEBUG   ] spawn_process: at 2018-11-15 16:22:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 16:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 16:22:29 [DEBUG   ] spawn_process: at 2018-11-15 16:22:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 16:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 16:22:29 [DEBUG   ] spawn_process: at 2018-11-15 16:22:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 16:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 16:22:29 [DEBUG   ] spawn_process: at 2018-11-15 16:22:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 16:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 16:22:29 [DEBUG   ] spawn_process: at 2018-11-15 16:22:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 16:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 16:22:29 [DEBUG   ] spawn_process: at 2018-11-15 16:22:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 16:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 16:22:29 [DEBUG   ] spawn_process: at 2018-11-15 16:22:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 16:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 16:22:29 [DEBUG   ] spawn_process: at 2018-11-15 16:22:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 16:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 16:22:29 [DEBUG   ] spawn_process: at 2018-11-15 16:22:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 16:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 16:22:29 [DEBUG   ] spawn_process: at 2018-11-15 16:22:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 16:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 16:22:29 [DEBUG   ] spawn_process: at 2018-11-15 16:22:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 16:22:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 16:22:51 [DEBUG   ] Got command BAM from MCS: ref #516167
2018-11-15 16:22:51 [INFO    ] Finished processing BAM request
2018-11-15 16:22:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:22:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516167   8 58437 58971025 A  ERROR'
2018-11-15 16:22:51 [DEBUG   ] Got command BAM from MCS: ref #516168
2018-11-15 16:22:51 [INFO    ] Finished processing BAM request
2018-11-15 16:22:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:22:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516168   8 58437 58971029 A  ERROR'
2018-11-15 16:22:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 16:22:51 [DEBUG   ] spawn_process: at 2018-11-15 16:22:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 16:22:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 16:22:51 [DEBUG   ] spawn_process: at 2018-11-15 16:22:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 16:22:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 16:22:51 [DEBUG   ] spawn_process: at 2018-11-15 16:22:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 16:22:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 16:22:51 [DEBUG   ] spawn_process: at 2018-11-15 16:22:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 16:22:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 16:22:51 [DEBUG   ] spawn_process: at 2018-11-15 16:22:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 16:22:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 16:22:51 [DEBUG   ] spawn_process: at 2018-11-15 16:22:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 16:22:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 16:22:51 [DEBUG   ] spawn_process: at 2018-11-15 16:22:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 16:22:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 16:22:51 [DEBUG   ] spawn_process: at 2018-11-15 16:22:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 16:22:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 16:22:51 [DEBUG   ] spawn_process: at 2018-11-15 16:22:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 16:22:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 16:22:51 [DEBUG   ] spawn_process: at 2018-11-15 16:22:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 16:22:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 16:22:51 [DEBUG   ] spawn_process: at 2018-11-15 16:22:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 16:22:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 16:22:51 [DEBUG   ] spawn_process: at 2018-11-15 16:22:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 16:22:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 16:22:51 [DEBUG   ] spawn_process: at 2018-11-15 16:22:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 16:22:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 16:22:51 [DEBUG   ] spawn_process: at 2018-11-15 16:22:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 16:22:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 16:22:51 [DEBUG   ] spawn_process: at 2018-11-15 16:22:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 16:22:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 16:22:51 [DEBUG   ] spawn_process: at 2018-11-15 16:22:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 16:22:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 16:22:51 [DEBUG   ] spawn_process: at 2018-11-15 16:22:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 16:22:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 16:22:51 [DEBUG   ] spawn_process: at 2018-11-15 16:22:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 16:22:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 16:22:51 [DEBUG   ] spawn_process: at 2018-11-15 16:22:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 16:22:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 16:22:51 [DEBUG   ] spawn_process: at 2018-11-15 16:22:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 16:22:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 16:22:51 [DEBUG   ] spawn_process: at 2018-11-15 16:22:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 16:22:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 16:22:51 [DEBUG   ] spawn_process: at 2018-11-15 16:22:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 16:22:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 16:22:51 [DEBUG   ] spawn_process: at 2018-11-15 16:22:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 16:22:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 16:22:51 [DEBUG   ] spawn_process: at 2018-11-15 16:22:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 16:22:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 16:22:51 [DEBUG   ] spawn_process: at 2018-11-15 16:22:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 16:22:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 16:22:51 [DEBUG   ] spawn_process: at 2018-11-15 16:22:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 16:22:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 16:22:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:22:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-15 16:22:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 16:22:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 16:22:59 [WARNING ] (13, 1, 'bot')
2018-11-15 16:22:59 [WARNING ] (13, 1, 'bot')
2018-11-15 16:22:59 [WARNING ] (13, 1, 'bot')
2018-11-15 16:22:59 [WARNING ] (13, 1, 'bot')
2018-11-15 16:22:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:22:59 [DEBUG   ] Finished updating board flags in 1.020 seconds
2018-11-15 16:23:13 [DEBUG   ] Got command BAM from MCS: ref #516169
2018-11-15 16:23:13 [INFO    ] Finished processing BAM request
2018-11-15 16:23:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:23:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516169   8 58437 58993029 A  ERROR'
2018-11-15 16:23:13 [DEBUG   ] Got command BAM from MCS: ref #516170
2018-11-15 16:23:13 [INFO    ] Finished processing BAM request
2018-11-15 16:23:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:23:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516170   8 58437 58993033 A  ERROR'
2018-11-15 16:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 16:23:13 [DEBUG   ] spawn_process: at 2018-11-15 16:23:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 16:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 16:23:13 [DEBUG   ] spawn_process: at 2018-11-15 16:23:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 16:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 16:23:13 [DEBUG   ] spawn_process: at 2018-11-15 16:23:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 16:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 16:23:13 [DEBUG   ] spawn_process: at 2018-11-15 16:23:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 16:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 16:23:13 [DEBUG   ] spawn_process: at 2018-11-15 16:23:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 16:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 16:23:13 [DEBUG   ] spawn_process: at 2018-11-15 16:23:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 16:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 16:23:13 [DEBUG   ] spawn_process: at 2018-11-15 16:23:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 16:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 16:23:13 [DEBUG   ] spawn_process: at 2018-11-15 16:23:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 16:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 16:23:13 [DEBUG   ] spawn_process: at 2018-11-15 16:23:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 16:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 16:23:13 [DEBUG   ] spawn_process: at 2018-11-15 16:23:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 16:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 16:23:13 [DEBUG   ] spawn_process: at 2018-11-15 16:23:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 16:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 16:23:13 [DEBUG   ] spawn_process: at 2018-11-15 16:23:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 16:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 16:23:13 [DEBUG   ] spawn_process: at 2018-11-15 16:23:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 16:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 16:23:13 [DEBUG   ] spawn_process: at 2018-11-15 16:23:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 16:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 16:23:13 [DEBUG   ] spawn_process: at 2018-11-15 16:23:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 16:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 16:23:13 [DEBUG   ] spawn_process: at 2018-11-15 16:23:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 16:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 16:23:13 [DEBUG   ] spawn_process: at 2018-11-15 16:23:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 16:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 16:23:13 [DEBUG   ] spawn_process: at 2018-11-15 16:23:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 16:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 16:23:13 [DEBUG   ] spawn_process: at 2018-11-15 16:23:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 16:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 16:23:13 [DEBUG   ] spawn_process: at 2018-11-15 16:23:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 16:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 16:23:13 [DEBUG   ] spawn_process: at 2018-11-15 16:23:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 16:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 16:23:13 [DEBUG   ] spawn_process: at 2018-11-15 16:23:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 16:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 16:23:13 [DEBUG   ] spawn_process: at 2018-11-15 16:23:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 16:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 16:23:13 [DEBUG   ] spawn_process: at 2018-11-15 16:23:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 16:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 16:23:13 [DEBUG   ] spawn_process: at 2018-11-15 16:23:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 16:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 16:23:13 [DEBUG   ] spawn_process: at 2018-11-15 16:23:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 16:23:16 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 16:23:19 [DEBUG   ] Got command RPT from MCS: ref #516171
2018-11-15 16:23:19 [DEBUG   ] summary = ERROR
2018-11-15 16:23:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516171  13 58437 58999409 A  ERRORERROR'
2018-11-15 16:23:19 [DEBUG   ] Got command RPT from MCS: ref #516172
2018-11-15 16:23:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 16:23:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516172  77 58437 58999613 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 16:23:19 [DEBUG   ] Got command RPT from MCS: ref #516173
2018-11-15 16:23:19 [DEBUG   ] summary = ERROR
2018-11-15 16:23:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516173  13 58437 58999817 A  ERRORERROR'
2018-11-15 16:23:20 [DEBUG   ] Got command RPT from MCS: ref #516174
2018-11-15 16:23:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 16:23:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516174  77 58437 59000021 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 16:23:20 [DEBUG   ] Got command RPT from MCS: ref #516175
2018-11-15 16:23:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 16:23:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516175  12 58437 59000213 A  ERRORB¢ff'
2018-11-15 16:23:35 [DEBUG   ] Got command BAM from MCS: ref #516180
2018-11-15 16:23:35 [INFO    ] Finished processing BAM request
2018-11-15 16:23:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:23:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516180   8 58437 59015025 A  ERROR'
2018-11-15 16:23:35 [DEBUG   ] Got command BAM from MCS: ref #516181
2018-11-15 16:23:35 [INFO    ] Finished processing BAM request
2018-11-15 16:23:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:23:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516181   8 58437 59015029 A  ERROR'
2018-11-15 16:23:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 16:23:35 [DEBUG   ] spawn_process: at 2018-11-15 16:23:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 16:23:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 16:23:35 [DEBUG   ] spawn_process: at 2018-11-15 16:23:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 16:23:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 16:23:35 [DEBUG   ] spawn_process: at 2018-11-15 16:23:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 16:23:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 16:23:35 [DEBUG   ] spawn_process: at 2018-11-15 16:23:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 16:23:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 16:23:35 [DEBUG   ] spawn_process: at 2018-11-15 16:23:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 16:23:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 16:23:35 [DEBUG   ] spawn_process: at 2018-11-15 16:23:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 16:23:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 16:23:35 [DEBUG   ] spawn_process: at 2018-11-15 16:23:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 16:23:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 16:23:35 [DEBUG   ] spawn_process: at 2018-11-15 16:23:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 16:23:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 16:23:35 [DEBUG   ] spawn_process: at 2018-11-15 16:23:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 16:23:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 16:23:35 [DEBUG   ] spawn_process: at 2018-11-15 16:23:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 16:23:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 16:23:35 [DEBUG   ] spawn_process: at 2018-11-15 16:23:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 16:23:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 16:23:35 [DEBUG   ] spawn_process: at 2018-11-15 16:23:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 16:23:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 16:23:35 [DEBUG   ] spawn_process: at 2018-11-15 16:23:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 16:23:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 16:23:35 [DEBUG   ] spawn_process: at 2018-11-15 16:23:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 16:23:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 16:23:35 [DEBUG   ] spawn_process: at 2018-11-15 16:23:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 16:23:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 16:23:35 [DEBUG   ] spawn_process: at 2018-11-15 16:23:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 16:23:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 16:23:35 [DEBUG   ] spawn_process: at 2018-11-15 16:23:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 16:23:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 16:23:35 [DEBUG   ] spawn_process: at 2018-11-15 16:23:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 16:23:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 16:23:35 [DEBUG   ] spawn_process: at 2018-11-15 16:23:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 16:23:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 16:23:35 [DEBUG   ] spawn_process: at 2018-11-15 16:23:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 16:23:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 16:23:35 [DEBUG   ] spawn_process: at 2018-11-15 16:23:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 16:23:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 16:23:35 [DEBUG   ] spawn_process: at 2018-11-15 16:23:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 16:23:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 16:23:35 [DEBUG   ] spawn_process: at 2018-11-15 16:23:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 16:23:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 16:23:35 [DEBUG   ] spawn_process: at 2018-11-15 16:23:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 16:23:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 16:23:35 [DEBUG   ] spawn_process: at 2018-11-15 16:23:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 16:23:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 16:23:35 [DEBUG   ] spawn_process: at 2018-11-15 16:23:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 16:23:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 16:23:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 16:23:57 [DEBUG   ] Got command BAM from MCS: ref #516182
2018-11-15 16:23:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:23:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516182   8 58437 59037033 A  ERROR'
2018-11-15 16:23:57 [DEBUG   ] Got command BAM from MCS: ref #516183
2018-11-15 16:23:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:23:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516183   8 58437 59037037 A  ERROR'
2018-11-15 16:23:57 [INFO    ] Finished processing BAM request
2018-11-15 16:23:57 [INFO    ] Finished processing BAM request
2018-11-15 16:23:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 16:23:57 [DEBUG   ] spawn_process: at 2018-11-15 16:23:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 16:23:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 16:23:57 [DEBUG   ] spawn_process: at 2018-11-15 16:23:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 16:23:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 16:23:57 [DEBUG   ] spawn_process: at 2018-11-15 16:23:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 16:23:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 16:23:57 [DEBUG   ] spawn_process: at 2018-11-15 16:23:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 16:23:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 16:23:57 [DEBUG   ] spawn_process: at 2018-11-15 16:23:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 16:23:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 16:23:57 [DEBUG   ] spawn_process: at 2018-11-15 16:23:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 16:23:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 16:23:57 [DEBUG   ] spawn_process: at 2018-11-15 16:23:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 16:23:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 16:23:57 [DEBUG   ] spawn_process: at 2018-11-15 16:23:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 16:23:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 16:23:57 [DEBUG   ] spawn_process: at 2018-11-15 16:23:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 16:23:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 16:23:57 [DEBUG   ] spawn_process: at 2018-11-15 16:23:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 16:23:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 16:23:57 [DEBUG   ] spawn_process: at 2018-11-15 16:23:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 16:23:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 16:23:57 [DEBUG   ] spawn_process: at 2018-11-15 16:23:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 16:23:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 16:23:57 [DEBUG   ] spawn_process: at 2018-11-15 16:23:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 16:23:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 16:23:57 [DEBUG   ] spawn_process: at 2018-11-15 16:23:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 16:23:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 16:23:57 [DEBUG   ] spawn_process: at 2018-11-15 16:23:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 16:23:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 16:23:57 [DEBUG   ] spawn_process: at 2018-11-15 16:23:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 16:23:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 16:23:57 [DEBUG   ] spawn_process: at 2018-11-15 16:23:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 16:23:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 16:23:57 [DEBUG   ] spawn_process: at 2018-11-15 16:23:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 16:23:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 16:23:57 [DEBUG   ] spawn_process: at 2018-11-15 16:23:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 16:23:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 16:23:57 [DEBUG   ] spawn_process: at 2018-11-15 16:23:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 16:23:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 16:23:57 [DEBUG   ] spawn_process: at 2018-11-15 16:23:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 16:23:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 16:23:57 [DEBUG   ] spawn_process: at 2018-11-15 16:23:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 16:23:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 16:23:57 [DEBUG   ] spawn_process: at 2018-11-15 16:23:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 16:23:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 16:23:57 [DEBUG   ] spawn_process: at 2018-11-15 16:23:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 16:23:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 16:23:57 [DEBUG   ] spawn_process: at 2018-11-15 16:23:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 16:23:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 16:23:57 [DEBUG   ] spawn_process: at 2018-11-15 16:23:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 16:23:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 16:23:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:23:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 16:23:59 [WARNING ] (13, 1, 'bot')
2018-11-15 16:23:59 [WARNING ] (13, 1, 'bot')
2018-11-15 16:23:59 [WARNING ] (13, 1, 'bot')
2018-11-15 16:23:59 [WARNING ] (13, 1, 'bot')
2018-11-15 16:23:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:23:59 [DEBUG   ] Finished updating board flags in 0.977 seconds
2018-11-15 16:24:16 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-15 16:24:18 [DEBUG   ] Got command BAM from MCS: ref #516185
2018-11-15 16:24:18 [INFO    ] Finished processing BAM request
2018-11-15 16:24:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:24:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516185   8 58437 59058029 A  ERROR'
2018-11-15 16:24:18 [DEBUG   ] Got command BAM from MCS: ref #516184
2018-11-15 16:24:18 [INFO    ] Finished processing BAM request
2018-11-15 16:24:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:24:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516184   8 58437 59058033 A  ERROR'
2018-11-15 16:24:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 16:24:18 [DEBUG   ] spawn_process: at 2018-11-15 16:24:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 16:24:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 16:24:18 [DEBUG   ] spawn_process: at 2018-11-15 16:24:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 16:24:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 16:24:18 [DEBUG   ] spawn_process: at 2018-11-15 16:24:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 16:24:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 16:24:18 [DEBUG   ] spawn_process: at 2018-11-15 16:24:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 16:24:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 16:24:18 [DEBUG   ] spawn_process: at 2018-11-15 16:24:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 16:24:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 16:24:18 [DEBUG   ] spawn_process: at 2018-11-15 16:24:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 16:24:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 16:24:18 [DEBUG   ] spawn_process: at 2018-11-15 16:24:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 16:24:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 16:24:18 [DEBUG   ] spawn_process: at 2018-11-15 16:24:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 16:24:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 16:24:18 [DEBUG   ] spawn_process: at 2018-11-15 16:24:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 16:24:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 16:24:18 [DEBUG   ] spawn_process: at 2018-11-15 16:24:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 16:24:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 16:24:18 [DEBUG   ] spawn_process: at 2018-11-15 16:24:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 16:24:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 16:24:18 [DEBUG   ] spawn_process: at 2018-11-15 16:24:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 16:24:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 16:24:18 [DEBUG   ] spawn_process: at 2018-11-15 16:24:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 16:24:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 16:24:18 [DEBUG   ] spawn_process: at 2018-11-15 16:24:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 16:24:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 16:24:18 [DEBUG   ] spawn_process: at 2018-11-15 16:24:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 16:24:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 16:24:18 [DEBUG   ] spawn_process: at 2018-11-15 16:24:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 16:24:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 16:24:18 [DEBUG   ] spawn_process: at 2018-11-15 16:24:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 16:24:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 16:24:18 [DEBUG   ] spawn_process: at 2018-11-15 16:24:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 16:24:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 16:24:18 [DEBUG   ] spawn_process: at 2018-11-15 16:24:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 16:24:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 16:24:18 [DEBUG   ] spawn_process: at 2018-11-15 16:24:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 16:24:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 16:24:18 [DEBUG   ] spawn_process: at 2018-11-15 16:24:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 16:24:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 16:24:18 [DEBUG   ] spawn_process: at 2018-11-15 16:24:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 16:24:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 16:24:18 [DEBUG   ] spawn_process: at 2018-11-15 16:24:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 16:24:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 16:24:18 [DEBUG   ] spawn_process: at 2018-11-15 16:24:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 16:24:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 16:24:18 [DEBUG   ] spawn_process: at 2018-11-15 16:24:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 16:24:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 16:24:18 [DEBUG   ] spawn_process: at 2018-11-15 16:24:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 16:24:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 16:24:39 [DEBUG   ] Got command BAM from MCS: ref #516186
2018-11-15 16:24:39 [INFO    ] Finished processing BAM request
2018-11-15 16:24:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:24:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516186   8 58437 59079033 A  ERROR'
2018-11-15 16:24:39 [DEBUG   ] Got command BAM from MCS: ref #516187
2018-11-15 16:24:39 [INFO    ] Finished processing BAM request
2018-11-15 16:24:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:24:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516187   8 58437 59079037 A  ERROR'
2018-11-15 16:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 16:24:39 [DEBUG   ] spawn_process: at 2018-11-15 16:24:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 16:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 16:24:39 [DEBUG   ] spawn_process: at 2018-11-15 16:24:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 16:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 16:24:39 [DEBUG   ] spawn_process: at 2018-11-15 16:24:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 16:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 16:24:39 [DEBUG   ] spawn_process: at 2018-11-15 16:24:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 16:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 16:24:39 [DEBUG   ] spawn_process: at 2018-11-15 16:24:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 16:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 16:24:39 [DEBUG   ] spawn_process: at 2018-11-15 16:24:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 16:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 16:24:39 [DEBUG   ] spawn_process: at 2018-11-15 16:24:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 16:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 16:24:39 [DEBUG   ] spawn_process: at 2018-11-15 16:24:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 16:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 16:24:39 [DEBUG   ] spawn_process: at 2018-11-15 16:24:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 16:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 16:24:39 [DEBUG   ] spawn_process: at 2018-11-15 16:24:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 16:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 16:24:39 [DEBUG   ] spawn_process: at 2018-11-15 16:24:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 16:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 16:24:39 [DEBUG   ] spawn_process: at 2018-11-15 16:24:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 16:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 16:24:39 [DEBUG   ] spawn_process: at 2018-11-15 16:24:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 16:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 16:24:39 [DEBUG   ] spawn_process: at 2018-11-15 16:24:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 16:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 16:24:39 [DEBUG   ] spawn_process: at 2018-11-15 16:24:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 16:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 16:24:39 [DEBUG   ] spawn_process: at 2018-11-15 16:24:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 16:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 16:24:39 [DEBUG   ] spawn_process: at 2018-11-15 16:24:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 16:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 16:24:39 [DEBUG   ] spawn_process: at 2018-11-15 16:24:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 16:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 16:24:39 [DEBUG   ] spawn_process: at 2018-11-15 16:24:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 16:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 16:24:39 [DEBUG   ] spawn_process: at 2018-11-15 16:24:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 16:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 16:24:39 [DEBUG   ] spawn_process: at 2018-11-15 16:24:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 16:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 16:24:39 [DEBUG   ] spawn_process: at 2018-11-15 16:24:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 16:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 16:24:39 [DEBUG   ] spawn_process: at 2018-11-15 16:24:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 16:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 16:24:39 [DEBUG   ] spawn_process: at 2018-11-15 16:24:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 16:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 16:24:39 [DEBUG   ] spawn_process: at 2018-11-15 16:24:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 16:24:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 16:24:39 [DEBUG   ] spawn_process: at 2018-11-15 16:24:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 16:24:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 16:24:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 16:24:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:24:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-15 16:25:00 [DEBUG   ] Got command BAM from MCS: ref #516189
2018-11-15 16:25:00 [INFO    ] Finished processing BAM request
2018-11-15 16:25:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:25:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516189   8 58437 59100025 A  ERROR'
2018-11-15 16:25:00 [DEBUG   ] Got command BAM from MCS: ref #516188
2018-11-15 16:25:00 [INFO    ] Finished processing BAM request
2018-11-15 16:25:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:25:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516188   8 58437 59100029 A  ERROR'
2018-11-15 16:25:00 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-15 16:25:00 [WARNING ] (13, 1, 'bot')
2018-11-15 16:25:00 [WARNING ] (13, 1, 'bot')
2018-11-15 16:25:00 [WARNING ] (13, 1, 'bot')
2018-11-15 16:25:00 [WARNING ] (13, 1, 'bot')
2018-11-15 16:25:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:25:00 [DEBUG   ] Finished updating board flags in 1.369 seconds
2018-11-15 16:25:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 16:25:00 [DEBUG   ] spawn_process: at 2018-11-15 16:25:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 16:25:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 16:25:00 [DEBUG   ] spawn_process: at 2018-11-15 16:25:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 16:25:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 16:25:00 [DEBUG   ] spawn_process: at 2018-11-15 16:25:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 16:25:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 16:25:00 [DEBUG   ] spawn_process: at 2018-11-15 16:25:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 16:25:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 16:25:00 [DEBUG   ] spawn_process: at 2018-11-15 16:25:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 16:25:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 16:25:00 [DEBUG   ] spawn_process: at 2018-11-15 16:25:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 16:25:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 16:25:00 [DEBUG   ] spawn_process: at 2018-11-15 16:25:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 16:25:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 16:25:00 [DEBUG   ] spawn_process: at 2018-11-15 16:25:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 16:25:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 16:25:00 [DEBUG   ] spawn_process: at 2018-11-15 16:25:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 16:25:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 16:25:00 [DEBUG   ] spawn_process: at 2018-11-15 16:25:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 16:25:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 16:25:00 [DEBUG   ] spawn_process: at 2018-11-15 16:25:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 16:25:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 16:25:00 [DEBUG   ] spawn_process: at 2018-11-15 16:25:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 16:25:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 16:25:00 [DEBUG   ] spawn_process: at 2018-11-15 16:25:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 16:25:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 16:25:00 [DEBUG   ] spawn_process: at 2018-11-15 16:25:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 16:25:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 16:25:00 [DEBUG   ] spawn_process: at 2018-11-15 16:25:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 16:25:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 16:25:00 [DEBUG   ] spawn_process: at 2018-11-15 16:25:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 16:25:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 16:25:00 [DEBUG   ] spawn_process: at 2018-11-15 16:25:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 16:25:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 16:25:00 [DEBUG   ] spawn_process: at 2018-11-15 16:25:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 16:25:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 16:25:00 [DEBUG   ] spawn_process: at 2018-11-15 16:25:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 16:25:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 16:25:00 [DEBUG   ] spawn_process: at 2018-11-15 16:25:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 16:25:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 16:25:00 [DEBUG   ] spawn_process: at 2018-11-15 16:25:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 16:25:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 16:25:00 [DEBUG   ] spawn_process: at 2018-11-15 16:25:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 16:25:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 16:25:00 [DEBUG   ] spawn_process: at 2018-11-15 16:25:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 16:25:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 16:25:00 [DEBUG   ] spawn_process: at 2018-11-15 16:25:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 16:25:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 16:25:00 [DEBUG   ] spawn_process: at 2018-11-15 16:25:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 16:25:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 16:25:00 [DEBUG   ] spawn_process: at 2018-11-15 16:25:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 16:25:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 16:25:21 [DEBUG   ] Got command BAM from MCS: ref #516191
2018-11-15 16:25:21 [INFO    ] Finished processing BAM request
2018-11-15 16:25:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:25:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516191   8 58437 59121025 A  ERROR'
2018-11-15 16:25:21 [DEBUG   ] Got command BAM from MCS: ref #516190
2018-11-15 16:25:21 [INFO    ] Finished processing BAM request
2018-11-15 16:25:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:25:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516190   8 58437 59121029 A  ERROR'
2018-11-15 16:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 16:25:21 [DEBUG   ] spawn_process: at 2018-11-15 16:25:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 16:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 16:25:21 [DEBUG   ] spawn_process: at 2018-11-15 16:25:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 16:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 16:25:21 [DEBUG   ] spawn_process: at 2018-11-15 16:25:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 16:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 16:25:21 [DEBUG   ] spawn_process: at 2018-11-15 16:25:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 16:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 16:25:21 [DEBUG   ] spawn_process: at 2018-11-15 16:25:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 16:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 16:25:21 [DEBUG   ] spawn_process: at 2018-11-15 16:25:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 16:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 16:25:21 [DEBUG   ] spawn_process: at 2018-11-15 16:25:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 16:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 16:25:21 [DEBUG   ] spawn_process: at 2018-11-15 16:25:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 16:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 16:25:21 [DEBUG   ] spawn_process: at 2018-11-15 16:25:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 16:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 16:25:21 [DEBUG   ] spawn_process: at 2018-11-15 16:25:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 16:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 16:25:21 [DEBUG   ] spawn_process: at 2018-11-15 16:25:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 16:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 16:25:21 [DEBUG   ] spawn_process: at 2018-11-15 16:25:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 16:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 16:25:21 [DEBUG   ] spawn_process: at 2018-11-15 16:25:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 16:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 16:25:21 [DEBUG   ] spawn_process: at 2018-11-15 16:25:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 16:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 16:25:21 [DEBUG   ] spawn_process: at 2018-11-15 16:25:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 16:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 16:25:21 [DEBUG   ] spawn_process: at 2018-11-15 16:25:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 16:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 16:25:21 [DEBUG   ] spawn_process: at 2018-11-15 16:25:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 16:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 16:25:21 [DEBUG   ] spawn_process: at 2018-11-15 16:25:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 16:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 16:25:21 [DEBUG   ] spawn_process: at 2018-11-15 16:25:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 16:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 16:25:21 [DEBUG   ] spawn_process: at 2018-11-15 16:25:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 16:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 16:25:21 [DEBUG   ] spawn_process: at 2018-11-15 16:25:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 16:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 16:25:21 [DEBUG   ] spawn_process: at 2018-11-15 16:25:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 16:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 16:25:21 [DEBUG   ] spawn_process: at 2018-11-15 16:25:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 16:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 16:25:21 [DEBUG   ] spawn_process: at 2018-11-15 16:25:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 16:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 16:25:21 [DEBUG   ] spawn_process: at 2018-11-15 16:25:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 16:25:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 16:25:21 [DEBUG   ] spawn_process: at 2018-11-15 16:25:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 16:25:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 16:25:42 [DEBUG   ] Got command BAM from MCS: ref #516192
2018-11-15 16:25:42 [INFO    ] Finished processing BAM request
2018-11-15 16:25:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:25:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516192   8 58437 59142029 A  ERROR'
2018-11-15 16:25:42 [DEBUG   ] Got command BAM from MCS: ref #516193
2018-11-15 16:25:42 [INFO    ] Finished processing BAM request
2018-11-15 16:25:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:25:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516193   8 58437 59142033 A  ERROR'
2018-11-15 16:25:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 16:25:42 [DEBUG   ] spawn_process: at 2018-11-15 16:25:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 16:25:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 16:25:42 [DEBUG   ] spawn_process: at 2018-11-15 16:25:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 16:25:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 16:25:42 [DEBUG   ] spawn_process: at 2018-11-15 16:25:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 16:25:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 16:25:42 [DEBUG   ] spawn_process: at 2018-11-15 16:25:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 16:25:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 16:25:42 [DEBUG   ] spawn_process: at 2018-11-15 16:25:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 16:25:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 16:25:42 [DEBUG   ] spawn_process: at 2018-11-15 16:25:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 16:25:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 16:25:42 [DEBUG   ] spawn_process: at 2018-11-15 16:25:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 16:25:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 16:25:42 [DEBUG   ] spawn_process: at 2018-11-15 16:25:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 16:25:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 16:25:42 [DEBUG   ] spawn_process: at 2018-11-15 16:25:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 16:25:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 16:25:42 [DEBUG   ] spawn_process: at 2018-11-15 16:25:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 16:25:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 16:25:42 [DEBUG   ] spawn_process: at 2018-11-15 16:25:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 16:25:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 16:25:42 [DEBUG   ] spawn_process: at 2018-11-15 16:25:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 16:25:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 16:25:42 [DEBUG   ] spawn_process: at 2018-11-15 16:25:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 16:25:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 16:25:42 [DEBUG   ] spawn_process: at 2018-11-15 16:25:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 16:25:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 16:25:42 [DEBUG   ] spawn_process: at 2018-11-15 16:25:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 16:25:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 16:25:42 [DEBUG   ] spawn_process: at 2018-11-15 16:25:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 16:25:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 16:25:42 [DEBUG   ] spawn_process: at 2018-11-15 16:25:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 16:25:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 16:25:42 [DEBUG   ] spawn_process: at 2018-11-15 16:25:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 16:25:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 16:25:42 [DEBUG   ] spawn_process: at 2018-11-15 16:25:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 16:25:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 16:25:42 [DEBUG   ] spawn_process: at 2018-11-15 16:25:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 16:25:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 16:25:42 [DEBUG   ] spawn_process: at 2018-11-15 16:25:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 16:25:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 16:25:42 [DEBUG   ] spawn_process: at 2018-11-15 16:25:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 16:25:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 16:25:42 [DEBUG   ] spawn_process: at 2018-11-15 16:25:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 16:25:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 16:25:42 [DEBUG   ] spawn_process: at 2018-11-15 16:25:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 16:25:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 16:25:42 [DEBUG   ] spawn_process: at 2018-11-15 16:25:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 16:25:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 16:25:42 [DEBUG   ] spawn_process: at 2018-11-15 16:25:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 16:25:45 [DEBUG   ] Got command RPT from MCS: ref #516194
2018-11-15 16:25:45 [DEBUG   ] summary = ERROR
2018-11-15 16:25:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516194  13 58437 59145129 A  ERRORERROR'
2018-11-15 16:25:45 [DEBUG   ] Got command RPT from MCS: ref #516195
2018-11-15 16:25:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 16:25:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516195  77 58437 59145130 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 16:25:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 16:25:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 16:25:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:26:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 16:26:00 [WARNING ] (13, 1, 'bot')
2018-11-15 16:26:00 [WARNING ] (13, 1, 'bot')
2018-11-15 16:26:00 [WARNING ] (13, 1, 'bot')
2018-11-15 16:26:00 [WARNING ] (13, 1, 'bot')
2018-11-15 16:26:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:26:00 [DEBUG   ] Finished updating board flags in 1.276 seconds
2018-11-15 16:26:03 [DEBUG   ] Got command BAM from MCS: ref #516212
2018-11-15 16:26:03 [INFO    ] Finished processing BAM request
2018-11-15 16:26:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:26:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516212   8 58437 59163025 A  ERROR'
2018-11-15 16:26:03 [DEBUG   ] Got command BAM from MCS: ref #516211
2018-11-15 16:26:03 [INFO    ] Finished processing BAM request
2018-11-15 16:26:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:26:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516211   8 58437 59163029 A  ERROR'
2018-11-15 16:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 16:26:03 [DEBUG   ] spawn_process: at 2018-11-15 16:26:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 16:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 16:26:03 [DEBUG   ] spawn_process: at 2018-11-15 16:26:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 16:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 16:26:03 [DEBUG   ] spawn_process: at 2018-11-15 16:26:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 16:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 16:26:03 [DEBUG   ] spawn_process: at 2018-11-15 16:26:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 16:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 16:26:03 [DEBUG   ] spawn_process: at 2018-11-15 16:26:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 16:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 16:26:03 [DEBUG   ] spawn_process: at 2018-11-15 16:26:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 16:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 16:26:03 [DEBUG   ] spawn_process: at 2018-11-15 16:26:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 16:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 16:26:03 [DEBUG   ] spawn_process: at 2018-11-15 16:26:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 16:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 16:26:03 [DEBUG   ] spawn_process: at 2018-11-15 16:26:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 16:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 16:26:03 [DEBUG   ] spawn_process: at 2018-11-15 16:26:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 16:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 16:26:03 [DEBUG   ] spawn_process: at 2018-11-15 16:26:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 16:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 16:26:03 [DEBUG   ] spawn_process: at 2018-11-15 16:26:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 16:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 16:26:03 [DEBUG   ] spawn_process: at 2018-11-15 16:26:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 16:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 16:26:03 [DEBUG   ] spawn_process: at 2018-11-15 16:26:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 16:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 16:26:03 [DEBUG   ] spawn_process: at 2018-11-15 16:26:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 16:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 16:26:03 [DEBUG   ] spawn_process: at 2018-11-15 16:26:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 16:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 16:26:03 [DEBUG   ] spawn_process: at 2018-11-15 16:26:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 16:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 16:26:03 [DEBUG   ] spawn_process: at 2018-11-15 16:26:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 16:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 16:26:03 [DEBUG   ] spawn_process: at 2018-11-15 16:26:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 16:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 16:26:03 [DEBUG   ] spawn_process: at 2018-11-15 16:26:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 16:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 16:26:03 [DEBUG   ] spawn_process: at 2018-11-15 16:26:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 16:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 16:26:03 [DEBUG   ] spawn_process: at 2018-11-15 16:26:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 16:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 16:26:03 [DEBUG   ] spawn_process: at 2018-11-15 16:26:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 16:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 16:26:03 [DEBUG   ] spawn_process: at 2018-11-15 16:26:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 16:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 16:26:03 [DEBUG   ] spawn_process: at 2018-11-15 16:26:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 16:26:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 16:26:03 [DEBUG   ] spawn_process: at 2018-11-15 16:26:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 16:26:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 16:26:24 [DEBUG   ] Got command BAM from MCS: ref #516213
2018-11-15 16:26:24 [INFO    ] Finished processing BAM request
2018-11-15 16:26:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:26:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516213   8 58437 59184033 A  ERROR'
2018-11-15 16:26:24 [DEBUG   ] Got command BAM from MCS: ref #516214
2018-11-15 16:26:24 [INFO    ] Finished processing BAM request
2018-11-15 16:26:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:26:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516214   8 58437 59184037 A  ERROR'
2018-11-15 16:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 16:26:24 [DEBUG   ] spawn_process: at 2018-11-15 16:26:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 16:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 16:26:24 [DEBUG   ] spawn_process: at 2018-11-15 16:26:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 16:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 16:26:24 [DEBUG   ] spawn_process: at 2018-11-15 16:26:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 16:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 16:26:24 [DEBUG   ] spawn_process: at 2018-11-15 16:26:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 16:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 16:26:24 [DEBUG   ] spawn_process: at 2018-11-15 16:26:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 16:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 16:26:24 [DEBUG   ] spawn_process: at 2018-11-15 16:26:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 16:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 16:26:24 [DEBUG   ] spawn_process: at 2018-11-15 16:26:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 16:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 16:26:24 [DEBUG   ] spawn_process: at 2018-11-15 16:26:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 16:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 16:26:24 [DEBUG   ] spawn_process: at 2018-11-15 16:26:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 16:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 16:26:24 [DEBUG   ] spawn_process: at 2018-11-15 16:26:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 16:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 16:26:24 [DEBUG   ] spawn_process: at 2018-11-15 16:26:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 16:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 16:26:24 [DEBUG   ] spawn_process: at 2018-11-15 16:26:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 16:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 16:26:24 [DEBUG   ] spawn_process: at 2018-11-15 16:26:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 16:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 16:26:24 [DEBUG   ] spawn_process: at 2018-11-15 16:26:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 16:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 16:26:24 [DEBUG   ] spawn_process: at 2018-11-15 16:26:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 16:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 16:26:24 [DEBUG   ] spawn_process: at 2018-11-15 16:26:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 16:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 16:26:24 [DEBUG   ] spawn_process: at 2018-11-15 16:26:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 16:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 16:26:24 [DEBUG   ] spawn_process: at 2018-11-15 16:26:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 16:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 16:26:24 [DEBUG   ] spawn_process: at 2018-11-15 16:26:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 16:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 16:26:24 [DEBUG   ] spawn_process: at 2018-11-15 16:26:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 16:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 16:26:24 [DEBUG   ] spawn_process: at 2018-11-15 16:26:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 16:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 16:26:24 [DEBUG   ] spawn_process: at 2018-11-15 16:26:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 16:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 16:26:24 [DEBUG   ] spawn_process: at 2018-11-15 16:26:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 16:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 16:26:24 [DEBUG   ] spawn_process: at 2018-11-15 16:26:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 16:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 16:26:24 [DEBUG   ] spawn_process: at 2018-11-15 16:26:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 16:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 16:26:24 [DEBUG   ] spawn_process: at 2018-11-15 16:26:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 16:26:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 16:26:45 [DEBUG   ] Got command BAM from MCS: ref #516219
2018-11-15 16:26:45 [INFO    ] Finished processing BAM request
2018-11-15 16:26:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:26:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516219   8 58437 59205029 A  ERROR'
2018-11-15 16:26:45 [DEBUG   ] Got command BAM from MCS: ref #516220
2018-11-15 16:26:45 [INFO    ] Finished processing BAM request
2018-11-15 16:26:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:26:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516220   8 58437 59205033 A  ERROR'
2018-11-15 16:26:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 16:26:45 [DEBUG   ] spawn_process: at 2018-11-15 16:26:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 16:26:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 16:26:45 [DEBUG   ] spawn_process: at 2018-11-15 16:26:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 16:26:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 16:26:45 [DEBUG   ] spawn_process: at 2018-11-15 16:26:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 16:26:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 16:26:45 [DEBUG   ] spawn_process: at 2018-11-15 16:26:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 16:26:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 16:26:45 [DEBUG   ] spawn_process: at 2018-11-15 16:26:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 16:26:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 16:26:45 [DEBUG   ] spawn_process: at 2018-11-15 16:26:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 16:26:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 16:26:45 [DEBUG   ] spawn_process: at 2018-11-15 16:26:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 16:26:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 16:26:45 [DEBUG   ] spawn_process: at 2018-11-15 16:26:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 16:26:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 16:26:45 [DEBUG   ] spawn_process: at 2018-11-15 16:26:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 16:26:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 16:26:45 [DEBUG   ] spawn_process: at 2018-11-15 16:26:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 16:26:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 16:26:45 [DEBUG   ] spawn_process: at 2018-11-15 16:26:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 16:26:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 16:26:45 [DEBUG   ] spawn_process: at 2018-11-15 16:26:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 16:26:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 16:26:45 [DEBUG   ] spawn_process: at 2018-11-15 16:26:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 16:26:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 16:26:45 [DEBUG   ] spawn_process: at 2018-11-15 16:26:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 16:26:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 16:26:45 [DEBUG   ] spawn_process: at 2018-11-15 16:26:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 16:26:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 16:26:45 [DEBUG   ] spawn_process: at 2018-11-15 16:26:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 16:26:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 16:26:45 [DEBUG   ] spawn_process: at 2018-11-15 16:26:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 16:26:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 16:26:45 [DEBUG   ] spawn_process: at 2018-11-15 16:26:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 16:26:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 16:26:45 [DEBUG   ] spawn_process: at 2018-11-15 16:26:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 16:26:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 16:26:45 [DEBUG   ] spawn_process: at 2018-11-15 16:26:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 16:26:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 16:26:45 [DEBUG   ] spawn_process: at 2018-11-15 16:26:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 16:26:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 16:26:45 [DEBUG   ] spawn_process: at 2018-11-15 16:26:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 16:26:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 16:26:45 [DEBUG   ] spawn_process: at 2018-11-15 16:26:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 16:26:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 16:26:45 [DEBUG   ] spawn_process: at 2018-11-15 16:26:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 16:26:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 16:26:45 [DEBUG   ] spawn_process: at 2018-11-15 16:26:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 16:26:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 16:26:45 [DEBUG   ] spawn_process: at 2018-11-15 16:26:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 16:26:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 16:26:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 16:26:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:27:00 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-15 16:27:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 16:27:00 [WARNING ] (13, 1, 'bot')
2018-11-15 16:27:00 [WARNING ] (13, 1, 'bot')
2018-11-15 16:27:00 [WARNING ] (13, 1, 'bot')
2018-11-15 16:27:00 [WARNING ] (13, 1, 'bot')
2018-11-15 16:27:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:27:00 [DEBUG   ] Finished updating board flags in 1.120 seconds
2018-11-15 16:27:06 [DEBUG   ] Got command BAM from MCS: ref #516221
2018-11-15 16:27:06 [INFO    ] Finished processing BAM request
2018-11-15 16:27:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:27:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516221   8 58437 59226029 A  ERROR'
2018-11-15 16:27:06 [DEBUG   ] Got command BAM from MCS: ref #516222
2018-11-15 16:27:06 [INFO    ] Finished processing BAM request
2018-11-15 16:27:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:27:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516222   8 58437 59226033 A  ERROR'
2018-11-15 16:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 16:27:07 [DEBUG   ] spawn_process: at 2018-11-15 16:27:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 16:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 16:27:07 [DEBUG   ] spawn_process: at 2018-11-15 16:27:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 16:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 16:27:07 [DEBUG   ] spawn_process: at 2018-11-15 16:27:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 16:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 16:27:07 [DEBUG   ] spawn_process: at 2018-11-15 16:27:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 16:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 16:27:07 [DEBUG   ] spawn_process: at 2018-11-15 16:27:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 16:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 16:27:07 [DEBUG   ] spawn_process: at 2018-11-15 16:27:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 16:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 16:27:07 [DEBUG   ] spawn_process: at 2018-11-15 16:27:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 16:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 16:27:07 [DEBUG   ] spawn_process: at 2018-11-15 16:27:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 16:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 16:27:07 [DEBUG   ] spawn_process: at 2018-11-15 16:27:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 16:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 16:27:07 [DEBUG   ] spawn_process: at 2018-11-15 16:27:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 16:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 16:27:07 [DEBUG   ] spawn_process: at 2018-11-15 16:27:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 16:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 16:27:07 [DEBUG   ] spawn_process: at 2018-11-15 16:27:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 16:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 16:27:07 [DEBUG   ] spawn_process: at 2018-11-15 16:27:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 16:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 16:27:07 [DEBUG   ] spawn_process: at 2018-11-15 16:27:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 16:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 16:27:07 [DEBUG   ] spawn_process: at 2018-11-15 16:27:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 16:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 16:27:07 [DEBUG   ] spawn_process: at 2018-11-15 16:27:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 16:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 16:27:07 [DEBUG   ] spawn_process: at 2018-11-15 16:27:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 16:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 16:27:07 [DEBUG   ] spawn_process: at 2018-11-15 16:27:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 16:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 16:27:07 [DEBUG   ] spawn_process: at 2018-11-15 16:27:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 16:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 16:27:07 [DEBUG   ] spawn_process: at 2018-11-15 16:27:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 16:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 16:27:07 [DEBUG   ] spawn_process: at 2018-11-15 16:27:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 16:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 16:27:07 [DEBUG   ] spawn_process: at 2018-11-15 16:27:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 16:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 16:27:07 [DEBUG   ] spawn_process: at 2018-11-15 16:27:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 16:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 16:27:07 [DEBUG   ] spawn_process: at 2018-11-15 16:27:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 16:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 16:27:07 [DEBUG   ] spawn_process: at 2018-11-15 16:27:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 16:27:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 16:27:07 [DEBUG   ] spawn_process: at 2018-11-15 16:27:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 16:27:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 16:27:27 [DEBUG   ] Got command BAM from MCS: ref #516223
2018-11-15 16:27:27 [INFO    ] Finished processing BAM request
2018-11-15 16:27:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:27:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516223   8 58437 59247025 A  ERROR'
2018-11-15 16:27:27 [DEBUG   ] Got command BAM from MCS: ref #516224
2018-11-15 16:27:27 [INFO    ] Finished processing BAM request
2018-11-15 16:27:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:27:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516224   8 58437 59247029 A  ERROR'
2018-11-15 16:27:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 16:27:27 [DEBUG   ] spawn_process: at 2018-11-15 16:27:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 16:27:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 16:27:27 [DEBUG   ] spawn_process: at 2018-11-15 16:27:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 16:27:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 16:27:27 [DEBUG   ] spawn_process: at 2018-11-15 16:27:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 16:27:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 16:27:27 [DEBUG   ] spawn_process: at 2018-11-15 16:27:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 16:27:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 16:27:27 [DEBUG   ] spawn_process: at 2018-11-15 16:27:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 16:27:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 16:27:27 [DEBUG   ] spawn_process: at 2018-11-15 16:27:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 16:27:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 16:27:27 [DEBUG   ] spawn_process: at 2018-11-15 16:27:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 16:27:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 16:27:27 [DEBUG   ] spawn_process: at 2018-11-15 16:27:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 16:27:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 16:27:27 [DEBUG   ] spawn_process: at 2018-11-15 16:27:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 16:27:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 16:27:27 [DEBUG   ] spawn_process: at 2018-11-15 16:27:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 16:27:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 16:27:27 [DEBUG   ] spawn_process: at 2018-11-15 16:27:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 16:27:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 16:27:27 [DEBUG   ] spawn_process: at 2018-11-15 16:27:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 16:27:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 16:27:27 [DEBUG   ] spawn_process: at 2018-11-15 16:27:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 16:27:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 16:27:27 [DEBUG   ] spawn_process: at 2018-11-15 16:27:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 16:27:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 16:27:27 [DEBUG   ] spawn_process: at 2018-11-15 16:27:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 16:27:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 16:27:27 [DEBUG   ] spawn_process: at 2018-11-15 16:27:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 16:27:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 16:27:27 [DEBUG   ] spawn_process: at 2018-11-15 16:27:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 16:27:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 16:27:27 [DEBUG   ] spawn_process: at 2018-11-15 16:27:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 16:27:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 16:27:27 [DEBUG   ] spawn_process: at 2018-11-15 16:27:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 16:27:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 16:27:27 [DEBUG   ] spawn_process: at 2018-11-15 16:27:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 16:27:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 16:27:27 [DEBUG   ] spawn_process: at 2018-11-15 16:27:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 16:27:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 16:27:27 [DEBUG   ] spawn_process: at 2018-11-15 16:27:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 16:27:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 16:27:27 [DEBUG   ] spawn_process: at 2018-11-15 16:27:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 16:27:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 16:27:27 [DEBUG   ] spawn_process: at 2018-11-15 16:27:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 16:27:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 16:27:27 [DEBUG   ] spawn_process: at 2018-11-15 16:27:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 16:27:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 16:27:27 [DEBUG   ] spawn_process: at 2018-11-15 16:27:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 16:27:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 16:27:48 [DEBUG   ] Got command BAM from MCS: ref #516226
2018-11-15 16:27:48 [INFO    ] Finished processing BAM request
2018-11-15 16:27:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:27:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516226   8 58437 59268029 A  ERROR'
2018-11-15 16:27:48 [DEBUG   ] Got command BAM from MCS: ref #516225
2018-11-15 16:27:48 [INFO    ] Finished processing BAM request
2018-11-15 16:27:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:27:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516225   8 58437 59268037 A  ERROR'
2018-11-15 16:27:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 16:27:48 [DEBUG   ] spawn_process: at 2018-11-15 16:27:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 16:27:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 16:27:48 [DEBUG   ] spawn_process: at 2018-11-15 16:27:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 16:27:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 16:27:48 [DEBUG   ] spawn_process: at 2018-11-15 16:27:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 16:27:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 16:27:48 [DEBUG   ] spawn_process: at 2018-11-15 16:27:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 16:27:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 16:27:48 [DEBUG   ] spawn_process: at 2018-11-15 16:27:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 16:27:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 16:27:48 [DEBUG   ] spawn_process: at 2018-11-15 16:27:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 16:27:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 16:27:48 [DEBUG   ] spawn_process: at 2018-11-15 16:27:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 16:27:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 16:27:48 [DEBUG   ] spawn_process: at 2018-11-15 16:27:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 16:27:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 16:27:48 [DEBUG   ] spawn_process: at 2018-11-15 16:27:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 16:27:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 16:27:48 [DEBUG   ] spawn_process: at 2018-11-15 16:27:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 16:27:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 16:27:48 [DEBUG   ] spawn_process: at 2018-11-15 16:27:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 16:27:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 16:27:48 [DEBUG   ] spawn_process: at 2018-11-15 16:27:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 16:27:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 16:27:48 [DEBUG   ] spawn_process: at 2018-11-15 16:27:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 16:27:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 16:27:48 [DEBUG   ] spawn_process: at 2018-11-15 16:27:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 16:27:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 16:27:48 [DEBUG   ] spawn_process: at 2018-11-15 16:27:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 16:27:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 16:27:48 [DEBUG   ] spawn_process: at 2018-11-15 16:27:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 16:27:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 16:27:48 [DEBUG   ] spawn_process: at 2018-11-15 16:27:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 16:27:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 16:27:48 [DEBUG   ] spawn_process: at 2018-11-15 16:27:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 16:27:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 16:27:48 [DEBUG   ] spawn_process: at 2018-11-15 16:27:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 16:27:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 16:27:48 [DEBUG   ] spawn_process: at 2018-11-15 16:27:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 16:27:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 16:27:48 [DEBUG   ] spawn_process: at 2018-11-15 16:27:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 16:27:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 16:27:48 [DEBUG   ] spawn_process: at 2018-11-15 16:27:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 16:27:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 16:27:48 [DEBUG   ] spawn_process: at 2018-11-15 16:27:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 16:27:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 16:27:48 [DEBUG   ] spawn_process: at 2018-11-15 16:27:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 16:27:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 16:27:48 [DEBUG   ] spawn_process: at 2018-11-15 16:27:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 16:27:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 16:27:48 [DEBUG   ] spawn_process: at 2018-11-15 16:27:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 16:27:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 16:27:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 16:27:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:28:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 16:28:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-15 16:28:00 [WARNING ] (13, 1, 'bot')
2018-11-15 16:28:00 [WARNING ] (13, 1, 'bot')
2018-11-15 16:28:00 [WARNING ] (13, 1, 'bot')
2018-11-15 16:28:00 [WARNING ] (13, 1, 'bot')
2018-11-15 16:28:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:28:00 [DEBUG   ] Finished updating board flags in 1.003 seconds
2018-11-15 16:28:09 [DEBUG   ] Got command BAM from MCS: ref #516228
2018-11-15 16:28:09 [INFO    ] Finished processing BAM request
2018-11-15 16:28:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:28:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516228   8 58437 59289029 A  ERROR'
2018-11-15 16:28:09 [DEBUG   ] Got command BAM from MCS: ref #516227
2018-11-15 16:28:09 [INFO    ] Finished processing BAM request
2018-11-15 16:28:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:28:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516227   8 58437 59289033 A  ERROR'
2018-11-15 16:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 16:28:09 [DEBUG   ] spawn_process: at 2018-11-15 16:28:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 16:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 16:28:09 [DEBUG   ] spawn_process: at 2018-11-15 16:28:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 16:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 16:28:09 [DEBUG   ] spawn_process: at 2018-11-15 16:28:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 16:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 16:28:09 [DEBUG   ] spawn_process: at 2018-11-15 16:28:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 16:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 16:28:09 [DEBUG   ] spawn_process: at 2018-11-15 16:28:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 16:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 16:28:09 [DEBUG   ] spawn_process: at 2018-11-15 16:28:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 16:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 16:28:09 [DEBUG   ] spawn_process: at 2018-11-15 16:28:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 16:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 16:28:09 [DEBUG   ] spawn_process: at 2018-11-15 16:28:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 16:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 16:28:09 [DEBUG   ] spawn_process: at 2018-11-15 16:28:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 16:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 16:28:09 [DEBUG   ] spawn_process: at 2018-11-15 16:28:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 16:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 16:28:09 [DEBUG   ] spawn_process: at 2018-11-15 16:28:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 16:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 16:28:09 [DEBUG   ] spawn_process: at 2018-11-15 16:28:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 16:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 16:28:09 [DEBUG   ] spawn_process: at 2018-11-15 16:28:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 16:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 16:28:09 [DEBUG   ] spawn_process: at 2018-11-15 16:28:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 16:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 16:28:09 [DEBUG   ] spawn_process: at 2018-11-15 16:28:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 16:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 16:28:09 [DEBUG   ] spawn_process: at 2018-11-15 16:28:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 16:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 16:28:09 [DEBUG   ] spawn_process: at 2018-11-15 16:28:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 16:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 16:28:09 [DEBUG   ] spawn_process: at 2018-11-15 16:28:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 16:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 16:28:09 [DEBUG   ] spawn_process: at 2018-11-15 16:28:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 16:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 16:28:09 [DEBUG   ] spawn_process: at 2018-11-15 16:28:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 16:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 16:28:09 [DEBUG   ] spawn_process: at 2018-11-15 16:28:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 16:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 16:28:09 [DEBUG   ] spawn_process: at 2018-11-15 16:28:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 16:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 16:28:09 [DEBUG   ] spawn_process: at 2018-11-15 16:28:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 16:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 16:28:09 [DEBUG   ] spawn_process: at 2018-11-15 16:28:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 16:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 16:28:09 [DEBUG   ] spawn_process: at 2018-11-15 16:28:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 16:28:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 16:28:09 [DEBUG   ] spawn_process: at 2018-11-15 16:28:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 16:28:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 16:28:19 [DEBUG   ] Got command RPT from MCS: ref #516231
2018-11-15 16:28:19 [DEBUG   ] summary = ERROR
2018-11-15 16:28:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516231  13 58437 59299497 A  ERRORERROR'
2018-11-15 16:28:19 [DEBUG   ] Got command RPT from MCS: ref #516232
2018-11-15 16:28:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 16:28:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516232  77 58437 59299701 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 16:28:19 [DEBUG   ] Got command RPT from MCS: ref #516233
2018-11-15 16:28:19 [DEBUG   ] summary = ERROR
2018-11-15 16:28:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516233  13 58437 59299905 A  ERRORERROR'
2018-11-15 16:28:20 [DEBUG   ] Got command RPT from MCS: ref #516234
2018-11-15 16:28:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 16:28:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516234  77 58437 59300097 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 16:28:20 [DEBUG   ] Got command RPT from MCS: ref #516236
2018-11-15 16:28:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 16:28:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516236  12 58437 59300301 A  ERRORB¢ff'
2018-11-15 16:28:30 [DEBUG   ] Got command BAM from MCS: ref #516242
2018-11-15 16:28:30 [INFO    ] Finished processing BAM request
2018-11-15 16:28:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:28:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516242   8 58437 59310025 A  ERROR'
2018-11-15 16:28:30 [DEBUG   ] Got command BAM from MCS: ref #516241
2018-11-15 16:28:30 [INFO    ] Finished processing BAM request
2018-11-15 16:28:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:28:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516241   8 58437 59310029 A  ERROR'
2018-11-15 16:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 16:28:30 [DEBUG   ] spawn_process: at 2018-11-15 16:28:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 16:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 16:28:30 [DEBUG   ] spawn_process: at 2018-11-15 16:28:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 16:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 16:28:30 [DEBUG   ] spawn_process: at 2018-11-15 16:28:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 16:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 16:28:30 [DEBUG   ] spawn_process: at 2018-11-15 16:28:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 16:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 16:28:30 [DEBUG   ] spawn_process: at 2018-11-15 16:28:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 16:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 16:28:30 [DEBUG   ] spawn_process: at 2018-11-15 16:28:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 16:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 16:28:30 [DEBUG   ] spawn_process: at 2018-11-15 16:28:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 16:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 16:28:30 [DEBUG   ] spawn_process: at 2018-11-15 16:28:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 16:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 16:28:30 [DEBUG   ] spawn_process: at 2018-11-15 16:28:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 16:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 16:28:30 [DEBUG   ] spawn_process: at 2018-11-15 16:28:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 16:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 16:28:30 [DEBUG   ] spawn_process: at 2018-11-15 16:28:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 16:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 16:28:30 [DEBUG   ] spawn_process: at 2018-11-15 16:28:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 16:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 16:28:30 [DEBUG   ] spawn_process: at 2018-11-15 16:28:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 16:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 16:28:30 [DEBUG   ] spawn_process: at 2018-11-15 16:28:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 16:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 16:28:30 [DEBUG   ] spawn_process: at 2018-11-15 16:28:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 16:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 16:28:30 [DEBUG   ] spawn_process: at 2018-11-15 16:28:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 16:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 16:28:30 [DEBUG   ] spawn_process: at 2018-11-15 16:28:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 16:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 16:28:30 [DEBUG   ] spawn_process: at 2018-11-15 16:28:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 16:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 16:28:30 [DEBUG   ] spawn_process: at 2018-11-15 16:28:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 16:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 16:28:30 [DEBUG   ] spawn_process: at 2018-11-15 16:28:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 16:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 16:28:30 [DEBUG   ] spawn_process: at 2018-11-15 16:28:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 16:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 16:28:30 [DEBUG   ] spawn_process: at 2018-11-15 16:28:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 16:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 16:28:30 [DEBUG   ] spawn_process: at 2018-11-15 16:28:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 16:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 16:28:30 [DEBUG   ] spawn_process: at 2018-11-15 16:28:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 16:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 16:28:30 [DEBUG   ] spawn_process: at 2018-11-15 16:28:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 16:28:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 16:28:30 [DEBUG   ] spawn_process: at 2018-11-15 16:28:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 16:28:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 16:28:51 [DEBUG   ] Got command BAM from MCS: ref #516243
2018-11-15 16:28:51 [INFO    ] Finished processing BAM request
2018-11-15 16:28:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:28:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516243   8 58437 59331025 A  ERROR'
2018-11-15 16:28:51 [DEBUG   ] Got command BAM from MCS: ref #516244
2018-11-15 16:28:51 [INFO    ] Finished processing BAM request
2018-11-15 16:28:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:28:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516244   8 58437 59331029 A  ERROR'
2018-11-15 16:28:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 16:28:51 [DEBUG   ] spawn_process: at 2018-11-15 16:28:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 16:28:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 16:28:51 [DEBUG   ] spawn_process: at 2018-11-15 16:28:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 16:28:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 16:28:51 [DEBUG   ] spawn_process: at 2018-11-15 16:28:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 16:28:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 16:28:51 [DEBUG   ] spawn_process: at 2018-11-15 16:28:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 16:28:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 16:28:51 [DEBUG   ] spawn_process: at 2018-11-15 16:28:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 16:28:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 16:28:51 [DEBUG   ] spawn_process: at 2018-11-15 16:28:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 16:28:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 16:28:51 [DEBUG   ] spawn_process: at 2018-11-15 16:28:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 16:28:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 16:28:51 [DEBUG   ] spawn_process: at 2018-11-15 16:28:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 16:28:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 16:28:51 [DEBUG   ] spawn_process: at 2018-11-15 16:28:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 16:28:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 16:28:51 [DEBUG   ] spawn_process: at 2018-11-15 16:28:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 16:28:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 16:28:51 [DEBUG   ] spawn_process: at 2018-11-15 16:28:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 16:28:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 16:28:51 [DEBUG   ] spawn_process: at 2018-11-15 16:28:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 16:28:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 16:28:51 [DEBUG   ] spawn_process: at 2018-11-15 16:28:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 16:28:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 16:28:51 [DEBUG   ] spawn_process: at 2018-11-15 16:28:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 16:28:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 16:28:51 [DEBUG   ] spawn_process: at 2018-11-15 16:28:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 16:28:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 16:28:51 [DEBUG   ] spawn_process: at 2018-11-15 16:28:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 16:28:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 16:28:51 [DEBUG   ] spawn_process: at 2018-11-15 16:28:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 16:28:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 16:28:51 [DEBUG   ] spawn_process: at 2018-11-15 16:28:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 16:28:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 16:28:51 [DEBUG   ] spawn_process: at 2018-11-15 16:28:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 16:28:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 16:28:51 [DEBUG   ] spawn_process: at 2018-11-15 16:28:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 16:28:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 16:28:51 [DEBUG   ] spawn_process: at 2018-11-15 16:28:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 16:28:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 16:28:51 [DEBUG   ] spawn_process: at 2018-11-15 16:28:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 16:28:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 16:28:51 [DEBUG   ] spawn_process: at 2018-11-15 16:28:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 16:28:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 16:28:51 [DEBUG   ] spawn_process: at 2018-11-15 16:28:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 16:28:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 16:28:51 [DEBUG   ] spawn_process: at 2018-11-15 16:28:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 16:28:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 16:28:51 [DEBUG   ] spawn_process: at 2018-11-15 16:28:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 16:28:56 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-15 16:28:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:28:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-15 16:29:00 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-15 16:29:00 [WARNING ] (13, 1, 'bot')
2018-11-15 16:29:00 [WARNING ] (13, 1, 'bot')
2018-11-15 16:29:00 [WARNING ] (13, 1, 'bot')
2018-11-15 16:29:00 [WARNING ] (13, 1, 'bot')
2018-11-15 16:29:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:29:00 [DEBUG   ] Finished updating board flags in 1.012 seconds
2018-11-15 16:29:12 [DEBUG   ] Got command BAM from MCS: ref #516246
2018-11-15 16:29:12 [INFO    ] Finished processing BAM request
2018-11-15 16:29:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:29:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516246   8 58437 59352025 A  ERROR'
2018-11-15 16:29:12 [DEBUG   ] Got command BAM from MCS: ref #516245
2018-11-15 16:29:12 [INFO    ] Finished processing BAM request
2018-11-15 16:29:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:29:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516245   8 58437 59352029 A  ERROR'
2018-11-15 16:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 16:29:12 [DEBUG   ] spawn_process: at 2018-11-15 16:29:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 16:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 16:29:12 [DEBUG   ] spawn_process: at 2018-11-15 16:29:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 16:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 16:29:12 [DEBUG   ] spawn_process: at 2018-11-15 16:29:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 16:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 16:29:12 [DEBUG   ] spawn_process: at 2018-11-15 16:29:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 16:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 16:29:12 [DEBUG   ] spawn_process: at 2018-11-15 16:29:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 16:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 16:29:12 [DEBUG   ] spawn_process: at 2018-11-15 16:29:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 16:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 16:29:12 [DEBUG   ] spawn_process: at 2018-11-15 16:29:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 16:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 16:29:12 [DEBUG   ] spawn_process: at 2018-11-15 16:29:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 16:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 16:29:12 [DEBUG   ] spawn_process: at 2018-11-15 16:29:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 16:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 16:29:12 [DEBUG   ] spawn_process: at 2018-11-15 16:29:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 16:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 16:29:12 [DEBUG   ] spawn_process: at 2018-11-15 16:29:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 16:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 16:29:12 [DEBUG   ] spawn_process: at 2018-11-15 16:29:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 16:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 16:29:12 [DEBUG   ] spawn_process: at 2018-11-15 16:29:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 16:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 16:29:12 [DEBUG   ] spawn_process: at 2018-11-15 16:29:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 16:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 16:29:12 [DEBUG   ] spawn_process: at 2018-11-15 16:29:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 16:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 16:29:12 [DEBUG   ] spawn_process: at 2018-11-15 16:29:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 16:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 16:29:12 [DEBUG   ] spawn_process: at 2018-11-15 16:29:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 16:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 16:29:12 [DEBUG   ] spawn_process: at 2018-11-15 16:29:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 16:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 16:29:12 [DEBUG   ] spawn_process: at 2018-11-15 16:29:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 16:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 16:29:12 [DEBUG   ] spawn_process: at 2018-11-15 16:29:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 16:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 16:29:12 [DEBUG   ] spawn_process: at 2018-11-15 16:29:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 16:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 16:29:12 [DEBUG   ] spawn_process: at 2018-11-15 16:29:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 16:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 16:29:12 [DEBUG   ] spawn_process: at 2018-11-15 16:29:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 16:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 16:29:12 [DEBUG   ] spawn_process: at 2018-11-15 16:29:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 16:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 16:29:12 [DEBUG   ] spawn_process: at 2018-11-15 16:29:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 16:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 16:29:12 [DEBUG   ] spawn_process: at 2018-11-15 16:29:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 16:29:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 16:29:33 [DEBUG   ] Got command BAM from MCS: ref #516251
2018-11-15 16:29:33 [INFO    ] Finished processing BAM request
2018-11-15 16:29:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:29:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516251   8 58437 59373033 A  ERROR'
2018-11-15 16:29:33 [DEBUG   ] Got command BAM from MCS: ref #516252
2018-11-15 16:29:33 [INFO    ] Finished processing BAM request
2018-11-15 16:29:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:29:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516252   8 58437 59373037 A  ERROR'
2018-11-15 16:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 16:29:33 [DEBUG   ] spawn_process: at 2018-11-15 16:29:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 16:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 16:29:33 [DEBUG   ] spawn_process: at 2018-11-15 16:29:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 16:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 16:29:33 [DEBUG   ] spawn_process: at 2018-11-15 16:29:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 16:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 16:29:33 [DEBUG   ] spawn_process: at 2018-11-15 16:29:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 16:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 16:29:33 [DEBUG   ] spawn_process: at 2018-11-15 16:29:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 16:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 16:29:33 [DEBUG   ] spawn_process: at 2018-11-15 16:29:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 16:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 16:29:33 [DEBUG   ] spawn_process: at 2018-11-15 16:29:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 16:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 16:29:33 [DEBUG   ] spawn_process: at 2018-11-15 16:29:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 16:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 16:29:33 [DEBUG   ] spawn_process: at 2018-11-15 16:29:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 16:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 16:29:33 [DEBUG   ] spawn_process: at 2018-11-15 16:29:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 16:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 16:29:33 [DEBUG   ] spawn_process: at 2018-11-15 16:29:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 16:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 16:29:33 [DEBUG   ] spawn_process: at 2018-11-15 16:29:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 16:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 16:29:33 [DEBUG   ] spawn_process: at 2018-11-15 16:29:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 16:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 16:29:33 [DEBUG   ] spawn_process: at 2018-11-15 16:29:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 16:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 16:29:33 [DEBUG   ] spawn_process: at 2018-11-15 16:29:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 16:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 16:29:33 [DEBUG   ] spawn_process: at 2018-11-15 16:29:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 16:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 16:29:33 [DEBUG   ] spawn_process: at 2018-11-15 16:29:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 16:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 16:29:33 [DEBUG   ] spawn_process: at 2018-11-15 16:29:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 16:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 16:29:33 [DEBUG   ] spawn_process: at 2018-11-15 16:29:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 16:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 16:29:33 [DEBUG   ] spawn_process: at 2018-11-15 16:29:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 16:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 16:29:33 [DEBUG   ] spawn_process: at 2018-11-15 16:29:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 16:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 16:29:33 [DEBUG   ] spawn_process: at 2018-11-15 16:29:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 16:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 16:29:33 [DEBUG   ] spawn_process: at 2018-11-15 16:29:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 16:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 16:29:33 [DEBUG   ] spawn_process: at 2018-11-15 16:29:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 16:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 16:29:33 [DEBUG   ] spawn_process: at 2018-11-15 16:29:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 16:29:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 16:29:33 [DEBUG   ] spawn_process: at 2018-11-15 16:29:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 16:29:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 16:29:54 [DEBUG   ] Got command BAM from MCS: ref #516254
2018-11-15 16:29:54 [INFO    ] Finished processing BAM request
2018-11-15 16:29:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:29:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516254   8 58437 59394029 A  ERROR'
2018-11-15 16:29:54 [DEBUG   ] Got command BAM from MCS: ref #516253
2018-11-15 16:29:54 [INFO    ] Finished processing BAM request
2018-11-15 16:29:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:29:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516253   8 58437 59394033 A  ERROR'
2018-11-15 16:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 16:29:54 [DEBUG   ] spawn_process: at 2018-11-15 16:29:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 16:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 16:29:54 [DEBUG   ] spawn_process: at 2018-11-15 16:29:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 16:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 16:29:54 [DEBUG   ] spawn_process: at 2018-11-15 16:29:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 16:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 16:29:54 [DEBUG   ] spawn_process: at 2018-11-15 16:29:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 16:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 16:29:54 [DEBUG   ] spawn_process: at 2018-11-15 16:29:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 16:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 16:29:54 [DEBUG   ] spawn_process: at 2018-11-15 16:29:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 16:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 16:29:54 [DEBUG   ] spawn_process: at 2018-11-15 16:29:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 16:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 16:29:54 [DEBUG   ] spawn_process: at 2018-11-15 16:29:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 16:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 16:29:54 [DEBUG   ] spawn_process: at 2018-11-15 16:29:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 16:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 16:29:54 [DEBUG   ] spawn_process: at 2018-11-15 16:29:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 16:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 16:29:54 [DEBUG   ] spawn_process: at 2018-11-15 16:29:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 16:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 16:29:54 [DEBUG   ] spawn_process: at 2018-11-15 16:29:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 16:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 16:29:54 [DEBUG   ] spawn_process: at 2018-11-15 16:29:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 16:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 16:29:54 [DEBUG   ] spawn_process: at 2018-11-15 16:29:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 16:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 16:29:54 [DEBUG   ] spawn_process: at 2018-11-15 16:29:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 16:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 16:29:54 [DEBUG   ] spawn_process: at 2018-11-15 16:29:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 16:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 16:29:54 [DEBUG   ] spawn_process: at 2018-11-15 16:29:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 16:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 16:29:54 [DEBUG   ] spawn_process: at 2018-11-15 16:29:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 16:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 16:29:54 [DEBUG   ] spawn_process: at 2018-11-15 16:29:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 16:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 16:29:54 [DEBUG   ] spawn_process: at 2018-11-15 16:29:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 16:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 16:29:54 [DEBUG   ] spawn_process: at 2018-11-15 16:29:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 16:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 16:29:54 [DEBUG   ] spawn_process: at 2018-11-15 16:29:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 16:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 16:29:54 [DEBUG   ] spawn_process: at 2018-11-15 16:29:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 16:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 16:29:54 [DEBUG   ] spawn_process: at 2018-11-15 16:29:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 16:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 16:29:54 [DEBUG   ] spawn_process: at 2018-11-15 16:29:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 16:29:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 16:29:54 [DEBUG   ] spawn_process: at 2018-11-15 16:29:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 16:29:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 16:29:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2018-11-15 16:29:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:30:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 16:30:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-15 16:30:00 [WARNING ] (13, 1, 'bot')
2018-11-15 16:30:00 [WARNING ] (13, 1, 'bot')
2018-11-15 16:30:00 [WARNING ] (13, 1, 'bot')
2018-11-15 16:30:00 [WARNING ] (13, 1, 'bot')
2018-11-15 16:30:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:30:00 [DEBUG   ] Finished updating board flags in 0.986 seconds
2018-11-15 16:30:15 [DEBUG   ] Got command BAM from MCS: ref #516255
2018-11-15 16:30:15 [INFO    ] Finished processing BAM request
2018-11-15 16:30:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:30:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516255   8 58437 59415029 A  ERROR'
2018-11-15 16:30:15 [DEBUG   ] Got command BAM from MCS: ref #516256
2018-11-15 16:30:15 [INFO    ] Finished processing BAM request
2018-11-15 16:30:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:30:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516256   8 58437 59415033 A  ERROR'
2018-11-15 16:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 16:30:15 [DEBUG   ] spawn_process: at 2018-11-15 16:30:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 16:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 16:30:15 [DEBUG   ] spawn_process: at 2018-11-15 16:30:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 16:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 16:30:15 [DEBUG   ] spawn_process: at 2018-11-15 16:30:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 16:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 16:30:15 [DEBUG   ] spawn_process: at 2018-11-15 16:30:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 16:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 16:30:15 [DEBUG   ] spawn_process: at 2018-11-15 16:30:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 16:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 16:30:15 [DEBUG   ] spawn_process: at 2018-11-15 16:30:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 16:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 16:30:15 [DEBUG   ] spawn_process: at 2018-11-15 16:30:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 16:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 16:30:15 [DEBUG   ] spawn_process: at 2018-11-15 16:30:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 16:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 16:30:15 [DEBUG   ] spawn_process: at 2018-11-15 16:30:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 16:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 16:30:15 [DEBUG   ] spawn_process: at 2018-11-15 16:30:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 16:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 16:30:15 [DEBUG   ] spawn_process: at 2018-11-15 16:30:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 16:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 16:30:15 [DEBUG   ] spawn_process: at 2018-11-15 16:30:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 16:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 16:30:15 [DEBUG   ] spawn_process: at 2018-11-15 16:30:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 16:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 16:30:15 [DEBUG   ] spawn_process: at 2018-11-15 16:30:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 16:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 16:30:15 [DEBUG   ] spawn_process: at 2018-11-15 16:30:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 16:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 16:30:15 [DEBUG   ] spawn_process: at 2018-11-15 16:30:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 16:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 16:30:15 [DEBUG   ] spawn_process: at 2018-11-15 16:30:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 16:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 16:30:15 [DEBUG   ] spawn_process: at 2018-11-15 16:30:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 16:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 16:30:15 [DEBUG   ] spawn_process: at 2018-11-15 16:30:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 16:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 16:30:15 [DEBUG   ] spawn_process: at 2018-11-15 16:30:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 16:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 16:30:15 [DEBUG   ] spawn_process: at 2018-11-15 16:30:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 16:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 16:30:15 [DEBUG   ] spawn_process: at 2018-11-15 16:30:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 16:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 16:30:15 [DEBUG   ] spawn_process: at 2018-11-15 16:30:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 16:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 16:30:15 [DEBUG   ] spawn_process: at 2018-11-15 16:30:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 16:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 16:30:15 [DEBUG   ] spawn_process: at 2018-11-15 16:30:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 16:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 16:30:15 [DEBUG   ] spawn_process: at 2018-11-15 16:30:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 16:30:16 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-15 16:30:36 [DEBUG   ] Got command BAM from MCS: ref #516258
2018-11-15 16:30:36 [INFO    ] Finished processing BAM request
2018-11-15 16:30:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:30:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516258   8 58437 59436033 A  ERROR'
2018-11-15 16:30:36 [DEBUG   ] Got command BAM from MCS: ref #516257
2018-11-15 16:30:36 [INFO    ] Finished processing BAM request
2018-11-15 16:30:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:30:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516257   8 58437 59436037 A  ERROR'
2018-11-15 16:30:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 16:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 16:30:36 [DEBUG   ] spawn_process: at 2018-11-15 16:30:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 16:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 16:30:36 [DEBUG   ] spawn_process: at 2018-11-15 16:30:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 16:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 16:30:36 [DEBUG   ] spawn_process: at 2018-11-15 16:30:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 16:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 16:30:36 [DEBUG   ] spawn_process: at 2018-11-15 16:30:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 16:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 16:30:36 [DEBUG   ] spawn_process: at 2018-11-15 16:30:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 16:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 16:30:36 [DEBUG   ] spawn_process: at 2018-11-15 16:30:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 16:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 16:30:36 [DEBUG   ] spawn_process: at 2018-11-15 16:30:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 16:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 16:30:36 [DEBUG   ] spawn_process: at 2018-11-15 16:30:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 16:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 16:30:36 [DEBUG   ] spawn_process: at 2018-11-15 16:30:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 16:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 16:30:36 [DEBUG   ] spawn_process: at 2018-11-15 16:30:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 16:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 16:30:36 [DEBUG   ] spawn_process: at 2018-11-15 16:30:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 16:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 16:30:36 [DEBUG   ] spawn_process: at 2018-11-15 16:30:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 16:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 16:30:36 [DEBUG   ] spawn_process: at 2018-11-15 16:30:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 16:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 16:30:36 [DEBUG   ] spawn_process: at 2018-11-15 16:30:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 16:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 16:30:36 [DEBUG   ] spawn_process: at 2018-11-15 16:30:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 16:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 16:30:36 [DEBUG   ] spawn_process: at 2018-11-15 16:30:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 16:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 16:30:36 [DEBUG   ] spawn_process: at 2018-11-15 16:30:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 16:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 16:30:36 [DEBUG   ] spawn_process: at 2018-11-15 16:30:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 16:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 16:30:36 [DEBUG   ] spawn_process: at 2018-11-15 16:30:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 16:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 16:30:36 [DEBUG   ] spawn_process: at 2018-11-15 16:30:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 16:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 16:30:36 [DEBUG   ] spawn_process: at 2018-11-15 16:30:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 16:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 16:30:36 [DEBUG   ] spawn_process: at 2018-11-15 16:30:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 16:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 16:30:36 [DEBUG   ] spawn_process: at 2018-11-15 16:30:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 16:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 16:30:36 [DEBUG   ] spawn_process: at 2018-11-15 16:30:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 16:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 16:30:36 [DEBUG   ] spawn_process: at 2018-11-15 16:30:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 16:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 16:30:36 [DEBUG   ] spawn_process: at 2018-11-15 16:30:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 16:30:45 [DEBUG   ] Got command RPT from MCS: ref #516259
2018-11-15 16:30:45 [DEBUG   ] summary = ERROR
2018-11-15 16:30:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516259  13 58437 59445133 A  ERRORERROR'
2018-11-15 16:30:45 [DEBUG   ] Got command RPT from MCS: ref #516260
2018-11-15 16:30:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 16:30:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516260  77 58437 59445134 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 16:30:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 16:30:57 [DEBUG   ] Got command BAM from MCS: ref #516276
2018-11-15 16:30:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:30:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516276   8 58437 59457029 A  ERROR'
2018-11-15 16:30:57 [DEBUG   ] Got command BAM from MCS: ref #516277
2018-11-15 16:30:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:30:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516277   8 58437 59457033 A  ERROR'
2018-11-15 16:30:57 [INFO    ] Finished processing BAM request
2018-11-15 16:30:57 [INFO    ] Finished processing BAM request
2018-11-15 16:30:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 16:30:57 [DEBUG   ] spawn_process: at 2018-11-15 16:30:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 16:30:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 16:30:57 [DEBUG   ] spawn_process: at 2018-11-15 16:30:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 16:30:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 16:30:57 [DEBUG   ] spawn_process: at 2018-11-15 16:30:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 16:30:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 16:30:57 [DEBUG   ] spawn_process: at 2018-11-15 16:30:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 16:30:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 16:30:57 [DEBUG   ] spawn_process: at 2018-11-15 16:30:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 16:30:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 16:30:57 [DEBUG   ] spawn_process: at 2018-11-15 16:30:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 16:30:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 16:30:57 [DEBUG   ] spawn_process: at 2018-11-15 16:30:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 16:30:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 16:30:57 [DEBUG   ] spawn_process: at 2018-11-15 16:30:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 16:30:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 16:30:57 [DEBUG   ] spawn_process: at 2018-11-15 16:30:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 16:30:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 16:30:57 [DEBUG   ] spawn_process: at 2018-11-15 16:30:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 16:30:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 16:30:57 [DEBUG   ] spawn_process: at 2018-11-15 16:30:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 16:30:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 16:30:57 [DEBUG   ] spawn_process: at 2018-11-15 16:30:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 16:30:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 16:30:57 [DEBUG   ] spawn_process: at 2018-11-15 16:30:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 16:30:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 16:30:57 [DEBUG   ] spawn_process: at 2018-11-15 16:30:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 16:30:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 16:30:57 [DEBUG   ] spawn_process: at 2018-11-15 16:30:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 16:30:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 16:30:57 [DEBUG   ] spawn_process: at 2018-11-15 16:30:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 16:30:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 16:30:57 [DEBUG   ] spawn_process: at 2018-11-15 16:30:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 16:30:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 16:30:57 [DEBUG   ] spawn_process: at 2018-11-15 16:30:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 16:30:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 16:30:57 [DEBUG   ] spawn_process: at 2018-11-15 16:30:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 16:30:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 16:30:57 [DEBUG   ] spawn_process: at 2018-11-15 16:30:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 16:30:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 16:30:57 [DEBUG   ] spawn_process: at 2018-11-15 16:30:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 16:30:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 16:30:57 [DEBUG   ] spawn_process: at 2018-11-15 16:30:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 16:30:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 16:30:57 [DEBUG   ] spawn_process: at 2018-11-15 16:30:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 16:30:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 16:30:57 [DEBUG   ] spawn_process: at 2018-11-15 16:30:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 16:30:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 16:30:57 [DEBUG   ] spawn_process: at 2018-11-15 16:30:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 16:30:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 16:30:57 [DEBUG   ] spawn_process: at 2018-11-15 16:30:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 16:31:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-11-15 16:31:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 16:31:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:31:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 16:31:00 [WARNING ] (13, 1, 'bot')
2018-11-15 16:31:00 [WARNING ] (13, 1, 'bot')
2018-11-15 16:31:00 [WARNING ] (13, 1, 'bot')
2018-11-15 16:31:00 [WARNING ] (13, 1, 'bot')
2018-11-15 16:31:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:31:00 [DEBUG   ] Finished updating board flags in 1.262 seconds
2018-11-15 16:31:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 16:31:18 [DEBUG   ] Got command BAM from MCS: ref #516278
2018-11-15 16:31:18 [INFO    ] Finished processing BAM request
2018-11-15 16:31:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:31:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516278   8 58437 59478026 A  ERROR'
2018-11-15 16:31:18 [DEBUG   ] Got command BAM from MCS: ref #516279
2018-11-15 16:31:18 [INFO    ] Finished processing BAM request
2018-11-15 16:31:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:31:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516279   8 58437 59478030 A  ERROR'
2018-11-15 16:31:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 16:31:18 [DEBUG   ] spawn_process: at 2018-11-15 16:31:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 16:31:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 16:31:18 [DEBUG   ] spawn_process: at 2018-11-15 16:31:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 16:31:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 16:31:18 [DEBUG   ] spawn_process: at 2018-11-15 16:31:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 16:31:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 16:31:18 [DEBUG   ] spawn_process: at 2018-11-15 16:31:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 16:31:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 16:31:18 [DEBUG   ] spawn_process: at 2018-11-15 16:31:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 16:31:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 16:31:18 [DEBUG   ] spawn_process: at 2018-11-15 16:31:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 16:31:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 16:31:18 [DEBUG   ] spawn_process: at 2018-11-15 16:31:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 16:31:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 16:31:18 [DEBUG   ] spawn_process: at 2018-11-15 16:31:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 16:31:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 16:31:18 [DEBUG   ] spawn_process: at 2018-11-15 16:31:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 16:31:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 16:31:18 [DEBUG   ] spawn_process: at 2018-11-15 16:31:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 16:31:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 16:31:18 [DEBUG   ] spawn_process: at 2018-11-15 16:31:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 16:31:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 16:31:18 [DEBUG   ] spawn_process: at 2018-11-15 16:31:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 16:31:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 16:31:18 [DEBUG   ] spawn_process: at 2018-11-15 16:31:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 16:31:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 16:31:18 [DEBUG   ] spawn_process: at 2018-11-15 16:31:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 16:31:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 16:31:18 [DEBUG   ] spawn_process: at 2018-11-15 16:31:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 16:31:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 16:31:18 [DEBUG   ] spawn_process: at 2018-11-15 16:31:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 16:31:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 16:31:18 [DEBUG   ] spawn_process: at 2018-11-15 16:31:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 16:31:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 16:31:18 [DEBUG   ] spawn_process: at 2018-11-15 16:31:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 16:31:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 16:31:18 [DEBUG   ] spawn_process: at 2018-11-15 16:31:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 16:31:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 16:31:18 [DEBUG   ] spawn_process: at 2018-11-15 16:31:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 16:31:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 16:31:18 [DEBUG   ] spawn_process: at 2018-11-15 16:31:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 16:31:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 16:31:18 [DEBUG   ] spawn_process: at 2018-11-15 16:31:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 16:31:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 16:31:18 [DEBUG   ] spawn_process: at 2018-11-15 16:31:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 16:31:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 16:31:18 [DEBUG   ] spawn_process: at 2018-11-15 16:31:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 16:31:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 16:31:18 [DEBUG   ] spawn_process: at 2018-11-15 16:31:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 16:31:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 16:31:18 [DEBUG   ] spawn_process: at 2018-11-15 16:31:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 16:31:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 16:31:39 [DEBUG   ] Got command BAM from MCS: ref #516280
2018-11-15 16:31:39 [INFO    ] Finished processing BAM request
2018-11-15 16:31:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:31:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516280   8 58437 59499034 A  ERROR'
2018-11-15 16:31:39 [DEBUG   ] Got command BAM from MCS: ref #516281
2018-11-15 16:31:39 [INFO    ] Finished processing BAM request
2018-11-15 16:31:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:31:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516281   8 58437 59499038 A  ERROR'
2018-11-15 16:31:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 16:31:39 [DEBUG   ] spawn_process: at 2018-11-15 16:31:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 16:31:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 16:31:39 [DEBUG   ] spawn_process: at 2018-11-15 16:31:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 16:31:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 16:31:39 [DEBUG   ] spawn_process: at 2018-11-15 16:31:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 16:31:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 16:31:39 [DEBUG   ] spawn_process: at 2018-11-15 16:31:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 16:31:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 16:31:39 [DEBUG   ] spawn_process: at 2018-11-15 16:31:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 16:31:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 16:31:39 [DEBUG   ] spawn_process: at 2018-11-15 16:31:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 16:31:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 16:31:39 [DEBUG   ] spawn_process: at 2018-11-15 16:31:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 16:31:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 16:31:39 [DEBUG   ] spawn_process: at 2018-11-15 16:31:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 16:31:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 16:31:39 [DEBUG   ] spawn_process: at 2018-11-15 16:31:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 16:31:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 16:31:39 [DEBUG   ] spawn_process: at 2018-11-15 16:31:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 16:31:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 16:31:39 [DEBUG   ] spawn_process: at 2018-11-15 16:31:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 16:31:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 16:31:39 [DEBUG   ] spawn_process: at 2018-11-15 16:31:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 16:31:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 16:31:39 [DEBUG   ] spawn_process: at 2018-11-15 16:31:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 16:31:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 16:31:39 [DEBUG   ] spawn_process: at 2018-11-15 16:31:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 16:31:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 16:31:39 [DEBUG   ] spawn_process: at 2018-11-15 16:31:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 16:31:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 16:31:39 [DEBUG   ] spawn_process: at 2018-11-15 16:31:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 16:31:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 16:31:39 [DEBUG   ] spawn_process: at 2018-11-15 16:31:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 16:31:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 16:31:39 [DEBUG   ] spawn_process: at 2018-11-15 16:31:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 16:31:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 16:31:39 [DEBUG   ] spawn_process: at 2018-11-15 16:31:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 16:31:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 16:31:39 [DEBUG   ] spawn_process: at 2018-11-15 16:31:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 16:31:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 16:31:39 [DEBUG   ] spawn_process: at 2018-11-15 16:31:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 16:31:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 16:31:39 [DEBUG   ] spawn_process: at 2018-11-15 16:31:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 16:31:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 16:31:39 [DEBUG   ] spawn_process: at 2018-11-15 16:31:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 16:31:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 16:31:39 [DEBUG   ] spawn_process: at 2018-11-15 16:31:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 16:31:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 16:31:39 [DEBUG   ] spawn_process: at 2018-11-15 16:31:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 16:31:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 16:31:39 [DEBUG   ] spawn_process: at 2018-11-15 16:31:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 16:31:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 16:32:00 [DEBUG   ] Got command BAM from MCS: ref #516283
2018-11-15 16:32:00 [INFO    ] Finished processing BAM request
2018-11-15 16:32:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:32:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516283   8 58437 59520030 A  ERROR'
2018-11-15 16:32:00 [DEBUG   ] Got command BAM from MCS: ref #516282
2018-11-15 16:32:00 [INFO    ] Finished processing BAM request
2018-11-15 16:32:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:32:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516282   8 58437 59520034 A  ERROR'
2018-11-15 16:32:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-11-15 16:32:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 16:32:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:32:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 16:32:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 16:32:00 [WARNING ] (13, 1, 'bot')
2018-11-15 16:32:00 [WARNING ] (13, 1, 'bot')
2018-11-15 16:32:00 [WARNING ] (13, 1, 'bot')
2018-11-15 16:32:00 [WARNING ] (13, 1, 'bot')
2018-11-15 16:32:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:32:00 [DEBUG   ] Finished updating board flags in 1.195 seconds
2018-11-15 16:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 16:32:00 [DEBUG   ] spawn_process: at 2018-11-15 16:32:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 16:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 16:32:00 [DEBUG   ] spawn_process: at 2018-11-15 16:32:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 16:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 16:32:00 [DEBUG   ] spawn_process: at 2018-11-15 16:32:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 16:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 16:32:00 [DEBUG   ] spawn_process: at 2018-11-15 16:32:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 16:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 16:32:00 [DEBUG   ] spawn_process: at 2018-11-15 16:32:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 16:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 16:32:00 [DEBUG   ] spawn_process: at 2018-11-15 16:32:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 16:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 16:32:00 [DEBUG   ] spawn_process: at 2018-11-15 16:32:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 16:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 16:32:00 [DEBUG   ] spawn_process: at 2018-11-15 16:32:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 16:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 16:32:00 [DEBUG   ] spawn_process: at 2018-11-15 16:32:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 16:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 16:32:00 [DEBUG   ] spawn_process: at 2018-11-15 16:32:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 16:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 16:32:00 [DEBUG   ] spawn_process: at 2018-11-15 16:32:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 16:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 16:32:00 [DEBUG   ] spawn_process: at 2018-11-15 16:32:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 16:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 16:32:00 [DEBUG   ] spawn_process: at 2018-11-15 16:32:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 16:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 16:32:00 [DEBUG   ] spawn_process: at 2018-11-15 16:32:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 16:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 16:32:00 [DEBUG   ] spawn_process: at 2018-11-15 16:32:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 16:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 16:32:00 [DEBUG   ] spawn_process: at 2018-11-15 16:32:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 16:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 16:32:00 [DEBUG   ] spawn_process: at 2018-11-15 16:32:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 16:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 16:32:00 [DEBUG   ] spawn_process: at 2018-11-15 16:32:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 16:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 16:32:00 [DEBUG   ] spawn_process: at 2018-11-15 16:32:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 16:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 16:32:00 [DEBUG   ] spawn_process: at 2018-11-15 16:32:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 16:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 16:32:00 [DEBUG   ] spawn_process: at 2018-11-15 16:32:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 16:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 16:32:00 [DEBUG   ] spawn_process: at 2018-11-15 16:32:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 16:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 16:32:00 [DEBUG   ] spawn_process: at 2018-11-15 16:32:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 16:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 16:32:00 [DEBUG   ] spawn_process: at 2018-11-15 16:32:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 16:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 16:32:00 [DEBUG   ] spawn_process: at 2018-11-15 16:32:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 16:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 16:32:00 [DEBUG   ] spawn_process: at 2018-11-15 16:32:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 16:32:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 16:32:21 [DEBUG   ] Got command BAM from MCS: ref #516285
2018-11-15 16:32:21 [INFO    ] Finished processing BAM request
2018-11-15 16:32:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:32:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516285   8 58437 59541026 A  ERROR'
2018-11-15 16:32:21 [DEBUG   ] Got command BAM from MCS: ref #516284
2018-11-15 16:32:21 [INFO    ] Finished processing BAM request
2018-11-15 16:32:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:32:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516284   8 58437 59541030 A  ERROR'
2018-11-15 16:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 16:32:21 [DEBUG   ] spawn_process: at 2018-11-15 16:32:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 16:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 16:32:21 [DEBUG   ] spawn_process: at 2018-11-15 16:32:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 16:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 16:32:21 [DEBUG   ] spawn_process: at 2018-11-15 16:32:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 16:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 16:32:21 [DEBUG   ] spawn_process: at 2018-11-15 16:32:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 16:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 16:32:21 [DEBUG   ] spawn_process: at 2018-11-15 16:32:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 16:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 16:32:21 [DEBUG   ] spawn_process: at 2018-11-15 16:32:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 16:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 16:32:21 [DEBUG   ] spawn_process: at 2018-11-15 16:32:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 16:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 16:32:21 [DEBUG   ] spawn_process: at 2018-11-15 16:32:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 16:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 16:32:21 [DEBUG   ] spawn_process: at 2018-11-15 16:32:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 16:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 16:32:21 [DEBUG   ] spawn_process: at 2018-11-15 16:32:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 16:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 16:32:21 [DEBUG   ] spawn_process: at 2018-11-15 16:32:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 16:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 16:32:21 [DEBUG   ] spawn_process: at 2018-11-15 16:32:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 16:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 16:32:21 [DEBUG   ] spawn_process: at 2018-11-15 16:32:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 16:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 16:32:21 [DEBUG   ] spawn_process: at 2018-11-15 16:32:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 16:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 16:32:21 [DEBUG   ] spawn_process: at 2018-11-15 16:32:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 16:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 16:32:21 [DEBUG   ] spawn_process: at 2018-11-15 16:32:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 16:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 16:32:21 [DEBUG   ] spawn_process: at 2018-11-15 16:32:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 16:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 16:32:21 [DEBUG   ] spawn_process: at 2018-11-15 16:32:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 16:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 16:32:21 [DEBUG   ] spawn_process: at 2018-11-15 16:32:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 16:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 16:32:21 [DEBUG   ] spawn_process: at 2018-11-15 16:32:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 16:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 16:32:21 [DEBUG   ] spawn_process: at 2018-11-15 16:32:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 16:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 16:32:21 [DEBUG   ] spawn_process: at 2018-11-15 16:32:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 16:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 16:32:21 [DEBUG   ] spawn_process: at 2018-11-15 16:32:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 16:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 16:32:21 [DEBUG   ] spawn_process: at 2018-11-15 16:32:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 16:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 16:32:21 [DEBUG   ] spawn_process: at 2018-11-15 16:32:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 16:32:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 16:32:21 [DEBUG   ] spawn_process: at 2018-11-15 16:32:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 16:32:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 16:32:42 [DEBUG   ] Got command BAM from MCS: ref #516291
2018-11-15 16:32:42 [INFO    ] Finished processing BAM request
2018-11-15 16:32:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:32:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516291   8 58437 59562034 A  ERROR'
2018-11-15 16:32:42 [DEBUG   ] Got command BAM from MCS: ref #516290
2018-11-15 16:32:42 [INFO    ] Finished processing BAM request
2018-11-15 16:32:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:32:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516290   8 58437 59562038 A  ERROR'
2018-11-15 16:32:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 16:32:42 [DEBUG   ] spawn_process: at 2018-11-15 16:32:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 16:32:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 16:32:42 [DEBUG   ] spawn_process: at 2018-11-15 16:32:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 16:32:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 16:32:42 [DEBUG   ] spawn_process: at 2018-11-15 16:32:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 16:32:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 16:32:42 [DEBUG   ] spawn_process: at 2018-11-15 16:32:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 16:32:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 16:32:42 [DEBUG   ] spawn_process: at 2018-11-15 16:32:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 16:32:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 16:32:42 [DEBUG   ] spawn_process: at 2018-11-15 16:32:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 16:32:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 16:32:42 [DEBUG   ] spawn_process: at 2018-11-15 16:32:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 16:32:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 16:32:42 [DEBUG   ] spawn_process: at 2018-11-15 16:32:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 16:32:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 16:32:42 [DEBUG   ] spawn_process: at 2018-11-15 16:32:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 16:32:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 16:32:42 [DEBUG   ] spawn_process: at 2018-11-15 16:32:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 16:32:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 16:32:42 [DEBUG   ] spawn_process: at 2018-11-15 16:32:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 16:32:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 16:32:42 [DEBUG   ] spawn_process: at 2018-11-15 16:32:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 16:32:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 16:32:42 [DEBUG   ] spawn_process: at 2018-11-15 16:32:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 16:32:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 16:32:42 [DEBUG   ] spawn_process: at 2018-11-15 16:32:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 16:32:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 16:32:42 [DEBUG   ] spawn_process: at 2018-11-15 16:32:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 16:32:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 16:32:42 [DEBUG   ] spawn_process: at 2018-11-15 16:32:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 16:32:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 16:32:42 [DEBUG   ] spawn_process: at 2018-11-15 16:32:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 16:32:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 16:32:42 [DEBUG   ] spawn_process: at 2018-11-15 16:32:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 16:32:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 16:32:42 [DEBUG   ] spawn_process: at 2018-11-15 16:32:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 16:32:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 16:32:42 [DEBUG   ] spawn_process: at 2018-11-15 16:32:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 16:32:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 16:32:42 [DEBUG   ] spawn_process: at 2018-11-15 16:32:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 16:32:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 16:32:42 [DEBUG   ] spawn_process: at 2018-11-15 16:32:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 16:32:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 16:32:42 [DEBUG   ] spawn_process: at 2018-11-15 16:32:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 16:32:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 16:32:42 [DEBUG   ] spawn_process: at 2018-11-15 16:32:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 16:32:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 16:32:42 [DEBUG   ] spawn_process: at 2018-11-15 16:32:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 16:32:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 16:32:42 [DEBUG   ] spawn_process: at 2018-11-15 16:32:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 16:32:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 16:33:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:33:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 16:33:00 [WARNING ] (13, 1, 'bot')
2018-11-15 16:33:00 [WARNING ] (13, 1, 'bot')
2018-11-15 16:33:00 [WARNING ] (13, 1, 'bot')
2018-11-15 16:33:00 [WARNING ] (13, 1, 'bot')
2018-11-15 16:33:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:33:00 [DEBUG   ] Finished updating board flags in 1.027 seconds
2018-11-15 16:33:03 [DEBUG   ] Got command BAM from MCS: ref #516293
2018-11-15 16:33:03 [INFO    ] Finished processing BAM request
2018-11-15 16:33:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:33:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516293   8 58437 59583030 A  ERROR'
2018-11-15 16:33:03 [DEBUG   ] Got command BAM from MCS: ref #516292
2018-11-15 16:33:03 [INFO    ] Finished processing BAM request
2018-11-15 16:33:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:33:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516292   8 58437 59583034 A  ERROR'
2018-11-15 16:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 16:33:03 [DEBUG   ] spawn_process: at 2018-11-15 16:33:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 16:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 16:33:03 [DEBUG   ] spawn_process: at 2018-11-15 16:33:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 16:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 16:33:03 [DEBUG   ] spawn_process: at 2018-11-15 16:33:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 16:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 16:33:03 [DEBUG   ] spawn_process: at 2018-11-15 16:33:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 16:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 16:33:03 [DEBUG   ] spawn_process: at 2018-11-15 16:33:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 16:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 16:33:03 [DEBUG   ] spawn_process: at 2018-11-15 16:33:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 16:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 16:33:03 [DEBUG   ] spawn_process: at 2018-11-15 16:33:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 16:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 16:33:03 [DEBUG   ] spawn_process: at 2018-11-15 16:33:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 16:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 16:33:03 [DEBUG   ] spawn_process: at 2018-11-15 16:33:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 16:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 16:33:03 [DEBUG   ] spawn_process: at 2018-11-15 16:33:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 16:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 16:33:03 [DEBUG   ] spawn_process: at 2018-11-15 16:33:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 16:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 16:33:03 [DEBUG   ] spawn_process: at 2018-11-15 16:33:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 16:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 16:33:03 [DEBUG   ] spawn_process: at 2018-11-15 16:33:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 16:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 16:33:03 [DEBUG   ] spawn_process: at 2018-11-15 16:33:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 16:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 16:33:03 [DEBUG   ] spawn_process: at 2018-11-15 16:33:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 16:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 16:33:03 [DEBUG   ] spawn_process: at 2018-11-15 16:33:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 16:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 16:33:03 [DEBUG   ] spawn_process: at 2018-11-15 16:33:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 16:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 16:33:03 [DEBUG   ] spawn_process: at 2018-11-15 16:33:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 16:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 16:33:03 [DEBUG   ] spawn_process: at 2018-11-15 16:33:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 16:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 16:33:03 [DEBUG   ] spawn_process: at 2018-11-15 16:33:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 16:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 16:33:03 [DEBUG   ] spawn_process: at 2018-11-15 16:33:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 16:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 16:33:03 [DEBUG   ] spawn_process: at 2018-11-15 16:33:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 16:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 16:33:03 [DEBUG   ] spawn_process: at 2018-11-15 16:33:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 16:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 16:33:03 [DEBUG   ] spawn_process: at 2018-11-15 16:33:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 16:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 16:33:03 [DEBUG   ] spawn_process: at 2018-11-15 16:33:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 16:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 16:33:03 [DEBUG   ] spawn_process: at 2018-11-15 16:33:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 16:33:16 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-15 16:33:19 [DEBUG   ] Got command RPT from MCS: ref #516294
2018-11-15 16:33:19 [DEBUG   ] summary = ERROR
2018-11-15 16:33:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516294  13 58437 59599585 A  ERRORERROR'
2018-11-15 16:33:19 [DEBUG   ] Got command RPT from MCS: ref #516295
2018-11-15 16:33:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 16:33:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516295  77 58437 59599789 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 16:33:19 [DEBUG   ] Got command RPT from MCS: ref #516296
2018-11-15 16:33:19 [DEBUG   ] summary = ERROR
2018-11-15 16:33:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516296  13 58437 59599993 A  ERRORERROR'
2018-11-15 16:33:20 [DEBUG   ] Got command RPT from MCS: ref #516297
2018-11-15 16:33:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 16:33:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516297  77 58437 59600186 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 16:33:20 [DEBUG   ] Got command RPT from MCS: ref #516298
2018-11-15 16:33:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 16:33:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516298  12 58437 59600389 A  ERRORB£ff'
2018-11-15 16:33:24 [DEBUG   ] Got command BAM from MCS: ref #516299
2018-11-15 16:33:24 [INFO    ] Finished processing BAM request
2018-11-15 16:33:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:33:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516299   8 58437 59604030 A  ERROR'
2018-11-15 16:33:24 [DEBUG   ] Got command BAM from MCS: ref #516300
2018-11-15 16:33:24 [INFO    ] Finished processing BAM request
2018-11-15 16:33:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:33:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516300   8 58437 59604034 A  ERROR'
2018-11-15 16:33:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 16:33:24 [DEBUG   ] spawn_process: at 2018-11-15 16:33:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 16:33:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 16:33:24 [DEBUG   ] spawn_process: at 2018-11-15 16:33:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 16:33:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 16:33:24 [DEBUG   ] spawn_process: at 2018-11-15 16:33:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 16:33:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 16:33:24 [DEBUG   ] spawn_process: at 2018-11-15 16:33:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 16:33:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 16:33:24 [DEBUG   ] spawn_process: at 2018-11-15 16:33:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 16:33:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 16:33:24 [DEBUG   ] spawn_process: at 2018-11-15 16:33:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 16:33:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 16:33:24 [DEBUG   ] spawn_process: at 2018-11-15 16:33:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 16:33:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 16:33:24 [DEBUG   ] spawn_process: at 2018-11-15 16:33:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 16:33:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 16:33:24 [DEBUG   ] spawn_process: at 2018-11-15 16:33:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 16:33:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 16:33:24 [DEBUG   ] spawn_process: at 2018-11-15 16:33:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 16:33:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 16:33:24 [DEBUG   ] spawn_process: at 2018-11-15 16:33:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 16:33:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 16:33:24 [DEBUG   ] spawn_process: at 2018-11-15 16:33:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 16:33:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 16:33:24 [DEBUG   ] spawn_process: at 2018-11-15 16:33:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 16:33:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 16:33:24 [DEBUG   ] spawn_process: at 2018-11-15 16:33:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 16:33:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 16:33:24 [DEBUG   ] spawn_process: at 2018-11-15 16:33:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 16:33:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 16:33:24 [DEBUG   ] spawn_process: at 2018-11-15 16:33:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 16:33:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 16:33:24 [DEBUG   ] spawn_process: at 2018-11-15 16:33:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 16:33:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 16:33:24 [DEBUG   ] spawn_process: at 2018-11-15 16:33:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 16:33:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 16:33:24 [DEBUG   ] spawn_process: at 2018-11-15 16:33:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 16:33:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 16:33:24 [DEBUG   ] spawn_process: at 2018-11-15 16:33:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 16:33:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 16:33:24 [DEBUG   ] spawn_process: at 2018-11-15 16:33:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 16:33:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 16:33:24 [DEBUG   ] spawn_process: at 2018-11-15 16:33:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 16:33:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 16:33:24 [DEBUG   ] spawn_process: at 2018-11-15 16:33:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 16:33:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 16:33:24 [DEBUG   ] spawn_process: at 2018-11-15 16:33:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 16:33:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 16:33:24 [DEBUG   ] spawn_process: at 2018-11-15 16:33:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 16:33:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 16:33:24 [DEBUG   ] spawn_process: at 2018-11-15 16:33:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 16:33:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 16:33:45 [DEBUG   ] Got command BAM from MCS: ref #516301
2018-11-15 16:33:45 [INFO    ] Finished processing BAM request
2018-11-15 16:33:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:33:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516301   8 58437 59625026 A  ERROR'
2018-11-15 16:33:45 [DEBUG   ] Got command BAM from MCS: ref #516302
2018-11-15 16:33:45 [INFO    ] Finished processing BAM request
2018-11-15 16:33:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:33:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516302   8 58437 59625030 A  ERROR'
2018-11-15 16:33:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 16:33:45 [DEBUG   ] spawn_process: at 2018-11-15 16:33:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 16:33:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 16:33:45 [DEBUG   ] spawn_process: at 2018-11-15 16:33:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 16:33:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 16:33:45 [DEBUG   ] spawn_process: at 2018-11-15 16:33:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 16:33:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 16:33:45 [DEBUG   ] spawn_process: at 2018-11-15 16:33:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 16:33:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 16:33:45 [DEBUG   ] spawn_process: at 2018-11-15 16:33:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 16:33:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 16:33:45 [DEBUG   ] spawn_process: at 2018-11-15 16:33:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 16:33:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 16:33:45 [DEBUG   ] spawn_process: at 2018-11-15 16:33:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 16:33:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 16:33:45 [DEBUG   ] spawn_process: at 2018-11-15 16:33:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 16:33:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 16:33:45 [DEBUG   ] spawn_process: at 2018-11-15 16:33:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 16:33:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 16:33:45 [DEBUG   ] spawn_process: at 2018-11-15 16:33:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 16:33:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 16:33:45 [DEBUG   ] spawn_process: at 2018-11-15 16:33:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 16:33:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 16:33:45 [DEBUG   ] spawn_process: at 2018-11-15 16:33:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 16:33:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 16:33:45 [DEBUG   ] spawn_process: at 2018-11-15 16:33:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 16:33:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 16:33:45 [DEBUG   ] spawn_process: at 2018-11-15 16:33:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 16:33:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 16:33:45 [DEBUG   ] spawn_process: at 2018-11-15 16:33:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 16:33:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 16:33:45 [DEBUG   ] spawn_process: at 2018-11-15 16:33:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 16:33:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 16:33:45 [DEBUG   ] spawn_process: at 2018-11-15 16:33:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 16:33:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 16:33:45 [DEBUG   ] spawn_process: at 2018-11-15 16:33:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 16:33:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 16:33:45 [DEBUG   ] spawn_process: at 2018-11-15 16:33:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 16:33:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 16:33:45 [DEBUG   ] spawn_process: at 2018-11-15 16:33:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 16:33:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 16:33:45 [DEBUG   ] spawn_process: at 2018-11-15 16:33:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 16:33:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 16:33:45 [DEBUG   ] spawn_process: at 2018-11-15 16:33:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 16:33:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 16:33:45 [DEBUG   ] spawn_process: at 2018-11-15 16:33:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 16:33:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 16:33:45 [DEBUG   ] spawn_process: at 2018-11-15 16:33:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 16:33:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 16:33:45 [DEBUG   ] spawn_process: at 2018-11-15 16:33:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 16:33:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 16:33:45 [DEBUG   ] spawn_process: at 2018-11-15 16:33:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 16:33:56 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-15 16:34:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 16:34:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:34:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 16:34:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 16:34:00 [WARNING ] (13, 1, 'bot')
2018-11-15 16:34:00 [WARNING ] (13, 1, 'bot')
2018-11-15 16:34:00 [WARNING ] (13, 1, 'bot')
2018-11-15 16:34:00 [WARNING ] (13, 1, 'bot')
2018-11-15 16:34:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:34:00 [DEBUG   ] Finished updating board flags in 0.983 seconds
2018-11-15 16:34:06 [DEBUG   ] Got command BAM from MCS: ref #516303
2018-11-15 16:34:06 [INFO    ] Finished processing BAM request
2018-11-15 16:34:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:34:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516303   8 58437 59646034 A  ERROR'
2018-11-15 16:34:06 [DEBUG   ] Got command BAM from MCS: ref #516304
2018-11-15 16:34:06 [INFO    ] Finished processing BAM request
2018-11-15 16:34:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:34:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516304   8 58437 59646038 A  ERROR'
2018-11-15 16:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 16:34:06 [DEBUG   ] spawn_process: at 2018-11-15 16:34:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 16:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 16:34:06 [DEBUG   ] spawn_process: at 2018-11-15 16:34:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 16:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 16:34:06 [DEBUG   ] spawn_process: at 2018-11-15 16:34:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 16:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 16:34:06 [DEBUG   ] spawn_process: at 2018-11-15 16:34:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 16:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 16:34:06 [DEBUG   ] spawn_process: at 2018-11-15 16:34:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 16:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 16:34:06 [DEBUG   ] spawn_process: at 2018-11-15 16:34:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 16:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 16:34:06 [DEBUG   ] spawn_process: at 2018-11-15 16:34:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 16:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 16:34:06 [DEBUG   ] spawn_process: at 2018-11-15 16:34:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 16:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 16:34:06 [DEBUG   ] spawn_process: at 2018-11-15 16:34:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 16:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 16:34:06 [DEBUG   ] spawn_process: at 2018-11-15 16:34:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 16:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 16:34:06 [DEBUG   ] spawn_process: at 2018-11-15 16:34:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 16:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 16:34:06 [DEBUG   ] spawn_process: at 2018-11-15 16:34:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 16:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 16:34:06 [DEBUG   ] spawn_process: at 2018-11-15 16:34:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 16:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 16:34:06 [DEBUG   ] spawn_process: at 2018-11-15 16:34:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 16:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 16:34:06 [DEBUG   ] spawn_process: at 2018-11-15 16:34:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 16:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 16:34:06 [DEBUG   ] spawn_process: at 2018-11-15 16:34:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 16:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 16:34:06 [DEBUG   ] spawn_process: at 2018-11-15 16:34:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 16:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 16:34:06 [DEBUG   ] spawn_process: at 2018-11-15 16:34:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 16:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 16:34:06 [DEBUG   ] spawn_process: at 2018-11-15 16:34:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 16:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 16:34:06 [DEBUG   ] spawn_process: at 2018-11-15 16:34:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 16:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 16:34:06 [DEBUG   ] spawn_process: at 2018-11-15 16:34:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 16:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 16:34:06 [DEBUG   ] spawn_process: at 2018-11-15 16:34:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 16:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 16:34:06 [DEBUG   ] spawn_process: at 2018-11-15 16:34:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 16:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 16:34:06 [DEBUG   ] spawn_process: at 2018-11-15 16:34:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 16:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 16:34:06 [DEBUG   ] spawn_process: at 2018-11-15 16:34:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 16:34:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 16:34:06 [DEBUG   ] spawn_process: at 2018-11-15 16:34:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 16:34:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 16:34:27 [DEBUG   ] Got command BAM from MCS: ref #516306
2018-11-15 16:34:27 [INFO    ] Finished processing BAM request
2018-11-15 16:34:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:34:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516306   8 58437 59667029 A  ERROR'
2018-11-15 16:34:27 [DEBUG   ] Got command BAM from MCS: ref #516305
2018-11-15 16:34:27 [INFO    ] Finished processing BAM request
2018-11-15 16:34:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:34:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516305   8 58437 59667033 A  ERROR'
2018-11-15 16:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 16:34:27 [DEBUG   ] spawn_process: at 2018-11-15 16:34:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 16:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 16:34:27 [DEBUG   ] spawn_process: at 2018-11-15 16:34:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 16:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 16:34:27 [DEBUG   ] spawn_process: at 2018-11-15 16:34:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 16:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 16:34:27 [DEBUG   ] spawn_process: at 2018-11-15 16:34:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 16:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 16:34:27 [DEBUG   ] spawn_process: at 2018-11-15 16:34:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 16:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 16:34:27 [DEBUG   ] spawn_process: at 2018-11-15 16:34:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 16:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 16:34:27 [DEBUG   ] spawn_process: at 2018-11-15 16:34:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 16:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 16:34:27 [DEBUG   ] spawn_process: at 2018-11-15 16:34:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 16:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 16:34:27 [DEBUG   ] spawn_process: at 2018-11-15 16:34:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 16:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 16:34:27 [DEBUG   ] spawn_process: at 2018-11-15 16:34:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 16:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 16:34:27 [DEBUG   ] spawn_process: at 2018-11-15 16:34:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 16:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 16:34:27 [DEBUG   ] spawn_process: at 2018-11-15 16:34:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 16:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 16:34:27 [DEBUG   ] spawn_process: at 2018-11-15 16:34:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 16:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 16:34:27 [DEBUG   ] spawn_process: at 2018-11-15 16:34:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 16:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 16:34:27 [DEBUG   ] spawn_process: at 2018-11-15 16:34:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 16:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 16:34:27 [DEBUG   ] spawn_process: at 2018-11-15 16:34:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 16:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 16:34:27 [DEBUG   ] spawn_process: at 2018-11-15 16:34:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 16:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 16:34:27 [DEBUG   ] spawn_process: at 2018-11-15 16:34:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 16:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 16:34:27 [DEBUG   ] spawn_process: at 2018-11-15 16:34:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 16:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 16:34:27 [DEBUG   ] spawn_process: at 2018-11-15 16:34:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 16:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 16:34:27 [DEBUG   ] spawn_process: at 2018-11-15 16:34:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 16:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 16:34:27 [DEBUG   ] spawn_process: at 2018-11-15 16:34:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 16:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 16:34:27 [DEBUG   ] spawn_process: at 2018-11-15 16:34:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 16:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 16:34:27 [DEBUG   ] spawn_process: at 2018-11-15 16:34:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 16:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 16:34:27 [DEBUG   ] spawn_process: at 2018-11-15 16:34:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 16:34:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 16:34:27 [DEBUG   ] spawn_process: at 2018-11-15 16:34:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 16:34:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 16:34:48 [DEBUG   ] Got command BAM from MCS: ref #516308
2018-11-15 16:34:48 [INFO    ] Finished processing BAM request
2018-11-15 16:34:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:34:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516308   8 58437 59688025 A  ERROR'
2018-11-15 16:34:48 [DEBUG   ] Got command BAM from MCS: ref #516307
2018-11-15 16:34:48 [INFO    ] Finished processing BAM request
2018-11-15 16:34:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:34:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516307   8 58437 59688029 A  ERROR'
2018-11-15 16:34:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 16:34:48 [DEBUG   ] spawn_process: at 2018-11-15 16:34:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 16:34:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 16:34:48 [DEBUG   ] spawn_process: at 2018-11-15 16:34:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 16:34:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 16:34:48 [DEBUG   ] spawn_process: at 2018-11-15 16:34:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 16:34:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 16:34:48 [DEBUG   ] spawn_process: at 2018-11-15 16:34:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 16:34:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 16:34:48 [DEBUG   ] spawn_process: at 2018-11-15 16:34:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 16:34:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 16:34:48 [DEBUG   ] spawn_process: at 2018-11-15 16:34:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 16:34:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 16:34:48 [DEBUG   ] spawn_process: at 2018-11-15 16:34:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 16:34:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 16:34:48 [DEBUG   ] spawn_process: at 2018-11-15 16:34:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 16:34:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 16:34:48 [DEBUG   ] spawn_process: at 2018-11-15 16:34:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 16:34:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 16:34:48 [DEBUG   ] spawn_process: at 2018-11-15 16:34:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 16:34:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 16:34:48 [DEBUG   ] spawn_process: at 2018-11-15 16:34:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 16:34:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 16:34:48 [DEBUG   ] spawn_process: at 2018-11-15 16:34:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 16:34:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 16:34:48 [DEBUG   ] spawn_process: at 2018-11-15 16:34:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 16:34:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 16:34:48 [DEBUG   ] spawn_process: at 2018-11-15 16:34:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 16:34:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 16:34:48 [DEBUG   ] spawn_process: at 2018-11-15 16:34:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 16:34:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 16:34:48 [DEBUG   ] spawn_process: at 2018-11-15 16:34:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 16:34:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 16:34:48 [DEBUG   ] spawn_process: at 2018-11-15 16:34:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 16:34:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 16:34:48 [DEBUG   ] spawn_process: at 2018-11-15 16:34:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 16:34:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 16:34:48 [DEBUG   ] spawn_process: at 2018-11-15 16:34:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 16:34:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 16:34:48 [DEBUG   ] spawn_process: at 2018-11-15 16:34:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 16:34:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 16:34:48 [DEBUG   ] spawn_process: at 2018-11-15 16:34:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 16:34:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 16:34:48 [DEBUG   ] spawn_process: at 2018-11-15 16:34:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 16:34:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 16:34:48 [DEBUG   ] spawn_process: at 2018-11-15 16:34:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 16:34:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 16:34:48 [DEBUG   ] spawn_process: at 2018-11-15 16:34:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 16:34:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 16:34:48 [DEBUG   ] spawn_process: at 2018-11-15 16:34:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 16:34:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 16:34:48 [DEBUG   ] spawn_process: at 2018-11-15 16:34:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 16:34:56 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-15 16:35:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 16:35:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:35:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 16:35:01 [WARNING ] (13, 1, 'bot')
2018-11-15 16:35:01 [WARNING ] (13, 1, 'bot')
2018-11-15 16:35:01 [WARNING ] (13, 1, 'bot')
2018-11-15 16:35:01 [WARNING ] (13, 1, 'bot')
2018-11-15 16:35:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:35:01 [DEBUG   ] Finished updating board flags in 1.361 seconds
2018-11-15 16:35:09 [DEBUG   ] Got command BAM from MCS: ref #516310
2018-11-15 16:35:09 [INFO    ] Finished processing BAM request
2018-11-15 16:35:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:35:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516310   8 58437 59709033 A  ERROR'
2018-11-15 16:35:09 [DEBUG   ] Got command BAM from MCS: ref #516309
2018-11-15 16:35:09 [INFO    ] Finished processing BAM request
2018-11-15 16:35:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:35:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516309   8 58437 59709037 A  ERROR'
2018-11-15 16:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 16:35:09 [DEBUG   ] spawn_process: at 2018-11-15 16:35:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 16:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 16:35:09 [DEBUG   ] spawn_process: at 2018-11-15 16:35:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 16:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 16:35:09 [DEBUG   ] spawn_process: at 2018-11-15 16:35:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 16:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 16:35:09 [DEBUG   ] spawn_process: at 2018-11-15 16:35:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 16:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 16:35:09 [DEBUG   ] spawn_process: at 2018-11-15 16:35:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 16:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 16:35:09 [DEBUG   ] spawn_process: at 2018-11-15 16:35:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 16:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 16:35:09 [DEBUG   ] spawn_process: at 2018-11-15 16:35:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 16:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 16:35:09 [DEBUG   ] spawn_process: at 2018-11-15 16:35:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 16:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 16:35:09 [DEBUG   ] spawn_process: at 2018-11-15 16:35:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 16:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 16:35:09 [DEBUG   ] spawn_process: at 2018-11-15 16:35:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 16:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 16:35:09 [DEBUG   ] spawn_process: at 2018-11-15 16:35:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 16:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 16:35:09 [DEBUG   ] spawn_process: at 2018-11-15 16:35:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 16:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 16:35:09 [DEBUG   ] spawn_process: at 2018-11-15 16:35:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 16:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 16:35:09 [DEBUG   ] spawn_process: at 2018-11-15 16:35:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 16:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 16:35:09 [DEBUG   ] spawn_process: at 2018-11-15 16:35:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 16:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 16:35:09 [DEBUG   ] spawn_process: at 2018-11-15 16:35:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 16:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 16:35:09 [DEBUG   ] spawn_process: at 2018-11-15 16:35:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 16:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 16:35:09 [DEBUG   ] spawn_process: at 2018-11-15 16:35:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 16:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 16:35:09 [DEBUG   ] spawn_process: at 2018-11-15 16:35:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 16:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 16:35:09 [DEBUG   ] spawn_process: at 2018-11-15 16:35:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 16:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 16:35:09 [DEBUG   ] spawn_process: at 2018-11-15 16:35:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 16:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 16:35:09 [DEBUG   ] spawn_process: at 2018-11-15 16:35:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 16:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 16:35:09 [DEBUG   ] spawn_process: at 2018-11-15 16:35:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 16:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 16:35:09 [DEBUG   ] spawn_process: at 2018-11-15 16:35:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 16:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 16:35:09 [DEBUG   ] spawn_process: at 2018-11-15 16:35:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 16:35:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 16:35:09 [DEBUG   ] spawn_process: at 2018-11-15 16:35:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 16:35:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 16:35:30 [DEBUG   ] Got command BAM from MCS: ref #516316
2018-11-15 16:35:30 [INFO    ] Finished processing BAM request
2018-11-15 16:35:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:35:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516316   8 58437 59730033 A  ERROR'
2018-11-15 16:35:30 [DEBUG   ] Got command BAM from MCS: ref #516315
2018-11-15 16:35:30 [INFO    ] Finished processing BAM request
2018-11-15 16:35:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:35:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516315   8 58437 59730037 A  ERROR'
2018-11-15 16:35:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 16:35:30 [DEBUG   ] spawn_process: at 2018-11-15 16:35:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 16:35:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 16:35:30 [DEBUG   ] spawn_process: at 2018-11-15 16:35:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 16:35:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 16:35:30 [DEBUG   ] spawn_process: at 2018-11-15 16:35:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 16:35:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 16:35:30 [DEBUG   ] spawn_process: at 2018-11-15 16:35:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 16:35:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 16:35:30 [DEBUG   ] spawn_process: at 2018-11-15 16:35:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 16:35:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 16:35:30 [DEBUG   ] spawn_process: at 2018-11-15 16:35:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 16:35:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 16:35:30 [DEBUG   ] spawn_process: at 2018-11-15 16:35:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 16:35:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 16:35:30 [DEBUG   ] spawn_process: at 2018-11-15 16:35:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 16:35:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 16:35:30 [DEBUG   ] spawn_process: at 2018-11-15 16:35:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 16:35:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 16:35:30 [DEBUG   ] spawn_process: at 2018-11-15 16:35:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 16:35:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 16:35:30 [DEBUG   ] spawn_process: at 2018-11-15 16:35:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 16:35:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 16:35:30 [DEBUG   ] spawn_process: at 2018-11-15 16:35:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 16:35:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 16:35:30 [DEBUG   ] spawn_process: at 2018-11-15 16:35:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 16:35:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 16:35:30 [DEBUG   ] spawn_process: at 2018-11-15 16:35:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 16:35:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 16:35:30 [DEBUG   ] spawn_process: at 2018-11-15 16:35:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 16:35:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 16:35:30 [DEBUG   ] spawn_process: at 2018-11-15 16:35:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 16:35:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 16:35:30 [DEBUG   ] spawn_process: at 2018-11-15 16:35:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 16:35:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 16:35:30 [DEBUG   ] spawn_process: at 2018-11-15 16:35:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 16:35:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 16:35:30 [DEBUG   ] spawn_process: at 2018-11-15 16:35:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 16:35:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 16:35:30 [DEBUG   ] spawn_process: at 2018-11-15 16:35:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 16:35:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 16:35:30 [DEBUG   ] spawn_process: at 2018-11-15 16:35:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 16:35:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 16:35:30 [DEBUG   ] spawn_process: at 2018-11-15 16:35:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 16:35:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 16:35:30 [DEBUG   ] spawn_process: at 2018-11-15 16:35:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 16:35:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 16:35:30 [DEBUG   ] spawn_process: at 2018-11-15 16:35:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 16:35:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 16:35:30 [DEBUG   ] spawn_process: at 2018-11-15 16:35:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 16:35:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 16:35:30 [DEBUG   ] spawn_process: at 2018-11-15 16:35:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 16:35:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 16:35:45 [DEBUG   ] Got command RPT from MCS: ref #516317
2018-11-15 16:35:45 [DEBUG   ] summary = ERROR
2018-11-15 16:35:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516317  13 58437 59745133 A  ERRORERROR'
2018-11-15 16:35:45 [DEBUG   ] Got command RPT from MCS: ref #516318
2018-11-15 16:35:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 16:35:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516318  77 58437 59745134 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 16:35:51 [DEBUG   ] Got command BAM from MCS: ref #516335
2018-11-15 16:35:51 [INFO    ] Finished processing BAM request
2018-11-15 16:35:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:35:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516335   8 58437 59751029 A  ERROR'
2018-11-15 16:35:51 [DEBUG   ] Got command BAM from MCS: ref #516334
2018-11-15 16:35:51 [INFO    ] Finished processing BAM request
2018-11-15 16:35:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:35:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516334   8 58437 59751033 A  ERROR'
2018-11-15 16:35:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 16:35:51 [DEBUG   ] spawn_process: at 2018-11-15 16:35:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 16:35:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 16:35:51 [DEBUG   ] spawn_process: at 2018-11-15 16:35:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 16:35:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 16:35:51 [DEBUG   ] spawn_process: at 2018-11-15 16:35:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 16:35:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 16:35:51 [DEBUG   ] spawn_process: at 2018-11-15 16:35:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 16:35:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 16:35:51 [DEBUG   ] spawn_process: at 2018-11-15 16:35:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 16:35:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 16:35:51 [DEBUG   ] spawn_process: at 2018-11-15 16:35:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 16:35:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 16:35:51 [DEBUG   ] spawn_process: at 2018-11-15 16:35:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 16:35:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 16:35:51 [DEBUG   ] spawn_process: at 2018-11-15 16:35:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 16:35:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 16:35:51 [DEBUG   ] spawn_process: at 2018-11-15 16:35:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 16:35:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 16:35:51 [DEBUG   ] spawn_process: at 2018-11-15 16:35:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 16:35:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 16:35:51 [DEBUG   ] spawn_process: at 2018-11-15 16:35:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 16:35:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 16:35:51 [DEBUG   ] spawn_process: at 2018-11-15 16:35:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 16:35:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 16:35:51 [DEBUG   ] spawn_process: at 2018-11-15 16:35:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 16:35:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 16:35:51 [DEBUG   ] spawn_process: at 2018-11-15 16:35:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 16:35:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 16:35:51 [DEBUG   ] spawn_process: at 2018-11-15 16:35:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 16:35:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 16:35:51 [DEBUG   ] spawn_process: at 2018-11-15 16:35:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 16:35:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 16:35:51 [DEBUG   ] spawn_process: at 2018-11-15 16:35:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 16:35:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 16:35:51 [DEBUG   ] spawn_process: at 2018-11-15 16:35:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 16:35:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 16:35:51 [DEBUG   ] spawn_process: at 2018-11-15 16:35:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 16:35:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 16:35:51 [DEBUG   ] spawn_process: at 2018-11-15 16:35:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 16:35:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 16:35:51 [DEBUG   ] spawn_process: at 2018-11-15 16:35:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 16:35:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 16:35:51 [DEBUG   ] spawn_process: at 2018-11-15 16:35:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 16:35:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 16:35:51 [DEBUG   ] spawn_process: at 2018-11-15 16:35:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 16:35:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 16:35:51 [DEBUG   ] spawn_process: at 2018-11-15 16:35:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 16:35:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 16:35:51 [DEBUG   ] spawn_process: at 2018-11-15 16:35:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 16:35:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 16:35:51 [DEBUG   ] spawn_process: at 2018-11-15 16:35:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 16:35:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 16:36:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 16:36:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 16:36:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:36:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-15 16:36:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 16:36:01 [WARNING ] (13, 1, 'bot')
2018-11-15 16:36:01 [WARNING ] (13, 1, 'bot')
2018-11-15 16:36:01 [WARNING ] (13, 1, 'bot')
2018-11-15 16:36:01 [WARNING ] (13, 1, 'bot')
2018-11-15 16:36:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:36:01 [DEBUG   ] Finished updating board flags in 1.198 seconds
2018-11-15 16:36:12 [DEBUG   ] Got command BAM from MCS: ref #516337
2018-11-15 16:36:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:36:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516337   8 58437 59772025 A  ERROR'
2018-11-15 16:36:12 [DEBUG   ] Got command BAM from MCS: ref #516336
2018-11-15 16:36:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:36:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516336   8 58437 59772029 A  ERROR'
2018-11-15 16:36:12 [INFO    ] Finished processing BAM request
2018-11-15 16:36:12 [INFO    ] Finished processing BAM request
2018-11-15 16:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 16:36:12 [DEBUG   ] spawn_process: at 2018-11-15 16:36:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 16:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 16:36:12 [DEBUG   ] spawn_process: at 2018-11-15 16:36:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 16:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 16:36:12 [DEBUG   ] spawn_process: at 2018-11-15 16:36:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 16:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 16:36:12 [DEBUG   ] spawn_process: at 2018-11-15 16:36:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 16:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 16:36:12 [DEBUG   ] spawn_process: at 2018-11-15 16:36:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 16:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 16:36:12 [DEBUG   ] spawn_process: at 2018-11-15 16:36:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 16:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 16:36:12 [DEBUG   ] spawn_process: at 2018-11-15 16:36:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 16:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 16:36:12 [DEBUG   ] spawn_process: at 2018-11-15 16:36:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 16:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 16:36:12 [DEBUG   ] spawn_process: at 2018-11-15 16:36:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 16:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 16:36:12 [DEBUG   ] spawn_process: at 2018-11-15 16:36:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 16:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 16:36:12 [DEBUG   ] spawn_process: at 2018-11-15 16:36:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 16:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 16:36:12 [DEBUG   ] spawn_process: at 2018-11-15 16:36:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 16:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 16:36:12 [DEBUG   ] spawn_process: at 2018-11-15 16:36:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 16:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 16:36:12 [DEBUG   ] spawn_process: at 2018-11-15 16:36:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 16:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 16:36:12 [DEBUG   ] spawn_process: at 2018-11-15 16:36:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 16:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 16:36:12 [DEBUG   ] spawn_process: at 2018-11-15 16:36:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 16:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 16:36:12 [DEBUG   ] spawn_process: at 2018-11-15 16:36:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 16:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 16:36:12 [DEBUG   ] spawn_process: at 2018-11-15 16:36:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 16:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 16:36:12 [DEBUG   ] spawn_process: at 2018-11-15 16:36:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 16:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 16:36:12 [DEBUG   ] spawn_process: at 2018-11-15 16:36:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 16:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 16:36:12 [DEBUG   ] spawn_process: at 2018-11-15 16:36:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 16:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 16:36:12 [DEBUG   ] spawn_process: at 2018-11-15 16:36:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 16:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 16:36:12 [DEBUG   ] spawn_process: at 2018-11-15 16:36:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 16:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 16:36:12 [DEBUG   ] spawn_process: at 2018-11-15 16:36:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 16:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 16:36:12 [DEBUG   ] spawn_process: at 2018-11-15 16:36:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 16:36:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 16:36:12 [DEBUG   ] spawn_process: at 2018-11-15 16:36:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 16:36:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 16:36:33 [DEBUG   ] Got command BAM from MCS: ref #516339
2018-11-15 16:36:33 [INFO    ] Finished processing BAM request
2018-11-15 16:36:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:36:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516339   8 58437 59793025 A  ERROR'
2018-11-15 16:36:33 [DEBUG   ] Got command BAM from MCS: ref #516338
2018-11-15 16:36:33 [INFO    ] Finished processing BAM request
2018-11-15 16:36:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:36:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516338   8 58437 59793029 A  ERROR'
2018-11-15 16:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 16:36:33 [DEBUG   ] spawn_process: at 2018-11-15 16:36:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 16:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 16:36:33 [DEBUG   ] spawn_process: at 2018-11-15 16:36:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 16:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 16:36:33 [DEBUG   ] spawn_process: at 2018-11-15 16:36:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 16:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 16:36:33 [DEBUG   ] spawn_process: at 2018-11-15 16:36:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 16:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 16:36:33 [DEBUG   ] spawn_process: at 2018-11-15 16:36:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 16:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 16:36:33 [DEBUG   ] spawn_process: at 2018-11-15 16:36:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 16:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 16:36:33 [DEBUG   ] spawn_process: at 2018-11-15 16:36:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 16:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 16:36:33 [DEBUG   ] spawn_process: at 2018-11-15 16:36:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 16:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 16:36:33 [DEBUG   ] spawn_process: at 2018-11-15 16:36:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 16:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 16:36:33 [DEBUG   ] spawn_process: at 2018-11-15 16:36:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 16:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 16:36:33 [DEBUG   ] spawn_process: at 2018-11-15 16:36:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 16:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 16:36:33 [DEBUG   ] spawn_process: at 2018-11-15 16:36:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 16:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 16:36:33 [DEBUG   ] spawn_process: at 2018-11-15 16:36:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 16:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 16:36:33 [DEBUG   ] spawn_process: at 2018-11-15 16:36:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 16:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 16:36:33 [DEBUG   ] spawn_process: at 2018-11-15 16:36:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 16:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 16:36:33 [DEBUG   ] spawn_process: at 2018-11-15 16:36:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 16:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 16:36:33 [DEBUG   ] spawn_process: at 2018-11-15 16:36:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 16:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 16:36:33 [DEBUG   ] spawn_process: at 2018-11-15 16:36:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 16:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 16:36:33 [DEBUG   ] spawn_process: at 2018-11-15 16:36:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 16:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 16:36:33 [DEBUG   ] spawn_process: at 2018-11-15 16:36:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 16:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 16:36:33 [DEBUG   ] spawn_process: at 2018-11-15 16:36:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 16:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 16:36:33 [DEBUG   ] spawn_process: at 2018-11-15 16:36:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 16:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 16:36:33 [DEBUG   ] spawn_process: at 2018-11-15 16:36:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 16:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 16:36:33 [DEBUG   ] spawn_process: at 2018-11-15 16:36:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 16:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 16:36:33 [DEBUG   ] spawn_process: at 2018-11-15 16:36:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 16:36:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 16:36:33 [DEBUG   ] spawn_process: at 2018-11-15 16:36:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 16:36:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 16:36:54 [DEBUG   ] Got command BAM from MCS: ref #516340
2018-11-15 16:36:54 [INFO    ] Finished processing BAM request
2018-11-15 16:36:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:36:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516340   8 58437 59814033 A  ERROR'
2018-11-15 16:36:54 [DEBUG   ] Got command BAM from MCS: ref #516341
2018-11-15 16:36:54 [INFO    ] Finished processing BAM request
2018-11-15 16:36:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:36:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516341   8 58437 59814037 A  ERROR'
2018-11-15 16:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 16:36:54 [DEBUG   ] spawn_process: at 2018-11-15 16:36:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 16:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 16:36:54 [DEBUG   ] spawn_process: at 2018-11-15 16:36:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 16:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 16:36:54 [DEBUG   ] spawn_process: at 2018-11-15 16:36:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 16:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 16:36:54 [DEBUG   ] spawn_process: at 2018-11-15 16:36:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 16:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 16:36:54 [DEBUG   ] spawn_process: at 2018-11-15 16:36:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 16:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 16:36:54 [DEBUG   ] spawn_process: at 2018-11-15 16:36:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 16:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 16:36:54 [DEBUG   ] spawn_process: at 2018-11-15 16:36:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 16:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 16:36:54 [DEBUG   ] spawn_process: at 2018-11-15 16:36:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 16:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 16:36:54 [DEBUG   ] spawn_process: at 2018-11-15 16:36:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 16:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 16:36:54 [DEBUG   ] spawn_process: at 2018-11-15 16:36:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 16:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 16:36:54 [DEBUG   ] spawn_process: at 2018-11-15 16:36:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 16:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 16:36:54 [DEBUG   ] spawn_process: at 2018-11-15 16:36:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 16:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 16:36:54 [DEBUG   ] spawn_process: at 2018-11-15 16:36:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 16:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 16:36:54 [DEBUG   ] spawn_process: at 2018-11-15 16:36:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 16:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 16:36:54 [DEBUG   ] spawn_process: at 2018-11-15 16:36:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 16:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 16:36:54 [DEBUG   ] spawn_process: at 2018-11-15 16:36:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 16:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 16:36:54 [DEBUG   ] spawn_process: at 2018-11-15 16:36:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 16:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 16:36:54 [DEBUG   ] spawn_process: at 2018-11-15 16:36:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 16:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 16:36:54 [DEBUG   ] spawn_process: at 2018-11-15 16:36:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 16:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 16:36:54 [DEBUG   ] spawn_process: at 2018-11-15 16:36:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 16:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 16:36:54 [DEBUG   ] spawn_process: at 2018-11-15 16:36:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 16:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 16:36:54 [DEBUG   ] spawn_process: at 2018-11-15 16:36:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 16:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 16:36:54 [DEBUG   ] spawn_process: at 2018-11-15 16:36:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 16:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 16:36:54 [DEBUG   ] spawn_process: at 2018-11-15 16:36:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 16:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 16:36:54 [DEBUG   ] spawn_process: at 2018-11-15 16:36:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 16:36:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 16:36:54 [DEBUG   ] spawn_process: at 2018-11-15 16:36:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 16:36:56 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-15 16:37:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 16:37:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:37:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 16:37:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 16:37:01 [WARNING ] (13, 1, 'bot')
2018-11-15 16:37:01 [WARNING ] (13, 1, 'bot')
2018-11-15 16:37:01 [WARNING ] (13, 1, 'bot')
2018-11-15 16:37:01 [WARNING ] (13, 1, 'bot')
2018-11-15 16:37:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:37:01 [DEBUG   ] Finished updating board flags in 0.996 seconds
2018-11-15 16:37:15 [DEBUG   ] Got command BAM from MCS: ref #516342
2018-11-15 16:37:15 [INFO    ] Finished processing BAM request
2018-11-15 16:37:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:37:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516342   8 58437 59835025 A  ERROR'
2018-11-15 16:37:15 [DEBUG   ] Got command BAM from MCS: ref #516343
2018-11-15 16:37:15 [INFO    ] Finished processing BAM request
2018-11-15 16:37:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:37:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516343   8 58437 59835029 A  ERROR'
2018-11-15 16:37:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 16:37:15 [DEBUG   ] spawn_process: at 2018-11-15 16:37:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 16:37:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 16:37:15 [DEBUG   ] spawn_process: at 2018-11-15 16:37:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 16:37:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 16:37:15 [DEBUG   ] spawn_process: at 2018-11-15 16:37:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 16:37:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 16:37:15 [DEBUG   ] spawn_process: at 2018-11-15 16:37:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 16:37:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 16:37:15 [DEBUG   ] spawn_process: at 2018-11-15 16:37:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 16:37:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 16:37:15 [DEBUG   ] spawn_process: at 2018-11-15 16:37:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 16:37:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 16:37:15 [DEBUG   ] spawn_process: at 2018-11-15 16:37:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 16:37:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 16:37:15 [DEBUG   ] spawn_process: at 2018-11-15 16:37:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 16:37:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 16:37:15 [DEBUG   ] spawn_process: at 2018-11-15 16:37:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 16:37:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 16:37:15 [DEBUG   ] spawn_process: at 2018-11-15 16:37:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 16:37:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 16:37:15 [DEBUG   ] spawn_process: at 2018-11-15 16:37:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 16:37:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 16:37:15 [DEBUG   ] spawn_process: at 2018-11-15 16:37:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 16:37:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 16:37:15 [DEBUG   ] spawn_process: at 2018-11-15 16:37:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 16:37:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 16:37:15 [DEBUG   ] spawn_process: at 2018-11-15 16:37:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 16:37:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 16:37:15 [DEBUG   ] spawn_process: at 2018-11-15 16:37:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 16:37:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 16:37:15 [DEBUG   ] spawn_process: at 2018-11-15 16:37:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 16:37:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 16:37:15 [DEBUG   ] spawn_process: at 2018-11-15 16:37:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 16:37:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 16:37:15 [DEBUG   ] spawn_process: at 2018-11-15 16:37:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 16:37:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 16:37:15 [DEBUG   ] spawn_process: at 2018-11-15 16:37:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 16:37:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 16:37:15 [DEBUG   ] spawn_process: at 2018-11-15 16:37:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 16:37:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 16:37:15 [DEBUG   ] spawn_process: at 2018-11-15 16:37:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 16:37:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 16:37:15 [DEBUG   ] spawn_process: at 2018-11-15 16:37:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 16:37:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 16:37:15 [DEBUG   ] spawn_process: at 2018-11-15 16:37:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 16:37:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 16:37:15 [DEBUG   ] spawn_process: at 2018-11-15 16:37:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 16:37:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 16:37:15 [DEBUG   ] spawn_process: at 2018-11-15 16:37:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 16:37:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 16:37:15 [DEBUG   ] spawn_process: at 2018-11-15 16:37:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 16:37:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 16:37:36 [DEBUG   ] Got command BAM from MCS: ref #516345
2018-11-15 16:37:36 [INFO    ] Finished processing BAM request
2018-11-15 16:37:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:37:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516345   8 58437 59856025 A  ERROR'
2018-11-15 16:37:36 [DEBUG   ] Got command BAM from MCS: ref #516344
2018-11-15 16:37:36 [INFO    ] Finished processing BAM request
2018-11-15 16:37:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:37:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516344   8 58437 59856029 A  ERROR'
2018-11-15 16:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 16:37:36 [DEBUG   ] spawn_process: at 2018-11-15 16:37:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 16:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 16:37:36 [DEBUG   ] spawn_process: at 2018-11-15 16:37:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 16:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 16:37:36 [DEBUG   ] spawn_process: at 2018-11-15 16:37:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 16:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 16:37:36 [DEBUG   ] spawn_process: at 2018-11-15 16:37:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 16:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 16:37:36 [DEBUG   ] spawn_process: at 2018-11-15 16:37:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 16:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 16:37:36 [DEBUG   ] spawn_process: at 2018-11-15 16:37:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 16:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 16:37:36 [DEBUG   ] spawn_process: at 2018-11-15 16:37:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 16:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 16:37:36 [DEBUG   ] spawn_process: at 2018-11-15 16:37:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 16:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 16:37:36 [DEBUG   ] spawn_process: at 2018-11-15 16:37:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 16:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 16:37:36 [DEBUG   ] spawn_process: at 2018-11-15 16:37:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 16:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 16:37:36 [DEBUG   ] spawn_process: at 2018-11-15 16:37:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 16:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 16:37:36 [DEBUG   ] spawn_process: at 2018-11-15 16:37:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 16:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 16:37:36 [DEBUG   ] spawn_process: at 2018-11-15 16:37:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 16:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 16:37:36 [DEBUG   ] spawn_process: at 2018-11-15 16:37:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 16:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 16:37:36 [DEBUG   ] spawn_process: at 2018-11-15 16:37:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 16:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 16:37:36 [DEBUG   ] spawn_process: at 2018-11-15 16:37:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 16:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 16:37:36 [DEBUG   ] spawn_process: at 2018-11-15 16:37:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 16:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 16:37:36 [DEBUG   ] spawn_process: at 2018-11-15 16:37:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 16:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 16:37:36 [DEBUG   ] spawn_process: at 2018-11-15 16:37:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 16:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 16:37:36 [DEBUG   ] spawn_process: at 2018-11-15 16:37:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 16:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 16:37:36 [DEBUG   ] spawn_process: at 2018-11-15 16:37:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 16:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 16:37:36 [DEBUG   ] spawn_process: at 2018-11-15 16:37:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 16:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 16:37:36 [DEBUG   ] spawn_process: at 2018-11-15 16:37:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 16:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 16:37:36 [DEBUG   ] spawn_process: at 2018-11-15 16:37:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 16:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 16:37:36 [DEBUG   ] spawn_process: at 2018-11-15 16:37:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 16:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 16:37:36 [DEBUG   ] spawn_process: at 2018-11-15 16:37:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 16:37:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 16:37:57 [DEBUG   ] Got command BAM from MCS: ref #516346
2018-11-15 16:37:57 [INFO    ] Finished processing BAM request
2018-11-15 16:37:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:37:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516346   8 58437 59877033 A  ERROR'
2018-11-15 16:37:57 [DEBUG   ] Got command BAM from MCS: ref #516347
2018-11-15 16:37:57 [INFO    ] Finished processing BAM request
2018-11-15 16:37:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:37:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516347   8 58437 59877041 A  ERROR'
2018-11-15 16:37:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 16:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 16:37:57 [DEBUG   ] spawn_process: at 2018-11-15 16:37:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 16:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 16:37:57 [DEBUG   ] spawn_process: at 2018-11-15 16:37:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 16:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 16:37:57 [DEBUG   ] spawn_process: at 2018-11-15 16:37:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 16:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 16:37:57 [DEBUG   ] spawn_process: at 2018-11-15 16:37:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 16:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 16:37:57 [DEBUG   ] spawn_process: at 2018-11-15 16:37:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 16:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 16:37:57 [DEBUG   ] spawn_process: at 2018-11-15 16:37:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 16:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 16:37:57 [DEBUG   ] spawn_process: at 2018-11-15 16:37:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 16:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 16:37:57 [DEBUG   ] spawn_process: at 2018-11-15 16:37:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 16:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 16:37:57 [DEBUG   ] spawn_process: at 2018-11-15 16:37:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 16:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 16:37:57 [DEBUG   ] spawn_process: at 2018-11-15 16:37:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 16:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 16:37:57 [DEBUG   ] spawn_process: at 2018-11-15 16:37:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 16:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 16:37:57 [DEBUG   ] spawn_process: at 2018-11-15 16:37:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 16:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 16:37:57 [DEBUG   ] spawn_process: at 2018-11-15 16:37:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 16:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 16:37:57 [DEBUG   ] spawn_process: at 2018-11-15 16:37:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 16:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 16:37:57 [DEBUG   ] spawn_process: at 2018-11-15 16:37:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 16:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 16:37:57 [DEBUG   ] spawn_process: at 2018-11-15 16:37:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 16:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 16:37:57 [DEBUG   ] spawn_process: at 2018-11-15 16:37:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 16:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 16:37:57 [DEBUG   ] spawn_process: at 2018-11-15 16:37:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 16:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 16:37:57 [DEBUG   ] spawn_process: at 2018-11-15 16:37:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 16:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 16:37:57 [DEBUG   ] spawn_process: at 2018-11-15 16:37:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 16:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 16:37:57 [DEBUG   ] spawn_process: at 2018-11-15 16:37:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 16:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 16:37:57 [DEBUG   ] spawn_process: at 2018-11-15 16:37:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 16:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 16:37:57 [DEBUG   ] spawn_process: at 2018-11-15 16:37:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 16:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 16:37:57 [DEBUG   ] spawn_process: at 2018-11-15 16:37:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 16:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 16:37:57 [DEBUG   ] spawn_process: at 2018-11-15 16:37:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 16:37:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 16:37:57 [DEBUG   ] spawn_process: at 2018-11-15 16:37:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 16:38:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 16:38:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-15 16:38:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:38:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-15 16:38:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 16:38:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-11-15 16:38:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 16:38:01 [WARNING ] (13, 1, 'bot')
2018-11-15 16:38:01 [WARNING ] (13, 1, 'bot')
2018-11-15 16:38:01 [WARNING ] (13, 1, 'bot')
2018-11-15 16:38:01 [WARNING ] (13, 1, 'bot')
2018-11-15 16:38:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:38:01 [DEBUG   ] Finished updating board flags in 1.257 seconds
2018-11-15 16:38:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 16:38:18 [DEBUG   ] Got command BAM from MCS: ref #516351
2018-11-15 16:38:18 [INFO    ] Finished processing BAM request
2018-11-15 16:38:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:38:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516351   8 58437 59898029 A  ERROR'
2018-11-15 16:38:18 [DEBUG   ] Got command BAM from MCS: ref #516350
2018-11-15 16:38:18 [INFO    ] Finished processing BAM request
2018-11-15 16:38:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:38:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516350   8 58437 59898033 A  ERROR'
2018-11-15 16:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 16:38:18 [DEBUG   ] spawn_process: at 2018-11-15 16:38:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 16:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 16:38:18 [DEBUG   ] spawn_process: at 2018-11-15 16:38:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 16:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 16:38:18 [DEBUG   ] spawn_process: at 2018-11-15 16:38:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 16:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 16:38:18 [DEBUG   ] spawn_process: at 2018-11-15 16:38:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 16:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 16:38:18 [DEBUG   ] spawn_process: at 2018-11-15 16:38:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 16:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 16:38:18 [DEBUG   ] spawn_process: at 2018-11-15 16:38:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 16:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 16:38:18 [DEBUG   ] spawn_process: at 2018-11-15 16:38:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 16:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 16:38:18 [DEBUG   ] spawn_process: at 2018-11-15 16:38:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 16:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 16:38:18 [DEBUG   ] spawn_process: at 2018-11-15 16:38:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 16:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 16:38:18 [DEBUG   ] spawn_process: at 2018-11-15 16:38:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 16:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 16:38:18 [DEBUG   ] spawn_process: at 2018-11-15 16:38:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 16:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 16:38:18 [DEBUG   ] spawn_process: at 2018-11-15 16:38:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 16:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 16:38:18 [DEBUG   ] spawn_process: at 2018-11-15 16:38:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 16:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 16:38:18 [DEBUG   ] spawn_process: at 2018-11-15 16:38:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 16:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 16:38:18 [DEBUG   ] spawn_process: at 2018-11-15 16:38:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 16:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 16:38:18 [DEBUG   ] spawn_process: at 2018-11-15 16:38:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 16:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 16:38:18 [DEBUG   ] spawn_process: at 2018-11-15 16:38:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 16:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 16:38:18 [DEBUG   ] spawn_process: at 2018-11-15 16:38:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 16:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 16:38:18 [DEBUG   ] spawn_process: at 2018-11-15 16:38:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 16:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 16:38:18 [DEBUG   ] spawn_process: at 2018-11-15 16:38:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 16:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 16:38:18 [DEBUG   ] spawn_process: at 2018-11-15 16:38:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 16:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 16:38:18 [DEBUG   ] spawn_process: at 2018-11-15 16:38:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 16:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 16:38:18 [DEBUG   ] spawn_process: at 2018-11-15 16:38:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 16:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 16:38:18 [DEBUG   ] spawn_process: at 2018-11-15 16:38:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 16:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 16:38:18 [DEBUG   ] spawn_process: at 2018-11-15 16:38:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 16:38:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 16:38:18 [DEBUG   ] spawn_process: at 2018-11-15 16:38:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 16:38:19 [DEBUG   ] Got command RPT from MCS: ref #516352
2018-11-15 16:38:19 [DEBUG   ] summary = ERROR
2018-11-15 16:38:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516352  13 58437 59899677 A  ERRORERROR'
2018-11-15 16:38:19 [DEBUG   ] Got command RPT from MCS: ref #516353
2018-11-15 16:38:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 16:38:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516353  77 58437 59899869 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 16:38:20 [DEBUG   ] Got command RPT from MCS: ref #516354
2018-11-15 16:38:20 [DEBUG   ] summary = ERROR
2018-11-15 16:38:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516354  13 58437 59900073 A  ERRORERROR'
2018-11-15 16:38:20 [DEBUG   ] Got command RPT from MCS: ref #516356
2018-11-15 16:38:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 16:38:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516356  77 58437 59900277 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 16:38:20 [DEBUG   ] Got command RPT from MCS: ref #516357
2018-11-15 16:38:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 16:38:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516357  12 58437 59900481 A  ERRORB¢ff'
2018-11-15 16:38:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 16:38:39 [DEBUG   ] Got command BAM from MCS: ref #516366
2018-11-15 16:38:39 [INFO    ] Finished processing BAM request
2018-11-15 16:38:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516366   8 58437 59919025 A  ERROR'
2018-11-15 16:38:39 [DEBUG   ] Got command BAM from MCS: ref #516367
2018-11-15 16:38:39 [INFO    ] Finished processing BAM request
2018-11-15 16:38:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516367   8 58437 59919029 A  ERROR'
2018-11-15 16:38:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 16:38:39 [DEBUG   ] spawn_process: at 2018-11-15 16:38:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 16:38:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 16:38:39 [DEBUG   ] spawn_process: at 2018-11-15 16:38:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 16:38:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 16:38:39 [DEBUG   ] spawn_process: at 2018-11-15 16:38:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 16:38:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 16:38:39 [DEBUG   ] spawn_process: at 2018-11-15 16:38:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 16:38:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 16:38:39 [DEBUG   ] spawn_process: at 2018-11-15 16:38:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 16:38:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 16:38:39 [DEBUG   ] spawn_process: at 2018-11-15 16:38:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 16:38:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 16:38:39 [DEBUG   ] spawn_process: at 2018-11-15 16:38:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 16:38:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 16:38:39 [DEBUG   ] spawn_process: at 2018-11-15 16:38:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 16:38:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 16:38:39 [DEBUG   ] spawn_process: at 2018-11-15 16:38:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 16:38:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 16:38:39 [DEBUG   ] spawn_process: at 2018-11-15 16:38:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 16:38:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 16:38:39 [DEBUG   ] spawn_process: at 2018-11-15 16:38:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 16:38:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 16:38:39 [DEBUG   ] spawn_process: at 2018-11-15 16:38:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 16:38:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 16:38:39 [DEBUG   ] spawn_process: at 2018-11-15 16:38:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 16:38:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 16:38:39 [DEBUG   ] spawn_process: at 2018-11-15 16:38:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 16:38:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 16:38:39 [DEBUG   ] spawn_process: at 2018-11-15 16:38:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 16:38:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 16:38:39 [DEBUG   ] spawn_process: at 2018-11-15 16:38:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 16:38:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 16:38:39 [DEBUG   ] spawn_process: at 2018-11-15 16:38:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 16:38:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 16:38:39 [DEBUG   ] spawn_process: at 2018-11-15 16:38:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 16:38:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 16:38:39 [DEBUG   ] spawn_process: at 2018-11-15 16:38:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 16:38:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 16:38:39 [DEBUG   ] spawn_process: at 2018-11-15 16:38:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 16:38:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 16:38:39 [DEBUG   ] spawn_process: at 2018-11-15 16:38:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 16:38:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 16:38:39 [DEBUG   ] spawn_process: at 2018-11-15 16:38:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 16:38:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 16:38:39 [DEBUG   ] spawn_process: at 2018-11-15 16:38:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 16:38:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 16:38:39 [DEBUG   ] spawn_process: at 2018-11-15 16:38:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 16:38:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 16:38:39 [DEBUG   ] spawn_process: at 2018-11-15 16:38:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 16:38:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 16:38:39 [DEBUG   ] spawn_process: at 2018-11-15 16:38:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 16:38:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 16:39:00 [DEBUG   ] Got command BAM from MCS: ref #516369
2018-11-15 16:39:00 [INFO    ] Finished processing BAM request
2018-11-15 16:39:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:39:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516369   8 58437 59940025 A  ERROR'
2018-11-15 16:39:00 [DEBUG   ] Got command BAM from MCS: ref #516368
2018-11-15 16:39:00 [INFO    ] Finished processing BAM request
2018-11-15 16:39:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:39:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516368   8 58437 59940029 A  ERROR'
2018-11-15 16:39:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 16:39:00 [DEBUG   ] spawn_process: at 2018-11-15 16:39:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 16:39:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 16:39:00 [DEBUG   ] spawn_process: at 2018-11-15 16:39:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 16:39:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 16:39:00 [DEBUG   ] spawn_process: at 2018-11-15 16:39:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 16:39:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 16:39:00 [DEBUG   ] spawn_process: at 2018-11-15 16:39:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 16:39:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 16:39:00 [DEBUG   ] spawn_process: at 2018-11-15 16:39:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 16:39:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 16:39:00 [DEBUG   ] spawn_process: at 2018-11-15 16:39:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 16:39:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 16:39:00 [DEBUG   ] spawn_process: at 2018-11-15 16:39:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 16:39:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 16:39:00 [DEBUG   ] spawn_process: at 2018-11-15 16:39:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 16:39:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 16:39:00 [DEBUG   ] spawn_process: at 2018-11-15 16:39:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 16:39:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 16:39:00 [DEBUG   ] spawn_process: at 2018-11-15 16:39:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 16:39:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 16:39:00 [DEBUG   ] spawn_process: at 2018-11-15 16:39:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 16:39:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 16:39:00 [DEBUG   ] spawn_process: at 2018-11-15 16:39:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 16:39:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 16:39:00 [DEBUG   ] spawn_process: at 2018-11-15 16:39:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 16:39:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 16:39:00 [DEBUG   ] spawn_process: at 2018-11-15 16:39:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 16:39:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 16:39:00 [DEBUG   ] spawn_process: at 2018-11-15 16:39:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 16:39:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 16:39:00 [DEBUG   ] spawn_process: at 2018-11-15 16:39:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 16:39:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 16:39:00 [DEBUG   ] spawn_process: at 2018-11-15 16:39:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 16:39:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 16:39:00 [DEBUG   ] spawn_process: at 2018-11-15 16:39:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 16:39:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 16:39:00 [DEBUG   ] spawn_process: at 2018-11-15 16:39:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 16:39:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 16:39:00 [DEBUG   ] spawn_process: at 2018-11-15 16:39:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 16:39:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 16:39:00 [DEBUG   ] spawn_process: at 2018-11-15 16:39:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 16:39:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 16:39:00 [DEBUG   ] spawn_process: at 2018-11-15 16:39:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 16:39:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 16:39:00 [DEBUG   ] spawn_process: at 2018-11-15 16:39:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 16:39:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 16:39:00 [DEBUG   ] spawn_process: at 2018-11-15 16:39:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 16:39:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 16:39:00 [DEBUG   ] spawn_process: at 2018-11-15 16:39:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 16:39:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 16:39:00 [DEBUG   ] spawn_process: at 2018-11-15 16:39:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 16:39:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 16:39:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:39:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 16:39:01 [WARNING ] (13, 1, 'bot')
2018-11-15 16:39:01 [WARNING ] (13, 1, 'bot')
2018-11-15 16:39:01 [WARNING ] (13, 1, 'bot')
2018-11-15 16:39:01 [WARNING ] (13, 1, 'bot')
2018-11-15 16:39:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:39:01 [DEBUG   ] Finished updating board flags in 1.218 seconds
2018-11-15 16:39:17 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-15 16:39:21 [DEBUG   ] Got command BAM from MCS: ref #516370
2018-11-15 16:39:21 [INFO    ] Finished processing BAM request
2018-11-15 16:39:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:39:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516370   8 58437 59961025 A  ERROR'
2018-11-15 16:39:21 [DEBUG   ] Got command BAM from MCS: ref #516371
2018-11-15 16:39:21 [INFO    ] Finished processing BAM request
2018-11-15 16:39:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:39:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516371   8 58437 59961029 A  ERROR'
2018-11-15 16:39:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 16:39:21 [DEBUG   ] spawn_process: at 2018-11-15 16:39:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 16:39:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 16:39:21 [DEBUG   ] spawn_process: at 2018-11-15 16:39:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 16:39:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 16:39:21 [DEBUG   ] spawn_process: at 2018-11-15 16:39:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 16:39:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 16:39:21 [DEBUG   ] spawn_process: at 2018-11-15 16:39:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 16:39:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 16:39:21 [DEBUG   ] spawn_process: at 2018-11-15 16:39:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 16:39:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 16:39:21 [DEBUG   ] spawn_process: at 2018-11-15 16:39:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 16:39:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 16:39:21 [DEBUG   ] spawn_process: at 2018-11-15 16:39:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 16:39:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 16:39:21 [DEBUG   ] spawn_process: at 2018-11-15 16:39:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 16:39:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 16:39:21 [DEBUG   ] spawn_process: at 2018-11-15 16:39:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 16:39:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 16:39:21 [DEBUG   ] spawn_process: at 2018-11-15 16:39:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 16:39:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 16:39:21 [DEBUG   ] spawn_process: at 2018-11-15 16:39:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 16:39:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 16:39:21 [DEBUG   ] spawn_process: at 2018-11-15 16:39:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 16:39:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 16:39:21 [DEBUG   ] spawn_process: at 2018-11-15 16:39:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 16:39:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 16:39:21 [DEBUG   ] spawn_process: at 2018-11-15 16:39:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 16:39:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 16:39:21 [DEBUG   ] spawn_process: at 2018-11-15 16:39:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 16:39:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 16:39:21 [DEBUG   ] spawn_process: at 2018-11-15 16:39:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 16:39:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 16:39:21 [DEBUG   ] spawn_process: at 2018-11-15 16:39:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 16:39:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 16:39:21 [DEBUG   ] spawn_process: at 2018-11-15 16:39:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 16:39:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 16:39:21 [DEBUG   ] spawn_process: at 2018-11-15 16:39:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 16:39:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 16:39:21 [DEBUG   ] spawn_process: at 2018-11-15 16:39:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 16:39:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 16:39:21 [DEBUG   ] spawn_process: at 2018-11-15 16:39:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 16:39:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 16:39:21 [DEBUG   ] spawn_process: at 2018-11-15 16:39:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 16:39:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 16:39:21 [DEBUG   ] spawn_process: at 2018-11-15 16:39:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 16:39:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 16:39:21 [DEBUG   ] spawn_process: at 2018-11-15 16:39:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 16:39:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 16:39:21 [DEBUG   ] spawn_process: at 2018-11-15 16:39:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 16:39:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 16:39:21 [DEBUG   ] spawn_process: at 2018-11-15 16:39:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 16:39:37 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-15 16:39:42 [DEBUG   ] Got command BAM from MCS: ref #516372
2018-11-15 16:39:42 [INFO    ] Finished processing BAM request
2018-11-15 16:39:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:39:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516372   8 58437 59982033 A  ERROR'
2018-11-15 16:39:42 [DEBUG   ] Got command BAM from MCS: ref #516373
2018-11-15 16:39:42 [INFO    ] Finished processing BAM request
2018-11-15 16:39:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:39:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516373   8 58437 59982037 A  ERROR'
2018-11-15 16:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 16:39:42 [DEBUG   ] spawn_process: at 2018-11-15 16:39:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 16:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 16:39:42 [DEBUG   ] spawn_process: at 2018-11-15 16:39:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 16:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 16:39:42 [DEBUG   ] spawn_process: at 2018-11-15 16:39:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 16:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 16:39:42 [DEBUG   ] spawn_process: at 2018-11-15 16:39:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 16:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 16:39:42 [DEBUG   ] spawn_process: at 2018-11-15 16:39:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 16:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 16:39:42 [DEBUG   ] spawn_process: at 2018-11-15 16:39:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 16:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 16:39:42 [DEBUG   ] spawn_process: at 2018-11-15 16:39:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 16:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 16:39:42 [DEBUG   ] spawn_process: at 2018-11-15 16:39:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 16:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 16:39:42 [DEBUG   ] spawn_process: at 2018-11-15 16:39:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 16:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 16:39:42 [DEBUG   ] spawn_process: at 2018-11-15 16:39:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 16:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 16:39:42 [DEBUG   ] spawn_process: at 2018-11-15 16:39:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 16:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 16:39:42 [DEBUG   ] spawn_process: at 2018-11-15 16:39:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 16:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 16:39:42 [DEBUG   ] spawn_process: at 2018-11-15 16:39:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 16:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 16:39:42 [DEBUG   ] spawn_process: at 2018-11-15 16:39:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 16:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 16:39:42 [DEBUG   ] spawn_process: at 2018-11-15 16:39:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 16:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 16:39:42 [DEBUG   ] spawn_process: at 2018-11-15 16:39:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 16:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 16:39:42 [DEBUG   ] spawn_process: at 2018-11-15 16:39:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 16:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 16:39:42 [DEBUG   ] spawn_process: at 2018-11-15 16:39:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 16:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 16:39:42 [DEBUG   ] spawn_process: at 2018-11-15 16:39:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 16:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 16:39:42 [DEBUG   ] spawn_process: at 2018-11-15 16:39:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 16:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 16:39:42 [DEBUG   ] spawn_process: at 2018-11-15 16:39:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 16:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 16:39:42 [DEBUG   ] spawn_process: at 2018-11-15 16:39:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 16:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 16:39:42 [DEBUG   ] spawn_process: at 2018-11-15 16:39:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 16:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 16:39:42 [DEBUG   ] spawn_process: at 2018-11-15 16:39:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 16:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 16:39:42 [DEBUG   ] spawn_process: at 2018-11-15 16:39:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 16:39:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 16:39:42 [DEBUG   ] spawn_process: at 2018-11-15 16:39:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 16:39:57 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-15 16:40:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 16:40:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:40:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 16:40:01 [WARNING ] (13, 1, 'bot')
2018-11-15 16:40:01 [WARNING ] (13, 1, 'bot')
2018-11-15 16:40:01 [WARNING ] (13, 1, 'bot')
2018-11-15 16:40:01 [WARNING ] (13, 1, 'bot')
2018-11-15 16:40:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:40:01 [DEBUG   ] Finished updating board flags in 1.187 seconds
2018-11-15 16:40:03 [DEBUG   ] Got command BAM from MCS: ref #516375
2018-11-15 16:40:03 [INFO    ] Finished processing BAM request
2018-11-15 16:40:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:40:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516375   8 58437 60003033 A  ERROR'
2018-11-15 16:40:03 [DEBUG   ] Got command BAM from MCS: ref #516374
2018-11-15 16:40:03 [INFO    ] Finished processing BAM request
2018-11-15 16:40:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:40:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516374   8 58437 60003037 A  ERROR'
2018-11-15 16:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 16:40:03 [DEBUG   ] spawn_process: at 2018-11-15 16:40:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 16:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 16:40:03 [DEBUG   ] spawn_process: at 2018-11-15 16:40:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 16:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 16:40:03 [DEBUG   ] spawn_process: at 2018-11-15 16:40:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 16:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 16:40:03 [DEBUG   ] spawn_process: at 2018-11-15 16:40:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 16:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 16:40:03 [DEBUG   ] spawn_process: at 2018-11-15 16:40:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 16:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 16:40:03 [DEBUG   ] spawn_process: at 2018-11-15 16:40:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 16:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 16:40:03 [DEBUG   ] spawn_process: at 2018-11-15 16:40:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 16:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 16:40:03 [DEBUG   ] spawn_process: at 2018-11-15 16:40:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 16:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 16:40:03 [DEBUG   ] spawn_process: at 2018-11-15 16:40:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 16:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 16:40:03 [DEBUG   ] spawn_process: at 2018-11-15 16:40:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 16:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 16:40:03 [DEBUG   ] spawn_process: at 2018-11-15 16:40:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 16:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 16:40:03 [DEBUG   ] spawn_process: at 2018-11-15 16:40:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 16:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 16:40:03 [DEBUG   ] spawn_process: at 2018-11-15 16:40:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 16:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 16:40:03 [DEBUG   ] spawn_process: at 2018-11-15 16:40:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 16:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 16:40:03 [DEBUG   ] spawn_process: at 2018-11-15 16:40:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 16:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 16:40:03 [DEBUG   ] spawn_process: at 2018-11-15 16:40:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 16:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 16:40:03 [DEBUG   ] spawn_process: at 2018-11-15 16:40:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 16:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 16:40:03 [DEBUG   ] spawn_process: at 2018-11-15 16:40:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 16:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 16:40:03 [DEBUG   ] spawn_process: at 2018-11-15 16:40:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 16:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 16:40:03 [DEBUG   ] spawn_process: at 2018-11-15 16:40:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 16:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 16:40:03 [DEBUG   ] spawn_process: at 2018-11-15 16:40:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 16:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 16:40:03 [DEBUG   ] spawn_process: at 2018-11-15 16:40:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 16:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 16:40:03 [DEBUG   ] spawn_process: at 2018-11-15 16:40:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 16:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 16:40:03 [DEBUG   ] spawn_process: at 2018-11-15 16:40:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 16:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 16:40:03 [DEBUG   ] spawn_process: at 2018-11-15 16:40:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 16:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 16:40:03 [DEBUG   ] spawn_process: at 2018-11-15 16:40:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 16:40:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 16:40:24 [DEBUG   ] Got command BAM from MCS: ref #516377
2018-11-15 16:40:24 [INFO    ] Finished processing BAM request
2018-11-15 16:40:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:40:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516377   8 58437 60024025 A  ERROR'
2018-11-15 16:40:24 [DEBUG   ] Got command BAM from MCS: ref #516376
2018-11-15 16:40:24 [INFO    ] Finished processing BAM request
2018-11-15 16:40:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:40:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516376   8 58437 60024029 A  ERROR'
2018-11-15 16:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 16:40:24 [DEBUG   ] spawn_process: at 2018-11-15 16:40:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 16:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 16:40:24 [DEBUG   ] spawn_process: at 2018-11-15 16:40:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 16:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 16:40:24 [DEBUG   ] spawn_process: at 2018-11-15 16:40:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 16:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 16:40:24 [DEBUG   ] spawn_process: at 2018-11-15 16:40:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 16:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 16:40:24 [DEBUG   ] spawn_process: at 2018-11-15 16:40:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 16:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 16:40:24 [DEBUG   ] spawn_process: at 2018-11-15 16:40:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 16:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 16:40:24 [DEBUG   ] spawn_process: at 2018-11-15 16:40:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 16:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 16:40:24 [DEBUG   ] spawn_process: at 2018-11-15 16:40:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 16:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 16:40:24 [DEBUG   ] spawn_process: at 2018-11-15 16:40:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 16:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 16:40:24 [DEBUG   ] spawn_process: at 2018-11-15 16:40:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 16:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 16:40:24 [DEBUG   ] spawn_process: at 2018-11-15 16:40:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 16:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 16:40:24 [DEBUG   ] spawn_process: at 2018-11-15 16:40:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 16:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 16:40:24 [DEBUG   ] spawn_process: at 2018-11-15 16:40:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 16:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 16:40:24 [DEBUG   ] spawn_process: at 2018-11-15 16:40:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 16:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 16:40:24 [DEBUG   ] spawn_process: at 2018-11-15 16:40:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 16:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 16:40:24 [DEBUG   ] spawn_process: at 2018-11-15 16:40:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 16:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 16:40:24 [DEBUG   ] spawn_process: at 2018-11-15 16:40:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 16:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 16:40:24 [DEBUG   ] spawn_process: at 2018-11-15 16:40:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 16:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 16:40:24 [DEBUG   ] spawn_process: at 2018-11-15 16:40:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 16:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 16:40:24 [DEBUG   ] spawn_process: at 2018-11-15 16:40:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 16:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 16:40:24 [DEBUG   ] spawn_process: at 2018-11-15 16:40:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 16:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 16:40:24 [DEBUG   ] spawn_process: at 2018-11-15 16:40:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 16:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 16:40:24 [DEBUG   ] spawn_process: at 2018-11-15 16:40:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 16:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 16:40:24 [DEBUG   ] spawn_process: at 2018-11-15 16:40:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 16:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 16:40:24 [DEBUG   ] spawn_process: at 2018-11-15 16:40:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 16:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 16:40:24 [DEBUG   ] spawn_process: at 2018-11-15 16:40:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 16:40:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 16:40:45 [DEBUG   ] Got command BAM from MCS: ref #516379
2018-11-15 16:40:45 [INFO    ] Finished processing BAM request
2018-11-15 16:40:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:40:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516379   8 58437 60045025 A  ERROR'
2018-11-15 16:40:45 [DEBUG   ] Got command BAM from MCS: ref #516378
2018-11-15 16:40:45 [INFO    ] Finished processing BAM request
2018-11-15 16:40:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:40:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516378   8 58437 60045029 A  ERROR'
2018-11-15 16:40:45 [DEBUG   ] Got command RPT from MCS: ref #516380
2018-11-15 16:40:45 [DEBUG   ] summary = ERROR
2018-11-15 16:40:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516380  13 58437 60045137 A  ERRORERROR'
2018-11-15 16:40:45 [DEBUG   ] Got command RPT from MCS: ref #516381
2018-11-15 16:40:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 16:40:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516381  77 58437 60045138 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 16:40:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 16:40:45 [DEBUG   ] spawn_process: at 2018-11-15 16:40:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 16:40:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 16:40:45 [DEBUG   ] spawn_process: at 2018-11-15 16:40:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 16:40:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 16:40:45 [DEBUG   ] spawn_process: at 2018-11-15 16:40:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 16:40:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 16:40:45 [DEBUG   ] spawn_process: at 2018-11-15 16:40:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 16:40:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 16:40:45 [DEBUG   ] spawn_process: at 2018-11-15 16:40:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 16:40:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 16:40:45 [DEBUG   ] spawn_process: at 2018-11-15 16:40:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 16:40:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 16:40:45 [DEBUG   ] spawn_process: at 2018-11-15 16:40:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 16:40:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 16:40:45 [DEBUG   ] spawn_process: at 2018-11-15 16:40:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 16:40:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 16:40:45 [DEBUG   ] spawn_process: at 2018-11-15 16:40:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 16:40:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 16:40:45 [DEBUG   ] spawn_process: at 2018-11-15 16:40:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 16:40:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 16:40:45 [DEBUG   ] spawn_process: at 2018-11-15 16:40:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 16:40:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 16:40:45 [DEBUG   ] spawn_process: at 2018-11-15 16:40:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 16:40:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 16:40:45 [DEBUG   ] spawn_process: at 2018-11-15 16:40:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 16:40:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 16:40:45 [DEBUG   ] spawn_process: at 2018-11-15 16:40:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 16:40:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 16:40:45 [DEBUG   ] spawn_process: at 2018-11-15 16:40:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 16:40:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 16:40:45 [DEBUG   ] spawn_process: at 2018-11-15 16:40:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 16:40:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 16:40:45 [DEBUG   ] spawn_process: at 2018-11-15 16:40:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 16:40:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 16:40:45 [DEBUG   ] spawn_process: at 2018-11-15 16:40:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 16:40:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 16:40:45 [DEBUG   ] spawn_process: at 2018-11-15 16:40:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 16:40:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 16:40:45 [DEBUG   ] spawn_process: at 2018-11-15 16:40:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 16:40:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 16:40:45 [DEBUG   ] spawn_process: at 2018-11-15 16:40:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 16:40:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 16:40:45 [DEBUG   ] spawn_process: at 2018-11-15 16:40:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 16:40:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 16:40:45 [DEBUG   ] spawn_process: at 2018-11-15 16:40:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 16:40:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 16:40:45 [DEBUG   ] spawn_process: at 2018-11-15 16:40:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 16:40:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 16:40:45 [DEBUG   ] spawn_process: at 2018-11-15 16:40:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 16:40:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 16:40:45 [DEBUG   ] spawn_process: at 2018-11-15 16:40:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 16:40:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 16:41:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 16:41:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 16:41:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:41:01 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-15 16:41:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 16:41:01 [WARNING ] (13, 1, 'bot')
2018-11-15 16:41:01 [WARNING ] (13, 1, 'bot')
2018-11-15 16:41:01 [WARNING ] (13, 1, 'bot')
2018-11-15 16:41:01 [WARNING ] (13, 1, 'bot')
2018-11-15 16:41:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:41:01 [DEBUG   ] Finished updating board flags in 1.023 seconds
2018-11-15 16:41:06 [DEBUG   ] Got command BAM from MCS: ref #516397
2018-11-15 16:41:06 [INFO    ] Finished processing BAM request
2018-11-15 16:41:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:41:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516397   8 58437 60066025 A  ERROR'
2018-11-15 16:41:06 [DEBUG   ] Got command BAM from MCS: ref #516398
2018-11-15 16:41:06 [INFO    ] Finished processing BAM request
2018-11-15 16:41:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:41:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516398   8 58437 60066029 A  ERROR'
2018-11-15 16:41:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 16:41:06 [DEBUG   ] spawn_process: at 2018-11-15 16:41:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 16:41:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 16:41:06 [DEBUG   ] spawn_process: at 2018-11-15 16:41:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 16:41:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 16:41:06 [DEBUG   ] spawn_process: at 2018-11-15 16:41:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 16:41:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 16:41:06 [DEBUG   ] spawn_process: at 2018-11-15 16:41:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 16:41:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 16:41:06 [DEBUG   ] spawn_process: at 2018-11-15 16:41:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 16:41:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 16:41:06 [DEBUG   ] spawn_process: at 2018-11-15 16:41:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 16:41:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 16:41:06 [DEBUG   ] spawn_process: at 2018-11-15 16:41:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 16:41:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 16:41:06 [DEBUG   ] spawn_process: at 2018-11-15 16:41:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 16:41:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 16:41:06 [DEBUG   ] spawn_process: at 2018-11-15 16:41:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 16:41:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 16:41:06 [DEBUG   ] spawn_process: at 2018-11-15 16:41:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 16:41:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 16:41:06 [DEBUG   ] spawn_process: at 2018-11-15 16:41:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 16:41:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 16:41:06 [DEBUG   ] spawn_process: at 2018-11-15 16:41:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 16:41:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 16:41:06 [DEBUG   ] spawn_process: at 2018-11-15 16:41:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 16:41:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 16:41:06 [DEBUG   ] spawn_process: at 2018-11-15 16:41:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 16:41:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 16:41:06 [DEBUG   ] spawn_process: at 2018-11-15 16:41:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 16:41:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 16:41:06 [DEBUG   ] spawn_process: at 2018-11-15 16:41:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 16:41:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 16:41:06 [DEBUG   ] spawn_process: at 2018-11-15 16:41:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 16:41:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 16:41:06 [DEBUG   ] spawn_process: at 2018-11-15 16:41:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 16:41:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 16:41:06 [DEBUG   ] spawn_process: at 2018-11-15 16:41:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 16:41:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 16:41:06 [DEBUG   ] spawn_process: at 2018-11-15 16:41:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 16:41:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 16:41:06 [DEBUG   ] spawn_process: at 2018-11-15 16:41:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 16:41:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 16:41:06 [DEBUG   ] spawn_process: at 2018-11-15 16:41:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 16:41:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 16:41:06 [DEBUG   ] spawn_process: at 2018-11-15 16:41:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 16:41:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 16:41:06 [DEBUG   ] spawn_process: at 2018-11-15 16:41:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 16:41:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 16:41:06 [DEBUG   ] spawn_process: at 2018-11-15 16:41:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 16:41:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 16:41:06 [DEBUG   ] spawn_process: at 2018-11-15 16:41:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 16:41:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 16:41:27 [DEBUG   ] Got command BAM from MCS: ref #516403
2018-11-15 16:41:27 [INFO    ] Finished processing BAM request
2018-11-15 16:41:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:41:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516403   8 58437 60087033 A  ERROR'
2018-11-15 16:41:27 [DEBUG   ] Got command BAM from MCS: ref #516404
2018-11-15 16:41:27 [INFO    ] Finished processing BAM request
2018-11-15 16:41:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:41:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516404   8 58437 60087037 A  ERROR'
2018-11-15 16:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 16:41:27 [DEBUG   ] spawn_process: at 2018-11-15 16:41:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 16:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 16:41:27 [DEBUG   ] spawn_process: at 2018-11-15 16:41:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 16:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 16:41:27 [DEBUG   ] spawn_process: at 2018-11-15 16:41:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 16:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 16:41:27 [DEBUG   ] spawn_process: at 2018-11-15 16:41:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 16:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 16:41:27 [DEBUG   ] spawn_process: at 2018-11-15 16:41:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 16:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 16:41:27 [DEBUG   ] spawn_process: at 2018-11-15 16:41:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 16:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 16:41:27 [DEBUG   ] spawn_process: at 2018-11-15 16:41:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 16:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 16:41:27 [DEBUG   ] spawn_process: at 2018-11-15 16:41:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 16:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 16:41:27 [DEBUG   ] spawn_process: at 2018-11-15 16:41:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 16:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 16:41:27 [DEBUG   ] spawn_process: at 2018-11-15 16:41:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 16:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 16:41:27 [DEBUG   ] spawn_process: at 2018-11-15 16:41:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 16:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 16:41:27 [DEBUG   ] spawn_process: at 2018-11-15 16:41:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 16:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 16:41:27 [DEBUG   ] spawn_process: at 2018-11-15 16:41:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 16:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 16:41:27 [DEBUG   ] spawn_process: at 2018-11-15 16:41:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 16:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 16:41:27 [DEBUG   ] spawn_process: at 2018-11-15 16:41:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 16:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 16:41:27 [DEBUG   ] spawn_process: at 2018-11-15 16:41:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 16:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 16:41:27 [DEBUG   ] spawn_process: at 2018-11-15 16:41:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 16:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 16:41:27 [DEBUG   ] spawn_process: at 2018-11-15 16:41:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 16:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 16:41:27 [DEBUG   ] spawn_process: at 2018-11-15 16:41:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 16:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 16:41:27 [DEBUG   ] spawn_process: at 2018-11-15 16:41:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 16:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 16:41:27 [DEBUG   ] spawn_process: at 2018-11-15 16:41:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 16:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 16:41:27 [DEBUG   ] spawn_process: at 2018-11-15 16:41:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 16:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 16:41:27 [DEBUG   ] spawn_process: at 2018-11-15 16:41:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 16:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 16:41:27 [DEBUG   ] spawn_process: at 2018-11-15 16:41:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 16:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 16:41:27 [DEBUG   ] spawn_process: at 2018-11-15 16:41:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 16:41:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 16:41:27 [DEBUG   ] spawn_process: at 2018-11-15 16:41:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 16:41:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 16:41:48 [DEBUG   ] Got command BAM from MCS: ref #516406
2018-11-15 16:41:48 [INFO    ] Finished processing BAM request
2018-11-15 16:41:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:41:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516406   8 58437 60108029 A  ERROR'
2018-11-15 16:41:48 [DEBUG   ] Got command BAM from MCS: ref #516405
2018-11-15 16:41:48 [INFO    ] Finished processing BAM request
2018-11-15 16:41:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:41:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516405   8 58437 60108033 A  ERROR'
2018-11-15 16:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 16:41:48 [DEBUG   ] spawn_process: at 2018-11-15 16:41:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 16:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 16:41:48 [DEBUG   ] spawn_process: at 2018-11-15 16:41:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 16:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 16:41:48 [DEBUG   ] spawn_process: at 2018-11-15 16:41:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 16:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 16:41:48 [DEBUG   ] spawn_process: at 2018-11-15 16:41:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 16:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 16:41:48 [DEBUG   ] spawn_process: at 2018-11-15 16:41:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 16:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 16:41:48 [DEBUG   ] spawn_process: at 2018-11-15 16:41:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 16:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 16:41:48 [DEBUG   ] spawn_process: at 2018-11-15 16:41:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 16:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 16:41:48 [DEBUG   ] spawn_process: at 2018-11-15 16:41:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 16:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 16:41:48 [DEBUG   ] spawn_process: at 2018-11-15 16:41:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 16:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 16:41:48 [DEBUG   ] spawn_process: at 2018-11-15 16:41:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 16:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 16:41:48 [DEBUG   ] spawn_process: at 2018-11-15 16:41:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 16:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 16:41:48 [DEBUG   ] spawn_process: at 2018-11-15 16:41:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 16:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 16:41:48 [DEBUG   ] spawn_process: at 2018-11-15 16:41:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 16:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 16:41:48 [DEBUG   ] spawn_process: at 2018-11-15 16:41:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 16:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 16:41:48 [DEBUG   ] spawn_process: at 2018-11-15 16:41:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 16:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 16:41:48 [DEBUG   ] spawn_process: at 2018-11-15 16:41:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 16:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 16:41:48 [DEBUG   ] spawn_process: at 2018-11-15 16:41:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 16:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 16:41:48 [DEBUG   ] spawn_process: at 2018-11-15 16:41:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 16:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 16:41:48 [DEBUG   ] spawn_process: at 2018-11-15 16:41:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 16:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 16:41:48 [DEBUG   ] spawn_process: at 2018-11-15 16:41:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 16:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 16:41:48 [DEBUG   ] spawn_process: at 2018-11-15 16:41:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 16:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 16:41:48 [DEBUG   ] spawn_process: at 2018-11-15 16:41:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 16:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 16:41:48 [DEBUG   ] spawn_process: at 2018-11-15 16:41:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 16:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 16:41:48 [DEBUG   ] spawn_process: at 2018-11-15 16:41:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 16:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 16:41:48 [DEBUG   ] spawn_process: at 2018-11-15 16:41:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 16:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 16:41:48 [DEBUG   ] spawn_process: at 2018-11-15 16:41:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 16:41:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 16:42:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:42:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 16:42:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-15 16:42:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 16:42:01 [WARNING ] (13, 1, 'bot')
2018-11-15 16:42:01 [WARNING ] (13, 1, 'bot')
2018-11-15 16:42:01 [WARNING ] (13, 1, 'bot')
2018-11-15 16:42:01 [WARNING ] (13, 1, 'bot')
2018-11-15 16:42:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:42:01 [DEBUG   ] Finished updating board flags in 0.964 seconds
2018-11-15 16:42:09 [DEBUG   ] Got command BAM from MCS: ref #516408
2018-11-15 16:42:09 [INFO    ] Finished processing BAM request
2018-11-15 16:42:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:42:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516408   8 58437 60129033 A  ERROR'
2018-11-15 16:42:09 [DEBUG   ] Got command BAM from MCS: ref #516407
2018-11-15 16:42:09 [INFO    ] Finished processing BAM request
2018-11-15 16:42:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:42:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516407   8 58437 60129037 A  ERROR'
2018-11-15 16:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 16:42:09 [DEBUG   ] spawn_process: at 2018-11-15 16:42:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 16:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 16:42:09 [DEBUG   ] spawn_process: at 2018-11-15 16:42:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 16:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 16:42:09 [DEBUG   ] spawn_process: at 2018-11-15 16:42:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 16:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 16:42:09 [DEBUG   ] spawn_process: at 2018-11-15 16:42:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 16:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 16:42:09 [DEBUG   ] spawn_process: at 2018-11-15 16:42:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 16:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 16:42:09 [DEBUG   ] spawn_process: at 2018-11-15 16:42:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 16:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 16:42:09 [DEBUG   ] spawn_process: at 2018-11-15 16:42:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 16:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 16:42:09 [DEBUG   ] spawn_process: at 2018-11-15 16:42:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 16:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 16:42:09 [DEBUG   ] spawn_process: at 2018-11-15 16:42:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 16:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 16:42:09 [DEBUG   ] spawn_process: at 2018-11-15 16:42:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 16:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 16:42:09 [DEBUG   ] spawn_process: at 2018-11-15 16:42:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 16:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 16:42:09 [DEBUG   ] spawn_process: at 2018-11-15 16:42:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 16:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 16:42:09 [DEBUG   ] spawn_process: at 2018-11-15 16:42:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 16:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 16:42:09 [DEBUG   ] spawn_process: at 2018-11-15 16:42:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 16:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 16:42:09 [DEBUG   ] spawn_process: at 2018-11-15 16:42:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 16:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 16:42:09 [DEBUG   ] spawn_process: at 2018-11-15 16:42:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 16:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 16:42:09 [DEBUG   ] spawn_process: at 2018-11-15 16:42:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 16:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 16:42:09 [DEBUG   ] spawn_process: at 2018-11-15 16:42:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 16:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 16:42:09 [DEBUG   ] spawn_process: at 2018-11-15 16:42:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 16:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 16:42:09 [DEBUG   ] spawn_process: at 2018-11-15 16:42:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 16:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 16:42:09 [DEBUG   ] spawn_process: at 2018-11-15 16:42:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 16:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 16:42:09 [DEBUG   ] spawn_process: at 2018-11-15 16:42:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 16:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 16:42:09 [DEBUG   ] spawn_process: at 2018-11-15 16:42:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 16:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 16:42:09 [DEBUG   ] spawn_process: at 2018-11-15 16:42:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 16:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 16:42:09 [DEBUG   ] spawn_process: at 2018-11-15 16:42:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 16:42:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 16:42:09 [DEBUG   ] spawn_process: at 2018-11-15 16:42:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 16:42:17 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-11-15 16:42:30 [DEBUG   ] Got command BAM from MCS: ref #516410
2018-11-15 16:42:30 [INFO    ] Finished processing BAM request
2018-11-15 16:42:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:42:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516410   8 58437 60150025 A  ERROR'
2018-11-15 16:42:30 [DEBUG   ] Got command BAM from MCS: ref #516409
2018-11-15 16:42:30 [INFO    ] Finished processing BAM request
2018-11-15 16:42:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:42:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516409   8 58437 60150029 A  ERROR'
2018-11-15 16:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 16:42:30 [DEBUG   ] spawn_process: at 2018-11-15 16:42:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 16:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 16:42:30 [DEBUG   ] spawn_process: at 2018-11-15 16:42:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 16:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 16:42:30 [DEBUG   ] spawn_process: at 2018-11-15 16:42:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 16:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 16:42:30 [DEBUG   ] spawn_process: at 2018-11-15 16:42:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 16:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 16:42:30 [DEBUG   ] spawn_process: at 2018-11-15 16:42:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 16:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 16:42:30 [DEBUG   ] spawn_process: at 2018-11-15 16:42:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 16:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 16:42:30 [DEBUG   ] spawn_process: at 2018-11-15 16:42:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 16:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 16:42:30 [DEBUG   ] spawn_process: at 2018-11-15 16:42:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 16:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 16:42:30 [DEBUG   ] spawn_process: at 2018-11-15 16:42:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 16:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 16:42:30 [DEBUG   ] spawn_process: at 2018-11-15 16:42:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 16:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 16:42:30 [DEBUG   ] spawn_process: at 2018-11-15 16:42:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 16:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 16:42:30 [DEBUG   ] spawn_process: at 2018-11-15 16:42:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 16:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 16:42:30 [DEBUG   ] spawn_process: at 2018-11-15 16:42:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 16:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 16:42:30 [DEBUG   ] spawn_process: at 2018-11-15 16:42:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 16:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 16:42:30 [DEBUG   ] spawn_process: at 2018-11-15 16:42:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 16:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 16:42:30 [DEBUG   ] spawn_process: at 2018-11-15 16:42:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 16:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 16:42:30 [DEBUG   ] spawn_process: at 2018-11-15 16:42:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 16:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 16:42:30 [DEBUG   ] spawn_process: at 2018-11-15 16:42:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 16:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 16:42:30 [DEBUG   ] spawn_process: at 2018-11-15 16:42:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 16:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 16:42:30 [DEBUG   ] spawn_process: at 2018-11-15 16:42:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 16:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 16:42:30 [DEBUG   ] spawn_process: at 2018-11-15 16:42:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 16:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 16:42:30 [DEBUG   ] spawn_process: at 2018-11-15 16:42:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 16:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 16:42:30 [DEBUG   ] spawn_process: at 2018-11-15 16:42:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 16:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 16:42:30 [DEBUG   ] spawn_process: at 2018-11-15 16:42:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 16:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 16:42:30 [DEBUG   ] spawn_process: at 2018-11-15 16:42:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 16:42:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 16:42:30 [DEBUG   ] spawn_process: at 2018-11-15 16:42:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 16:42:37 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-15 16:42:51 [DEBUG   ] Got command BAM from MCS: ref #516412
2018-11-15 16:42:51 [INFO    ] Finished processing BAM request
2018-11-15 16:42:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:42:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516412   8 58437 60171033 A  ERROR'
2018-11-15 16:42:51 [DEBUG   ] Got command BAM from MCS: ref #516411
2018-11-15 16:42:51 [INFO    ] Finished processing BAM request
2018-11-15 16:42:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:42:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516411   8 58437 60171037 A  ERROR'
2018-11-15 16:42:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 16:42:51 [DEBUG   ] spawn_process: at 2018-11-15 16:42:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 16:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 16:42:52 [DEBUG   ] spawn_process: at 2018-11-15 16:42:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 16:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 16:42:52 [DEBUG   ] spawn_process: at 2018-11-15 16:42:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 16:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 16:42:52 [DEBUG   ] spawn_process: at 2018-11-15 16:42:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 16:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 16:42:52 [DEBUG   ] spawn_process: at 2018-11-15 16:42:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 16:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 16:42:52 [DEBUG   ] spawn_process: at 2018-11-15 16:42:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 16:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 16:42:52 [DEBUG   ] spawn_process: at 2018-11-15 16:42:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 16:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 16:42:52 [DEBUG   ] spawn_process: at 2018-11-15 16:42:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 16:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 16:42:52 [DEBUG   ] spawn_process: at 2018-11-15 16:42:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 16:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 16:42:52 [DEBUG   ] spawn_process: at 2018-11-15 16:42:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 16:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 16:42:52 [DEBUG   ] spawn_process: at 2018-11-15 16:42:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 16:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 16:42:52 [DEBUG   ] spawn_process: at 2018-11-15 16:42:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 16:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 16:42:52 [DEBUG   ] spawn_process: at 2018-11-15 16:42:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 16:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 16:42:52 [DEBUG   ] spawn_process: at 2018-11-15 16:42:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 16:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 16:42:52 [DEBUG   ] spawn_process: at 2018-11-15 16:42:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 16:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 16:42:52 [DEBUG   ] spawn_process: at 2018-11-15 16:42:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 16:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 16:42:52 [DEBUG   ] spawn_process: at 2018-11-15 16:42:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 16:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 16:42:52 [DEBUG   ] spawn_process: at 2018-11-15 16:42:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 16:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 16:42:52 [DEBUG   ] spawn_process: at 2018-11-15 16:42:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 16:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 16:42:52 [DEBUG   ] spawn_process: at 2018-11-15 16:42:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 16:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 16:42:52 [DEBUG   ] spawn_process: at 2018-11-15 16:42:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 16:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 16:42:52 [DEBUG   ] spawn_process: at 2018-11-15 16:42:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 16:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 16:42:52 [DEBUG   ] spawn_process: at 2018-11-15 16:42:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 16:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 16:42:52 [DEBUG   ] spawn_process: at 2018-11-15 16:42:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 16:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 16:42:52 [DEBUG   ] spawn_process: at 2018-11-15 16:42:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 16:42:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 16:42:52 [DEBUG   ] spawn_process: at 2018-11-15 16:42:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 16:42:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 16:43:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:43:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-15 16:43:02 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-15 16:43:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 16:43:02 [WARNING ] (13, 1, 'bot')
2018-11-15 16:43:02 [WARNING ] (13, 1, 'bot')
2018-11-15 16:43:02 [WARNING ] (13, 1, 'bot')
2018-11-15 16:43:02 [WARNING ] (13, 1, 'bot')
2018-11-15 16:43:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:43:02 [DEBUG   ] Finished updating board flags in 1.369 seconds
2018-11-15 16:43:12 [DEBUG   ] Got command BAM from MCS: ref #516414
2018-11-15 16:43:12 [INFO    ] Finished processing BAM request
2018-11-15 16:43:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:43:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516414   8 58437 60192033 A  ERROR'
2018-11-15 16:43:12 [DEBUG   ] Got command BAM from MCS: ref #516413
2018-11-15 16:43:12 [INFO    ] Finished processing BAM request
2018-11-15 16:43:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:43:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516413   8 58437 60192037 A  ERROR'
2018-11-15 16:43:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 16:43:12 [DEBUG   ] spawn_process: at 2018-11-15 16:43:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 16:43:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 16:43:12 [DEBUG   ] spawn_process: at 2018-11-15 16:43:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 16:43:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 16:43:12 [DEBUG   ] spawn_process: at 2018-11-15 16:43:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 16:43:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 16:43:12 [DEBUG   ] spawn_process: at 2018-11-15 16:43:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 16:43:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 16:43:12 [DEBUG   ] spawn_process: at 2018-11-15 16:43:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 16:43:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 16:43:12 [DEBUG   ] spawn_process: at 2018-11-15 16:43:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 16:43:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 16:43:12 [DEBUG   ] spawn_process: at 2018-11-15 16:43:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 16:43:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 16:43:12 [DEBUG   ] spawn_process: at 2018-11-15 16:43:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 16:43:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 16:43:12 [DEBUG   ] spawn_process: at 2018-11-15 16:43:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 16:43:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 16:43:12 [DEBUG   ] spawn_process: at 2018-11-15 16:43:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 16:43:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 16:43:12 [DEBUG   ] spawn_process: at 2018-11-15 16:43:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 16:43:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 16:43:12 [DEBUG   ] spawn_process: at 2018-11-15 16:43:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 16:43:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 16:43:12 [DEBUG   ] spawn_process: at 2018-11-15 16:43:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 16:43:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 16:43:12 [DEBUG   ] spawn_process: at 2018-11-15 16:43:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 16:43:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 16:43:12 [DEBUG   ] spawn_process: at 2018-11-15 16:43:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 16:43:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 16:43:12 [DEBUG   ] spawn_process: at 2018-11-15 16:43:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 16:43:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 16:43:12 [DEBUG   ] spawn_process: at 2018-11-15 16:43:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 16:43:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 16:43:12 [DEBUG   ] spawn_process: at 2018-11-15 16:43:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 16:43:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 16:43:12 [DEBUG   ] spawn_process: at 2018-11-15 16:43:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 16:43:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 16:43:12 [DEBUG   ] spawn_process: at 2018-11-15 16:43:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 16:43:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 16:43:12 [DEBUG   ] spawn_process: at 2018-11-15 16:43:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 16:43:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 16:43:12 [DEBUG   ] spawn_process: at 2018-11-15 16:43:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 16:43:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 16:43:12 [DEBUG   ] spawn_process: at 2018-11-15 16:43:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 16:43:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 16:43:12 [DEBUG   ] spawn_process: at 2018-11-15 16:43:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 16:43:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 16:43:12 [DEBUG   ] spawn_process: at 2018-11-15 16:43:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 16:43:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 16:43:12 [DEBUG   ] spawn_process: at 2018-11-15 16:43:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 16:43:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 16:43:19 [DEBUG   ] Got command RPT from MCS: ref #516415
2018-11-15 16:43:19 [DEBUG   ] summary = ERROR
2018-11-15 16:43:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516415  13 58437 60199765 A  ERRORERROR'
2018-11-15 16:43:19 [DEBUG   ] Got command RPT from MCS: ref #516416
2018-11-15 16:43:19 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 16:43:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516416  77 58437 60199957 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 16:43:20 [DEBUG   ] Got command RPT from MCS: ref #516417
2018-11-15 16:43:20 [DEBUG   ] summary = ERROR
2018-11-15 16:43:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516417  13 58437 60200161 A  ERRORERROR'
2018-11-15 16:43:20 [DEBUG   ] Got command RPT from MCS: ref #516418
2018-11-15 16:43:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 16:43:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516418  77 58437 60200365 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 16:43:20 [DEBUG   ] Got command RPT from MCS: ref #516419
2018-11-15 16:43:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 16:43:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516419  12 58437 60200557 A  ERRORB¡ff'
2018-11-15 16:43:33 [DEBUG   ] Got command BAM from MCS: ref #516421
2018-11-15 16:43:33 [INFO    ] Finished processing BAM request
2018-11-15 16:43:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:43:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516421   8 58437 60213029 A  ERROR'
2018-11-15 16:43:33 [DEBUG   ] Got command BAM from MCS: ref #516420
2018-11-15 16:43:33 [INFO    ] Finished processing BAM request
2018-11-15 16:43:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:43:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516420   8 58437 60213033 A  ERROR'
2018-11-15 16:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 16:43:33 [DEBUG   ] spawn_process: at 2018-11-15 16:43:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 16:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 16:43:33 [DEBUG   ] spawn_process: at 2018-11-15 16:43:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 16:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 16:43:33 [DEBUG   ] spawn_process: at 2018-11-15 16:43:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 16:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 16:43:33 [DEBUG   ] spawn_process: at 2018-11-15 16:43:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 16:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 16:43:33 [DEBUG   ] spawn_process: at 2018-11-15 16:43:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 16:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 16:43:33 [DEBUG   ] spawn_process: at 2018-11-15 16:43:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 16:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 16:43:33 [DEBUG   ] spawn_process: at 2018-11-15 16:43:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 16:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 16:43:33 [DEBUG   ] spawn_process: at 2018-11-15 16:43:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 16:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 16:43:33 [DEBUG   ] spawn_process: at 2018-11-15 16:43:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 16:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 16:43:33 [DEBUG   ] spawn_process: at 2018-11-15 16:43:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 16:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 16:43:33 [DEBUG   ] spawn_process: at 2018-11-15 16:43:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 16:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 16:43:33 [DEBUG   ] spawn_process: at 2018-11-15 16:43:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 16:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 16:43:33 [DEBUG   ] spawn_process: at 2018-11-15 16:43:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 16:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 16:43:33 [DEBUG   ] spawn_process: at 2018-11-15 16:43:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 16:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 16:43:33 [DEBUG   ] spawn_process: at 2018-11-15 16:43:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 16:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 16:43:33 [DEBUG   ] spawn_process: at 2018-11-15 16:43:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 16:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 16:43:33 [DEBUG   ] spawn_process: at 2018-11-15 16:43:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 16:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 16:43:33 [DEBUG   ] spawn_process: at 2018-11-15 16:43:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 16:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 16:43:33 [DEBUG   ] spawn_process: at 2018-11-15 16:43:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 16:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 16:43:33 [DEBUG   ] spawn_process: at 2018-11-15 16:43:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 16:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 16:43:33 [DEBUG   ] spawn_process: at 2018-11-15 16:43:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 16:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 16:43:33 [DEBUG   ] spawn_process: at 2018-11-15 16:43:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 16:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 16:43:33 [DEBUG   ] spawn_process: at 2018-11-15 16:43:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 16:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 16:43:33 [DEBUG   ] spawn_process: at 2018-11-15 16:43:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 16:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 16:43:33 [DEBUG   ] spawn_process: at 2018-11-15 16:43:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 16:43:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 16:43:33 [DEBUG   ] spawn_process: at 2018-11-15 16:43:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 16:43:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 16:43:54 [DEBUG   ] Got command BAM from MCS: ref #516423
2018-11-15 16:43:54 [INFO    ] Finished processing BAM request
2018-11-15 16:43:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:43:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516423   8 58437 60234033 A  ERROR'
2018-11-15 16:43:54 [DEBUG   ] Got command BAM from MCS: ref #516422
2018-11-15 16:43:54 [INFO    ] Finished processing BAM request
2018-11-15 16:43:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:43:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516422   8 58437 60234037 A  ERROR'
2018-11-15 16:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 16:43:54 [DEBUG   ] spawn_process: at 2018-11-15 16:43:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 16:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 16:43:54 [DEBUG   ] spawn_process: at 2018-11-15 16:43:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 16:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 16:43:54 [DEBUG   ] spawn_process: at 2018-11-15 16:43:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 16:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 16:43:54 [DEBUG   ] spawn_process: at 2018-11-15 16:43:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 16:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 16:43:54 [DEBUG   ] spawn_process: at 2018-11-15 16:43:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 16:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 16:43:54 [DEBUG   ] spawn_process: at 2018-11-15 16:43:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 16:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 16:43:54 [DEBUG   ] spawn_process: at 2018-11-15 16:43:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 16:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 16:43:54 [DEBUG   ] spawn_process: at 2018-11-15 16:43:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 16:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 16:43:54 [DEBUG   ] spawn_process: at 2018-11-15 16:43:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 16:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 16:43:54 [DEBUG   ] spawn_process: at 2018-11-15 16:43:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 16:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 16:43:54 [DEBUG   ] spawn_process: at 2018-11-15 16:43:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 16:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 16:43:54 [DEBUG   ] spawn_process: at 2018-11-15 16:43:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 16:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 16:43:54 [DEBUG   ] spawn_process: at 2018-11-15 16:43:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 16:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 16:43:54 [DEBUG   ] spawn_process: at 2018-11-15 16:43:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 16:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 16:43:54 [DEBUG   ] spawn_process: at 2018-11-15 16:43:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 16:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 16:43:54 [DEBUG   ] spawn_process: at 2018-11-15 16:43:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 16:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 16:43:54 [DEBUG   ] spawn_process: at 2018-11-15 16:43:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 16:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 16:43:54 [DEBUG   ] spawn_process: at 2018-11-15 16:43:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 16:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 16:43:54 [DEBUG   ] spawn_process: at 2018-11-15 16:43:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 16:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 16:43:54 [DEBUG   ] spawn_process: at 2018-11-15 16:43:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 16:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 16:43:54 [DEBUG   ] spawn_process: at 2018-11-15 16:43:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 16:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 16:43:54 [DEBUG   ] spawn_process: at 2018-11-15 16:43:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 16:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 16:43:54 [DEBUG   ] spawn_process: at 2018-11-15 16:43:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 16:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 16:43:54 [DEBUG   ] spawn_process: at 2018-11-15 16:43:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 16:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 16:43:54 [DEBUG   ] spawn_process: at 2018-11-15 16:43:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 16:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 16:43:54 [DEBUG   ] spawn_process: at 2018-11-15 16:43:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 16:43:57 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-15 16:44:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa24, chip 4
2018-11-15 16:44:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 16:44:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 16:44:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:44:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-11-15 16:44:02 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-15 16:44:02 [WARNING ] (13, 1, 'bot')
2018-11-15 16:44:02 [WARNING ] (13, 1, 'bot')
2018-11-15 16:44:02 [WARNING ] (13, 1, 'bot')
2018-11-15 16:44:02 [WARNING ] (13, 1, 'bot')
2018-11-15 16:44:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:44:02 [DEBUG   ] Finished updating board flags in 1.189 seconds
2018-11-15 16:44:15 [DEBUG   ] Got command BAM from MCS: ref #516425
2018-11-15 16:44:15 [INFO    ] Finished processing BAM request
2018-11-15 16:44:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:44:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516425   8 58437 60255025 A  ERROR'
2018-11-15 16:44:15 [DEBUG   ] Got command BAM from MCS: ref #516424
2018-11-15 16:44:15 [INFO    ] Finished processing BAM request
2018-11-15 16:44:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:44:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516424   8 58437 60255029 A  ERROR'
2018-11-15 16:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 16:44:15 [DEBUG   ] spawn_process: at 2018-11-15 16:44:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 16:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 16:44:15 [DEBUG   ] spawn_process: at 2018-11-15 16:44:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 16:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 16:44:15 [DEBUG   ] spawn_process: at 2018-11-15 16:44:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 16:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 16:44:15 [DEBUG   ] spawn_process: at 2018-11-15 16:44:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 16:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 16:44:15 [DEBUG   ] spawn_process: at 2018-11-15 16:44:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 16:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 16:44:15 [DEBUG   ] spawn_process: at 2018-11-15 16:44:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 16:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 16:44:15 [DEBUG   ] spawn_process: at 2018-11-15 16:44:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 16:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 16:44:15 [DEBUG   ] spawn_process: at 2018-11-15 16:44:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 16:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 16:44:15 [DEBUG   ] spawn_process: at 2018-11-15 16:44:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 16:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 16:44:15 [DEBUG   ] spawn_process: at 2018-11-15 16:44:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 16:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 16:44:15 [DEBUG   ] spawn_process: at 2018-11-15 16:44:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 16:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 16:44:15 [DEBUG   ] spawn_process: at 2018-11-15 16:44:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 16:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 16:44:15 [DEBUG   ] spawn_process: at 2018-11-15 16:44:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 16:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 16:44:15 [DEBUG   ] spawn_process: at 2018-11-15 16:44:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 16:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 16:44:15 [DEBUG   ] spawn_process: at 2018-11-15 16:44:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 16:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 16:44:15 [DEBUG   ] spawn_process: at 2018-11-15 16:44:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 16:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 16:44:15 [DEBUG   ] spawn_process: at 2018-11-15 16:44:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 16:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 16:44:15 [DEBUG   ] spawn_process: at 2018-11-15 16:44:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 16:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 16:44:15 [DEBUG   ] spawn_process: at 2018-11-15 16:44:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 16:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 16:44:15 [DEBUG   ] spawn_process: at 2018-11-15 16:44:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 16:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 16:44:15 [DEBUG   ] spawn_process: at 2018-11-15 16:44:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 16:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 16:44:15 [DEBUG   ] spawn_process: at 2018-11-15 16:44:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 16:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 16:44:15 [DEBUG   ] spawn_process: at 2018-11-15 16:44:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 16:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 16:44:15 [DEBUG   ] spawn_process: at 2018-11-15 16:44:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 16:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 16:44:15 [DEBUG   ] spawn_process: at 2018-11-15 16:44:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 16:44:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 16:44:15 [DEBUG   ] spawn_process: at 2018-11-15 16:44:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 16:44:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 16:44:36 [DEBUG   ] Got command BAM from MCS: ref #516430
2018-11-15 16:44:36 [INFO    ] Finished processing BAM request
2018-11-15 16:44:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:44:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516430   8 58437 60276029 A  ERROR'
2018-11-15 16:44:36 [DEBUG   ] Got command BAM from MCS: ref #516431
2018-11-15 16:44:36 [INFO    ] Finished processing BAM request
2018-11-15 16:44:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:44:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516431   8 58437 60276033 A  ERROR'
2018-11-15 16:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 16:44:36 [DEBUG   ] spawn_process: at 2018-11-15 16:44:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 16:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 16:44:36 [DEBUG   ] spawn_process: at 2018-11-15 16:44:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 16:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 16:44:36 [DEBUG   ] spawn_process: at 2018-11-15 16:44:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 16:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 16:44:36 [DEBUG   ] spawn_process: at 2018-11-15 16:44:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 16:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 16:44:36 [DEBUG   ] spawn_process: at 2018-11-15 16:44:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 16:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 16:44:36 [DEBUG   ] spawn_process: at 2018-11-15 16:44:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 16:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 16:44:36 [DEBUG   ] spawn_process: at 2018-11-15 16:44:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 16:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 16:44:36 [DEBUG   ] spawn_process: at 2018-11-15 16:44:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 16:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 16:44:36 [DEBUG   ] spawn_process: at 2018-11-15 16:44:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 16:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 16:44:36 [DEBUG   ] spawn_process: at 2018-11-15 16:44:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 16:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 16:44:36 [DEBUG   ] spawn_process: at 2018-11-15 16:44:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 16:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 16:44:36 [DEBUG   ] spawn_process: at 2018-11-15 16:44:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 16:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 16:44:36 [DEBUG   ] spawn_process: at 2018-11-15 16:44:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 16:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 16:44:36 [DEBUG   ] spawn_process: at 2018-11-15 16:44:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 16:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 16:44:36 [DEBUG   ] spawn_process: at 2018-11-15 16:44:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 16:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 16:44:36 [DEBUG   ] spawn_process: at 2018-11-15 16:44:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 16:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 16:44:36 [DEBUG   ] spawn_process: at 2018-11-15 16:44:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 16:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 16:44:36 [DEBUG   ] spawn_process: at 2018-11-15 16:44:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 16:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 16:44:36 [DEBUG   ] spawn_process: at 2018-11-15 16:44:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 16:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 16:44:36 [DEBUG   ] spawn_process: at 2018-11-15 16:44:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 16:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 16:44:36 [DEBUG   ] spawn_process: at 2018-11-15 16:44:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 16:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 16:44:36 [DEBUG   ] spawn_process: at 2018-11-15 16:44:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 16:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 16:44:36 [DEBUG   ] spawn_process: at 2018-11-15 16:44:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 16:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 16:44:36 [DEBUG   ] spawn_process: at 2018-11-15 16:44:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 16:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 16:44:36 [DEBUG   ] spawn_process: at 2018-11-15 16:44:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 16:44:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 16:44:36 [DEBUG   ] spawn_process: at 2018-11-15 16:44:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 16:44:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 16:44:57 [DEBUG   ] Got command BAM from MCS: ref #516433
2018-11-15 16:44:57 [INFO    ] Finished processing BAM request
2018-11-15 16:44:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:44:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516433   8 58437 60297029 A  ERROR'
2018-11-15 16:44:57 [DEBUG   ] Got command BAM from MCS: ref #516432
2018-11-15 16:44:57 [INFO    ] Finished processing BAM request
2018-11-15 16:44:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:44:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516432   8 58437 60297033 A  ERROR'
2018-11-15 16:44:57 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-15 16:44:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 16:44:57 [DEBUG   ] spawn_process: at 2018-11-15 16:44:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 16:44:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 16:44:57 [DEBUG   ] spawn_process: at 2018-11-15 16:44:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 16:44:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 16:44:57 [DEBUG   ] spawn_process: at 2018-11-15 16:44:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 16:44:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 16:44:57 [DEBUG   ] spawn_process: at 2018-11-15 16:44:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 16:44:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 16:44:57 [DEBUG   ] spawn_process: at 2018-11-15 16:44:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 16:44:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 16:44:57 [DEBUG   ] spawn_process: at 2018-11-15 16:44:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 16:44:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 16:44:57 [DEBUG   ] spawn_process: at 2018-11-15 16:44:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 16:44:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 16:44:57 [DEBUG   ] spawn_process: at 2018-11-15 16:44:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 16:44:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 16:44:57 [DEBUG   ] spawn_process: at 2018-11-15 16:44:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 16:44:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 16:44:57 [DEBUG   ] spawn_process: at 2018-11-15 16:44:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 16:44:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 16:44:57 [DEBUG   ] spawn_process: at 2018-11-15 16:44:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 16:44:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 16:44:57 [DEBUG   ] spawn_process: at 2018-11-15 16:44:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 16:44:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 16:44:57 [DEBUG   ] spawn_process: at 2018-11-15 16:44:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 16:44:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 16:44:57 [DEBUG   ] spawn_process: at 2018-11-15 16:44:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 16:44:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 16:44:57 [DEBUG   ] spawn_process: at 2018-11-15 16:44:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 16:44:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 16:44:57 [DEBUG   ] spawn_process: at 2018-11-15 16:44:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 16:44:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 16:44:57 [DEBUG   ] spawn_process: at 2018-11-15 16:44:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 16:44:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 16:44:57 [DEBUG   ] spawn_process: at 2018-11-15 16:44:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 16:44:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 16:44:57 [DEBUG   ] spawn_process: at 2018-11-15 16:44:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 16:44:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 16:44:57 [DEBUG   ] spawn_process: at 2018-11-15 16:44:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 16:44:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 16:44:57 [DEBUG   ] spawn_process: at 2018-11-15 16:44:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 16:44:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 16:44:57 [DEBUG   ] spawn_process: at 2018-11-15 16:44:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 16:44:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 16:44:57 [DEBUG   ] spawn_process: at 2018-11-15 16:44:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 16:44:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 16:44:57 [DEBUG   ] spawn_process: at 2018-11-15 16:44:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 16:44:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 16:44:57 [DEBUG   ] spawn_process: at 2018-11-15 16:44:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 16:44:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 16:44:57 [DEBUG   ] spawn_process: at 2018-11-15 16:44:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 16:45:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 16:45:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:45:02 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 16:45:02 [WARNING ] (13, 1, 'bot')
2018-11-15 16:45:02 [WARNING ] (13, 1, 'bot')
2018-11-15 16:45:02 [WARNING ] (13, 1, 'bot')
2018-11-15 16:45:02 [WARNING ] (13, 1, 'bot')
2018-11-15 16:45:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:45:02 [DEBUG   ] Finished updating board flags in 1.014 seconds
2018-11-15 16:45:17 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-15 16:45:18 [DEBUG   ] Got command BAM from MCS: ref #516434
2018-11-15 16:45:18 [INFO    ] Finished processing BAM request
2018-11-15 16:45:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:45:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516434   8 58437 60318029 A  ERROR'
2018-11-15 16:45:18 [DEBUG   ] Got command BAM from MCS: ref #516435
2018-11-15 16:45:18 [INFO    ] Finished processing BAM request
2018-11-15 16:45:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:45:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516435   8 58437 60318033 A  ERROR'
2018-11-15 16:45:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 16:45:18 [DEBUG   ] spawn_process: at 2018-11-15 16:45:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 16:45:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 16:45:18 [DEBUG   ] spawn_process: at 2018-11-15 16:45:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 16:45:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 16:45:18 [DEBUG   ] spawn_process: at 2018-11-15 16:45:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 16:45:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 16:45:18 [DEBUG   ] spawn_process: at 2018-11-15 16:45:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 16:45:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 16:45:18 [DEBUG   ] spawn_process: at 2018-11-15 16:45:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 16:45:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 16:45:18 [DEBUG   ] spawn_process: at 2018-11-15 16:45:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 16:45:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 16:45:18 [DEBUG   ] spawn_process: at 2018-11-15 16:45:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 16:45:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 16:45:18 [DEBUG   ] spawn_process: at 2018-11-15 16:45:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 16:45:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 16:45:18 [DEBUG   ] spawn_process: at 2018-11-15 16:45:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 16:45:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 16:45:18 [DEBUG   ] spawn_process: at 2018-11-15 16:45:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 16:45:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 16:45:18 [DEBUG   ] spawn_process: at 2018-11-15 16:45:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 16:45:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 16:45:18 [DEBUG   ] spawn_process: at 2018-11-15 16:45:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 16:45:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 16:45:18 [DEBUG   ] spawn_process: at 2018-11-15 16:45:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 16:45:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 16:45:18 [DEBUG   ] spawn_process: at 2018-11-15 16:45:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 16:45:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 16:45:18 [DEBUG   ] spawn_process: at 2018-11-15 16:45:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 16:45:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 16:45:18 [DEBUG   ] spawn_process: at 2018-11-15 16:45:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 16:45:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 16:45:18 [DEBUG   ] spawn_process: at 2018-11-15 16:45:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 16:45:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 16:45:18 [DEBUG   ] spawn_process: at 2018-11-15 16:45:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 16:45:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 16:45:18 [DEBUG   ] spawn_process: at 2018-11-15 16:45:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 16:45:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 16:45:18 [DEBUG   ] spawn_process: at 2018-11-15 16:45:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 16:45:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 16:45:18 [DEBUG   ] spawn_process: at 2018-11-15 16:45:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 16:45:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 16:45:18 [DEBUG   ] spawn_process: at 2018-11-15 16:45:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 16:45:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 16:45:18 [DEBUG   ] spawn_process: at 2018-11-15 16:45:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 16:45:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 16:45:18 [DEBUG   ] spawn_process: at 2018-11-15 16:45:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 16:45:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 16:45:18 [DEBUG   ] spawn_process: at 2018-11-15 16:45:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 16:45:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 16:45:18 [DEBUG   ] spawn_process: at 2018-11-15 16:45:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 16:45:37 [DEBUG   ] Finished updating ant stats in 0.461 seconds
2018-11-15 16:45:39 [DEBUG   ] Got command BAM from MCS: ref #516437
2018-11-15 16:45:39 [INFO    ] Finished processing BAM request
2018-11-15 16:45:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:45:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516437   8 58437 60339025 A  ERROR'
2018-11-15 16:45:39 [DEBUG   ] Got command BAM from MCS: ref #516436
2018-11-15 16:45:39 [INFO    ] Finished processing BAM request
2018-11-15 16:45:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:45:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516436   8 58437 60339029 A  ERROR'
2018-11-15 16:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 16:45:39 [DEBUG   ] spawn_process: at 2018-11-15 16:45:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 16:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 16:45:39 [DEBUG   ] spawn_process: at 2018-11-15 16:45:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 16:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 16:45:39 [DEBUG   ] spawn_process: at 2018-11-15 16:45:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 16:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 16:45:39 [DEBUG   ] spawn_process: at 2018-11-15 16:45:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 16:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 16:45:39 [DEBUG   ] spawn_process: at 2018-11-15 16:45:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 16:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 16:45:39 [DEBUG   ] spawn_process: at 2018-11-15 16:45:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 16:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 16:45:39 [DEBUG   ] spawn_process: at 2018-11-15 16:45:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 16:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 16:45:39 [DEBUG   ] spawn_process: at 2018-11-15 16:45:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 16:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 16:45:39 [DEBUG   ] spawn_process: at 2018-11-15 16:45:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 16:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 16:45:39 [DEBUG   ] spawn_process: at 2018-11-15 16:45:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 16:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 16:45:39 [DEBUG   ] spawn_process: at 2018-11-15 16:45:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 16:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 16:45:39 [DEBUG   ] spawn_process: at 2018-11-15 16:45:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 16:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 16:45:39 [DEBUG   ] spawn_process: at 2018-11-15 16:45:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 16:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 16:45:39 [DEBUG   ] spawn_process: at 2018-11-15 16:45:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 16:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 16:45:39 [DEBUG   ] spawn_process: at 2018-11-15 16:45:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 16:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 16:45:39 [DEBUG   ] spawn_process: at 2018-11-15 16:45:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 16:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 16:45:39 [DEBUG   ] spawn_process: at 2018-11-15 16:45:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 16:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 16:45:39 [DEBUG   ] spawn_process: at 2018-11-15 16:45:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 16:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 16:45:39 [DEBUG   ] spawn_process: at 2018-11-15 16:45:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 16:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 16:45:39 [DEBUG   ] spawn_process: at 2018-11-15 16:45:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 16:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 16:45:39 [DEBUG   ] spawn_process: at 2018-11-15 16:45:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 16:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 16:45:39 [DEBUG   ] spawn_process: at 2018-11-15 16:45:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 16:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 16:45:39 [DEBUG   ] spawn_process: at 2018-11-15 16:45:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 16:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 16:45:39 [DEBUG   ] spawn_process: at 2018-11-15 16:45:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 16:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 16:45:39 [DEBUG   ] spawn_process: at 2018-11-15 16:45:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 16:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 16:45:39 [DEBUG   ] spawn_process: at 2018-11-15 16:45:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 16:45:45 [DEBUG   ] Got command RPT from MCS: ref #516438
2018-11-15 16:45:45 [DEBUG   ] summary = ERROR
2018-11-15 16:45:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516438  13 58437 60345129 A  ERRORERROR'
2018-11-15 16:45:45 [DEBUG   ] Got command RPT from MCS: ref #516439
2018-11-15 16:45:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 16:45:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516439  77 58437 60345130 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 16:45:57 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-15 16:46:00 [DEBUG   ] Got command BAM from MCS: ref #516455
2018-11-15 16:46:00 [INFO    ] Finished processing BAM request
2018-11-15 16:46:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:46:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516455   8 58437 60360025 A  ERROR'
2018-11-15 16:46:00 [DEBUG   ] Got command BAM from MCS: ref #516456
2018-11-15 16:46:00 [INFO    ] Finished processing BAM request
2018-11-15 16:46:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:46:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516456   8 58437 60360029 A  ERROR'
2018-11-15 16:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 16:46:00 [DEBUG   ] spawn_process: at 2018-11-15 16:46:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 16:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 16:46:00 [DEBUG   ] spawn_process: at 2018-11-15 16:46:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 16:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 16:46:00 [DEBUG   ] spawn_process: at 2018-11-15 16:46:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 16:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 16:46:00 [DEBUG   ] spawn_process: at 2018-11-15 16:46:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 16:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 16:46:00 [DEBUG   ] spawn_process: at 2018-11-15 16:46:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 16:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 16:46:00 [DEBUG   ] spawn_process: at 2018-11-15 16:46:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 16:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 16:46:00 [DEBUG   ] spawn_process: at 2018-11-15 16:46:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 16:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 16:46:00 [DEBUG   ] spawn_process: at 2018-11-15 16:46:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 16:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 16:46:00 [DEBUG   ] spawn_process: at 2018-11-15 16:46:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 16:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 16:46:00 [DEBUG   ] spawn_process: at 2018-11-15 16:46:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 16:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 16:46:00 [DEBUG   ] spawn_process: at 2018-11-15 16:46:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 16:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 16:46:00 [DEBUG   ] spawn_process: at 2018-11-15 16:46:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 16:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 16:46:00 [DEBUG   ] spawn_process: at 2018-11-15 16:46:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 16:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 16:46:00 [DEBUG   ] spawn_process: at 2018-11-15 16:46:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 16:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 16:46:00 [DEBUG   ] spawn_process: at 2018-11-15 16:46:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 16:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 16:46:00 [DEBUG   ] spawn_process: at 2018-11-15 16:46:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 16:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 16:46:00 [DEBUG   ] spawn_process: at 2018-11-15 16:46:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 16:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 16:46:00 [DEBUG   ] spawn_process: at 2018-11-15 16:46:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 16:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 16:46:00 [DEBUG   ] spawn_process: at 2018-11-15 16:46:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 16:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 16:46:00 [DEBUG   ] spawn_process: at 2018-11-15 16:46:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 16:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 16:46:00 [DEBUG   ] spawn_process: at 2018-11-15 16:46:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 16:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 16:46:00 [DEBUG   ] spawn_process: at 2018-11-15 16:46:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 16:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 16:46:00 [DEBUG   ] spawn_process: at 2018-11-15 16:46:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 16:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 16:46:00 [DEBUG   ] spawn_process: at 2018-11-15 16:46:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 16:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 16:46:00 [DEBUG   ] spawn_process: at 2018-11-15 16:46:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 16:46:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 16:46:00 [DEBUG   ] spawn_process: at 2018-11-15 16:46:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 16:46:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 16:46:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2018-11-15 16:46:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:46:02 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-15 16:46:02 [WARNING ] (13, 1, 'bot')
2018-11-15 16:46:02 [WARNING ] (13, 1, 'bot')
2018-11-15 16:46:02 [WARNING ] (13, 1, 'bot')
2018-11-15 16:46:02 [WARNING ] (13, 1, 'bot')
2018-11-15 16:46:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:46:02 [DEBUG   ] Finished updating board flags in 0.995 seconds
2018-11-15 16:46:17 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 16:46:21 [DEBUG   ] Got command BAM from MCS: ref #516457
2018-11-15 16:46:21 [INFO    ] Finished processing BAM request
2018-11-15 16:46:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:46:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516457   8 58437 60381025 A  ERROR'
2018-11-15 16:46:21 [DEBUG   ] Got command BAM from MCS: ref #516458
2018-11-15 16:46:21 [INFO    ] Finished processing BAM request
2018-11-15 16:46:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:46:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516458   8 58437 60381033 A  ERROR'
2018-11-15 16:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 16:46:21 [DEBUG   ] spawn_process: at 2018-11-15 16:46:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 16:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 16:46:21 [DEBUG   ] spawn_process: at 2018-11-15 16:46:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 16:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 16:46:21 [DEBUG   ] spawn_process: at 2018-11-15 16:46:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 16:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 16:46:21 [DEBUG   ] spawn_process: at 2018-11-15 16:46:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 16:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 16:46:21 [DEBUG   ] spawn_process: at 2018-11-15 16:46:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 16:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 16:46:21 [DEBUG   ] spawn_process: at 2018-11-15 16:46:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 16:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 16:46:21 [DEBUG   ] spawn_process: at 2018-11-15 16:46:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 16:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 16:46:21 [DEBUG   ] spawn_process: at 2018-11-15 16:46:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 16:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 16:46:21 [DEBUG   ] spawn_process: at 2018-11-15 16:46:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 16:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 16:46:21 [DEBUG   ] spawn_process: at 2018-11-15 16:46:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 16:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 16:46:21 [DEBUG   ] spawn_process: at 2018-11-15 16:46:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 16:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 16:46:21 [DEBUG   ] spawn_process: at 2018-11-15 16:46:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 16:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 16:46:21 [DEBUG   ] spawn_process: at 2018-11-15 16:46:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 16:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 16:46:21 [DEBUG   ] spawn_process: at 2018-11-15 16:46:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 16:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 16:46:21 [DEBUG   ] spawn_process: at 2018-11-15 16:46:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 16:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 16:46:21 [DEBUG   ] spawn_process: at 2018-11-15 16:46:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 16:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 16:46:21 [DEBUG   ] spawn_process: at 2018-11-15 16:46:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 16:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 16:46:21 [DEBUG   ] spawn_process: at 2018-11-15 16:46:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 16:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 16:46:21 [DEBUG   ] spawn_process: at 2018-11-15 16:46:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 16:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 16:46:21 [DEBUG   ] spawn_process: at 2018-11-15 16:46:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 16:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 16:46:21 [DEBUG   ] spawn_process: at 2018-11-15 16:46:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 16:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 16:46:21 [DEBUG   ] spawn_process: at 2018-11-15 16:46:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 16:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 16:46:21 [DEBUG   ] spawn_process: at 2018-11-15 16:46:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 16:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 16:46:21 [DEBUG   ] spawn_process: at 2018-11-15 16:46:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 16:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 16:46:21 [DEBUG   ] spawn_process: at 2018-11-15 16:46:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 16:46:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 16:46:21 [DEBUG   ] spawn_process: at 2018-11-15 16:46:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 16:46:37 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 16:46:42 [DEBUG   ] Got command BAM from MCS: ref #516460
2018-11-15 16:46:42 [INFO    ] Finished processing BAM request
2018-11-15 16:46:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:46:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516460   8 58437 60402025 A  ERROR'
2018-11-15 16:46:42 [DEBUG   ] Got command BAM from MCS: ref #516459
2018-11-15 16:46:42 [INFO    ] Finished processing BAM request
2018-11-15 16:46:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:46:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516459   8 58437 60402029 A  ERROR'
2018-11-15 16:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 16:46:42 [DEBUG   ] spawn_process: at 2018-11-15 16:46:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 16:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 16:46:42 [DEBUG   ] spawn_process: at 2018-11-15 16:46:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 16:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 16:46:42 [DEBUG   ] spawn_process: at 2018-11-15 16:46:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 16:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 16:46:42 [DEBUG   ] spawn_process: at 2018-11-15 16:46:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 16:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 16:46:42 [DEBUG   ] spawn_process: at 2018-11-15 16:46:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 16:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 16:46:42 [DEBUG   ] spawn_process: at 2018-11-15 16:46:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 16:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 16:46:42 [DEBUG   ] spawn_process: at 2018-11-15 16:46:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 16:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 16:46:42 [DEBUG   ] spawn_process: at 2018-11-15 16:46:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 16:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 16:46:42 [DEBUG   ] spawn_process: at 2018-11-15 16:46:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 16:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 16:46:42 [DEBUG   ] spawn_process: at 2018-11-15 16:46:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 16:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 16:46:42 [DEBUG   ] spawn_process: at 2018-11-15 16:46:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 16:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 16:46:42 [DEBUG   ] spawn_process: at 2018-11-15 16:46:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 16:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 16:46:42 [DEBUG   ] spawn_process: at 2018-11-15 16:46:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 16:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 16:46:42 [DEBUG   ] spawn_process: at 2018-11-15 16:46:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 16:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 16:46:42 [DEBUG   ] spawn_process: at 2018-11-15 16:46:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 16:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 16:46:42 [DEBUG   ] spawn_process: at 2018-11-15 16:46:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 16:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 16:46:42 [DEBUG   ] spawn_process: at 2018-11-15 16:46:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 16:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 16:46:42 [DEBUG   ] spawn_process: at 2018-11-15 16:46:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 16:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 16:46:42 [DEBUG   ] spawn_process: at 2018-11-15 16:46:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 16:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 16:46:42 [DEBUG   ] spawn_process: at 2018-11-15 16:46:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 16:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 16:46:42 [DEBUG   ] spawn_process: at 2018-11-15 16:46:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 16:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 16:46:42 [DEBUG   ] spawn_process: at 2018-11-15 16:46:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 16:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 16:46:42 [DEBUG   ] spawn_process: at 2018-11-15 16:46:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 16:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 16:46:42 [DEBUG   ] spawn_process: at 2018-11-15 16:46:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 16:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 16:46:42 [DEBUG   ] spawn_process: at 2018-11-15 16:46:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 16:46:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 16:46:42 [DEBUG   ] spawn_process: at 2018-11-15 16:46:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 16:46:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 16:47:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:47:03 [DEBUG   ] Got command BAM from MCS: ref #516462
2018-11-15 16:47:03 [INFO    ] Finished processing BAM request
2018-11-15 16:47:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:47:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516462   8 58437 60423029 A  ERROR'
2018-11-15 16:47:03 [DEBUG   ] Got command BAM from MCS: ref #516461
2018-11-15 16:47:03 [INFO    ] Finished processing BAM request
2018-11-15 16:47:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:47:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516461   8 58437 60423033 A  ERROR'
2018-11-15 16:47:03 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-15 16:47:03 [WARNING ] (13, 1, 'bot')
2018-11-15 16:47:03 [WARNING ] (13, 1, 'bot')
2018-11-15 16:47:03 [WARNING ] (13, 1, 'bot')
2018-11-15 16:47:03 [WARNING ] (13, 1, 'bot')
2018-11-15 16:47:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:47:03 [DEBUG   ] Finished updating board flags in 1.881 seconds
2018-11-15 16:47:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 16:47:03 [DEBUG   ] spawn_process: at 2018-11-15 16:47:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 16:47:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 16:47:03 [DEBUG   ] spawn_process: at 2018-11-15 16:47:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 16:47:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 16:47:03 [DEBUG   ] spawn_process: at 2018-11-15 16:47:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 16:47:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 16:47:03 [DEBUG   ] spawn_process: at 2018-11-15 16:47:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 16:47:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 16:47:03 [DEBUG   ] spawn_process: at 2018-11-15 16:47:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 16:47:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 16:47:03 [DEBUG   ] spawn_process: at 2018-11-15 16:47:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 16:47:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 16:47:03 [DEBUG   ] spawn_process: at 2018-11-15 16:47:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 16:47:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 16:47:03 [DEBUG   ] spawn_process: at 2018-11-15 16:47:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 16:47:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 16:47:03 [DEBUG   ] spawn_process: at 2018-11-15 16:47:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 16:47:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 16:47:03 [DEBUG   ] spawn_process: at 2018-11-15 16:47:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 16:47:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 16:47:03 [DEBUG   ] spawn_process: at 2018-11-15 16:47:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 16:47:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 16:47:03 [DEBUG   ] spawn_process: at 2018-11-15 16:47:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 16:47:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 16:47:03 [DEBUG   ] spawn_process: at 2018-11-15 16:47:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 16:47:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 16:47:03 [DEBUG   ] spawn_process: at 2018-11-15 16:47:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 16:47:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 16:47:03 [DEBUG   ] spawn_process: at 2018-11-15 16:47:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 16:47:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 16:47:03 [DEBUG   ] spawn_process: at 2018-11-15 16:47:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 16:47:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 16:47:03 [DEBUG   ] spawn_process: at 2018-11-15 16:47:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 16:47:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 16:47:03 [DEBUG   ] spawn_process: at 2018-11-15 16:47:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 16:47:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 16:47:03 [DEBUG   ] spawn_process: at 2018-11-15 16:47:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 16:47:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 16:47:03 [DEBUG   ] spawn_process: at 2018-11-15 16:47:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 16:47:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 16:47:03 [DEBUG   ] spawn_process: at 2018-11-15 16:47:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 16:47:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 16:47:03 [DEBUG   ] spawn_process: at 2018-11-15 16:47:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 16:47:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 16:47:03 [DEBUG   ] spawn_process: at 2018-11-15 16:47:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 16:47:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 16:47:03 [DEBUG   ] spawn_process: at 2018-11-15 16:47:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 16:47:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 16:47:03 [DEBUG   ] spawn_process: at 2018-11-15 16:47:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 16:47:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 16:47:03 [DEBUG   ] spawn_process: at 2018-11-15 16:47:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 16:47:17 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-15 16:47:24 [DEBUG   ] Got command BAM from MCS: ref #516464
2018-11-15 16:47:24 [INFO    ] Finished processing BAM request
2018-11-15 16:47:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:47:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516464   8 58437 60444025 A  ERROR'
2018-11-15 16:47:24 [DEBUG   ] Got command BAM from MCS: ref #516463
2018-11-15 16:47:24 [INFO    ] Finished processing BAM request
2018-11-15 16:47:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:47:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516463   8 58437 60444029 A  ERROR'
2018-11-15 16:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 16:47:24 [DEBUG   ] spawn_process: at 2018-11-15 16:47:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 16:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 16:47:24 [DEBUG   ] spawn_process: at 2018-11-15 16:47:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 16:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 16:47:24 [DEBUG   ] spawn_process: at 2018-11-15 16:47:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 16:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 16:47:24 [DEBUG   ] spawn_process: at 2018-11-15 16:47:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 16:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 16:47:24 [DEBUG   ] spawn_process: at 2018-11-15 16:47:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 16:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 16:47:24 [DEBUG   ] spawn_process: at 2018-11-15 16:47:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 16:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 16:47:24 [DEBUG   ] spawn_process: at 2018-11-15 16:47:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 16:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 16:47:24 [DEBUG   ] spawn_process: at 2018-11-15 16:47:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 16:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 16:47:24 [DEBUG   ] spawn_process: at 2018-11-15 16:47:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 16:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 16:47:24 [DEBUG   ] spawn_process: at 2018-11-15 16:47:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 16:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 16:47:24 [DEBUG   ] spawn_process: at 2018-11-15 16:47:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 16:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 16:47:24 [DEBUG   ] spawn_process: at 2018-11-15 16:47:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 16:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 16:47:24 [DEBUG   ] spawn_process: at 2018-11-15 16:47:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 16:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 16:47:24 [DEBUG   ] spawn_process: at 2018-11-15 16:47:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 16:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 16:47:24 [DEBUG   ] spawn_process: at 2018-11-15 16:47:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 16:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 16:47:24 [DEBUG   ] spawn_process: at 2018-11-15 16:47:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 16:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 16:47:24 [DEBUG   ] spawn_process: at 2018-11-15 16:47:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 16:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 16:47:24 [DEBUG   ] spawn_process: at 2018-11-15 16:47:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 16:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 16:47:24 [DEBUG   ] spawn_process: at 2018-11-15 16:47:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 16:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 16:47:24 [DEBUG   ] spawn_process: at 2018-11-15 16:47:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 16:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 16:47:24 [DEBUG   ] spawn_process: at 2018-11-15 16:47:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 16:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 16:47:24 [DEBUG   ] spawn_process: at 2018-11-15 16:47:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 16:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 16:47:24 [DEBUG   ] spawn_process: at 2018-11-15 16:47:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 16:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 16:47:24 [DEBUG   ] spawn_process: at 2018-11-15 16:47:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 16:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 16:47:24 [DEBUG   ] spawn_process: at 2018-11-15 16:47:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 16:47:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 16:47:24 [DEBUG   ] spawn_process: at 2018-11-15 16:47:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 16:47:37 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 16:47:45 [DEBUG   ] Got command BAM from MCS: ref #516470
2018-11-15 16:47:45 [INFO    ] Finished processing BAM request
2018-11-15 16:47:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:47:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516470   8 58437 60465029 A  ERROR'
2018-11-15 16:47:45 [DEBUG   ] Got command BAM from MCS: ref #516469
2018-11-15 16:47:45 [INFO    ] Finished processing BAM request
2018-11-15 16:47:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:47:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516469   8 58437 60465033 A  ERROR'
2018-11-15 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 16:47:45 [DEBUG   ] spawn_process: at 2018-11-15 16:47:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 16:47:45 [DEBUG   ] spawn_process: at 2018-11-15 16:47:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 16:47:45 [DEBUG   ] spawn_process: at 2018-11-15 16:47:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 16:47:45 [DEBUG   ] spawn_process: at 2018-11-15 16:47:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 16:47:45 [DEBUG   ] spawn_process: at 2018-11-15 16:47:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 16:47:45 [DEBUG   ] spawn_process: at 2018-11-15 16:47:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 16:47:45 [DEBUG   ] spawn_process: at 2018-11-15 16:47:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 16:47:45 [DEBUG   ] spawn_process: at 2018-11-15 16:47:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 16:47:45 [DEBUG   ] spawn_process: at 2018-11-15 16:47:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 16:47:45 [DEBUG   ] spawn_process: at 2018-11-15 16:47:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 16:47:45 [DEBUG   ] spawn_process: at 2018-11-15 16:47:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 16:47:45 [DEBUG   ] spawn_process: at 2018-11-15 16:47:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 16:47:45 [DEBUG   ] spawn_process: at 2018-11-15 16:47:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 16:47:45 [DEBUG   ] spawn_process: at 2018-11-15 16:47:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 16:47:45 [DEBUG   ] spawn_process: at 2018-11-15 16:47:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 16:47:45 [DEBUG   ] spawn_process: at 2018-11-15 16:47:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 16:47:45 [DEBUG   ] spawn_process: at 2018-11-15 16:47:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 16:47:45 [DEBUG   ] spawn_process: at 2018-11-15 16:47:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 16:47:45 [DEBUG   ] spawn_process: at 2018-11-15 16:47:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 16:47:45 [DEBUG   ] spawn_process: at 2018-11-15 16:47:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 16:47:45 [DEBUG   ] spawn_process: at 2018-11-15 16:47:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 16:47:45 [DEBUG   ] spawn_process: at 2018-11-15 16:47:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 16:47:45 [DEBUG   ] spawn_process: at 2018-11-15 16:47:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 16:47:45 [DEBUG   ] spawn_process: at 2018-11-15 16:47:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 16:47:45 [DEBUG   ] spawn_process: at 2018-11-15 16:47:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 16:47:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 16:47:45 [DEBUG   ] spawn_process: at 2018-11-15 16:47:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 16:47:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 16:48:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 16:48:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:48:02 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-15 16:48:02 [WARNING ] (13, 1, 'bot')
2018-11-15 16:48:02 [WARNING ] (13, 1, 'bot')
2018-11-15 16:48:02 [WARNING ] (13, 1, 'bot')
2018-11-15 16:48:02 [WARNING ] (13, 1, 'bot')
2018-11-15 16:48:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:48:02 [DEBUG   ] Finished updating board flags in 1.170 seconds
2018-11-15 16:48:06 [DEBUG   ] Got command BAM from MCS: ref #516472
2018-11-15 16:48:06 [INFO    ] Finished processing BAM request
2018-11-15 16:48:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:48:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516472   8 58437 60486025 A  ERROR'
2018-11-15 16:48:06 [DEBUG   ] Got command BAM from MCS: ref #516471
2018-11-15 16:48:06 [INFO    ] Finished processing BAM request
2018-11-15 16:48:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:48:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516471   8 58437 60486029 A  ERROR'
2018-11-15 16:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 16:48:06 [DEBUG   ] spawn_process: at 2018-11-15 16:48:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 16:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 16:48:06 [DEBUG   ] spawn_process: at 2018-11-15 16:48:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 16:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 16:48:06 [DEBUG   ] spawn_process: at 2018-11-15 16:48:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 16:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 16:48:06 [DEBUG   ] spawn_process: at 2018-11-15 16:48:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 16:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 16:48:06 [DEBUG   ] spawn_process: at 2018-11-15 16:48:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 16:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 16:48:06 [DEBUG   ] spawn_process: at 2018-11-15 16:48:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 16:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 16:48:06 [DEBUG   ] spawn_process: at 2018-11-15 16:48:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 16:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 16:48:06 [DEBUG   ] spawn_process: at 2018-11-15 16:48:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 16:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 16:48:06 [DEBUG   ] spawn_process: at 2018-11-15 16:48:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 16:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 16:48:06 [DEBUG   ] spawn_process: at 2018-11-15 16:48:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 16:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 16:48:06 [DEBUG   ] spawn_process: at 2018-11-15 16:48:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 16:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 16:48:06 [DEBUG   ] spawn_process: at 2018-11-15 16:48:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 16:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 16:48:06 [DEBUG   ] spawn_process: at 2018-11-15 16:48:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 16:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 16:48:06 [DEBUG   ] spawn_process: at 2018-11-15 16:48:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 16:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 16:48:06 [DEBUG   ] spawn_process: at 2018-11-15 16:48:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 16:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 16:48:06 [DEBUG   ] spawn_process: at 2018-11-15 16:48:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 16:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 16:48:06 [DEBUG   ] spawn_process: at 2018-11-15 16:48:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 16:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 16:48:06 [DEBUG   ] spawn_process: at 2018-11-15 16:48:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 16:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 16:48:06 [DEBUG   ] spawn_process: at 2018-11-15 16:48:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 16:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 16:48:06 [DEBUG   ] spawn_process: at 2018-11-15 16:48:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 16:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 16:48:06 [DEBUG   ] spawn_process: at 2018-11-15 16:48:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 16:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 16:48:06 [DEBUG   ] spawn_process: at 2018-11-15 16:48:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 16:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 16:48:06 [DEBUG   ] spawn_process: at 2018-11-15 16:48:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 16:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 16:48:06 [DEBUG   ] spawn_process: at 2018-11-15 16:48:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 16:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 16:48:06 [DEBUG   ] spawn_process: at 2018-11-15 16:48:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 16:48:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 16:48:06 [DEBUG   ] spawn_process: at 2018-11-15 16:48:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 16:48:17 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 16:48:19 [DEBUG   ] Got command RPT from MCS: ref #516475
2018-11-15 16:48:19 [DEBUG   ] summary = ERROR
2018-11-15 16:48:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516475  13 58437 60499845 A  ERRORERROR'
2018-11-15 16:48:20 [DEBUG   ] Got command RPT from MCS: ref #516476
2018-11-15 16:48:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 16:48:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516476  77 58437 60500049 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 16:48:20 [DEBUG   ] Got command RPT from MCS: ref #516477
2018-11-15 16:48:20 [DEBUG   ] summary = ERROR
2018-11-15 16:48:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516477  13 58437 60500241 A  ERRORERROR'
2018-11-15 16:48:20 [DEBUG   ] Got command RPT from MCS: ref #516479
2018-11-15 16:48:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 16:48:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516479  77 58437 60500445 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 16:48:20 [DEBUG   ] Got command RPT from MCS: ref #516480
2018-11-15 16:48:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 16:48:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516480  12 58437 60500649 A  ERRORB¡ff'
2018-11-15 16:48:27 [DEBUG   ] Got command BAM from MCS: ref #516485
2018-11-15 16:48:27 [INFO    ] Finished processing BAM request
2018-11-15 16:48:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:48:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516485   8 58437 60507041 A  ERROR'
2018-11-15 16:48:27 [DEBUG   ] Got command BAM from MCS: ref #516486
2018-11-15 16:48:27 [INFO    ] Finished processing BAM request
2018-11-15 16:48:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:48:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516486   8 58437 60507045 A  ERROR'
2018-11-15 16:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 16:48:27 [DEBUG   ] spawn_process: at 2018-11-15 16:48:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 16:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 16:48:27 [DEBUG   ] spawn_process: at 2018-11-15 16:48:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 16:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 16:48:27 [DEBUG   ] spawn_process: at 2018-11-15 16:48:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 16:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 16:48:27 [DEBUG   ] spawn_process: at 2018-11-15 16:48:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 16:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 16:48:27 [DEBUG   ] spawn_process: at 2018-11-15 16:48:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 16:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 16:48:27 [DEBUG   ] spawn_process: at 2018-11-15 16:48:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 16:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 16:48:27 [DEBUG   ] spawn_process: at 2018-11-15 16:48:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 16:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 16:48:27 [DEBUG   ] spawn_process: at 2018-11-15 16:48:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 16:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 16:48:27 [DEBUG   ] spawn_process: at 2018-11-15 16:48:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 16:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 16:48:27 [DEBUG   ] spawn_process: at 2018-11-15 16:48:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 16:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 16:48:27 [DEBUG   ] spawn_process: at 2018-11-15 16:48:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 16:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 16:48:27 [DEBUG   ] spawn_process: at 2018-11-15 16:48:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 16:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 16:48:27 [DEBUG   ] spawn_process: at 2018-11-15 16:48:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 16:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 16:48:27 [DEBUG   ] spawn_process: at 2018-11-15 16:48:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 16:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 16:48:27 [DEBUG   ] spawn_process: at 2018-11-15 16:48:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 16:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 16:48:27 [DEBUG   ] spawn_process: at 2018-11-15 16:48:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 16:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 16:48:27 [DEBUG   ] spawn_process: at 2018-11-15 16:48:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 16:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 16:48:27 [DEBUG   ] spawn_process: at 2018-11-15 16:48:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 16:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 16:48:27 [DEBUG   ] spawn_process: at 2018-11-15 16:48:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 16:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 16:48:27 [DEBUG   ] spawn_process: at 2018-11-15 16:48:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 16:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 16:48:27 [DEBUG   ] spawn_process: at 2018-11-15 16:48:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 16:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 16:48:27 [DEBUG   ] spawn_process: at 2018-11-15 16:48:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 16:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 16:48:27 [DEBUG   ] spawn_process: at 2018-11-15 16:48:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 16:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 16:48:27 [DEBUG   ] spawn_process: at 2018-11-15 16:48:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 16:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 16:48:27 [DEBUG   ] spawn_process: at 2018-11-15 16:48:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 16:48:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 16:48:27 [DEBUG   ] spawn_process: at 2018-11-15 16:48:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 16:48:37 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 16:48:48 [DEBUG   ] Got command BAM from MCS: ref #516487
2018-11-15 16:48:48 [INFO    ] Finished processing BAM request
2018-11-15 16:48:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:48:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516487   8 58437 60528025 A  ERROR'
2018-11-15 16:48:48 [DEBUG   ] Got command BAM from MCS: ref #516488
2018-11-15 16:48:48 [INFO    ] Finished processing BAM request
2018-11-15 16:48:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:48:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516488   8 58437 60528029 A  ERROR'
2018-11-15 16:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 16:48:48 [DEBUG   ] spawn_process: at 2018-11-15 16:48:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 16:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 16:48:48 [DEBUG   ] spawn_process: at 2018-11-15 16:48:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 16:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 16:48:48 [DEBUG   ] spawn_process: at 2018-11-15 16:48:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 16:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 16:48:48 [DEBUG   ] spawn_process: at 2018-11-15 16:48:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 16:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 16:48:48 [DEBUG   ] spawn_process: at 2018-11-15 16:48:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 16:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 16:48:48 [DEBUG   ] spawn_process: at 2018-11-15 16:48:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 16:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 16:48:48 [DEBUG   ] spawn_process: at 2018-11-15 16:48:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 16:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 16:48:48 [DEBUG   ] spawn_process: at 2018-11-15 16:48:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 16:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 16:48:48 [DEBUG   ] spawn_process: at 2018-11-15 16:48:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 16:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 16:48:48 [DEBUG   ] spawn_process: at 2018-11-15 16:48:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 16:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 16:48:48 [DEBUG   ] spawn_process: at 2018-11-15 16:48:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 16:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 16:48:48 [DEBUG   ] spawn_process: at 2018-11-15 16:48:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 16:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 16:48:48 [DEBUG   ] spawn_process: at 2018-11-15 16:48:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 16:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 16:48:48 [DEBUG   ] spawn_process: at 2018-11-15 16:48:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 16:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 16:48:48 [DEBUG   ] spawn_process: at 2018-11-15 16:48:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 16:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 16:48:48 [DEBUG   ] spawn_process: at 2018-11-15 16:48:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 16:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 16:48:48 [DEBUG   ] spawn_process: at 2018-11-15 16:48:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 16:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 16:48:48 [DEBUG   ] spawn_process: at 2018-11-15 16:48:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 16:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 16:48:48 [DEBUG   ] spawn_process: at 2018-11-15 16:48:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 16:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 16:48:48 [DEBUG   ] spawn_process: at 2018-11-15 16:48:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 16:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 16:48:48 [DEBUG   ] spawn_process: at 2018-11-15 16:48:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 16:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 16:48:48 [DEBUG   ] spawn_process: at 2018-11-15 16:48:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 16:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 16:48:48 [DEBUG   ] spawn_process: at 2018-11-15 16:48:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 16:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 16:48:48 [DEBUG   ] spawn_process: at 2018-11-15 16:48:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 16:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 16:48:48 [DEBUG   ] spawn_process: at 2018-11-15 16:48:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 16:48:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 16:48:48 [DEBUG   ] spawn_process: at 2018-11-15 16:48:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 16:48:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 16:49:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 16:49:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:49:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-15 16:49:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 16:49:02 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-15 16:49:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 16:49:02 [WARNING ] (13, 1, 'bot')
2018-11-15 16:49:02 [WARNING ] (13, 1, 'bot')
2018-11-15 16:49:02 [WARNING ] (13, 1, 'bot')
2018-11-15 16:49:02 [WARNING ] (13, 1, 'bot')
2018-11-15 16:49:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:49:02 [DEBUG   ] Finished updating board flags in 1.043 seconds
2018-11-15 16:49:09 [DEBUG   ] Got command BAM from MCS: ref #516490
2018-11-15 16:49:09 [INFO    ] Finished processing BAM request
2018-11-15 16:49:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:49:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516490   8 58437 60549033 A  ERROR'
2018-11-15 16:49:09 [DEBUG   ] Got command BAM from MCS: ref #516489
2018-11-15 16:49:09 [INFO    ] Finished processing BAM request
2018-11-15 16:49:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:49:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516489   8 58437 60549037 A  ERROR'
2018-11-15 16:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 16:49:09 [DEBUG   ] spawn_process: at 2018-11-15 16:49:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 16:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 16:49:09 [DEBUG   ] spawn_process: at 2018-11-15 16:49:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 16:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 16:49:09 [DEBUG   ] spawn_process: at 2018-11-15 16:49:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 16:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 16:49:09 [DEBUG   ] spawn_process: at 2018-11-15 16:49:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 16:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 16:49:09 [DEBUG   ] spawn_process: at 2018-11-15 16:49:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 16:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 16:49:09 [DEBUG   ] spawn_process: at 2018-11-15 16:49:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 16:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 16:49:09 [DEBUG   ] spawn_process: at 2018-11-15 16:49:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 16:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 16:49:09 [DEBUG   ] spawn_process: at 2018-11-15 16:49:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 16:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 16:49:09 [DEBUG   ] spawn_process: at 2018-11-15 16:49:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 16:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 16:49:09 [DEBUG   ] spawn_process: at 2018-11-15 16:49:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 16:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 16:49:09 [DEBUG   ] spawn_process: at 2018-11-15 16:49:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 16:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 16:49:09 [DEBUG   ] spawn_process: at 2018-11-15 16:49:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 16:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 16:49:09 [DEBUG   ] spawn_process: at 2018-11-15 16:49:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 16:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 16:49:09 [DEBUG   ] spawn_process: at 2018-11-15 16:49:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 16:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 16:49:09 [DEBUG   ] spawn_process: at 2018-11-15 16:49:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 16:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 16:49:09 [DEBUG   ] spawn_process: at 2018-11-15 16:49:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 16:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 16:49:09 [DEBUG   ] spawn_process: at 2018-11-15 16:49:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 16:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 16:49:09 [DEBUG   ] spawn_process: at 2018-11-15 16:49:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 16:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 16:49:09 [DEBUG   ] spawn_process: at 2018-11-15 16:49:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 16:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 16:49:09 [DEBUG   ] spawn_process: at 2018-11-15 16:49:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 16:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 16:49:09 [DEBUG   ] spawn_process: at 2018-11-15 16:49:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 16:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 16:49:09 [DEBUG   ] spawn_process: at 2018-11-15 16:49:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 16:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 16:49:09 [DEBUG   ] spawn_process: at 2018-11-15 16:49:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 16:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 16:49:09 [DEBUG   ] spawn_process: at 2018-11-15 16:49:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 16:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 16:49:09 [DEBUG   ] spawn_process: at 2018-11-15 16:49:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 16:49:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 16:49:09 [DEBUG   ] spawn_process: at 2018-11-15 16:49:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 16:49:17 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 16:49:30 [DEBUG   ] Got command BAM from MCS: ref #516491
2018-11-15 16:49:30 [INFO    ] Finished processing BAM request
2018-11-15 16:49:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:49:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516491   8 58437 60570025 A  ERROR'
2018-11-15 16:49:30 [DEBUG   ] Got command BAM from MCS: ref #516492
2018-11-15 16:49:30 [INFO    ] Finished processing BAM request
2018-11-15 16:49:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:49:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516492   8 58437 60570029 A  ERROR'
2018-11-15 16:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 16:49:30 [DEBUG   ] spawn_process: at 2018-11-15 16:49:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 16:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 16:49:30 [DEBUG   ] spawn_process: at 2018-11-15 16:49:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 16:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 16:49:30 [DEBUG   ] spawn_process: at 2018-11-15 16:49:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 16:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 16:49:30 [DEBUG   ] spawn_process: at 2018-11-15 16:49:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 16:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 16:49:30 [DEBUG   ] spawn_process: at 2018-11-15 16:49:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 16:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 16:49:30 [DEBUG   ] spawn_process: at 2018-11-15 16:49:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 16:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 16:49:30 [DEBUG   ] spawn_process: at 2018-11-15 16:49:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 16:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 16:49:30 [DEBUG   ] spawn_process: at 2018-11-15 16:49:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 16:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 16:49:30 [DEBUG   ] spawn_process: at 2018-11-15 16:49:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 16:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 16:49:30 [DEBUG   ] spawn_process: at 2018-11-15 16:49:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 16:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 16:49:30 [DEBUG   ] spawn_process: at 2018-11-15 16:49:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 16:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 16:49:30 [DEBUG   ] spawn_process: at 2018-11-15 16:49:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 16:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 16:49:30 [DEBUG   ] spawn_process: at 2018-11-15 16:49:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 16:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 16:49:30 [DEBUG   ] spawn_process: at 2018-11-15 16:49:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 16:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 16:49:30 [DEBUG   ] spawn_process: at 2018-11-15 16:49:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 16:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 16:49:30 [DEBUG   ] spawn_process: at 2018-11-15 16:49:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 16:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 16:49:30 [DEBUG   ] spawn_process: at 2018-11-15 16:49:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 16:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 16:49:30 [DEBUG   ] spawn_process: at 2018-11-15 16:49:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 16:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 16:49:30 [DEBUG   ] spawn_process: at 2018-11-15 16:49:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 16:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 16:49:30 [DEBUG   ] spawn_process: at 2018-11-15 16:49:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 16:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 16:49:30 [DEBUG   ] spawn_process: at 2018-11-15 16:49:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 16:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 16:49:30 [DEBUG   ] spawn_process: at 2018-11-15 16:49:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 16:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 16:49:30 [DEBUG   ] spawn_process: at 2018-11-15 16:49:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 16:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 16:49:30 [DEBUG   ] spawn_process: at 2018-11-15 16:49:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 16:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 16:49:30 [DEBUG   ] spawn_process: at 2018-11-15 16:49:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 16:49:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 16:49:30 [DEBUG   ] spawn_process: at 2018-11-15 16:49:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 16:49:37 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-15 16:49:51 [DEBUG   ] Got command BAM from MCS: ref #516493
2018-11-15 16:49:51 [INFO    ] Finished processing BAM request
2018-11-15 16:49:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:49:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516493   8 58437 60591033 A  ERROR'
2018-11-15 16:49:51 [DEBUG   ] Got command BAM from MCS: ref #516494
2018-11-15 16:49:51 [INFO    ] Finished processing BAM request
2018-11-15 16:49:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:49:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516494   8 58437 60591037 A  ERROR'
2018-11-15 16:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 16:49:51 [DEBUG   ] spawn_process: at 2018-11-15 16:49:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 16:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 16:49:51 [DEBUG   ] spawn_process: at 2018-11-15 16:49:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 16:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 16:49:51 [DEBUG   ] spawn_process: at 2018-11-15 16:49:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 16:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 16:49:51 [DEBUG   ] spawn_process: at 2018-11-15 16:49:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 16:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 16:49:51 [DEBUG   ] spawn_process: at 2018-11-15 16:49:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 16:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 16:49:51 [DEBUG   ] spawn_process: at 2018-11-15 16:49:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 16:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 16:49:51 [DEBUG   ] spawn_process: at 2018-11-15 16:49:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 16:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 16:49:51 [DEBUG   ] spawn_process: at 2018-11-15 16:49:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 16:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 16:49:51 [DEBUG   ] spawn_process: at 2018-11-15 16:49:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 16:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 16:49:51 [DEBUG   ] spawn_process: at 2018-11-15 16:49:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 16:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 16:49:51 [DEBUG   ] spawn_process: at 2018-11-15 16:49:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 16:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 16:49:51 [DEBUG   ] spawn_process: at 2018-11-15 16:49:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 16:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 16:49:51 [DEBUG   ] spawn_process: at 2018-11-15 16:49:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 16:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 16:49:51 [DEBUG   ] spawn_process: at 2018-11-15 16:49:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 16:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 16:49:51 [DEBUG   ] spawn_process: at 2018-11-15 16:49:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 16:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 16:49:51 [DEBUG   ] spawn_process: at 2018-11-15 16:49:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 16:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 16:49:51 [DEBUG   ] spawn_process: at 2018-11-15 16:49:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 16:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 16:49:51 [DEBUG   ] spawn_process: at 2018-11-15 16:49:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 16:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 16:49:51 [DEBUG   ] spawn_process: at 2018-11-15 16:49:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 16:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 16:49:51 [DEBUG   ] spawn_process: at 2018-11-15 16:49:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 16:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 16:49:51 [DEBUG   ] spawn_process: at 2018-11-15 16:49:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 16:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 16:49:51 [DEBUG   ] spawn_process: at 2018-11-15 16:49:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 16:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 16:49:51 [DEBUG   ] spawn_process: at 2018-11-15 16:49:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 16:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 16:49:51 [DEBUG   ] spawn_process: at 2018-11-15 16:49:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 16:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 16:49:51 [DEBUG   ] spawn_process: at 2018-11-15 16:49:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 16:49:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 16:49:51 [DEBUG   ] spawn_process: at 2018-11-15 16:49:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 16:49:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 16:50:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 16:50:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:50:02 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-15 16:50:02 [WARNING ] (13, 1, 'bot')
2018-11-15 16:50:02 [WARNING ] (13, 1, 'bot')
2018-11-15 16:50:02 [WARNING ] (13, 1, 'bot')
2018-11-15 16:50:02 [WARNING ] (13, 1, 'bot')
2018-11-15 16:50:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:50:02 [DEBUG   ] Finished updating board flags in 0.972 seconds
2018-11-15 16:50:12 [DEBUG   ] Got command BAM from MCS: ref #516495
2018-11-15 16:50:12 [INFO    ] Finished processing BAM request
2018-11-15 16:50:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:50:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516495   8 58437 60612029 A  ERROR'
2018-11-15 16:50:12 [DEBUG   ] Got command BAM from MCS: ref #516496
2018-11-15 16:50:12 [INFO    ] Finished processing BAM request
2018-11-15 16:50:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:50:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516496   8 58437 60612033 A  ERROR'
2018-11-15 16:50:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 16:50:12 [DEBUG   ] spawn_process: at 2018-11-15 16:50:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 16:50:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 16:50:12 [DEBUG   ] spawn_process: at 2018-11-15 16:50:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 16:50:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 16:50:12 [DEBUG   ] spawn_process: at 2018-11-15 16:50:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 16:50:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 16:50:12 [DEBUG   ] spawn_process: at 2018-11-15 16:50:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 16:50:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 16:50:12 [DEBUG   ] spawn_process: at 2018-11-15 16:50:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 16:50:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 16:50:12 [DEBUG   ] spawn_process: at 2018-11-15 16:50:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 16:50:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 16:50:12 [DEBUG   ] spawn_process: at 2018-11-15 16:50:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 16:50:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 16:50:12 [DEBUG   ] spawn_process: at 2018-11-15 16:50:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 16:50:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 16:50:12 [DEBUG   ] spawn_process: at 2018-11-15 16:50:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 16:50:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 16:50:12 [DEBUG   ] spawn_process: at 2018-11-15 16:50:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 16:50:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 16:50:12 [DEBUG   ] spawn_process: at 2018-11-15 16:50:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 16:50:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 16:50:12 [DEBUG   ] spawn_process: at 2018-11-15 16:50:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 16:50:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 16:50:12 [DEBUG   ] spawn_process: at 2018-11-15 16:50:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 16:50:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 16:50:12 [DEBUG   ] spawn_process: at 2018-11-15 16:50:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 16:50:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 16:50:12 [DEBUG   ] spawn_process: at 2018-11-15 16:50:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 16:50:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 16:50:12 [DEBUG   ] spawn_process: at 2018-11-15 16:50:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 16:50:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 16:50:12 [DEBUG   ] spawn_process: at 2018-11-15 16:50:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 16:50:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 16:50:12 [DEBUG   ] spawn_process: at 2018-11-15 16:50:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 16:50:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 16:50:12 [DEBUG   ] spawn_process: at 2018-11-15 16:50:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 16:50:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 16:50:12 [DEBUG   ] spawn_process: at 2018-11-15 16:50:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 16:50:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 16:50:12 [DEBUG   ] spawn_process: at 2018-11-15 16:50:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 16:50:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 16:50:12 [DEBUG   ] spawn_process: at 2018-11-15 16:50:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 16:50:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 16:50:12 [DEBUG   ] spawn_process: at 2018-11-15 16:50:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 16:50:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 16:50:12 [DEBUG   ] spawn_process: at 2018-11-15 16:50:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 16:50:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 16:50:12 [DEBUG   ] spawn_process: at 2018-11-15 16:50:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 16:50:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 16:50:12 [DEBUG   ] spawn_process: at 2018-11-15 16:50:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 16:50:18 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-11-15 16:50:33 [DEBUG   ] Got command BAM from MCS: ref #516501
2018-11-15 16:50:33 [INFO    ] Finished processing BAM request
2018-11-15 16:50:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:50:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516501   8 58437 60633033 A  ERROR'
2018-11-15 16:50:33 [DEBUG   ] Got command BAM from MCS: ref #516502
2018-11-15 16:50:33 [INFO    ] Finished processing BAM request
2018-11-15 16:50:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:50:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516502   8 58437 60633037 A  ERROR'
2018-11-15 16:50:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 16:50:33 [DEBUG   ] spawn_process: at 2018-11-15 16:50:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 16:50:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 16:50:33 [DEBUG   ] spawn_process: at 2018-11-15 16:50:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 16:50:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 16:50:33 [DEBUG   ] spawn_process: at 2018-11-15 16:50:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 16:50:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 16:50:33 [DEBUG   ] spawn_process: at 2018-11-15 16:50:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 16:50:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 16:50:33 [DEBUG   ] spawn_process: at 2018-11-15 16:50:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 16:50:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 16:50:33 [DEBUG   ] spawn_process: at 2018-11-15 16:50:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 16:50:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 16:50:33 [DEBUG   ] spawn_process: at 2018-11-15 16:50:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 16:50:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 16:50:33 [DEBUG   ] spawn_process: at 2018-11-15 16:50:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 16:50:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 16:50:33 [DEBUG   ] spawn_process: at 2018-11-15 16:50:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 16:50:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 16:50:33 [DEBUG   ] spawn_process: at 2018-11-15 16:50:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 16:50:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 16:50:33 [DEBUG   ] spawn_process: at 2018-11-15 16:50:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 16:50:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 16:50:33 [DEBUG   ] spawn_process: at 2018-11-15 16:50:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 16:50:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 16:50:33 [DEBUG   ] spawn_process: at 2018-11-15 16:50:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 16:50:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 16:50:33 [DEBUG   ] spawn_process: at 2018-11-15 16:50:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 16:50:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 16:50:33 [DEBUG   ] spawn_process: at 2018-11-15 16:50:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 16:50:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 16:50:33 [DEBUG   ] spawn_process: at 2018-11-15 16:50:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 16:50:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 16:50:33 [DEBUG   ] spawn_process: at 2018-11-15 16:50:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 16:50:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 16:50:33 [DEBUG   ] spawn_process: at 2018-11-15 16:50:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 16:50:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 16:50:33 [DEBUG   ] spawn_process: at 2018-11-15 16:50:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 16:50:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 16:50:33 [DEBUG   ] spawn_process: at 2018-11-15 16:50:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 16:50:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 16:50:33 [DEBUG   ] spawn_process: at 2018-11-15 16:50:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 16:50:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 16:50:33 [DEBUG   ] spawn_process: at 2018-11-15 16:50:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 16:50:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 16:50:33 [DEBUG   ] spawn_process: at 2018-11-15 16:50:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 16:50:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 16:50:33 [DEBUG   ] spawn_process: at 2018-11-15 16:50:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 16:50:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 16:50:33 [DEBUG   ] spawn_process: at 2018-11-15 16:50:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 16:50:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 16:50:33 [DEBUG   ] spawn_process: at 2018-11-15 16:50:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 16:50:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 16:50:45 [DEBUG   ] Got command RPT from MCS: ref #516503
2018-11-15 16:50:45 [DEBUG   ] summary = ERROR
2018-11-15 16:50:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516503  13 58437 60645133 A  ERRORERROR'
2018-11-15 16:50:45 [DEBUG   ] Got command RPT from MCS: ref #516504
2018-11-15 16:50:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 16:50:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516504  77 58437 60645134 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 16:50:54 [DEBUG   ] Got command BAM from MCS: ref #516520
2018-11-15 16:50:54 [INFO    ] Finished processing BAM request
2018-11-15 16:50:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:50:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516520   8 58437 60654029 A  ERROR'
2018-11-15 16:50:54 [DEBUG   ] Got command BAM from MCS: ref #516521
2018-11-15 16:50:54 [INFO    ] Finished processing BAM request
2018-11-15 16:50:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:50:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516521   8 58437 60654033 A  ERROR'
2018-11-15 16:50:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 16:50:54 [DEBUG   ] spawn_process: at 2018-11-15 16:50:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 16:50:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 16:50:54 [DEBUG   ] spawn_process: at 2018-11-15 16:50:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 16:50:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 16:50:54 [DEBUG   ] spawn_process: at 2018-11-15 16:50:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 16:50:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 16:50:54 [DEBUG   ] spawn_process: at 2018-11-15 16:50:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 16:50:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 16:50:54 [DEBUG   ] spawn_process: at 2018-11-15 16:50:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 16:50:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 16:50:54 [DEBUG   ] spawn_process: at 2018-11-15 16:50:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 16:50:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 16:50:54 [DEBUG   ] spawn_process: at 2018-11-15 16:50:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 16:50:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 16:50:54 [DEBUG   ] spawn_process: at 2018-11-15 16:50:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 16:50:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 16:50:54 [DEBUG   ] spawn_process: at 2018-11-15 16:50:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 16:50:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 16:50:54 [DEBUG   ] spawn_process: at 2018-11-15 16:50:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 16:50:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 16:50:54 [DEBUG   ] spawn_process: at 2018-11-15 16:50:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 16:50:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 16:50:54 [DEBUG   ] spawn_process: at 2018-11-15 16:50:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 16:50:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 16:50:54 [DEBUG   ] spawn_process: at 2018-11-15 16:50:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 16:50:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 16:50:54 [DEBUG   ] spawn_process: at 2018-11-15 16:50:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 16:50:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 16:50:54 [DEBUG   ] spawn_process: at 2018-11-15 16:50:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 16:50:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 16:50:54 [DEBUG   ] spawn_process: at 2018-11-15 16:50:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 16:50:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 16:50:54 [DEBUG   ] spawn_process: at 2018-11-15 16:50:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 16:50:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 16:50:54 [DEBUG   ] spawn_process: at 2018-11-15 16:50:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 16:50:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 16:50:54 [DEBUG   ] spawn_process: at 2018-11-15 16:50:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 16:50:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 16:50:54 [DEBUG   ] spawn_process: at 2018-11-15 16:50:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 16:50:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 16:50:54 [DEBUG   ] spawn_process: at 2018-11-15 16:50:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 16:50:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 16:50:54 [DEBUG   ] spawn_process: at 2018-11-15 16:50:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 16:50:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 16:50:54 [DEBUG   ] spawn_process: at 2018-11-15 16:50:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 16:50:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 16:50:54 [DEBUG   ] spawn_process: at 2018-11-15 16:50:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 16:50:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 16:50:54 [DEBUG   ] spawn_process: at 2018-11-15 16:50:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 16:50:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 16:50:54 [DEBUG   ] spawn_process: at 2018-11-15 16:50:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 16:50:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 16:51:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-11-15 16:51:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 16:51:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 16:51:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:51:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-15 16:51:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-15 16:51:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 16:51:03 [WARNING ] (13, 1, 'bot')
2018-11-15 16:51:03 [WARNING ] (13, 1, 'bot')
2018-11-15 16:51:03 [WARNING ] (13, 1, 'bot')
2018-11-15 16:51:03 [WARNING ] (13, 1, 'bot')
2018-11-15 16:51:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:51:03 [DEBUG   ] Finished updating board flags in 1.352 seconds
2018-11-15 16:51:15 [DEBUG   ] Got command BAM from MCS: ref #516523
2018-11-15 16:51:15 [INFO    ] Finished processing BAM request
2018-11-15 16:51:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:51:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516523   8 58437 60675025 A  ERROR'
2018-11-15 16:51:15 [DEBUG   ] Got command BAM from MCS: ref #516522
2018-11-15 16:51:15 [INFO    ] Finished processing BAM request
2018-11-15 16:51:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:51:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516522   8 58437 60675029 A  ERROR'
2018-11-15 16:51:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 16:51:15 [DEBUG   ] spawn_process: at 2018-11-15 16:51:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 16:51:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 16:51:15 [DEBUG   ] spawn_process: at 2018-11-15 16:51:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 16:51:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 16:51:15 [DEBUG   ] spawn_process: at 2018-11-15 16:51:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 16:51:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 16:51:15 [DEBUG   ] spawn_process: at 2018-11-15 16:51:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 16:51:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 16:51:15 [DEBUG   ] spawn_process: at 2018-11-15 16:51:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 16:51:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 16:51:15 [DEBUG   ] spawn_process: at 2018-11-15 16:51:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 16:51:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 16:51:15 [DEBUG   ] spawn_process: at 2018-11-15 16:51:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 16:51:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 16:51:15 [DEBUG   ] spawn_process: at 2018-11-15 16:51:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 16:51:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 16:51:15 [DEBUG   ] spawn_process: at 2018-11-15 16:51:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 16:51:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 16:51:15 [DEBUG   ] spawn_process: at 2018-11-15 16:51:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 16:51:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 16:51:15 [DEBUG   ] spawn_process: at 2018-11-15 16:51:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 16:51:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 16:51:15 [DEBUG   ] spawn_process: at 2018-11-15 16:51:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 16:51:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 16:51:15 [DEBUG   ] spawn_process: at 2018-11-15 16:51:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 16:51:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 16:51:15 [DEBUG   ] spawn_process: at 2018-11-15 16:51:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 16:51:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 16:51:15 [DEBUG   ] spawn_process: at 2018-11-15 16:51:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 16:51:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 16:51:15 [DEBUG   ] spawn_process: at 2018-11-15 16:51:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 16:51:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 16:51:15 [DEBUG   ] spawn_process: at 2018-11-15 16:51:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 16:51:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 16:51:15 [DEBUG   ] spawn_process: at 2018-11-15 16:51:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 16:51:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 16:51:15 [DEBUG   ] spawn_process: at 2018-11-15 16:51:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 16:51:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 16:51:15 [DEBUG   ] spawn_process: at 2018-11-15 16:51:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 16:51:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 16:51:15 [DEBUG   ] spawn_process: at 2018-11-15 16:51:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 16:51:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 16:51:15 [DEBUG   ] spawn_process: at 2018-11-15 16:51:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 16:51:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 16:51:15 [DEBUG   ] spawn_process: at 2018-11-15 16:51:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 16:51:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 16:51:15 [DEBUG   ] spawn_process: at 2018-11-15 16:51:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 16:51:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 16:51:15 [DEBUG   ] spawn_process: at 2018-11-15 16:51:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 16:51:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 16:51:15 [DEBUG   ] spawn_process: at 2018-11-15 16:51:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 16:51:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 16:51:36 [DEBUG   ] Got command BAM from MCS: ref #516525
2018-11-15 16:51:36 [INFO    ] Finished processing BAM request
2018-11-15 16:51:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:51:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516525   8 58437 60696025 A  ERROR'
2018-11-15 16:51:36 [DEBUG   ] Got command BAM from MCS: ref #516524
2018-11-15 16:51:36 [INFO    ] Finished processing BAM request
2018-11-15 16:51:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:51:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516524   8 58437 60696029 A  ERROR'
2018-11-15 16:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 16:51:36 [DEBUG   ] spawn_process: at 2018-11-15 16:51:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 16:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 16:51:36 [DEBUG   ] spawn_process: at 2018-11-15 16:51:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 16:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 16:51:36 [DEBUG   ] spawn_process: at 2018-11-15 16:51:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 16:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 16:51:36 [DEBUG   ] spawn_process: at 2018-11-15 16:51:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 16:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 16:51:36 [DEBUG   ] spawn_process: at 2018-11-15 16:51:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 16:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 16:51:36 [DEBUG   ] spawn_process: at 2018-11-15 16:51:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 16:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 16:51:36 [DEBUG   ] spawn_process: at 2018-11-15 16:51:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 16:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 16:51:36 [DEBUG   ] spawn_process: at 2018-11-15 16:51:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 16:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 16:51:36 [DEBUG   ] spawn_process: at 2018-11-15 16:51:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 16:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 16:51:36 [DEBUG   ] spawn_process: at 2018-11-15 16:51:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 16:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 16:51:36 [DEBUG   ] spawn_process: at 2018-11-15 16:51:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 16:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 16:51:36 [DEBUG   ] spawn_process: at 2018-11-15 16:51:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 16:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 16:51:36 [DEBUG   ] spawn_process: at 2018-11-15 16:51:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 16:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 16:51:36 [DEBUG   ] spawn_process: at 2018-11-15 16:51:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 16:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 16:51:36 [DEBUG   ] spawn_process: at 2018-11-15 16:51:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 16:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 16:51:36 [DEBUG   ] spawn_process: at 2018-11-15 16:51:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 16:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 16:51:36 [DEBUG   ] spawn_process: at 2018-11-15 16:51:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 16:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 16:51:36 [DEBUG   ] spawn_process: at 2018-11-15 16:51:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 16:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 16:51:36 [DEBUG   ] spawn_process: at 2018-11-15 16:51:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 16:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 16:51:36 [DEBUG   ] spawn_process: at 2018-11-15 16:51:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 16:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 16:51:36 [DEBUG   ] spawn_process: at 2018-11-15 16:51:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 16:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 16:51:36 [DEBUG   ] spawn_process: at 2018-11-15 16:51:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 16:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 16:51:36 [DEBUG   ] spawn_process: at 2018-11-15 16:51:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 16:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 16:51:36 [DEBUG   ] spawn_process: at 2018-11-15 16:51:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 16:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 16:51:36 [DEBUG   ] spawn_process: at 2018-11-15 16:51:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 16:51:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 16:51:36 [DEBUG   ] spawn_process: at 2018-11-15 16:51:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 16:51:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 16:51:57 [DEBUG   ] Got command BAM from MCS: ref #516527
2018-11-15 16:51:57 [INFO    ] Finished processing BAM request
2018-11-15 16:51:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:51:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516527   8 58437 60717029 A  ERROR'
2018-11-15 16:51:57 [DEBUG   ] Got command BAM from MCS: ref #516526
2018-11-15 16:51:57 [INFO    ] Finished processing BAM request
2018-11-15 16:51:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:51:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516526   8 58437 60717033 A  ERROR'
2018-11-15 16:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 16:51:57 [DEBUG   ] spawn_process: at 2018-11-15 16:51:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 16:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 16:51:57 [DEBUG   ] spawn_process: at 2018-11-15 16:51:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 16:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 16:51:57 [DEBUG   ] spawn_process: at 2018-11-15 16:51:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 16:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 16:51:57 [DEBUG   ] spawn_process: at 2018-11-15 16:51:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 16:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 16:51:57 [DEBUG   ] spawn_process: at 2018-11-15 16:51:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 16:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 16:51:57 [DEBUG   ] spawn_process: at 2018-11-15 16:51:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 16:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 16:51:57 [DEBUG   ] spawn_process: at 2018-11-15 16:51:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 16:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 16:51:57 [DEBUG   ] spawn_process: at 2018-11-15 16:51:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 16:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 16:51:57 [DEBUG   ] spawn_process: at 2018-11-15 16:51:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 16:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 16:51:57 [DEBUG   ] spawn_process: at 2018-11-15 16:51:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 16:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 16:51:57 [DEBUG   ] spawn_process: at 2018-11-15 16:51:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 16:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 16:51:57 [DEBUG   ] spawn_process: at 2018-11-15 16:51:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 16:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 16:51:57 [DEBUG   ] spawn_process: at 2018-11-15 16:51:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 16:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 16:51:57 [DEBUG   ] spawn_process: at 2018-11-15 16:51:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 16:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 16:51:57 [DEBUG   ] spawn_process: at 2018-11-15 16:51:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 16:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 16:51:57 [DEBUG   ] spawn_process: at 2018-11-15 16:51:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 16:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 16:51:57 [DEBUG   ] spawn_process: at 2018-11-15 16:51:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 16:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 16:51:57 [DEBUG   ] spawn_process: at 2018-11-15 16:51:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 16:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 16:51:57 [DEBUG   ] spawn_process: at 2018-11-15 16:51:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 16:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 16:51:57 [DEBUG   ] spawn_process: at 2018-11-15 16:51:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 16:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 16:51:57 [DEBUG   ] spawn_process: at 2018-11-15 16:51:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 16:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 16:51:57 [DEBUG   ] spawn_process: at 2018-11-15 16:51:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 16:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 16:51:57 [DEBUG   ] spawn_process: at 2018-11-15 16:51:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 16:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 16:51:57 [DEBUG   ] spawn_process: at 2018-11-15 16:51:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 16:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 16:51:57 [DEBUG   ] spawn_process: at 2018-11-15 16:51:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 16:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 16:51:57 [DEBUG   ] spawn_process: at 2018-11-15 16:51:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 16:51:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 16:52:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 16:52:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:52:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-15 16:52:03 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 16:52:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 16:52:03 [WARNING ] (13, 1, 'bot')
2018-11-15 16:52:03 [WARNING ] (13, 1, 'bot')
2018-11-15 16:52:03 [WARNING ] (13, 1, 'bot')
2018-11-15 16:52:03 [WARNING ] (13, 1, 'bot')
2018-11-15 16:52:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:52:03 [DEBUG   ] Finished updating board flags in 1.191 seconds
2018-11-15 16:52:18 [DEBUG   ] Got command BAM from MCS: ref #516528
2018-11-15 16:52:18 [INFO    ] Finished processing BAM request
2018-11-15 16:52:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:52:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516528   8 58437 60738033 A  ERROR'
2018-11-15 16:52:18 [DEBUG   ] Got command BAM from MCS: ref #516529
2018-11-15 16:52:18 [INFO    ] Finished processing BAM request
2018-11-15 16:52:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:52:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516529   8 58437 60738037 A  ERROR'
2018-11-15 16:52:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 16:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 16:52:18 [DEBUG   ] spawn_process: at 2018-11-15 16:52:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 16:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 16:52:18 [DEBUG   ] spawn_process: at 2018-11-15 16:52:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 16:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 16:52:18 [DEBUG   ] spawn_process: at 2018-11-15 16:52:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 16:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 16:52:18 [DEBUG   ] spawn_process: at 2018-11-15 16:52:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 16:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 16:52:18 [DEBUG   ] spawn_process: at 2018-11-15 16:52:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 16:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 16:52:18 [DEBUG   ] spawn_process: at 2018-11-15 16:52:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 16:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 16:52:18 [DEBUG   ] spawn_process: at 2018-11-15 16:52:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 16:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 16:52:18 [DEBUG   ] spawn_process: at 2018-11-15 16:52:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 16:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 16:52:18 [DEBUG   ] spawn_process: at 2018-11-15 16:52:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 16:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 16:52:18 [DEBUG   ] spawn_process: at 2018-11-15 16:52:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 16:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 16:52:18 [DEBUG   ] spawn_process: at 2018-11-15 16:52:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 16:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 16:52:18 [DEBUG   ] spawn_process: at 2018-11-15 16:52:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 16:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 16:52:18 [DEBUG   ] spawn_process: at 2018-11-15 16:52:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 16:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 16:52:18 [DEBUG   ] spawn_process: at 2018-11-15 16:52:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 16:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 16:52:18 [DEBUG   ] spawn_process: at 2018-11-15 16:52:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 16:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 16:52:18 [DEBUG   ] spawn_process: at 2018-11-15 16:52:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 16:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 16:52:18 [DEBUG   ] spawn_process: at 2018-11-15 16:52:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 16:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 16:52:18 [DEBUG   ] spawn_process: at 2018-11-15 16:52:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 16:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 16:52:18 [DEBUG   ] spawn_process: at 2018-11-15 16:52:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 16:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 16:52:18 [DEBUG   ] spawn_process: at 2018-11-15 16:52:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 16:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 16:52:18 [DEBUG   ] spawn_process: at 2018-11-15 16:52:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 16:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 16:52:18 [DEBUG   ] spawn_process: at 2018-11-15 16:52:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 16:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 16:52:18 [DEBUG   ] spawn_process: at 2018-11-15 16:52:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 16:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 16:52:18 [DEBUG   ] spawn_process: at 2018-11-15 16:52:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 16:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 16:52:18 [DEBUG   ] spawn_process: at 2018-11-15 16:52:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 16:52:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 16:52:18 [DEBUG   ] spawn_process: at 2018-11-15 16:52:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 16:52:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 16:52:39 [DEBUG   ] Got command BAM from MCS: ref #516530
2018-11-15 16:52:39 [INFO    ] Finished processing BAM request
2018-11-15 16:52:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:52:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516530   8 58437 60759033 A  ERROR'
2018-11-15 16:52:39 [DEBUG   ] Got command BAM from MCS: ref #516531
2018-11-15 16:52:39 [INFO    ] Finished processing BAM request
2018-11-15 16:52:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:52:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516531   8 58437 60759037 A  ERROR'
2018-11-15 16:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 16:52:39 [DEBUG   ] spawn_process: at 2018-11-15 16:52:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 16:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 16:52:39 [DEBUG   ] spawn_process: at 2018-11-15 16:52:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 16:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 16:52:39 [DEBUG   ] spawn_process: at 2018-11-15 16:52:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 16:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 16:52:39 [DEBUG   ] spawn_process: at 2018-11-15 16:52:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 16:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 16:52:39 [DEBUG   ] spawn_process: at 2018-11-15 16:52:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 16:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 16:52:39 [DEBUG   ] spawn_process: at 2018-11-15 16:52:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 16:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 16:52:39 [DEBUG   ] spawn_process: at 2018-11-15 16:52:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 16:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 16:52:39 [DEBUG   ] spawn_process: at 2018-11-15 16:52:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 16:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 16:52:39 [DEBUG   ] spawn_process: at 2018-11-15 16:52:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 16:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 16:52:39 [DEBUG   ] spawn_process: at 2018-11-15 16:52:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 16:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 16:52:39 [DEBUG   ] spawn_process: at 2018-11-15 16:52:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 16:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 16:52:39 [DEBUG   ] spawn_process: at 2018-11-15 16:52:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 16:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 16:52:39 [DEBUG   ] spawn_process: at 2018-11-15 16:52:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 16:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 16:52:39 [DEBUG   ] spawn_process: at 2018-11-15 16:52:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 16:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 16:52:39 [DEBUG   ] spawn_process: at 2018-11-15 16:52:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 16:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 16:52:39 [DEBUG   ] spawn_process: at 2018-11-15 16:52:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 16:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 16:52:39 [DEBUG   ] spawn_process: at 2018-11-15 16:52:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 16:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 16:52:39 [DEBUG   ] spawn_process: at 2018-11-15 16:52:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 16:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 16:52:39 [DEBUG   ] spawn_process: at 2018-11-15 16:52:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 16:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 16:52:39 [DEBUG   ] spawn_process: at 2018-11-15 16:52:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 16:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 16:52:39 [DEBUG   ] spawn_process: at 2018-11-15 16:52:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 16:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 16:52:39 [DEBUG   ] spawn_process: at 2018-11-15 16:52:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 16:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 16:52:39 [DEBUG   ] spawn_process: at 2018-11-15 16:52:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 16:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 16:52:39 [DEBUG   ] spawn_process: at 2018-11-15 16:52:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 16:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 16:52:39 [DEBUG   ] spawn_process: at 2018-11-15 16:52:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 16:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 16:52:39 [DEBUG   ] spawn_process: at 2018-11-15 16:52:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 16:52:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 16:53:00 [DEBUG   ] Got command BAM from MCS: ref #516533
2018-11-15 16:53:00 [INFO    ] Finished processing BAM request
2018-11-15 16:53:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:53:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516533   8 58437 60780029 A  ERROR'
2018-11-15 16:53:00 [DEBUG   ] Got command BAM from MCS: ref #516532
2018-11-15 16:53:00 [INFO    ] Finished processing BAM request
2018-11-15 16:53:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:53:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516532   8 58437 60780033 A  ERROR'
2018-11-15 16:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 16:53:00 [DEBUG   ] spawn_process: at 2018-11-15 16:53:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 16:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 16:53:00 [DEBUG   ] spawn_process: at 2018-11-15 16:53:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 16:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 16:53:00 [DEBUG   ] spawn_process: at 2018-11-15 16:53:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 16:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 16:53:00 [DEBUG   ] spawn_process: at 2018-11-15 16:53:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 16:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 16:53:00 [DEBUG   ] spawn_process: at 2018-11-15 16:53:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 16:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 16:53:00 [DEBUG   ] spawn_process: at 2018-11-15 16:53:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 16:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 16:53:00 [DEBUG   ] spawn_process: at 2018-11-15 16:53:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 16:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 16:53:00 [DEBUG   ] spawn_process: at 2018-11-15 16:53:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 16:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 16:53:00 [DEBUG   ] spawn_process: at 2018-11-15 16:53:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 16:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 16:53:00 [DEBUG   ] spawn_process: at 2018-11-15 16:53:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 16:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 16:53:00 [DEBUG   ] spawn_process: at 2018-11-15 16:53:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 16:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 16:53:00 [DEBUG   ] spawn_process: at 2018-11-15 16:53:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 16:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 16:53:00 [DEBUG   ] spawn_process: at 2018-11-15 16:53:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 16:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 16:53:00 [DEBUG   ] spawn_process: at 2018-11-15 16:53:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 16:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 16:53:00 [DEBUG   ] spawn_process: at 2018-11-15 16:53:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 16:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 16:53:00 [DEBUG   ] spawn_process: at 2018-11-15 16:53:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 16:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 16:53:00 [DEBUG   ] spawn_process: at 2018-11-15 16:53:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 16:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 16:53:00 [DEBUG   ] spawn_process: at 2018-11-15 16:53:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 16:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 16:53:00 [DEBUG   ] spawn_process: at 2018-11-15 16:53:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 16:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 16:53:00 [DEBUG   ] spawn_process: at 2018-11-15 16:53:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 16:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 16:53:00 [DEBUG   ] spawn_process: at 2018-11-15 16:53:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 16:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 16:53:00 [DEBUG   ] spawn_process: at 2018-11-15 16:53:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 16:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 16:53:00 [DEBUG   ] spawn_process: at 2018-11-15 16:53:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 16:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 16:53:00 [DEBUG   ] spawn_process: at 2018-11-15 16:53:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 16:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 16:53:00 [DEBUG   ] spawn_process: at 2018-11-15 16:53:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 16:53:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 16:53:00 [DEBUG   ] spawn_process: at 2018-11-15 16:53:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 16:53:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 16:53:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:53:03 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 16:53:03 [WARNING ] (13, 1, 'bot')
2018-11-15 16:53:03 [WARNING ] (13, 1, 'bot')
2018-11-15 16:53:03 [WARNING ] (13, 1, 'bot')
2018-11-15 16:53:03 [WARNING ] (13, 1, 'bot')
2018-11-15 16:53:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:53:03 [DEBUG   ] Finished updating board flags in 1.010 seconds
2018-11-15 16:53:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 16:53:19 [DEBUG   ] Got command RPT from MCS: ref #516534
2018-11-15 16:53:19 [DEBUG   ] summary = ERROR
2018-11-15 16:53:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516534  13 58437 60799940 A  ERRORERROR'
2018-11-15 16:53:20 [DEBUG   ] Got command RPT from MCS: ref #516537
2018-11-15 16:53:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 16:53:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516537  77 58437 60800129 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 16:53:20 [DEBUG   ] Got command RPT from MCS: ref #516538
2018-11-15 16:53:20 [DEBUG   ] summary = ERROR
2018-11-15 16:53:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516538  13 58437 60800333 A  ERRORERROR'
2018-11-15 16:53:20 [DEBUG   ] Got command RPT from MCS: ref #516539
2018-11-15 16:53:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 16:53:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516539  77 58437 60800537 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 16:53:20 [DEBUG   ] Got command RPT from MCS: ref #516540
2018-11-15 16:53:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 16:53:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516540  12 58437 60800741 A  ERRORB£ff'
2018-11-15 16:53:21 [DEBUG   ] Got command BAM from MCS: ref #516535
2018-11-15 16:53:21 [INFO    ] Finished processing BAM request
2018-11-15 16:53:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:53:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516535   8 58437 60801033 A  ERROR'
2018-11-15 16:53:21 [DEBUG   ] Got command BAM from MCS: ref #516536
2018-11-15 16:53:21 [INFO    ] Finished processing BAM request
2018-11-15 16:53:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:53:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516536   8 58437 60801037 A  ERROR'
2018-11-15 16:53:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 16:53:21 [DEBUG   ] spawn_process: at 2018-11-15 16:53:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 16:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 16:53:22 [DEBUG   ] spawn_process: at 2018-11-15 16:53:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 16:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 16:53:22 [DEBUG   ] spawn_process: at 2018-11-15 16:53:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 16:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 16:53:22 [DEBUG   ] spawn_process: at 2018-11-15 16:53:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 16:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 16:53:22 [DEBUG   ] spawn_process: at 2018-11-15 16:53:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 16:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 16:53:22 [DEBUG   ] spawn_process: at 2018-11-15 16:53:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 16:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 16:53:22 [DEBUG   ] spawn_process: at 2018-11-15 16:53:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 16:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 16:53:22 [DEBUG   ] spawn_process: at 2018-11-15 16:53:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 16:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 16:53:22 [DEBUG   ] spawn_process: at 2018-11-15 16:53:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 16:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 16:53:22 [DEBUG   ] spawn_process: at 2018-11-15 16:53:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 16:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 16:53:22 [DEBUG   ] spawn_process: at 2018-11-15 16:53:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 16:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 16:53:22 [DEBUG   ] spawn_process: at 2018-11-15 16:53:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 16:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 16:53:22 [DEBUG   ] spawn_process: at 2018-11-15 16:53:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 16:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 16:53:22 [DEBUG   ] spawn_process: at 2018-11-15 16:53:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 16:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 16:53:22 [DEBUG   ] spawn_process: at 2018-11-15 16:53:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 16:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 16:53:22 [DEBUG   ] spawn_process: at 2018-11-15 16:53:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 16:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 16:53:22 [DEBUG   ] spawn_process: at 2018-11-15 16:53:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 16:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 16:53:22 [DEBUG   ] spawn_process: at 2018-11-15 16:53:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 16:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 16:53:22 [DEBUG   ] spawn_process: at 2018-11-15 16:53:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 16:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 16:53:22 [DEBUG   ] spawn_process: at 2018-11-15 16:53:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 16:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 16:53:22 [DEBUG   ] spawn_process: at 2018-11-15 16:53:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 16:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 16:53:22 [DEBUG   ] spawn_process: at 2018-11-15 16:53:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 16:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 16:53:22 [DEBUG   ] spawn_process: at 2018-11-15 16:53:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 16:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 16:53:22 [DEBUG   ] spawn_process: at 2018-11-15 16:53:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 16:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 16:53:22 [DEBUG   ] spawn_process: at 2018-11-15 16:53:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 16:53:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 16:53:22 [DEBUG   ] spawn_process: at 2018-11-15 16:53:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 16:53:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 16:53:42 [DEBUG   ] Got command BAM from MCS: ref #516545
2018-11-15 16:53:42 [INFO    ] Finished processing BAM request
2018-11-15 16:53:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:53:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516545   8 58437 60822025 A  ERROR'
2018-11-15 16:53:42 [DEBUG   ] Got command BAM from MCS: ref #516546
2018-11-15 16:53:42 [INFO    ] Finished processing BAM request
2018-11-15 16:53:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:53:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516546   8 58437 60822029 A  ERROR'
2018-11-15 16:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 16:53:42 [DEBUG   ] spawn_process: at 2018-11-15 16:53:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 16:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 16:53:42 [DEBUG   ] spawn_process: at 2018-11-15 16:53:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 16:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 16:53:42 [DEBUG   ] spawn_process: at 2018-11-15 16:53:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 16:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 16:53:42 [DEBUG   ] spawn_process: at 2018-11-15 16:53:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 16:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 16:53:42 [DEBUG   ] spawn_process: at 2018-11-15 16:53:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 16:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 16:53:42 [DEBUG   ] spawn_process: at 2018-11-15 16:53:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 16:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 16:53:42 [DEBUG   ] spawn_process: at 2018-11-15 16:53:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 16:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 16:53:42 [DEBUG   ] spawn_process: at 2018-11-15 16:53:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 16:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 16:53:42 [DEBUG   ] spawn_process: at 2018-11-15 16:53:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 16:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 16:53:42 [DEBUG   ] spawn_process: at 2018-11-15 16:53:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 16:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 16:53:42 [DEBUG   ] spawn_process: at 2018-11-15 16:53:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 16:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 16:53:42 [DEBUG   ] spawn_process: at 2018-11-15 16:53:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 16:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 16:53:42 [DEBUG   ] spawn_process: at 2018-11-15 16:53:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 16:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 16:53:42 [DEBUG   ] spawn_process: at 2018-11-15 16:53:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 16:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 16:53:42 [DEBUG   ] spawn_process: at 2018-11-15 16:53:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 16:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 16:53:42 [DEBUG   ] spawn_process: at 2018-11-15 16:53:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 16:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 16:53:42 [DEBUG   ] spawn_process: at 2018-11-15 16:53:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 16:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 16:53:42 [DEBUG   ] spawn_process: at 2018-11-15 16:53:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 16:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 16:53:42 [DEBUG   ] spawn_process: at 2018-11-15 16:53:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 16:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 16:53:42 [DEBUG   ] spawn_process: at 2018-11-15 16:53:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 16:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 16:53:42 [DEBUG   ] spawn_process: at 2018-11-15 16:53:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 16:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 16:53:42 [DEBUG   ] spawn_process: at 2018-11-15 16:53:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 16:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 16:53:42 [DEBUG   ] spawn_process: at 2018-11-15 16:53:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 16:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 16:53:42 [DEBUG   ] spawn_process: at 2018-11-15 16:53:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 16:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 16:53:42 [DEBUG   ] spawn_process: at 2018-11-15 16:53:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 16:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 16:53:42 [DEBUG   ] spawn_process: at 2018-11-15 16:53:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 16:53:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 16:54:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 16:54:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:54:03 [DEBUG   ] Got command BAM from MCS: ref #516547
2018-11-15 16:54:03 [INFO    ] Finished processing BAM request
2018-11-15 16:54:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:54:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516547   8 58437 60843025 A  ERROR'
2018-11-15 16:54:03 [DEBUG   ] Got command BAM from MCS: ref #516548
2018-11-15 16:54:03 [INFO    ] Finished processing BAM request
2018-11-15 16:54:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:54:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516548   8 58437 60843029 A  ERROR'
2018-11-15 16:54:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 16:54:03 [WARNING ] (13, 1, 'bot')
2018-11-15 16:54:03 [WARNING ] (13, 1, 'bot')
2018-11-15 16:54:03 [WARNING ] (13, 1, 'bot')
2018-11-15 16:54:03 [WARNING ] (13, 1, 'bot')
2018-11-15 16:54:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:54:03 [DEBUG   ] Finished updating board flags in 1.002 seconds
2018-11-15 16:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 16:54:03 [DEBUG   ] spawn_process: at 2018-11-15 16:54:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 16:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 16:54:03 [DEBUG   ] spawn_process: at 2018-11-15 16:54:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 16:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 16:54:03 [DEBUG   ] spawn_process: at 2018-11-15 16:54:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 16:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 16:54:03 [DEBUG   ] spawn_process: at 2018-11-15 16:54:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 16:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 16:54:03 [DEBUG   ] spawn_process: at 2018-11-15 16:54:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 16:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 16:54:03 [DEBUG   ] spawn_process: at 2018-11-15 16:54:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 16:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 16:54:03 [DEBUG   ] spawn_process: at 2018-11-15 16:54:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 16:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 16:54:03 [DEBUG   ] spawn_process: at 2018-11-15 16:54:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 16:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 16:54:03 [DEBUG   ] spawn_process: at 2018-11-15 16:54:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 16:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 16:54:03 [DEBUG   ] spawn_process: at 2018-11-15 16:54:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 16:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 16:54:03 [DEBUG   ] spawn_process: at 2018-11-15 16:54:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 16:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 16:54:03 [DEBUG   ] spawn_process: at 2018-11-15 16:54:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 16:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 16:54:03 [DEBUG   ] spawn_process: at 2018-11-15 16:54:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 16:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 16:54:03 [DEBUG   ] spawn_process: at 2018-11-15 16:54:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 16:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 16:54:03 [DEBUG   ] spawn_process: at 2018-11-15 16:54:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 16:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 16:54:03 [DEBUG   ] spawn_process: at 2018-11-15 16:54:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 16:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 16:54:03 [DEBUG   ] spawn_process: at 2018-11-15 16:54:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 16:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 16:54:03 [DEBUG   ] spawn_process: at 2018-11-15 16:54:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 16:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 16:54:03 [DEBUG   ] spawn_process: at 2018-11-15 16:54:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 16:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 16:54:03 [DEBUG   ] spawn_process: at 2018-11-15 16:54:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 16:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 16:54:03 [DEBUG   ] spawn_process: at 2018-11-15 16:54:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 16:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 16:54:03 [DEBUG   ] spawn_process: at 2018-11-15 16:54:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 16:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 16:54:03 [DEBUG   ] spawn_process: at 2018-11-15 16:54:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 16:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 16:54:03 [DEBUG   ] spawn_process: at 2018-11-15 16:54:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 16:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 16:54:03 [DEBUG   ] spawn_process: at 2018-11-15 16:54:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 16:54:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 16:54:03 [DEBUG   ] spawn_process: at 2018-11-15 16:54:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 16:54:18 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-15 16:54:24 [DEBUG   ] Got command BAM from MCS: ref #516550
2018-11-15 16:54:24 [INFO    ] Finished processing BAM request
2018-11-15 16:54:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:54:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516550   8 58437 60864033 A  ERROR'
2018-11-15 16:54:24 [DEBUG   ] Got command BAM from MCS: ref #516549
2018-11-15 16:54:24 [INFO    ] Finished processing BAM request
2018-11-15 16:54:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:54:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516549   8 58437 60864037 A  ERROR'
2018-11-15 16:54:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 16:54:24 [DEBUG   ] spawn_process: at 2018-11-15 16:54:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 16:54:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 16:54:24 [DEBUG   ] spawn_process: at 2018-11-15 16:54:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 16:54:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 16:54:24 [DEBUG   ] spawn_process: at 2018-11-15 16:54:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 16:54:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 16:54:24 [DEBUG   ] spawn_process: at 2018-11-15 16:54:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 16:54:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 16:54:24 [DEBUG   ] spawn_process: at 2018-11-15 16:54:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 16:54:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 16:54:24 [DEBUG   ] spawn_process: at 2018-11-15 16:54:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 16:54:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 16:54:24 [DEBUG   ] spawn_process: at 2018-11-15 16:54:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 16:54:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 16:54:24 [DEBUG   ] spawn_process: at 2018-11-15 16:54:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 16:54:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 16:54:24 [DEBUG   ] spawn_process: at 2018-11-15 16:54:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 16:54:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 16:54:24 [DEBUG   ] spawn_process: at 2018-11-15 16:54:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 16:54:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 16:54:24 [DEBUG   ] spawn_process: at 2018-11-15 16:54:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 16:54:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 16:54:24 [DEBUG   ] spawn_process: at 2018-11-15 16:54:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 16:54:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 16:54:24 [DEBUG   ] spawn_process: at 2018-11-15 16:54:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 16:54:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 16:54:24 [DEBUG   ] spawn_process: at 2018-11-15 16:54:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 16:54:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 16:54:24 [DEBUG   ] spawn_process: at 2018-11-15 16:54:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 16:54:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 16:54:24 [DEBUG   ] spawn_process: at 2018-11-15 16:54:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 16:54:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 16:54:24 [DEBUG   ] spawn_process: at 2018-11-15 16:54:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 16:54:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 16:54:24 [DEBUG   ] spawn_process: at 2018-11-15 16:54:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 16:54:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 16:54:24 [DEBUG   ] spawn_process: at 2018-11-15 16:54:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 16:54:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 16:54:24 [DEBUG   ] spawn_process: at 2018-11-15 16:54:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 16:54:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 16:54:24 [DEBUG   ] spawn_process: at 2018-11-15 16:54:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 16:54:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 16:54:24 [DEBUG   ] spawn_process: at 2018-11-15 16:54:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 16:54:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 16:54:24 [DEBUG   ] spawn_process: at 2018-11-15 16:54:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 16:54:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 16:54:24 [DEBUG   ] spawn_process: at 2018-11-15 16:54:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 16:54:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 16:54:24 [DEBUG   ] spawn_process: at 2018-11-15 16:54:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 16:54:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 16:54:24 [DEBUG   ] spawn_process: at 2018-11-15 16:54:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 16:54:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 16:54:45 [DEBUG   ] Got command BAM from MCS: ref #516552
2018-11-15 16:54:45 [INFO    ] Finished processing BAM request
2018-11-15 16:54:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:54:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516552   8 58437 60885025 A  ERROR'
2018-11-15 16:54:45 [DEBUG   ] Got command BAM from MCS: ref #516551
2018-11-15 16:54:45 [INFO    ] Finished processing BAM request
2018-11-15 16:54:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:54:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516551   8 58437 60885029 A  ERROR'
2018-11-15 16:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 16:54:45 [DEBUG   ] spawn_process: at 2018-11-15 16:54:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 16:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 16:54:45 [DEBUG   ] spawn_process: at 2018-11-15 16:54:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 16:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 16:54:45 [DEBUG   ] spawn_process: at 2018-11-15 16:54:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 16:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 16:54:45 [DEBUG   ] spawn_process: at 2018-11-15 16:54:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 16:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 16:54:45 [DEBUG   ] spawn_process: at 2018-11-15 16:54:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 16:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 16:54:45 [DEBUG   ] spawn_process: at 2018-11-15 16:54:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 16:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 16:54:45 [DEBUG   ] spawn_process: at 2018-11-15 16:54:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 16:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 16:54:45 [DEBUG   ] spawn_process: at 2018-11-15 16:54:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 16:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 16:54:45 [DEBUG   ] spawn_process: at 2018-11-15 16:54:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 16:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 16:54:45 [DEBUG   ] spawn_process: at 2018-11-15 16:54:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 16:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 16:54:45 [DEBUG   ] spawn_process: at 2018-11-15 16:54:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 16:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 16:54:45 [DEBUG   ] spawn_process: at 2018-11-15 16:54:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 16:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 16:54:45 [DEBUG   ] spawn_process: at 2018-11-15 16:54:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 16:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 16:54:45 [DEBUG   ] spawn_process: at 2018-11-15 16:54:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 16:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 16:54:45 [DEBUG   ] spawn_process: at 2018-11-15 16:54:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 16:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 16:54:45 [DEBUG   ] spawn_process: at 2018-11-15 16:54:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 16:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 16:54:45 [DEBUG   ] spawn_process: at 2018-11-15 16:54:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 16:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 16:54:45 [DEBUG   ] spawn_process: at 2018-11-15 16:54:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 16:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 16:54:45 [DEBUG   ] spawn_process: at 2018-11-15 16:54:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 16:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 16:54:45 [DEBUG   ] spawn_process: at 2018-11-15 16:54:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 16:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 16:54:45 [DEBUG   ] spawn_process: at 2018-11-15 16:54:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 16:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 16:54:45 [DEBUG   ] spawn_process: at 2018-11-15 16:54:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 16:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 16:54:45 [DEBUG   ] spawn_process: at 2018-11-15 16:54:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 16:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 16:54:45 [DEBUG   ] spawn_process: at 2018-11-15 16:54:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 16:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 16:54:45 [DEBUG   ] spawn_process: at 2018-11-15 16:54:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 16:54:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 16:54:45 [DEBUG   ] spawn_process: at 2018-11-15 16:54:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 16:54:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 16:55:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-15 16:55:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 16:55:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:55:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-15 16:55:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-15 16:55:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-11-15 16:55:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-11-15 16:55:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 16:55:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 16:55:03 [WARNING ] (13, 1, 'bot')
2018-11-15 16:55:03 [WARNING ] (13, 1, 'bot')
2018-11-15 16:55:03 [WARNING ] (13, 1, 'bot')
2018-11-15 16:55:03 [WARNING ] (13, 1, 'bot')
2018-11-15 16:55:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:55:03 [DEBUG   ] Finished updating board flags in 1.003 seconds
2018-11-15 16:55:06 [DEBUG   ] Got command BAM from MCS: ref #516553
2018-11-15 16:55:06 [INFO    ] Finished processing BAM request
2018-11-15 16:55:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:55:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516553   8 58437 60906037 A  ERROR'
2018-11-15 16:55:06 [DEBUG   ] Got command BAM from MCS: ref #516554
2018-11-15 16:55:06 [INFO    ] Finished processing BAM request
2018-11-15 16:55:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:55:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516554   8 58437 60906045 A  ERROR'
2018-11-15 16:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 16:55:06 [DEBUG   ] spawn_process: at 2018-11-15 16:55:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 16:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 16:55:06 [DEBUG   ] spawn_process: at 2018-11-15 16:55:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 16:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 16:55:06 [DEBUG   ] spawn_process: at 2018-11-15 16:55:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 16:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 16:55:06 [DEBUG   ] spawn_process: at 2018-11-15 16:55:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 16:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 16:55:06 [DEBUG   ] spawn_process: at 2018-11-15 16:55:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 16:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 16:55:06 [DEBUG   ] spawn_process: at 2018-11-15 16:55:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 16:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 16:55:06 [DEBUG   ] spawn_process: at 2018-11-15 16:55:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 16:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 16:55:06 [DEBUG   ] spawn_process: at 2018-11-15 16:55:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 16:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 16:55:06 [DEBUG   ] spawn_process: at 2018-11-15 16:55:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 16:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 16:55:06 [DEBUG   ] spawn_process: at 2018-11-15 16:55:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 16:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 16:55:06 [DEBUG   ] spawn_process: at 2018-11-15 16:55:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 16:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 16:55:06 [DEBUG   ] spawn_process: at 2018-11-15 16:55:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 16:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 16:55:06 [DEBUG   ] spawn_process: at 2018-11-15 16:55:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 16:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 16:55:06 [DEBUG   ] spawn_process: at 2018-11-15 16:55:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 16:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 16:55:06 [DEBUG   ] spawn_process: at 2018-11-15 16:55:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 16:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 16:55:06 [DEBUG   ] spawn_process: at 2018-11-15 16:55:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 16:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 16:55:06 [DEBUG   ] spawn_process: at 2018-11-15 16:55:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 16:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 16:55:06 [DEBUG   ] spawn_process: at 2018-11-15 16:55:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 16:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 16:55:06 [DEBUG   ] spawn_process: at 2018-11-15 16:55:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 16:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 16:55:06 [DEBUG   ] spawn_process: at 2018-11-15 16:55:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 16:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 16:55:06 [DEBUG   ] spawn_process: at 2018-11-15 16:55:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 16:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 16:55:06 [DEBUG   ] spawn_process: at 2018-11-15 16:55:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 16:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 16:55:06 [DEBUG   ] spawn_process: at 2018-11-15 16:55:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 16:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 16:55:06 [DEBUG   ] spawn_process: at 2018-11-15 16:55:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 16:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 16:55:06 [DEBUG   ] spawn_process: at 2018-11-15 16:55:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 16:55:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 16:55:06 [DEBUG   ] spawn_process: at 2018-11-15 16:55:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 16:55:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 16:55:27 [DEBUG   ] Got command BAM from MCS: ref #516556
2018-11-15 16:55:27 [INFO    ] Finished processing BAM request
2018-11-15 16:55:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:55:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516556   8 58437 60927029 A  ERROR'
2018-11-15 16:55:27 [DEBUG   ] Got command BAM from MCS: ref #516555
2018-11-15 16:55:27 [INFO    ] Finished processing BAM request
2018-11-15 16:55:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:55:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516555   8 58437 60927033 A  ERROR'
2018-11-15 16:55:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 16:55:27 [DEBUG   ] spawn_process: at 2018-11-15 16:55:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 16:55:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 16:55:27 [DEBUG   ] spawn_process: at 2018-11-15 16:55:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 16:55:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 16:55:27 [DEBUG   ] spawn_process: at 2018-11-15 16:55:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 16:55:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 16:55:27 [DEBUG   ] spawn_process: at 2018-11-15 16:55:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 16:55:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 16:55:27 [DEBUG   ] spawn_process: at 2018-11-15 16:55:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 16:55:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 16:55:27 [DEBUG   ] spawn_process: at 2018-11-15 16:55:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 16:55:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 16:55:27 [DEBUG   ] spawn_process: at 2018-11-15 16:55:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 16:55:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 16:55:27 [DEBUG   ] spawn_process: at 2018-11-15 16:55:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 16:55:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 16:55:27 [DEBUG   ] spawn_process: at 2018-11-15 16:55:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 16:55:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 16:55:27 [DEBUG   ] spawn_process: at 2018-11-15 16:55:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 16:55:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 16:55:27 [DEBUG   ] spawn_process: at 2018-11-15 16:55:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 16:55:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 16:55:27 [DEBUG   ] spawn_process: at 2018-11-15 16:55:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 16:55:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 16:55:27 [DEBUG   ] spawn_process: at 2018-11-15 16:55:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 16:55:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 16:55:27 [DEBUG   ] spawn_process: at 2018-11-15 16:55:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 16:55:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 16:55:27 [DEBUG   ] spawn_process: at 2018-11-15 16:55:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 16:55:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 16:55:27 [DEBUG   ] spawn_process: at 2018-11-15 16:55:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 16:55:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 16:55:27 [DEBUG   ] spawn_process: at 2018-11-15 16:55:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 16:55:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 16:55:27 [DEBUG   ] spawn_process: at 2018-11-15 16:55:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 16:55:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 16:55:27 [DEBUG   ] spawn_process: at 2018-11-15 16:55:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 16:55:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 16:55:27 [DEBUG   ] spawn_process: at 2018-11-15 16:55:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 16:55:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 16:55:27 [DEBUG   ] spawn_process: at 2018-11-15 16:55:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 16:55:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 16:55:27 [DEBUG   ] spawn_process: at 2018-11-15 16:55:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 16:55:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 16:55:27 [DEBUG   ] spawn_process: at 2018-11-15 16:55:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 16:55:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 16:55:27 [DEBUG   ] spawn_process: at 2018-11-15 16:55:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 16:55:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 16:55:27 [DEBUG   ] spawn_process: at 2018-11-15 16:55:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 16:55:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 16:55:27 [DEBUG   ] spawn_process: at 2018-11-15 16:55:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 16:55:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 16:55:45 [DEBUG   ] Got command RPT from MCS: ref #516557
2018-11-15 16:55:45 [DEBUG   ] summary = ERROR
2018-11-15 16:55:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516557  13 58437 60945141 A  ERRORERROR'
2018-11-15 16:55:45 [DEBUG   ] Got command RPT from MCS: ref #516558
2018-11-15 16:55:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 16:55:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516558  77 58437 60945142 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 16:55:48 [DEBUG   ] Got command BAM from MCS: ref #516575
2018-11-15 16:55:48 [INFO    ] Finished processing BAM request
2018-11-15 16:55:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:55:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516575   8 58437 60948029 A  ERROR'
2018-11-15 16:55:48 [DEBUG   ] Got command BAM from MCS: ref #516574
2018-11-15 16:55:48 [INFO    ] Finished processing BAM request
2018-11-15 16:55:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:55:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516574   8 58437 60948033 A  ERROR'
2018-11-15 16:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 16:55:48 [DEBUG   ] spawn_process: at 2018-11-15 16:55:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 16:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 16:55:48 [DEBUG   ] spawn_process: at 2018-11-15 16:55:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 16:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 16:55:48 [DEBUG   ] spawn_process: at 2018-11-15 16:55:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 16:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 16:55:48 [DEBUG   ] spawn_process: at 2018-11-15 16:55:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 16:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 16:55:48 [DEBUG   ] spawn_process: at 2018-11-15 16:55:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 16:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 16:55:48 [DEBUG   ] spawn_process: at 2018-11-15 16:55:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 16:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 16:55:48 [DEBUG   ] spawn_process: at 2018-11-15 16:55:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 16:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 16:55:48 [DEBUG   ] spawn_process: at 2018-11-15 16:55:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 16:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 16:55:48 [DEBUG   ] spawn_process: at 2018-11-15 16:55:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 16:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 16:55:48 [DEBUG   ] spawn_process: at 2018-11-15 16:55:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 16:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 16:55:48 [DEBUG   ] spawn_process: at 2018-11-15 16:55:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 16:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 16:55:48 [DEBUG   ] spawn_process: at 2018-11-15 16:55:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 16:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 16:55:48 [DEBUG   ] spawn_process: at 2018-11-15 16:55:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 16:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 16:55:48 [DEBUG   ] spawn_process: at 2018-11-15 16:55:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 16:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 16:55:48 [DEBUG   ] spawn_process: at 2018-11-15 16:55:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 16:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 16:55:48 [DEBUG   ] spawn_process: at 2018-11-15 16:55:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 16:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 16:55:48 [DEBUG   ] spawn_process: at 2018-11-15 16:55:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 16:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 16:55:48 [DEBUG   ] spawn_process: at 2018-11-15 16:55:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 16:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 16:55:48 [DEBUG   ] spawn_process: at 2018-11-15 16:55:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 16:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 16:55:48 [DEBUG   ] spawn_process: at 2018-11-15 16:55:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 16:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 16:55:48 [DEBUG   ] spawn_process: at 2018-11-15 16:55:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 16:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 16:55:48 [DEBUG   ] spawn_process: at 2018-11-15 16:55:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 16:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 16:55:48 [DEBUG   ] spawn_process: at 2018-11-15 16:55:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 16:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 16:55:48 [DEBUG   ] spawn_process: at 2018-11-15 16:55:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 16:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 16:55:48 [DEBUG   ] spawn_process: at 2018-11-15 16:55:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 16:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 16:55:48 [DEBUG   ] spawn_process: at 2018-11-15 16:55:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 16:55:58 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-15 16:56:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 16:56:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 16:56:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 16:56:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:56:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 16:56:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 16:56:03 [WARNING ] (13, 1, 'bot')
2018-11-15 16:56:03 [WARNING ] (13, 1, 'bot')
2018-11-15 16:56:03 [WARNING ] (13, 1, 'bot')
2018-11-15 16:56:03 [WARNING ] (13, 1, 'bot')
2018-11-15 16:56:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:56:03 [DEBUG   ] Finished updating board flags in 0.993 seconds
2018-11-15 16:56:09 [DEBUG   ] Got command BAM from MCS: ref #516577
2018-11-15 16:56:09 [INFO    ] Finished processing BAM request
2018-11-15 16:56:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:56:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516577   8 58437 60969033 A  ERROR'
2018-11-15 16:56:09 [DEBUG   ] Got command BAM from MCS: ref #516576
2018-11-15 16:56:09 [INFO    ] Finished processing BAM request
2018-11-15 16:56:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:56:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516576   8 58437 60969037 A  ERROR'
2018-11-15 16:56:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 16:56:09 [DEBUG   ] spawn_process: at 2018-11-15 16:56:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 16:56:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 16:56:09 [DEBUG   ] spawn_process: at 2018-11-15 16:56:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 16:56:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 16:56:09 [DEBUG   ] spawn_process: at 2018-11-15 16:56:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 16:56:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 16:56:09 [DEBUG   ] spawn_process: at 2018-11-15 16:56:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 16:56:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 16:56:09 [DEBUG   ] spawn_process: at 2018-11-15 16:56:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 16:56:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 16:56:09 [DEBUG   ] spawn_process: at 2018-11-15 16:56:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 16:56:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 16:56:09 [DEBUG   ] spawn_process: at 2018-11-15 16:56:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 16:56:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 16:56:09 [DEBUG   ] spawn_process: at 2018-11-15 16:56:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 16:56:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 16:56:09 [DEBUG   ] spawn_process: at 2018-11-15 16:56:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 16:56:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 16:56:09 [DEBUG   ] spawn_process: at 2018-11-15 16:56:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 16:56:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 16:56:09 [DEBUG   ] spawn_process: at 2018-11-15 16:56:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 16:56:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 16:56:09 [DEBUG   ] spawn_process: at 2018-11-15 16:56:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 16:56:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 16:56:09 [DEBUG   ] spawn_process: at 2018-11-15 16:56:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 16:56:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 16:56:09 [DEBUG   ] spawn_process: at 2018-11-15 16:56:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 16:56:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 16:56:09 [DEBUG   ] spawn_process: at 2018-11-15 16:56:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 16:56:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 16:56:09 [DEBUG   ] spawn_process: at 2018-11-15 16:56:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 16:56:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 16:56:09 [DEBUG   ] spawn_process: at 2018-11-15 16:56:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 16:56:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 16:56:09 [DEBUG   ] spawn_process: at 2018-11-15 16:56:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 16:56:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 16:56:09 [DEBUG   ] spawn_process: at 2018-11-15 16:56:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 16:56:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 16:56:09 [DEBUG   ] spawn_process: at 2018-11-15 16:56:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 16:56:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 16:56:09 [DEBUG   ] spawn_process: at 2018-11-15 16:56:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 16:56:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 16:56:09 [DEBUG   ] spawn_process: at 2018-11-15 16:56:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 16:56:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 16:56:09 [DEBUG   ] spawn_process: at 2018-11-15 16:56:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 16:56:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 16:56:09 [DEBUG   ] spawn_process: at 2018-11-15 16:56:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 16:56:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 16:56:09 [DEBUG   ] spawn_process: at 2018-11-15 16:56:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 16:56:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 16:56:09 [DEBUG   ] spawn_process: at 2018-11-15 16:56:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 16:56:18 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-15 16:56:30 [DEBUG   ] Got command BAM from MCS: ref #516583
2018-11-15 16:56:30 [INFO    ] Finished processing BAM request
2018-11-15 16:56:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:56:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516583   8 58437 60990029 A  ERROR'
2018-11-15 16:56:30 [DEBUG   ] Got command BAM from MCS: ref #516582
2018-11-15 16:56:30 [INFO    ] Finished processing BAM request
2018-11-15 16:56:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:56:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516582   8 58437 60990033 A  ERROR'
2018-11-15 16:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 16:56:30 [DEBUG   ] spawn_process: at 2018-11-15 16:56:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 16:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 16:56:30 [DEBUG   ] spawn_process: at 2018-11-15 16:56:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 16:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 16:56:30 [DEBUG   ] spawn_process: at 2018-11-15 16:56:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 16:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 16:56:30 [DEBUG   ] spawn_process: at 2018-11-15 16:56:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 16:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 16:56:30 [DEBUG   ] spawn_process: at 2018-11-15 16:56:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 16:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 16:56:30 [DEBUG   ] spawn_process: at 2018-11-15 16:56:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 16:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 16:56:30 [DEBUG   ] spawn_process: at 2018-11-15 16:56:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 16:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 16:56:30 [DEBUG   ] spawn_process: at 2018-11-15 16:56:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 16:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 16:56:30 [DEBUG   ] spawn_process: at 2018-11-15 16:56:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 16:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 16:56:30 [DEBUG   ] spawn_process: at 2018-11-15 16:56:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 16:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 16:56:30 [DEBUG   ] spawn_process: at 2018-11-15 16:56:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 16:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 16:56:30 [DEBUG   ] spawn_process: at 2018-11-15 16:56:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 16:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 16:56:30 [DEBUG   ] spawn_process: at 2018-11-15 16:56:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 16:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 16:56:30 [DEBUG   ] spawn_process: at 2018-11-15 16:56:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 16:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 16:56:30 [DEBUG   ] spawn_process: at 2018-11-15 16:56:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 16:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 16:56:30 [DEBUG   ] spawn_process: at 2018-11-15 16:56:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 16:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 16:56:30 [DEBUG   ] spawn_process: at 2018-11-15 16:56:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 16:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 16:56:30 [DEBUG   ] spawn_process: at 2018-11-15 16:56:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 16:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 16:56:30 [DEBUG   ] spawn_process: at 2018-11-15 16:56:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 16:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 16:56:30 [DEBUG   ] spawn_process: at 2018-11-15 16:56:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 16:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 16:56:30 [DEBUG   ] spawn_process: at 2018-11-15 16:56:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 16:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 16:56:30 [DEBUG   ] spawn_process: at 2018-11-15 16:56:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 16:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 16:56:30 [DEBUG   ] spawn_process: at 2018-11-15 16:56:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 16:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 16:56:30 [DEBUG   ] spawn_process: at 2018-11-15 16:56:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 16:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 16:56:30 [DEBUG   ] spawn_process: at 2018-11-15 16:56:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 16:56:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 16:56:30 [DEBUG   ] spawn_process: at 2018-11-15 16:56:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 16:56:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 16:56:51 [DEBUG   ] Got command BAM from MCS: ref #516585
2018-11-15 16:56:51 [INFO    ] Finished processing BAM request
2018-11-15 16:56:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:56:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516585   8 58437 61011025 A  ERROR'
2018-11-15 16:56:51 [DEBUG   ] Got command BAM from MCS: ref #516584
2018-11-15 16:56:51 [INFO    ] Finished processing BAM request
2018-11-15 16:56:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:56:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516584   8 58437 61011029 A  ERROR'
2018-11-15 16:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 16:56:51 [DEBUG   ] spawn_process: at 2018-11-15 16:56:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 16:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 16:56:51 [DEBUG   ] spawn_process: at 2018-11-15 16:56:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 16:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 16:56:51 [DEBUG   ] spawn_process: at 2018-11-15 16:56:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 16:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 16:56:51 [DEBUG   ] spawn_process: at 2018-11-15 16:56:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 16:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 16:56:51 [DEBUG   ] spawn_process: at 2018-11-15 16:56:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 16:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 16:56:51 [DEBUG   ] spawn_process: at 2018-11-15 16:56:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 16:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 16:56:51 [DEBUG   ] spawn_process: at 2018-11-15 16:56:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 16:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 16:56:51 [DEBUG   ] spawn_process: at 2018-11-15 16:56:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 16:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 16:56:51 [DEBUG   ] spawn_process: at 2018-11-15 16:56:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 16:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 16:56:51 [DEBUG   ] spawn_process: at 2018-11-15 16:56:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 16:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 16:56:51 [DEBUG   ] spawn_process: at 2018-11-15 16:56:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 16:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 16:56:51 [DEBUG   ] spawn_process: at 2018-11-15 16:56:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 16:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 16:56:51 [DEBUG   ] spawn_process: at 2018-11-15 16:56:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 16:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 16:56:51 [DEBUG   ] spawn_process: at 2018-11-15 16:56:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 16:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 16:56:51 [DEBUG   ] spawn_process: at 2018-11-15 16:56:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 16:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 16:56:51 [DEBUG   ] spawn_process: at 2018-11-15 16:56:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 16:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 16:56:51 [DEBUG   ] spawn_process: at 2018-11-15 16:56:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 16:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 16:56:51 [DEBUG   ] spawn_process: at 2018-11-15 16:56:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 16:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 16:56:51 [DEBUG   ] spawn_process: at 2018-11-15 16:56:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 16:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 16:56:51 [DEBUG   ] spawn_process: at 2018-11-15 16:56:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 16:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 16:56:51 [DEBUG   ] spawn_process: at 2018-11-15 16:56:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 16:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 16:56:51 [DEBUG   ] spawn_process: at 2018-11-15 16:56:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 16:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 16:56:51 [DEBUG   ] spawn_process: at 2018-11-15 16:56:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 16:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 16:56:51 [DEBUG   ] spawn_process: at 2018-11-15 16:56:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 16:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 16:56:51 [DEBUG   ] spawn_process: at 2018-11-15 16:56:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 16:56:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 16:56:51 [DEBUG   ] spawn_process: at 2018-11-15 16:56:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 16:56:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 16:57:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 16:57:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 16:57:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:57:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-11-15 16:57:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 16:57:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 16:57:03 [WARNING ] (13, 1, 'bot')
2018-11-15 16:57:03 [WARNING ] (13, 1, 'bot')
2018-11-15 16:57:03 [WARNING ] (13, 1, 'bot')
2018-11-15 16:57:03 [WARNING ] (13, 1, 'bot')
2018-11-15 16:57:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:57:03 [DEBUG   ] Finished updating board flags in 1.328 seconds
2018-11-15 16:57:12 [DEBUG   ] Got command BAM from MCS: ref #516587
2018-11-15 16:57:12 [INFO    ] Finished processing BAM request
2018-11-15 16:57:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:57:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516587   8 58437 61032045 A  ERROR'
2018-11-15 16:57:12 [DEBUG   ] Got command BAM from MCS: ref #516586
2018-11-15 16:57:12 [INFO    ] Finished processing BAM request
2018-11-15 16:57:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:57:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516586   8 58437 61032049 A  ERROR'
2018-11-15 16:57:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 16:57:12 [DEBUG   ] spawn_process: at 2018-11-15 16:57:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 16:57:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 16:57:12 [DEBUG   ] spawn_process: at 2018-11-15 16:57:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 16:57:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 16:57:12 [DEBUG   ] spawn_process: at 2018-11-15 16:57:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 16:57:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 16:57:12 [DEBUG   ] spawn_process: at 2018-11-15 16:57:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 16:57:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 16:57:12 [DEBUG   ] spawn_process: at 2018-11-15 16:57:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 16:57:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 16:57:12 [DEBUG   ] spawn_process: at 2018-11-15 16:57:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 16:57:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 16:57:12 [DEBUG   ] spawn_process: at 2018-11-15 16:57:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 16:57:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 16:57:12 [DEBUG   ] spawn_process: at 2018-11-15 16:57:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 16:57:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 16:57:12 [DEBUG   ] spawn_process: at 2018-11-15 16:57:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 16:57:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 16:57:12 [DEBUG   ] spawn_process: at 2018-11-15 16:57:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 16:57:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 16:57:12 [DEBUG   ] spawn_process: at 2018-11-15 16:57:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 16:57:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 16:57:12 [DEBUG   ] spawn_process: at 2018-11-15 16:57:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 16:57:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 16:57:12 [DEBUG   ] spawn_process: at 2018-11-15 16:57:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 16:57:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 16:57:12 [DEBUG   ] spawn_process: at 2018-11-15 16:57:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 16:57:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 16:57:12 [DEBUG   ] spawn_process: at 2018-11-15 16:57:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 16:57:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 16:57:12 [DEBUG   ] spawn_process: at 2018-11-15 16:57:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 16:57:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 16:57:12 [DEBUG   ] spawn_process: at 2018-11-15 16:57:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 16:57:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 16:57:12 [DEBUG   ] spawn_process: at 2018-11-15 16:57:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 16:57:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 16:57:12 [DEBUG   ] spawn_process: at 2018-11-15 16:57:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 16:57:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 16:57:12 [DEBUG   ] spawn_process: at 2018-11-15 16:57:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 16:57:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 16:57:12 [DEBUG   ] spawn_process: at 2018-11-15 16:57:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 16:57:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 16:57:12 [DEBUG   ] spawn_process: at 2018-11-15 16:57:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 16:57:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 16:57:12 [DEBUG   ] spawn_process: at 2018-11-15 16:57:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 16:57:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 16:57:12 [DEBUG   ] spawn_process: at 2018-11-15 16:57:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 16:57:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 16:57:12 [DEBUG   ] spawn_process: at 2018-11-15 16:57:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 16:57:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 16:57:12 [DEBUG   ] spawn_process: at 2018-11-15 16:57:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 16:57:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 16:57:33 [DEBUG   ] Got command BAM from MCS: ref #516589
2018-11-15 16:57:33 [INFO    ] Finished processing BAM request
2018-11-15 16:57:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:57:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516589   8 58437 61053033 A  ERROR'
2018-11-15 16:57:33 [DEBUG   ] Got command BAM from MCS: ref #516588
2018-11-15 16:57:33 [INFO    ] Finished processing BAM request
2018-11-15 16:57:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:57:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516588   8 58437 61053037 A  ERROR'
2018-11-15 16:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 16:57:33 [DEBUG   ] spawn_process: at 2018-11-15 16:57:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 16:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 16:57:33 [DEBUG   ] spawn_process: at 2018-11-15 16:57:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 16:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 16:57:33 [DEBUG   ] spawn_process: at 2018-11-15 16:57:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 16:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 16:57:33 [DEBUG   ] spawn_process: at 2018-11-15 16:57:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 16:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 16:57:33 [DEBUG   ] spawn_process: at 2018-11-15 16:57:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 16:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 16:57:33 [DEBUG   ] spawn_process: at 2018-11-15 16:57:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 16:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 16:57:33 [DEBUG   ] spawn_process: at 2018-11-15 16:57:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 16:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 16:57:33 [DEBUG   ] spawn_process: at 2018-11-15 16:57:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 16:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 16:57:33 [DEBUG   ] spawn_process: at 2018-11-15 16:57:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 16:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 16:57:33 [DEBUG   ] spawn_process: at 2018-11-15 16:57:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 16:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 16:57:33 [DEBUG   ] spawn_process: at 2018-11-15 16:57:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 16:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 16:57:33 [DEBUG   ] spawn_process: at 2018-11-15 16:57:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 16:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 16:57:33 [DEBUG   ] spawn_process: at 2018-11-15 16:57:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 16:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 16:57:33 [DEBUG   ] spawn_process: at 2018-11-15 16:57:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 16:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 16:57:33 [DEBUG   ] spawn_process: at 2018-11-15 16:57:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 16:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 16:57:33 [DEBUG   ] spawn_process: at 2018-11-15 16:57:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 16:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 16:57:33 [DEBUG   ] spawn_process: at 2018-11-15 16:57:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 16:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 16:57:33 [DEBUG   ] spawn_process: at 2018-11-15 16:57:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 16:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 16:57:33 [DEBUG   ] spawn_process: at 2018-11-15 16:57:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 16:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 16:57:33 [DEBUG   ] spawn_process: at 2018-11-15 16:57:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 16:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 16:57:33 [DEBUG   ] spawn_process: at 2018-11-15 16:57:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 16:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 16:57:33 [DEBUG   ] spawn_process: at 2018-11-15 16:57:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 16:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 16:57:33 [DEBUG   ] spawn_process: at 2018-11-15 16:57:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 16:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 16:57:33 [DEBUG   ] spawn_process: at 2018-11-15 16:57:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 16:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 16:57:33 [DEBUG   ] spawn_process: at 2018-11-15 16:57:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 16:57:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 16:57:33 [DEBUG   ] spawn_process: at 2018-11-15 16:57:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 16:57:38 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-15 16:57:54 [DEBUG   ] Got command BAM from MCS: ref #516591
2018-11-15 16:57:54 [INFO    ] Finished processing BAM request
2018-11-15 16:57:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:57:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516591   8 58437 61074029 A  ERROR'
2018-11-15 16:57:54 [DEBUG   ] Got command BAM from MCS: ref #516590
2018-11-15 16:57:54 [INFO    ] Finished processing BAM request
2018-11-15 16:57:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:57:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516590   8 58437 61074033 A  ERROR'
2018-11-15 16:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 16:57:54 [DEBUG   ] spawn_process: at 2018-11-15 16:57:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 16:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 16:57:54 [DEBUG   ] spawn_process: at 2018-11-15 16:57:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 16:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 16:57:54 [DEBUG   ] spawn_process: at 2018-11-15 16:57:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 16:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 16:57:54 [DEBUG   ] spawn_process: at 2018-11-15 16:57:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 16:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 16:57:54 [DEBUG   ] spawn_process: at 2018-11-15 16:57:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 16:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 16:57:54 [DEBUG   ] spawn_process: at 2018-11-15 16:57:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 16:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 16:57:54 [DEBUG   ] spawn_process: at 2018-11-15 16:57:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 16:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 16:57:54 [DEBUG   ] spawn_process: at 2018-11-15 16:57:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 16:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 16:57:54 [DEBUG   ] spawn_process: at 2018-11-15 16:57:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 16:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 16:57:54 [DEBUG   ] spawn_process: at 2018-11-15 16:57:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 16:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 16:57:54 [DEBUG   ] spawn_process: at 2018-11-15 16:57:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 16:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 16:57:54 [DEBUG   ] spawn_process: at 2018-11-15 16:57:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 16:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 16:57:54 [DEBUG   ] spawn_process: at 2018-11-15 16:57:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 16:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 16:57:54 [DEBUG   ] spawn_process: at 2018-11-15 16:57:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 16:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 16:57:54 [DEBUG   ] spawn_process: at 2018-11-15 16:57:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 16:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 16:57:54 [DEBUG   ] spawn_process: at 2018-11-15 16:57:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 16:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 16:57:54 [DEBUG   ] spawn_process: at 2018-11-15 16:57:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 16:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 16:57:54 [DEBUG   ] spawn_process: at 2018-11-15 16:57:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 16:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 16:57:54 [DEBUG   ] spawn_process: at 2018-11-15 16:57:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 16:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 16:57:54 [DEBUG   ] spawn_process: at 2018-11-15 16:57:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 16:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 16:57:54 [DEBUG   ] spawn_process: at 2018-11-15 16:57:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 16:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 16:57:54 [DEBUG   ] spawn_process: at 2018-11-15 16:57:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 16:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 16:57:54 [DEBUG   ] spawn_process: at 2018-11-15 16:57:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 16:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 16:57:54 [DEBUG   ] spawn_process: at 2018-11-15 16:57:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 16:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 16:57:54 [DEBUG   ] spawn_process: at 2018-11-15 16:57:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 16:57:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 16:57:54 [DEBUG   ] spawn_process: at 2018-11-15 16:57:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 16:57:58 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 16:58:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 16:58:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:58:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-15 16:58:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 16:58:03 [WARNING ] (13, 1, 'bot')
2018-11-15 16:58:03 [WARNING ] (13, 1, 'bot')
2018-11-15 16:58:03 [WARNING ] (13, 1, 'bot')
2018-11-15 16:58:03 [WARNING ] (13, 1, 'bot')
2018-11-15 16:58:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:58:03 [DEBUG   ] Finished updating board flags in 1.126 seconds
2018-11-15 16:58:15 [DEBUG   ] Got command BAM from MCS: ref #516595
2018-11-15 16:58:15 [INFO    ] Finished processing BAM request
2018-11-15 16:58:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:58:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516595   8 58437 61095029 A  ERROR'
2018-11-15 16:58:15 [DEBUG   ] Got command BAM from MCS: ref #516594
2018-11-15 16:58:15 [INFO    ] Finished processing BAM request
2018-11-15 16:58:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:58:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516594   8 58437 61095033 A  ERROR'
2018-11-15 16:58:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 16:58:15 [DEBUG   ] spawn_process: at 2018-11-15 16:58:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 16:58:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 16:58:15 [DEBUG   ] spawn_process: at 2018-11-15 16:58:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 16:58:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 16:58:15 [DEBUG   ] spawn_process: at 2018-11-15 16:58:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 16:58:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 16:58:15 [DEBUG   ] spawn_process: at 2018-11-15 16:58:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 16:58:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 16:58:15 [DEBUG   ] spawn_process: at 2018-11-15 16:58:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 16:58:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 16:58:15 [DEBUG   ] spawn_process: at 2018-11-15 16:58:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 16:58:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 16:58:15 [DEBUG   ] spawn_process: at 2018-11-15 16:58:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 16:58:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 16:58:15 [DEBUG   ] spawn_process: at 2018-11-15 16:58:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 16:58:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 16:58:15 [DEBUG   ] spawn_process: at 2018-11-15 16:58:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 16:58:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 16:58:15 [DEBUG   ] spawn_process: at 2018-11-15 16:58:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 16:58:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 16:58:15 [DEBUG   ] spawn_process: at 2018-11-15 16:58:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 16:58:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 16:58:15 [DEBUG   ] spawn_process: at 2018-11-15 16:58:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 16:58:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 16:58:15 [DEBUG   ] spawn_process: at 2018-11-15 16:58:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 16:58:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 16:58:15 [DEBUG   ] spawn_process: at 2018-11-15 16:58:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 16:58:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 16:58:15 [DEBUG   ] spawn_process: at 2018-11-15 16:58:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 16:58:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 16:58:15 [DEBUG   ] spawn_process: at 2018-11-15 16:58:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 16:58:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 16:58:15 [DEBUG   ] spawn_process: at 2018-11-15 16:58:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 16:58:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 16:58:15 [DEBUG   ] spawn_process: at 2018-11-15 16:58:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 16:58:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 16:58:15 [DEBUG   ] spawn_process: at 2018-11-15 16:58:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 16:58:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 16:58:15 [DEBUG   ] spawn_process: at 2018-11-15 16:58:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 16:58:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 16:58:15 [DEBUG   ] spawn_process: at 2018-11-15 16:58:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 16:58:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 16:58:15 [DEBUG   ] spawn_process: at 2018-11-15 16:58:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 16:58:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 16:58:15 [DEBUG   ] spawn_process: at 2018-11-15 16:58:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 16:58:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 16:58:15 [DEBUG   ] spawn_process: at 2018-11-15 16:58:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 16:58:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 16:58:15 [DEBUG   ] spawn_process: at 2018-11-15 16:58:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 16:58:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 16:58:15 [DEBUG   ] spawn_process: at 2018-11-15 16:58:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 16:58:18 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 16:58:20 [DEBUG   ] Got command RPT from MCS: ref #516596
2018-11-15 16:58:20 [DEBUG   ] summary = ERROR
2018-11-15 16:58:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516596  13 58437 61100017 A  ERRORERROR'
2018-11-15 16:58:20 [DEBUG   ] Got command RPT from MCS: ref #516597
2018-11-15 16:58:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 16:58:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516597  77 58437 61100221 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 16:58:20 [DEBUG   ] Got command RPT from MCS: ref #516598
2018-11-15 16:58:20 [DEBUG   ] summary = ERROR
2018-11-15 16:58:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516598  13 58437 61100413 A  ERRORERROR'
2018-11-15 16:58:20 [DEBUG   ] Got command RPT from MCS: ref #516600
2018-11-15 16:58:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 16:58:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516600  77 58437 61100617 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 16:58:20 [DEBUG   ] Got command RPT from MCS: ref #516602
2018-11-15 16:58:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 16:58:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516602  12 58437 61100821 A  ERRORB¢ff'
2018-11-15 16:58:36 [DEBUG   ] Got command BAM from MCS: ref #516606
2018-11-15 16:58:36 [INFO    ] Finished processing BAM request
2018-11-15 16:58:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:58:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516606   8 58437 61116029 A  ERROR'
2018-11-15 16:58:36 [DEBUG   ] Got command BAM from MCS: ref #516607
2018-11-15 16:58:36 [INFO    ] Finished processing BAM request
2018-11-15 16:58:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:58:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516607   8 58437 61116033 A  ERROR'
2018-11-15 16:58:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 16:58:36 [DEBUG   ] spawn_process: at 2018-11-15 16:58:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 16:58:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 16:58:37 [DEBUG   ] spawn_process: at 2018-11-15 16:58:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 16:58:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 16:58:37 [DEBUG   ] spawn_process: at 2018-11-15 16:58:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 16:58:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 16:58:37 [DEBUG   ] spawn_process: at 2018-11-15 16:58:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 16:58:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 16:58:37 [DEBUG   ] spawn_process: at 2018-11-15 16:58:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 16:58:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 16:58:37 [DEBUG   ] spawn_process: at 2018-11-15 16:58:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 16:58:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 16:58:37 [DEBUG   ] spawn_process: at 2018-11-15 16:58:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 16:58:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 16:58:37 [DEBUG   ] spawn_process: at 2018-11-15 16:58:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 16:58:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 16:58:37 [DEBUG   ] spawn_process: at 2018-11-15 16:58:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 16:58:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 16:58:37 [DEBUG   ] spawn_process: at 2018-11-15 16:58:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 16:58:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 16:58:37 [DEBUG   ] spawn_process: at 2018-11-15 16:58:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 16:58:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 16:58:37 [DEBUG   ] spawn_process: at 2018-11-15 16:58:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 16:58:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 16:58:37 [DEBUG   ] spawn_process: at 2018-11-15 16:58:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 16:58:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 16:58:37 [DEBUG   ] spawn_process: at 2018-11-15 16:58:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 16:58:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 16:58:37 [DEBUG   ] spawn_process: at 2018-11-15 16:58:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 16:58:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 16:58:37 [DEBUG   ] spawn_process: at 2018-11-15 16:58:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 16:58:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 16:58:37 [DEBUG   ] spawn_process: at 2018-11-15 16:58:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 16:58:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 16:58:37 [DEBUG   ] spawn_process: at 2018-11-15 16:58:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 16:58:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 16:58:37 [DEBUG   ] spawn_process: at 2018-11-15 16:58:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 16:58:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 16:58:37 [DEBUG   ] spawn_process: at 2018-11-15 16:58:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 16:58:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 16:58:37 [DEBUG   ] spawn_process: at 2018-11-15 16:58:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 16:58:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 16:58:37 [DEBUG   ] spawn_process: at 2018-11-15 16:58:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 16:58:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 16:58:37 [DEBUG   ] spawn_process: at 2018-11-15 16:58:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 16:58:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 16:58:37 [DEBUG   ] spawn_process: at 2018-11-15 16:58:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 16:58:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 16:58:37 [DEBUG   ] spawn_process: at 2018-11-15 16:58:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 16:58:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 16:58:37 [DEBUG   ] spawn_process: at 2018-11-15 16:58:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 16:58:38 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 16:58:57 [DEBUG   ] Got command BAM from MCS: ref #516608
2018-11-15 16:58:57 [INFO    ] Finished processing BAM request
2018-11-15 16:58:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:58:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516608   8 58437 61137025 A  ERROR'
2018-11-15 16:58:57 [DEBUG   ] Got command BAM from MCS: ref #516609
2018-11-15 16:58:57 [INFO    ] Finished processing BAM request
2018-11-15 16:58:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:58:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516609   8 58437 61137029 A  ERROR'
2018-11-15 16:58:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 16:58:57 [DEBUG   ] spawn_process: at 2018-11-15 16:58:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 16:58:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 16:58:57 [DEBUG   ] spawn_process: at 2018-11-15 16:58:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 16:58:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 16:58:57 [DEBUG   ] spawn_process: at 2018-11-15 16:58:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 16:58:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 16:58:57 [DEBUG   ] spawn_process: at 2018-11-15 16:58:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 16:58:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 16:58:57 [DEBUG   ] spawn_process: at 2018-11-15 16:58:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 16:58:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 16:58:57 [DEBUG   ] spawn_process: at 2018-11-15 16:58:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 16:58:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 16:58:57 [DEBUG   ] spawn_process: at 2018-11-15 16:58:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 16:58:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 16:58:57 [DEBUG   ] spawn_process: at 2018-11-15 16:58:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 16:58:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 16:58:57 [DEBUG   ] spawn_process: at 2018-11-15 16:58:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 16:58:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 16:58:57 [DEBUG   ] spawn_process: at 2018-11-15 16:58:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 16:58:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 16:58:57 [DEBUG   ] spawn_process: at 2018-11-15 16:58:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 16:58:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 16:58:57 [DEBUG   ] spawn_process: at 2018-11-15 16:58:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 16:58:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 16:58:57 [DEBUG   ] spawn_process: at 2018-11-15 16:58:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 16:58:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 16:58:57 [DEBUG   ] spawn_process: at 2018-11-15 16:58:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 16:58:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 16:58:57 [DEBUG   ] spawn_process: at 2018-11-15 16:58:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 16:58:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 16:58:57 [DEBUG   ] spawn_process: at 2018-11-15 16:58:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 16:58:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 16:58:57 [DEBUG   ] spawn_process: at 2018-11-15 16:58:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 16:58:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 16:58:57 [DEBUG   ] spawn_process: at 2018-11-15 16:58:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 16:58:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 16:58:57 [DEBUG   ] spawn_process: at 2018-11-15 16:58:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 16:58:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 16:58:57 [DEBUG   ] spawn_process: at 2018-11-15 16:58:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 16:58:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 16:58:57 [DEBUG   ] spawn_process: at 2018-11-15 16:58:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 16:58:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 16:58:57 [DEBUG   ] spawn_process: at 2018-11-15 16:58:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 16:58:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 16:58:57 [DEBUG   ] spawn_process: at 2018-11-15 16:58:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 16:58:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 16:58:57 [DEBUG   ] spawn_process: at 2018-11-15 16:58:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 16:58:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 16:58:57 [DEBUG   ] spawn_process: at 2018-11-15 16:58:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 16:58:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 16:58:57 [DEBUG   ] spawn_process: at 2018-11-15 16:58:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 16:58:58 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 16:59:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 16:59:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 16:59:03 [WARNING ] (13, 1, 'bot')
2018-11-15 16:59:03 [WARNING ] (13, 1, 'bot')
2018-11-15 16:59:03 [WARNING ] (13, 1, 'bot')
2018-11-15 16:59:03 [WARNING ] (13, 1, 'bot')
2018-11-15 16:59:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 16:59:03 [DEBUG   ] Finished updating board flags in 1.020 seconds
2018-11-15 16:59:18 [DEBUG   ] Got command BAM from MCS: ref #516610
2018-11-15 16:59:18 [INFO    ] Finished processing BAM request
2018-11-15 16:59:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:59:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516610   8 58437 61158029 A  ERROR'
2018-11-15 16:59:18 [DEBUG   ] Got command BAM from MCS: ref #516611
2018-11-15 16:59:18 [INFO    ] Finished processing BAM request
2018-11-15 16:59:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:59:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516611   8 58437 61158033 A  ERROR'
2018-11-15 16:59:18 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 16:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 16:59:18 [DEBUG   ] spawn_process: at 2018-11-15 16:59:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 16:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 16:59:18 [DEBUG   ] spawn_process: at 2018-11-15 16:59:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 16:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 16:59:18 [DEBUG   ] spawn_process: at 2018-11-15 16:59:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 16:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 16:59:18 [DEBUG   ] spawn_process: at 2018-11-15 16:59:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 16:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 16:59:18 [DEBUG   ] spawn_process: at 2018-11-15 16:59:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 16:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 16:59:18 [DEBUG   ] spawn_process: at 2018-11-15 16:59:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 16:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 16:59:18 [DEBUG   ] spawn_process: at 2018-11-15 16:59:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 16:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 16:59:18 [DEBUG   ] spawn_process: at 2018-11-15 16:59:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 16:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 16:59:18 [DEBUG   ] spawn_process: at 2018-11-15 16:59:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 16:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 16:59:18 [DEBUG   ] spawn_process: at 2018-11-15 16:59:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 16:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 16:59:18 [DEBUG   ] spawn_process: at 2018-11-15 16:59:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 16:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 16:59:18 [DEBUG   ] spawn_process: at 2018-11-15 16:59:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 16:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 16:59:18 [DEBUG   ] spawn_process: at 2018-11-15 16:59:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 16:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 16:59:18 [DEBUG   ] spawn_process: at 2018-11-15 16:59:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 16:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 16:59:18 [DEBUG   ] spawn_process: at 2018-11-15 16:59:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 16:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 16:59:18 [DEBUG   ] spawn_process: at 2018-11-15 16:59:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 16:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 16:59:18 [DEBUG   ] spawn_process: at 2018-11-15 16:59:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 16:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 16:59:18 [DEBUG   ] spawn_process: at 2018-11-15 16:59:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 16:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 16:59:18 [DEBUG   ] spawn_process: at 2018-11-15 16:59:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 16:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 16:59:18 [DEBUG   ] spawn_process: at 2018-11-15 16:59:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 16:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 16:59:18 [DEBUG   ] spawn_process: at 2018-11-15 16:59:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 16:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 16:59:18 [DEBUG   ] spawn_process: at 2018-11-15 16:59:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 16:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 16:59:18 [DEBUG   ] spawn_process: at 2018-11-15 16:59:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 16:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 16:59:18 [DEBUG   ] spawn_process: at 2018-11-15 16:59:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 16:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 16:59:18 [DEBUG   ] spawn_process: at 2018-11-15 16:59:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 16:59:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 16:59:18 [DEBUG   ] spawn_process: at 2018-11-15 16:59:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 16:59:38 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 16:59:39 [DEBUG   ] Got command BAM from MCS: ref #516617
2018-11-15 16:59:39 [INFO    ] Finished processing BAM request
2018-11-15 16:59:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:59:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516617   8 58437 61179033 A  ERROR'
2018-11-15 16:59:39 [DEBUG   ] Got command BAM from MCS: ref #516616
2018-11-15 16:59:39 [INFO    ] Finished processing BAM request
2018-11-15 16:59:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 16:59:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516616   8 58437 61179037 A  ERROR'
2018-11-15 16:59:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 16:59:39 [DEBUG   ] spawn_process: at 2018-11-15 16:59:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 16:59:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 16:59:39 [DEBUG   ] spawn_process: at 2018-11-15 16:59:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 16:59:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 16:59:39 [DEBUG   ] spawn_process: at 2018-11-15 16:59:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 16:59:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 16:59:39 [DEBUG   ] spawn_process: at 2018-11-15 16:59:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 16:59:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 16:59:39 [DEBUG   ] spawn_process: at 2018-11-15 16:59:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 16:59:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 16:59:39 [DEBUG   ] spawn_process: at 2018-11-15 16:59:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 16:59:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 16:59:39 [DEBUG   ] spawn_process: at 2018-11-15 16:59:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 16:59:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 16:59:39 [DEBUG   ] spawn_process: at 2018-11-15 16:59:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 16:59:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 16:59:39 [DEBUG   ] spawn_process: at 2018-11-15 16:59:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 16:59:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 16:59:39 [DEBUG   ] spawn_process: at 2018-11-15 16:59:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 16:59:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 16:59:39 [DEBUG   ] spawn_process: at 2018-11-15 16:59:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 16:59:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 16:59:39 [DEBUG   ] spawn_process: at 2018-11-15 16:59:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 16:59:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 16:59:39 [DEBUG   ] spawn_process: at 2018-11-15 16:59:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 16:59:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 16:59:39 [DEBUG   ] spawn_process: at 2018-11-15 16:59:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 16:59:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 16:59:39 [DEBUG   ] spawn_process: at 2018-11-15 16:59:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 16:59:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 16:59:39 [DEBUG   ] spawn_process: at 2018-11-15 16:59:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 16:59:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 16:59:39 [DEBUG   ] spawn_process: at 2018-11-15 16:59:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 16:59:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 16:59:39 [DEBUG   ] spawn_process: at 2018-11-15 16:59:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 16:59:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 16:59:39 [DEBUG   ] spawn_process: at 2018-11-15 16:59:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 16:59:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 16:59:39 [DEBUG   ] spawn_process: at 2018-11-15 16:59:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 16:59:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 16:59:39 [DEBUG   ] spawn_process: at 2018-11-15 16:59:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 16:59:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 16:59:39 [DEBUG   ] spawn_process: at 2018-11-15 16:59:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 16:59:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 16:59:39 [DEBUG   ] spawn_process: at 2018-11-15 16:59:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 16:59:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 16:59:39 [DEBUG   ] spawn_process: at 2018-11-15 16:59:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 16:59:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 16:59:39 [DEBUG   ] spawn_process: at 2018-11-15 16:59:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 16:59:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 16:59:39 [DEBUG   ] spawn_process: at 2018-11-15 16:59:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 16:59:58 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-15 17:00:00 [DEBUG   ] Got command BAM from MCS: ref #516618
2018-11-15 17:00:00 [INFO    ] Finished processing BAM request
2018-11-15 17:00:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:00:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516618   8 58437 61200029 A  ERROR'
2018-11-15 17:00:00 [DEBUG   ] Got command BAM from MCS: ref #516619
2018-11-15 17:00:00 [INFO    ] Finished processing BAM request
2018-11-15 17:00:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:00:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516619   8 58437 61200033 A  ERROR'
2018-11-15 17:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 17:00:00 [DEBUG   ] spawn_process: at 2018-11-15 17:00:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 17:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 17:00:00 [DEBUG   ] spawn_process: at 2018-11-15 17:00:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 17:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 17:00:00 [DEBUG   ] spawn_process: at 2018-11-15 17:00:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 17:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 17:00:00 [DEBUG   ] spawn_process: at 2018-11-15 17:00:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 17:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 17:00:00 [DEBUG   ] spawn_process: at 2018-11-15 17:00:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 17:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 17:00:00 [DEBUG   ] spawn_process: at 2018-11-15 17:00:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 17:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 17:00:00 [DEBUG   ] spawn_process: at 2018-11-15 17:00:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 17:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 17:00:00 [DEBUG   ] spawn_process: at 2018-11-15 17:00:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 17:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 17:00:00 [DEBUG   ] spawn_process: at 2018-11-15 17:00:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 17:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 17:00:00 [DEBUG   ] spawn_process: at 2018-11-15 17:00:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 17:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 17:00:00 [DEBUG   ] spawn_process: at 2018-11-15 17:00:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 17:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 17:00:00 [DEBUG   ] spawn_process: at 2018-11-15 17:00:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 17:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 17:00:00 [DEBUG   ] spawn_process: at 2018-11-15 17:00:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 17:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 17:00:00 [DEBUG   ] spawn_process: at 2018-11-15 17:00:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 17:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 17:00:00 [DEBUG   ] spawn_process: at 2018-11-15 17:00:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 17:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 17:00:00 [DEBUG   ] spawn_process: at 2018-11-15 17:00:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 17:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 17:00:00 [DEBUG   ] spawn_process: at 2018-11-15 17:00:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 17:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 17:00:00 [DEBUG   ] spawn_process: at 2018-11-15 17:00:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 17:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 17:00:00 [DEBUG   ] spawn_process: at 2018-11-15 17:00:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 17:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 17:00:00 [DEBUG   ] spawn_process: at 2018-11-15 17:00:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 17:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 17:00:00 [DEBUG   ] spawn_process: at 2018-11-15 17:00:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 17:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 17:00:00 [DEBUG   ] spawn_process: at 2018-11-15 17:00:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 17:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 17:00:00 [DEBUG   ] spawn_process: at 2018-11-15 17:00:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 17:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 17:00:00 [DEBUG   ] spawn_process: at 2018-11-15 17:00:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 17:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 17:00:00 [DEBUG   ] spawn_process: at 2018-11-15 17:00:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 17:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 17:00:00 [DEBUG   ] spawn_process: at 2018-11-15 17:00:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 17:00:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 17:00:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 17:00:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-15 17:00:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:00:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 17:00:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 17:00:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 17:00:03 [WARNING ] (13, 1, 'bot')
2018-11-15 17:00:03 [WARNING ] (13, 1, 'bot')
2018-11-15 17:00:03 [WARNING ] (13, 1, 'bot')
2018-11-15 17:00:03 [WARNING ] (13, 1, 'bot')
2018-11-15 17:00:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:00:03 [DEBUG   ] Finished updating board flags in 0.973 seconds
2018-11-15 17:00:19 [DEBUG   ] Finished updating ant stats in 1.190 seconds
2018-11-15 17:00:21 [DEBUG   ] Got command BAM from MCS: ref #516620
2018-11-15 17:00:21 [INFO    ] Finished processing BAM request
2018-11-15 17:00:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:00:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516620   8 58437 61221025 A  ERROR'
2018-11-15 17:00:21 [DEBUG   ] Got command BAM from MCS: ref #516621
2018-11-15 17:00:21 [INFO    ] Finished processing BAM request
2018-11-15 17:00:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:00:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516621   8 58437 61221029 A  ERROR'
2018-11-15 17:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 17:00:21 [DEBUG   ] spawn_process: at 2018-11-15 17:00:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 17:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 17:00:21 [DEBUG   ] spawn_process: at 2018-11-15 17:00:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 17:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 17:00:21 [DEBUG   ] spawn_process: at 2018-11-15 17:00:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 17:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 17:00:21 [DEBUG   ] spawn_process: at 2018-11-15 17:00:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 17:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 17:00:21 [DEBUG   ] spawn_process: at 2018-11-15 17:00:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 17:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 17:00:21 [DEBUG   ] spawn_process: at 2018-11-15 17:00:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 17:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 17:00:21 [DEBUG   ] spawn_process: at 2018-11-15 17:00:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 17:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 17:00:21 [DEBUG   ] spawn_process: at 2018-11-15 17:00:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 17:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 17:00:21 [DEBUG   ] spawn_process: at 2018-11-15 17:00:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 17:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 17:00:21 [DEBUG   ] spawn_process: at 2018-11-15 17:00:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 17:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 17:00:21 [DEBUG   ] spawn_process: at 2018-11-15 17:00:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 17:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 17:00:21 [DEBUG   ] spawn_process: at 2018-11-15 17:00:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 17:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 17:00:21 [DEBUG   ] spawn_process: at 2018-11-15 17:00:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 17:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 17:00:21 [DEBUG   ] spawn_process: at 2018-11-15 17:00:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 17:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 17:00:21 [DEBUG   ] spawn_process: at 2018-11-15 17:00:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 17:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 17:00:21 [DEBUG   ] spawn_process: at 2018-11-15 17:00:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 17:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 17:00:21 [DEBUG   ] spawn_process: at 2018-11-15 17:00:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 17:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 17:00:21 [DEBUG   ] spawn_process: at 2018-11-15 17:00:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 17:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 17:00:21 [DEBUG   ] spawn_process: at 2018-11-15 17:00:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 17:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 17:00:21 [DEBUG   ] spawn_process: at 2018-11-15 17:00:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 17:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 17:00:21 [DEBUG   ] spawn_process: at 2018-11-15 17:00:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 17:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 17:00:21 [DEBUG   ] spawn_process: at 2018-11-15 17:00:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 17:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 17:00:21 [DEBUG   ] spawn_process: at 2018-11-15 17:00:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 17:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 17:00:21 [DEBUG   ] spawn_process: at 2018-11-15 17:00:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 17:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 17:00:21 [DEBUG   ] spawn_process: at 2018-11-15 17:00:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 17:00:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 17:00:21 [DEBUG   ] spawn_process: at 2018-11-15 17:00:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 17:00:39 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-15 17:00:42 [DEBUG   ] Got command BAM from MCS: ref #516623
2018-11-15 17:00:42 [INFO    ] Finished processing BAM request
2018-11-15 17:00:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:00:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516623   8 58437 61242029 A  ERROR'
2018-11-15 17:00:42 [DEBUG   ] Got command BAM from MCS: ref #516622
2018-11-15 17:00:42 [INFO    ] Finished processing BAM request
2018-11-15 17:00:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:00:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516622   8 58437 61242033 A  ERROR'
2018-11-15 17:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 17:00:42 [DEBUG   ] spawn_process: at 2018-11-15 17:00:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 17:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 17:00:42 [DEBUG   ] spawn_process: at 2018-11-15 17:00:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 17:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 17:00:42 [DEBUG   ] spawn_process: at 2018-11-15 17:00:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 17:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 17:00:42 [DEBUG   ] spawn_process: at 2018-11-15 17:00:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 17:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 17:00:42 [DEBUG   ] spawn_process: at 2018-11-15 17:00:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 17:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 17:00:42 [DEBUG   ] spawn_process: at 2018-11-15 17:00:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 17:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 17:00:42 [DEBUG   ] spawn_process: at 2018-11-15 17:00:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 17:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 17:00:42 [DEBUG   ] spawn_process: at 2018-11-15 17:00:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 17:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 17:00:42 [DEBUG   ] spawn_process: at 2018-11-15 17:00:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 17:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 17:00:42 [DEBUG   ] spawn_process: at 2018-11-15 17:00:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 17:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 17:00:42 [DEBUG   ] spawn_process: at 2018-11-15 17:00:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 17:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 17:00:42 [DEBUG   ] spawn_process: at 2018-11-15 17:00:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 17:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 17:00:42 [DEBUG   ] spawn_process: at 2018-11-15 17:00:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 17:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 17:00:42 [DEBUG   ] spawn_process: at 2018-11-15 17:00:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 17:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 17:00:42 [DEBUG   ] spawn_process: at 2018-11-15 17:00:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 17:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 17:00:42 [DEBUG   ] spawn_process: at 2018-11-15 17:00:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 17:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 17:00:42 [DEBUG   ] spawn_process: at 2018-11-15 17:00:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 17:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 17:00:42 [DEBUG   ] spawn_process: at 2018-11-15 17:00:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 17:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 17:00:42 [DEBUG   ] spawn_process: at 2018-11-15 17:00:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 17:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 17:00:42 [DEBUG   ] spawn_process: at 2018-11-15 17:00:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 17:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 17:00:42 [DEBUG   ] spawn_process: at 2018-11-15 17:00:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 17:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 17:00:42 [DEBUG   ] spawn_process: at 2018-11-15 17:00:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 17:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 17:00:42 [DEBUG   ] spawn_process: at 2018-11-15 17:00:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 17:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 17:00:42 [DEBUG   ] spawn_process: at 2018-11-15 17:00:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 17:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 17:00:42 [DEBUG   ] spawn_process: at 2018-11-15 17:00:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 17:00:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 17:00:42 [DEBUG   ] spawn_process: at 2018-11-15 17:00:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 17:00:45 [DEBUG   ] Got command RPT from MCS: ref #516624
2018-11-15 17:00:45 [DEBUG   ] summary = ERROR
2018-11-15 17:00:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516624  13 58437 61245141 A  ERRORERROR'
2018-11-15 17:00:45 [DEBUG   ] Got command RPT from MCS: ref #516625
2018-11-15 17:00:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 17:00:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516625  77 58437 61245142 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 17:00:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 17:01:03 [DEBUG   ] Got command BAM from MCS: ref #516642
2018-11-15 17:01:03 [INFO    ] Finished processing BAM request
2018-11-15 17:01:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:01:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516642   8 58437 61263029 A  ERROR'
2018-11-15 17:01:03 [DEBUG   ] Got command BAM from MCS: ref #516641
2018-11-15 17:01:03 [INFO    ] Finished processing BAM request
2018-11-15 17:01:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:01:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516641   8 58437 61263033 A  ERROR'
2018-11-15 17:01:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 17:01:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:01:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 17:01:03 [DEBUG   ] spawn_process: at 2018-11-15 17:01:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 17:01:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 17:01:03 [DEBUG   ] spawn_process: at 2018-11-15 17:01:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 17:01:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 17:01:03 [DEBUG   ] spawn_process: at 2018-11-15 17:01:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 17:01:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 17:01:03 [DEBUG   ] spawn_process: at 2018-11-15 17:01:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 17:01:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 17:01:03 [DEBUG   ] spawn_process: at 2018-11-15 17:01:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 17:01:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 17:01:03 [DEBUG   ] spawn_process: at 2018-11-15 17:01:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 17:01:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 17:01:03 [DEBUG   ] spawn_process: at 2018-11-15 17:01:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 17:01:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 17:01:03 [DEBUG   ] spawn_process: at 2018-11-15 17:01:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 17:01:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 17:01:03 [DEBUG   ] spawn_process: at 2018-11-15 17:01:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 17:01:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 17:01:03 [DEBUG   ] spawn_process: at 2018-11-15 17:01:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 17:01:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 17:01:03 [DEBUG   ] spawn_process: at 2018-11-15 17:01:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 17:01:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 17:01:03 [DEBUG   ] spawn_process: at 2018-11-15 17:01:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 17:01:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 17:01:03 [DEBUG   ] spawn_process: at 2018-11-15 17:01:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 17:01:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 17:01:03 [DEBUG   ] spawn_process: at 2018-11-15 17:01:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 17:01:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 17:01:03 [DEBUG   ] spawn_process: at 2018-11-15 17:01:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 17:01:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 17:01:03 [DEBUG   ] spawn_process: at 2018-11-15 17:01:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 17:01:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 17:01:03 [DEBUG   ] spawn_process: at 2018-11-15 17:01:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 17:01:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 17:01:03 [DEBUG   ] spawn_process: at 2018-11-15 17:01:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 17:01:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 17:01:03 [DEBUG   ] spawn_process: at 2018-11-15 17:01:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 17:01:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 17:01:03 [DEBUG   ] spawn_process: at 2018-11-15 17:01:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 17:01:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 17:01:03 [DEBUG   ] spawn_process: at 2018-11-15 17:01:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 17:01:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 17:01:03 [DEBUG   ] spawn_process: at 2018-11-15 17:01:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 17:01:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 17:01:03 [DEBUG   ] spawn_process: at 2018-11-15 17:01:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 17:01:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 17:01:03 [DEBUG   ] spawn_process: at 2018-11-15 17:01:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 17:01:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 17:01:03 [DEBUG   ] spawn_process: at 2018-11-15 17:01:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 17:01:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 17:01:03 [DEBUG   ] spawn_process: at 2018-11-15 17:01:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 17:01:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 17:01:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 17:01:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 17:01:04 [WARNING ] (13, 1, 'bot')
2018-11-15 17:01:04 [WARNING ] (13, 1, 'bot')
2018-11-15 17:01:04 [WARNING ] (13, 1, 'bot')
2018-11-15 17:01:04 [WARNING ] (13, 1, 'bot')
2018-11-15 17:01:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:01:04 [DEBUG   ] Finished updating board flags in 1.363 seconds
2018-11-15 17:01:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 17:01:24 [DEBUG   ] Got command BAM from MCS: ref #516643
2018-11-15 17:01:24 [INFO    ] Finished processing BAM request
2018-11-15 17:01:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:01:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516643   8 58437 61284033 A  ERROR'
2018-11-15 17:01:24 [DEBUG   ] Got command BAM from MCS: ref #516644
2018-11-15 17:01:24 [INFO    ] Finished processing BAM request
2018-11-15 17:01:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:01:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516644   8 58437 61284037 A  ERROR'
2018-11-15 17:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 17:01:24 [DEBUG   ] spawn_process: at 2018-11-15 17:01:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 17:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 17:01:24 [DEBUG   ] spawn_process: at 2018-11-15 17:01:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 17:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 17:01:24 [DEBUG   ] spawn_process: at 2018-11-15 17:01:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 17:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 17:01:24 [DEBUG   ] spawn_process: at 2018-11-15 17:01:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 17:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 17:01:24 [DEBUG   ] spawn_process: at 2018-11-15 17:01:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 17:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 17:01:24 [DEBUG   ] spawn_process: at 2018-11-15 17:01:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 17:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 17:01:24 [DEBUG   ] spawn_process: at 2018-11-15 17:01:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 17:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 17:01:24 [DEBUG   ] spawn_process: at 2018-11-15 17:01:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 17:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 17:01:24 [DEBUG   ] spawn_process: at 2018-11-15 17:01:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 17:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 17:01:24 [DEBUG   ] spawn_process: at 2018-11-15 17:01:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 17:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 17:01:24 [DEBUG   ] spawn_process: at 2018-11-15 17:01:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 17:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 17:01:24 [DEBUG   ] spawn_process: at 2018-11-15 17:01:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 17:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 17:01:24 [DEBUG   ] spawn_process: at 2018-11-15 17:01:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 17:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 17:01:24 [DEBUG   ] spawn_process: at 2018-11-15 17:01:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 17:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 17:01:24 [DEBUG   ] spawn_process: at 2018-11-15 17:01:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 17:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 17:01:24 [DEBUG   ] spawn_process: at 2018-11-15 17:01:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 17:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 17:01:24 [DEBUG   ] spawn_process: at 2018-11-15 17:01:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 17:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 17:01:24 [DEBUG   ] spawn_process: at 2018-11-15 17:01:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 17:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 17:01:24 [DEBUG   ] spawn_process: at 2018-11-15 17:01:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 17:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 17:01:24 [DEBUG   ] spawn_process: at 2018-11-15 17:01:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 17:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 17:01:24 [DEBUG   ] spawn_process: at 2018-11-15 17:01:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 17:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 17:01:24 [DEBUG   ] spawn_process: at 2018-11-15 17:01:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 17:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 17:01:24 [DEBUG   ] spawn_process: at 2018-11-15 17:01:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 17:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 17:01:24 [DEBUG   ] spawn_process: at 2018-11-15 17:01:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 17:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 17:01:24 [DEBUG   ] spawn_process: at 2018-11-15 17:01:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 17:01:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 17:01:24 [DEBUG   ] spawn_process: at 2018-11-15 17:01:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 17:01:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 17:01:45 [DEBUG   ] Got command BAM from MCS: ref #516645
2018-11-15 17:01:45 [INFO    ] Finished processing BAM request
2018-11-15 17:01:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:01:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516645   8 58437 61305033 A  ERROR'
2018-11-15 17:01:45 [DEBUG   ] Got command BAM from MCS: ref #516646
2018-11-15 17:01:45 [INFO    ] Finished processing BAM request
2018-11-15 17:01:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:01:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516646   8 58437 61305037 A  ERROR'
2018-11-15 17:01:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 17:01:45 [DEBUG   ] spawn_process: at 2018-11-15 17:01:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 17:01:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 17:01:45 [DEBUG   ] spawn_process: at 2018-11-15 17:01:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 17:01:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 17:01:45 [DEBUG   ] spawn_process: at 2018-11-15 17:01:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 17:01:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 17:01:45 [DEBUG   ] spawn_process: at 2018-11-15 17:01:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 17:01:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 17:01:45 [DEBUG   ] spawn_process: at 2018-11-15 17:01:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 17:01:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 17:01:45 [DEBUG   ] spawn_process: at 2018-11-15 17:01:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 17:01:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 17:01:45 [DEBUG   ] spawn_process: at 2018-11-15 17:01:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 17:01:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 17:01:45 [DEBUG   ] spawn_process: at 2018-11-15 17:01:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 17:01:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 17:01:45 [DEBUG   ] spawn_process: at 2018-11-15 17:01:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 17:01:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 17:01:45 [DEBUG   ] spawn_process: at 2018-11-15 17:01:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 17:01:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 17:01:45 [DEBUG   ] spawn_process: at 2018-11-15 17:01:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 17:01:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 17:01:45 [DEBUG   ] spawn_process: at 2018-11-15 17:01:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 17:01:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 17:01:45 [DEBUG   ] spawn_process: at 2018-11-15 17:01:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 17:01:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 17:01:45 [DEBUG   ] spawn_process: at 2018-11-15 17:01:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 17:01:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 17:01:45 [DEBUG   ] spawn_process: at 2018-11-15 17:01:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 17:01:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 17:01:45 [DEBUG   ] spawn_process: at 2018-11-15 17:01:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 17:01:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 17:01:45 [DEBUG   ] spawn_process: at 2018-11-15 17:01:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 17:01:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 17:01:45 [DEBUG   ] spawn_process: at 2018-11-15 17:01:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 17:01:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 17:01:45 [DEBUG   ] spawn_process: at 2018-11-15 17:01:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 17:01:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 17:01:45 [DEBUG   ] spawn_process: at 2018-11-15 17:01:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 17:01:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 17:01:45 [DEBUG   ] spawn_process: at 2018-11-15 17:01:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 17:01:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 17:01:45 [DEBUG   ] spawn_process: at 2018-11-15 17:01:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 17:01:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 17:01:45 [DEBUG   ] spawn_process: at 2018-11-15 17:01:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 17:01:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 17:01:45 [DEBUG   ] spawn_process: at 2018-11-15 17:01:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 17:01:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 17:01:45 [DEBUG   ] spawn_process: at 2018-11-15 17:01:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 17:01:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 17:01:45 [DEBUG   ] spawn_process: at 2018-11-15 17:01:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 17:01:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 17:02:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:02:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 17:02:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 17:02:04 [WARNING ] (13, 1, 'bot')
2018-11-15 17:02:04 [WARNING ] (13, 1, 'bot')
2018-11-15 17:02:04 [WARNING ] (13, 1, 'bot')
2018-11-15 17:02:04 [WARNING ] (13, 1, 'bot')
2018-11-15 17:02:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:02:04 [DEBUG   ] Finished updating board flags in 1.213 seconds
2018-11-15 17:02:06 [DEBUG   ] Got command BAM from MCS: ref #516647
2018-11-15 17:02:06 [INFO    ] Finished processing BAM request
2018-11-15 17:02:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:02:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516647   8 58437 61326029 A  ERROR'
2018-11-15 17:02:06 [DEBUG   ] Got command BAM from MCS: ref #516648
2018-11-15 17:02:06 [INFO    ] Finished processing BAM request
2018-11-15 17:02:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:02:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516648   8 58437 61326033 A  ERROR'
2018-11-15 17:02:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 17:02:06 [DEBUG   ] spawn_process: at 2018-11-15 17:02:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 17:02:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 17:02:06 [DEBUG   ] spawn_process: at 2018-11-15 17:02:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 17:02:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 17:02:06 [DEBUG   ] spawn_process: at 2018-11-15 17:02:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 17:02:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 17:02:06 [DEBUG   ] spawn_process: at 2018-11-15 17:02:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 17:02:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 17:02:06 [DEBUG   ] spawn_process: at 2018-11-15 17:02:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 17:02:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 17:02:06 [DEBUG   ] spawn_process: at 2018-11-15 17:02:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 17:02:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 17:02:06 [DEBUG   ] spawn_process: at 2018-11-15 17:02:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 17:02:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 17:02:06 [DEBUG   ] spawn_process: at 2018-11-15 17:02:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 17:02:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 17:02:06 [DEBUG   ] spawn_process: at 2018-11-15 17:02:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 17:02:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 17:02:06 [DEBUG   ] spawn_process: at 2018-11-15 17:02:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 17:02:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 17:02:06 [DEBUG   ] spawn_process: at 2018-11-15 17:02:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 17:02:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 17:02:06 [DEBUG   ] spawn_process: at 2018-11-15 17:02:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 17:02:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 17:02:06 [DEBUG   ] spawn_process: at 2018-11-15 17:02:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 17:02:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 17:02:06 [DEBUG   ] spawn_process: at 2018-11-15 17:02:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 17:02:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 17:02:06 [DEBUG   ] spawn_process: at 2018-11-15 17:02:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 17:02:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 17:02:06 [DEBUG   ] spawn_process: at 2018-11-15 17:02:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 17:02:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 17:02:06 [DEBUG   ] spawn_process: at 2018-11-15 17:02:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 17:02:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 17:02:06 [DEBUG   ] spawn_process: at 2018-11-15 17:02:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 17:02:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 17:02:06 [DEBUG   ] spawn_process: at 2018-11-15 17:02:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 17:02:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 17:02:06 [DEBUG   ] spawn_process: at 2018-11-15 17:02:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 17:02:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 17:02:06 [DEBUG   ] spawn_process: at 2018-11-15 17:02:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 17:02:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 17:02:06 [DEBUG   ] spawn_process: at 2018-11-15 17:02:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 17:02:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 17:02:06 [DEBUG   ] spawn_process: at 2018-11-15 17:02:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 17:02:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 17:02:06 [DEBUG   ] spawn_process: at 2018-11-15 17:02:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 17:02:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 17:02:06 [DEBUG   ] spawn_process: at 2018-11-15 17:02:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 17:02:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 17:02:06 [DEBUG   ] spawn_process: at 2018-11-15 17:02:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 17:02:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 17:02:27 [DEBUG   ] Got command BAM from MCS: ref #516653
2018-11-15 17:02:27 [INFO    ] Finished processing BAM request
2018-11-15 17:02:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:02:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516653   8 58437 61347033 A  ERROR'
2018-11-15 17:02:27 [DEBUG   ] Got command BAM from MCS: ref #516654
2018-11-15 17:02:27 [INFO    ] Finished processing BAM request
2018-11-15 17:02:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:02:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516654   8 58437 61347037 A  ERROR'
2018-11-15 17:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 17:02:27 [DEBUG   ] spawn_process: at 2018-11-15 17:02:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 17:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 17:02:27 [DEBUG   ] spawn_process: at 2018-11-15 17:02:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 17:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 17:02:27 [DEBUG   ] spawn_process: at 2018-11-15 17:02:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 17:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 17:02:27 [DEBUG   ] spawn_process: at 2018-11-15 17:02:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 17:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 17:02:27 [DEBUG   ] spawn_process: at 2018-11-15 17:02:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 17:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 17:02:27 [DEBUG   ] spawn_process: at 2018-11-15 17:02:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 17:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 17:02:27 [DEBUG   ] spawn_process: at 2018-11-15 17:02:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 17:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 17:02:27 [DEBUG   ] spawn_process: at 2018-11-15 17:02:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 17:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 17:02:27 [DEBUG   ] spawn_process: at 2018-11-15 17:02:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 17:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 17:02:27 [DEBUG   ] spawn_process: at 2018-11-15 17:02:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 17:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 17:02:27 [DEBUG   ] spawn_process: at 2018-11-15 17:02:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 17:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 17:02:27 [DEBUG   ] spawn_process: at 2018-11-15 17:02:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 17:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 17:02:27 [DEBUG   ] spawn_process: at 2018-11-15 17:02:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 17:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 17:02:27 [DEBUG   ] spawn_process: at 2018-11-15 17:02:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 17:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 17:02:27 [DEBUG   ] spawn_process: at 2018-11-15 17:02:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 17:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 17:02:27 [DEBUG   ] spawn_process: at 2018-11-15 17:02:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 17:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 17:02:27 [DEBUG   ] spawn_process: at 2018-11-15 17:02:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 17:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 17:02:27 [DEBUG   ] spawn_process: at 2018-11-15 17:02:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 17:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 17:02:27 [DEBUG   ] spawn_process: at 2018-11-15 17:02:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 17:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 17:02:27 [DEBUG   ] spawn_process: at 2018-11-15 17:02:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 17:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 17:02:27 [DEBUG   ] spawn_process: at 2018-11-15 17:02:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 17:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 17:02:27 [DEBUG   ] spawn_process: at 2018-11-15 17:02:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 17:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 17:02:27 [DEBUG   ] spawn_process: at 2018-11-15 17:02:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 17:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 17:02:27 [DEBUG   ] spawn_process: at 2018-11-15 17:02:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 17:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 17:02:27 [DEBUG   ] spawn_process: at 2018-11-15 17:02:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 17:02:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 17:02:27 [DEBUG   ] spawn_process: at 2018-11-15 17:02:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 17:02:39 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-15 17:02:48 [DEBUG   ] Got command BAM from MCS: ref #516656
2018-11-15 17:02:48 [INFO    ] Finished processing BAM request
2018-11-15 17:02:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:02:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516656   8 58437 61368029 A  ERROR'
2018-11-15 17:02:48 [DEBUG   ] Got command BAM from MCS: ref #516655
2018-11-15 17:02:48 [INFO    ] Finished processing BAM request
2018-11-15 17:02:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:02:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516655   8 58437 61368033 A  ERROR'
2018-11-15 17:02:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 17:02:48 [DEBUG   ] spawn_process: at 2018-11-15 17:02:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 17:02:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 17:02:48 [DEBUG   ] spawn_process: at 2018-11-15 17:02:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 17:02:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 17:02:48 [DEBUG   ] spawn_process: at 2018-11-15 17:02:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 17:02:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 17:02:48 [DEBUG   ] spawn_process: at 2018-11-15 17:02:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 17:02:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 17:02:48 [DEBUG   ] spawn_process: at 2018-11-15 17:02:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 17:02:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 17:02:48 [DEBUG   ] spawn_process: at 2018-11-15 17:02:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 17:02:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 17:02:48 [DEBUG   ] spawn_process: at 2018-11-15 17:02:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 17:02:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 17:02:48 [DEBUG   ] spawn_process: at 2018-11-15 17:02:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 17:02:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 17:02:48 [DEBUG   ] spawn_process: at 2018-11-15 17:02:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 17:02:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 17:02:48 [DEBUG   ] spawn_process: at 2018-11-15 17:02:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 17:02:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 17:02:48 [DEBUG   ] spawn_process: at 2018-11-15 17:02:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 17:02:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 17:02:48 [DEBUG   ] spawn_process: at 2018-11-15 17:02:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 17:02:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 17:02:48 [DEBUG   ] spawn_process: at 2018-11-15 17:02:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 17:02:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 17:02:48 [DEBUG   ] spawn_process: at 2018-11-15 17:02:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 17:02:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 17:02:48 [DEBUG   ] spawn_process: at 2018-11-15 17:02:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 17:02:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 17:02:48 [DEBUG   ] spawn_process: at 2018-11-15 17:02:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 17:02:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 17:02:48 [DEBUG   ] spawn_process: at 2018-11-15 17:02:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 17:02:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 17:02:48 [DEBUG   ] spawn_process: at 2018-11-15 17:02:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 17:02:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 17:02:48 [DEBUG   ] spawn_process: at 2018-11-15 17:02:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 17:02:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 17:02:48 [DEBUG   ] spawn_process: at 2018-11-15 17:02:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 17:02:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 17:02:48 [DEBUG   ] spawn_process: at 2018-11-15 17:02:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 17:02:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 17:02:48 [DEBUG   ] spawn_process: at 2018-11-15 17:02:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 17:02:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 17:02:48 [DEBUG   ] spawn_process: at 2018-11-15 17:02:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 17:02:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 17:02:48 [DEBUG   ] spawn_process: at 2018-11-15 17:02:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 17:02:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 17:02:48 [DEBUG   ] spawn_process: at 2018-11-15 17:02:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 17:02:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 17:02:48 [DEBUG   ] spawn_process: at 2018-11-15 17:02:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 17:02:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 17:03:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 17:03:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:03:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 17:03:04 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-15 17:03:04 [WARNING ] (13, 1, 'bot')
2018-11-15 17:03:04 [WARNING ] (13, 1, 'bot')
2018-11-15 17:03:04 [WARNING ] (13, 1, 'bot')
2018-11-15 17:03:04 [WARNING ] (13, 1, 'bot')
2018-11-15 17:03:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:03:04 [DEBUG   ] Finished updating board flags in 1.197 seconds
2018-11-15 17:03:09 [DEBUG   ] Got command BAM from MCS: ref #516658
2018-11-15 17:03:09 [INFO    ] Finished processing BAM request
2018-11-15 17:03:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:03:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516658   8 58437 61389029 A  ERROR'
2018-11-15 17:03:09 [DEBUG   ] Got command BAM from MCS: ref #516657
2018-11-15 17:03:09 [INFO    ] Finished processing BAM request
2018-11-15 17:03:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:03:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516657   8 58437 61389033 A  ERROR'
2018-11-15 17:03:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 17:03:09 [DEBUG   ] spawn_process: at 2018-11-15 17:03:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 17:03:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 17:03:09 [DEBUG   ] spawn_process: at 2018-11-15 17:03:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 17:03:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 17:03:09 [DEBUG   ] spawn_process: at 2018-11-15 17:03:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 17:03:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 17:03:09 [DEBUG   ] spawn_process: at 2018-11-15 17:03:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 17:03:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 17:03:09 [DEBUG   ] spawn_process: at 2018-11-15 17:03:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 17:03:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 17:03:09 [DEBUG   ] spawn_process: at 2018-11-15 17:03:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 17:03:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 17:03:09 [DEBUG   ] spawn_process: at 2018-11-15 17:03:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 17:03:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 17:03:09 [DEBUG   ] spawn_process: at 2018-11-15 17:03:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 17:03:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 17:03:09 [DEBUG   ] spawn_process: at 2018-11-15 17:03:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 17:03:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 17:03:09 [DEBUG   ] spawn_process: at 2018-11-15 17:03:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 17:03:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 17:03:09 [DEBUG   ] spawn_process: at 2018-11-15 17:03:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 17:03:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 17:03:09 [DEBUG   ] spawn_process: at 2018-11-15 17:03:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 17:03:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 17:03:09 [DEBUG   ] spawn_process: at 2018-11-15 17:03:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 17:03:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 17:03:09 [DEBUG   ] spawn_process: at 2018-11-15 17:03:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 17:03:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 17:03:09 [DEBUG   ] spawn_process: at 2018-11-15 17:03:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 17:03:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 17:03:09 [DEBUG   ] spawn_process: at 2018-11-15 17:03:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 17:03:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 17:03:09 [DEBUG   ] spawn_process: at 2018-11-15 17:03:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 17:03:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 17:03:09 [DEBUG   ] spawn_process: at 2018-11-15 17:03:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 17:03:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 17:03:09 [DEBUG   ] spawn_process: at 2018-11-15 17:03:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 17:03:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 17:03:09 [DEBUG   ] spawn_process: at 2018-11-15 17:03:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 17:03:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 17:03:09 [DEBUG   ] spawn_process: at 2018-11-15 17:03:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 17:03:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 17:03:09 [DEBUG   ] spawn_process: at 2018-11-15 17:03:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 17:03:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 17:03:09 [DEBUG   ] spawn_process: at 2018-11-15 17:03:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 17:03:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 17:03:09 [DEBUG   ] spawn_process: at 2018-11-15 17:03:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 17:03:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 17:03:09 [DEBUG   ] spawn_process: at 2018-11-15 17:03:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 17:03:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 17:03:09 [DEBUG   ] spawn_process: at 2018-11-15 17:03:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 17:03:19 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-15 17:03:20 [DEBUG   ] Got command RPT from MCS: ref #516659
2018-11-15 17:03:20 [DEBUG   ] summary = ERROR
2018-11-15 17:03:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516659  13 58437 61400097 A  ERRORERROR'
2018-11-15 17:03:20 [DEBUG   ] Got command RPT from MCS: ref #516660
2018-11-15 17:03:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 17:03:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516660  77 58437 61400301 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 17:03:20 [DEBUG   ] Got command RPT from MCS: ref #516661
2018-11-15 17:03:20 [DEBUG   ] summary = ERROR
2018-11-15 17:03:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516661  13 58437 61400505 A  ERRORERROR'
2018-11-15 17:03:20 [DEBUG   ] Got command RPT from MCS: ref #516662
2018-11-15 17:03:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 17:03:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516662  77 58437 61400713 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 17:03:20 [DEBUG   ] Got command RPT from MCS: ref #516663
2018-11-15 17:03:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 17:03:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516663  12 58437 61400905 A  ERRORB¡ff'
2018-11-15 17:03:30 [DEBUG   ] Got command BAM from MCS: ref #516664
2018-11-15 17:03:30 [INFO    ] Finished processing BAM request
2018-11-15 17:03:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:03:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516664   8 58437 61410029 A  ERROR'
2018-11-15 17:03:30 [DEBUG   ] Got command BAM from MCS: ref #516665
2018-11-15 17:03:30 [INFO    ] Finished processing BAM request
2018-11-15 17:03:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:03:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516665   8 58437 61410033 A  ERROR'
2018-11-15 17:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 17:03:30 [DEBUG   ] spawn_process: at 2018-11-15 17:03:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 17:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 17:03:30 [DEBUG   ] spawn_process: at 2018-11-15 17:03:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 17:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 17:03:30 [DEBUG   ] spawn_process: at 2018-11-15 17:03:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 17:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 17:03:30 [DEBUG   ] spawn_process: at 2018-11-15 17:03:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 17:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 17:03:30 [DEBUG   ] spawn_process: at 2018-11-15 17:03:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 17:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 17:03:30 [DEBUG   ] spawn_process: at 2018-11-15 17:03:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 17:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 17:03:30 [DEBUG   ] spawn_process: at 2018-11-15 17:03:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 17:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 17:03:30 [DEBUG   ] spawn_process: at 2018-11-15 17:03:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 17:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 17:03:30 [DEBUG   ] spawn_process: at 2018-11-15 17:03:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 17:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 17:03:30 [DEBUG   ] spawn_process: at 2018-11-15 17:03:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 17:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 17:03:30 [DEBUG   ] spawn_process: at 2018-11-15 17:03:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 17:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 17:03:30 [DEBUG   ] spawn_process: at 2018-11-15 17:03:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 17:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 17:03:30 [DEBUG   ] spawn_process: at 2018-11-15 17:03:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 17:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 17:03:30 [DEBUG   ] spawn_process: at 2018-11-15 17:03:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 17:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 17:03:30 [DEBUG   ] spawn_process: at 2018-11-15 17:03:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 17:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 17:03:30 [DEBUG   ] spawn_process: at 2018-11-15 17:03:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 17:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 17:03:30 [DEBUG   ] spawn_process: at 2018-11-15 17:03:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 17:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 17:03:30 [DEBUG   ] spawn_process: at 2018-11-15 17:03:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 17:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 17:03:30 [DEBUG   ] spawn_process: at 2018-11-15 17:03:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 17:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 17:03:30 [DEBUG   ] spawn_process: at 2018-11-15 17:03:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 17:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 17:03:30 [DEBUG   ] spawn_process: at 2018-11-15 17:03:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 17:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 17:03:30 [DEBUG   ] spawn_process: at 2018-11-15 17:03:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 17:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 17:03:30 [DEBUG   ] spawn_process: at 2018-11-15 17:03:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 17:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 17:03:30 [DEBUG   ] spawn_process: at 2018-11-15 17:03:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 17:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 17:03:30 [DEBUG   ] spawn_process: at 2018-11-15 17:03:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 17:03:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 17:03:30 [DEBUG   ] spawn_process: at 2018-11-15 17:03:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 17:03:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 17:03:51 [DEBUG   ] Got command BAM from MCS: ref #516667
2018-11-15 17:03:51 [INFO    ] Finished processing BAM request
2018-11-15 17:03:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:03:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516667   8 58437 61431033 A  ERROR'
2018-11-15 17:03:51 [DEBUG   ] Got command BAM from MCS: ref #516666
2018-11-15 17:03:51 [INFO    ] Finished processing BAM request
2018-11-15 17:03:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:03:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516666   8 58437 61431037 A  ERROR'
2018-11-15 17:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 17:03:51 [DEBUG   ] spawn_process: at 2018-11-15 17:03:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 17:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 17:03:51 [DEBUG   ] spawn_process: at 2018-11-15 17:03:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 17:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 17:03:51 [DEBUG   ] spawn_process: at 2018-11-15 17:03:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 17:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 17:03:51 [DEBUG   ] spawn_process: at 2018-11-15 17:03:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 17:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 17:03:51 [DEBUG   ] spawn_process: at 2018-11-15 17:03:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 17:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 17:03:51 [DEBUG   ] spawn_process: at 2018-11-15 17:03:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 17:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 17:03:51 [DEBUG   ] spawn_process: at 2018-11-15 17:03:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 17:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 17:03:51 [DEBUG   ] spawn_process: at 2018-11-15 17:03:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 17:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 17:03:51 [DEBUG   ] spawn_process: at 2018-11-15 17:03:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 17:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 17:03:51 [DEBUG   ] spawn_process: at 2018-11-15 17:03:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 17:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 17:03:51 [DEBUG   ] spawn_process: at 2018-11-15 17:03:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 17:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 17:03:51 [DEBUG   ] spawn_process: at 2018-11-15 17:03:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 17:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 17:03:51 [DEBUG   ] spawn_process: at 2018-11-15 17:03:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 17:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 17:03:51 [DEBUG   ] spawn_process: at 2018-11-15 17:03:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 17:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 17:03:51 [DEBUG   ] spawn_process: at 2018-11-15 17:03:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 17:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 17:03:51 [DEBUG   ] spawn_process: at 2018-11-15 17:03:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 17:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 17:03:51 [DEBUG   ] spawn_process: at 2018-11-15 17:03:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 17:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 17:03:51 [DEBUG   ] spawn_process: at 2018-11-15 17:03:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 17:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 17:03:51 [DEBUG   ] spawn_process: at 2018-11-15 17:03:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 17:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 17:03:51 [DEBUG   ] spawn_process: at 2018-11-15 17:03:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 17:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 17:03:51 [DEBUG   ] spawn_process: at 2018-11-15 17:03:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 17:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 17:03:51 [DEBUG   ] spawn_process: at 2018-11-15 17:03:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 17:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 17:03:51 [DEBUG   ] spawn_process: at 2018-11-15 17:03:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 17:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 17:03:51 [DEBUG   ] spawn_process: at 2018-11-15 17:03:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 17:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 17:03:51 [DEBUG   ] spawn_process: at 2018-11-15 17:03:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 17:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 17:03:51 [DEBUG   ] spawn_process: at 2018-11-15 17:03:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 17:03:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 17:04:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:04:04 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-15 17:04:04 [WARNING ] (13, 1, 'bot')
2018-11-15 17:04:04 [WARNING ] (13, 1, 'bot')
2018-11-15 17:04:04 [WARNING ] (13, 1, 'bot')
2018-11-15 17:04:04 [WARNING ] (13, 1, 'bot')
2018-11-15 17:04:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:04:04 [DEBUG   ] Finished updating board flags in 0.997 seconds
2018-11-15 17:04:12 [DEBUG   ] Got command BAM from MCS: ref #516669
2018-11-15 17:04:12 [INFO    ] Finished processing BAM request
2018-11-15 17:04:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:04:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516669   8 58437 61452025 A  ERROR'
2018-11-15 17:04:12 [DEBUG   ] Got command BAM from MCS: ref #516668
2018-11-15 17:04:12 [INFO    ] Finished processing BAM request
2018-11-15 17:04:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:04:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516668   8 58437 61452029 A  ERROR'
2018-11-15 17:04:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 17:04:12 [DEBUG   ] spawn_process: at 2018-11-15 17:04:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 17:04:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 17:04:12 [DEBUG   ] spawn_process: at 2018-11-15 17:04:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 17:04:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 17:04:12 [DEBUG   ] spawn_process: at 2018-11-15 17:04:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 17:04:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 17:04:12 [DEBUG   ] spawn_process: at 2018-11-15 17:04:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 17:04:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 17:04:12 [DEBUG   ] spawn_process: at 2018-11-15 17:04:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 17:04:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 17:04:12 [DEBUG   ] spawn_process: at 2018-11-15 17:04:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 17:04:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 17:04:12 [DEBUG   ] spawn_process: at 2018-11-15 17:04:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 17:04:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 17:04:12 [DEBUG   ] spawn_process: at 2018-11-15 17:04:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 17:04:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 17:04:12 [DEBUG   ] spawn_process: at 2018-11-15 17:04:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 17:04:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 17:04:12 [DEBUG   ] spawn_process: at 2018-11-15 17:04:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 17:04:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 17:04:12 [DEBUG   ] spawn_process: at 2018-11-15 17:04:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 17:04:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 17:04:12 [DEBUG   ] spawn_process: at 2018-11-15 17:04:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 17:04:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 17:04:12 [DEBUG   ] spawn_process: at 2018-11-15 17:04:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 17:04:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 17:04:12 [DEBUG   ] spawn_process: at 2018-11-15 17:04:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 17:04:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 17:04:12 [DEBUG   ] spawn_process: at 2018-11-15 17:04:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 17:04:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 17:04:12 [DEBUG   ] spawn_process: at 2018-11-15 17:04:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 17:04:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 17:04:12 [DEBUG   ] spawn_process: at 2018-11-15 17:04:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 17:04:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 17:04:12 [DEBUG   ] spawn_process: at 2018-11-15 17:04:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 17:04:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 17:04:12 [DEBUG   ] spawn_process: at 2018-11-15 17:04:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 17:04:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 17:04:12 [DEBUG   ] spawn_process: at 2018-11-15 17:04:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 17:04:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 17:04:12 [DEBUG   ] spawn_process: at 2018-11-15 17:04:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 17:04:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 17:04:12 [DEBUG   ] spawn_process: at 2018-11-15 17:04:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 17:04:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 17:04:12 [DEBUG   ] spawn_process: at 2018-11-15 17:04:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 17:04:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 17:04:12 [DEBUG   ] spawn_process: at 2018-11-15 17:04:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 17:04:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 17:04:12 [DEBUG   ] spawn_process: at 2018-11-15 17:04:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 17:04:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 17:04:12 [DEBUG   ] spawn_process: at 2018-11-15 17:04:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 17:04:19 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-15 17:04:33 [DEBUG   ] Got command BAM from MCS: ref #516670
2018-11-15 17:04:33 [INFO    ] Finished processing BAM request
2018-11-15 17:04:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:04:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516670   8 58437 61473033 A  ERROR'
2018-11-15 17:04:33 [DEBUG   ] Got command BAM from MCS: ref #516671
2018-11-15 17:04:33 [INFO    ] Finished processing BAM request
2018-11-15 17:04:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:04:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516671   8 58437 61473041 A  ERROR'
2018-11-15 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 17:04:33 [DEBUG   ] spawn_process: at 2018-11-15 17:04:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 17:04:33 [DEBUG   ] spawn_process: at 2018-11-15 17:04:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 17:04:33 [DEBUG   ] spawn_process: at 2018-11-15 17:04:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 17:04:33 [DEBUG   ] spawn_process: at 2018-11-15 17:04:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 17:04:33 [DEBUG   ] spawn_process: at 2018-11-15 17:04:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 17:04:33 [DEBUG   ] spawn_process: at 2018-11-15 17:04:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 17:04:33 [DEBUG   ] spawn_process: at 2018-11-15 17:04:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 17:04:33 [DEBUG   ] spawn_process: at 2018-11-15 17:04:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 17:04:33 [DEBUG   ] spawn_process: at 2018-11-15 17:04:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 17:04:33 [DEBUG   ] spawn_process: at 2018-11-15 17:04:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 17:04:33 [DEBUG   ] spawn_process: at 2018-11-15 17:04:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 17:04:33 [DEBUG   ] spawn_process: at 2018-11-15 17:04:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 17:04:33 [DEBUG   ] spawn_process: at 2018-11-15 17:04:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 17:04:33 [DEBUG   ] spawn_process: at 2018-11-15 17:04:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 17:04:33 [DEBUG   ] spawn_process: at 2018-11-15 17:04:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 17:04:33 [DEBUG   ] spawn_process: at 2018-11-15 17:04:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 17:04:33 [DEBUG   ] spawn_process: at 2018-11-15 17:04:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 17:04:33 [DEBUG   ] spawn_process: at 2018-11-15 17:04:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 17:04:33 [DEBUG   ] spawn_process: at 2018-11-15 17:04:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 17:04:33 [DEBUG   ] spawn_process: at 2018-11-15 17:04:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 17:04:33 [DEBUG   ] spawn_process: at 2018-11-15 17:04:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 17:04:33 [DEBUG   ] spawn_process: at 2018-11-15 17:04:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 17:04:33 [DEBUG   ] spawn_process: at 2018-11-15 17:04:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 17:04:33 [DEBUG   ] spawn_process: at 2018-11-15 17:04:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 17:04:33 [DEBUG   ] spawn_process: at 2018-11-15 17:04:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 17:04:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 17:04:33 [DEBUG   ] spawn_process: at 2018-11-15 17:04:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 17:04:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 17:04:54 [DEBUG   ] Got command BAM from MCS: ref #516672
2018-11-15 17:04:54 [INFO    ] Finished processing BAM request
2018-11-15 17:04:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:04:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516672   8 58437 61494033 A  ERROR'
2018-11-15 17:04:54 [DEBUG   ] Got command BAM from MCS: ref #516673
2018-11-15 17:04:54 [INFO    ] Finished processing BAM request
2018-11-15 17:04:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:04:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516673   8 58437 61494037 A  ERROR'
2018-11-15 17:04:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 17:04:54 [DEBUG   ] spawn_process: at 2018-11-15 17:04:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 17:04:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 17:04:54 [DEBUG   ] spawn_process: at 2018-11-15 17:04:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 17:04:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 17:04:54 [DEBUG   ] spawn_process: at 2018-11-15 17:04:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 17:04:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 17:04:54 [DEBUG   ] spawn_process: at 2018-11-15 17:04:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 17:04:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 17:04:54 [DEBUG   ] spawn_process: at 2018-11-15 17:04:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 17:04:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 17:04:54 [DEBUG   ] spawn_process: at 2018-11-15 17:04:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 17:04:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 17:04:54 [DEBUG   ] spawn_process: at 2018-11-15 17:04:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 17:04:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 17:04:54 [DEBUG   ] spawn_process: at 2018-11-15 17:04:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 17:04:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 17:04:54 [DEBUG   ] spawn_process: at 2018-11-15 17:04:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 17:04:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 17:04:54 [DEBUG   ] spawn_process: at 2018-11-15 17:04:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 17:04:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 17:04:54 [DEBUG   ] spawn_process: at 2018-11-15 17:04:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 17:04:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 17:04:54 [DEBUG   ] spawn_process: at 2018-11-15 17:04:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 17:04:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 17:04:54 [DEBUG   ] spawn_process: at 2018-11-15 17:04:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 17:04:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 17:04:54 [DEBUG   ] spawn_process: at 2018-11-15 17:04:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 17:04:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 17:04:54 [DEBUG   ] spawn_process: at 2018-11-15 17:04:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 17:04:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 17:04:54 [DEBUG   ] spawn_process: at 2018-11-15 17:04:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 17:04:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 17:04:54 [DEBUG   ] spawn_process: at 2018-11-15 17:04:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 17:04:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 17:04:54 [DEBUG   ] spawn_process: at 2018-11-15 17:04:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 17:04:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 17:04:54 [DEBUG   ] spawn_process: at 2018-11-15 17:04:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 17:04:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 17:04:54 [DEBUG   ] spawn_process: at 2018-11-15 17:04:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 17:04:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 17:04:54 [DEBUG   ] spawn_process: at 2018-11-15 17:04:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 17:04:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 17:04:54 [DEBUG   ] spawn_process: at 2018-11-15 17:04:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 17:04:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 17:04:54 [DEBUG   ] spawn_process: at 2018-11-15 17:04:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 17:04:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 17:04:54 [DEBUG   ] spawn_process: at 2018-11-15 17:04:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 17:04:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 17:04:54 [DEBUG   ] spawn_process: at 2018-11-15 17:04:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 17:04:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 17:04:54 [DEBUG   ] spawn_process: at 2018-11-15 17:04:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 17:04:59 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 17:05:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:05:04 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-15 17:05:04 [WARNING ] (13, 1, 'bot')
2018-11-15 17:05:04 [WARNING ] (13, 1, 'bot')
2018-11-15 17:05:04 [WARNING ] (13, 1, 'bot')
2018-11-15 17:05:04 [WARNING ] (13, 1, 'bot')
2018-11-15 17:05:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:05:04 [DEBUG   ] Finished updating board flags in 1.267 seconds
2018-11-15 17:05:15 [DEBUG   ] Got command BAM from MCS: ref #516674
2018-11-15 17:05:15 [INFO    ] Finished processing BAM request
2018-11-15 17:05:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:05:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516674   8 58437 61515029 A  ERROR'
2018-11-15 17:05:15 [DEBUG   ] Got command BAM from MCS: ref #516675
2018-11-15 17:05:15 [INFO    ] Finished processing BAM request
2018-11-15 17:05:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:05:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516675   8 58437 61515033 A  ERROR'
2018-11-15 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 17:05:15 [DEBUG   ] spawn_process: at 2018-11-15 17:05:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 17:05:15 [DEBUG   ] spawn_process: at 2018-11-15 17:05:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 17:05:15 [DEBUG   ] spawn_process: at 2018-11-15 17:05:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 17:05:15 [DEBUG   ] spawn_process: at 2018-11-15 17:05:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 17:05:15 [DEBUG   ] spawn_process: at 2018-11-15 17:05:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 17:05:15 [DEBUG   ] spawn_process: at 2018-11-15 17:05:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 17:05:15 [DEBUG   ] spawn_process: at 2018-11-15 17:05:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 17:05:15 [DEBUG   ] spawn_process: at 2018-11-15 17:05:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 17:05:15 [DEBUG   ] spawn_process: at 2018-11-15 17:05:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 17:05:15 [DEBUG   ] spawn_process: at 2018-11-15 17:05:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 17:05:15 [DEBUG   ] spawn_process: at 2018-11-15 17:05:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 17:05:15 [DEBUG   ] spawn_process: at 2018-11-15 17:05:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 17:05:15 [DEBUG   ] spawn_process: at 2018-11-15 17:05:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 17:05:15 [DEBUG   ] spawn_process: at 2018-11-15 17:05:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 17:05:15 [DEBUG   ] spawn_process: at 2018-11-15 17:05:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 17:05:15 [DEBUG   ] spawn_process: at 2018-11-15 17:05:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 17:05:15 [DEBUG   ] spawn_process: at 2018-11-15 17:05:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 17:05:15 [DEBUG   ] spawn_process: at 2018-11-15 17:05:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 17:05:15 [DEBUG   ] spawn_process: at 2018-11-15 17:05:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 17:05:15 [DEBUG   ] spawn_process: at 2018-11-15 17:05:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 17:05:15 [DEBUG   ] spawn_process: at 2018-11-15 17:05:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 17:05:15 [DEBUG   ] spawn_process: at 2018-11-15 17:05:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 17:05:15 [DEBUG   ] spawn_process: at 2018-11-15 17:05:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 17:05:15 [DEBUG   ] spawn_process: at 2018-11-15 17:05:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 17:05:15 [DEBUG   ] spawn_process: at 2018-11-15 17:05:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 17:05:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 17:05:15 [DEBUG   ] spawn_process: at 2018-11-15 17:05:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 17:05:19 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 17:05:36 [DEBUG   ] Got command BAM from MCS: ref #516681
2018-11-15 17:05:36 [INFO    ] Finished processing BAM request
2018-11-15 17:05:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:05:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516681   8 58437 61536026 A  ERROR'
2018-11-15 17:05:36 [DEBUG   ] Got command BAM from MCS: ref #516680
2018-11-15 17:05:36 [INFO    ] Finished processing BAM request
2018-11-15 17:05:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:05:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516680   8 58437 61536030 A  ERROR'
2018-11-15 17:05:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 17:05:36 [DEBUG   ] spawn_process: at 2018-11-15 17:05:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 17:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 17:05:37 [DEBUG   ] spawn_process: at 2018-11-15 17:05:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 17:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 17:05:37 [DEBUG   ] spawn_process: at 2018-11-15 17:05:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 17:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 17:05:37 [DEBUG   ] spawn_process: at 2018-11-15 17:05:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 17:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 17:05:37 [DEBUG   ] spawn_process: at 2018-11-15 17:05:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 17:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 17:05:37 [DEBUG   ] spawn_process: at 2018-11-15 17:05:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 17:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 17:05:37 [DEBUG   ] spawn_process: at 2018-11-15 17:05:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 17:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 17:05:37 [DEBUG   ] spawn_process: at 2018-11-15 17:05:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 17:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 17:05:37 [DEBUG   ] spawn_process: at 2018-11-15 17:05:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 17:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 17:05:37 [DEBUG   ] spawn_process: at 2018-11-15 17:05:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 17:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 17:05:37 [DEBUG   ] spawn_process: at 2018-11-15 17:05:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 17:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 17:05:37 [DEBUG   ] spawn_process: at 2018-11-15 17:05:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 17:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 17:05:37 [DEBUG   ] spawn_process: at 2018-11-15 17:05:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 17:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 17:05:37 [DEBUG   ] spawn_process: at 2018-11-15 17:05:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 17:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 17:05:37 [DEBUG   ] spawn_process: at 2018-11-15 17:05:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 17:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 17:05:37 [DEBUG   ] spawn_process: at 2018-11-15 17:05:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 17:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 17:05:37 [DEBUG   ] spawn_process: at 2018-11-15 17:05:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 17:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 17:05:37 [DEBUG   ] spawn_process: at 2018-11-15 17:05:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 17:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 17:05:37 [DEBUG   ] spawn_process: at 2018-11-15 17:05:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 17:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 17:05:37 [DEBUG   ] spawn_process: at 2018-11-15 17:05:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 17:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 17:05:37 [DEBUG   ] spawn_process: at 2018-11-15 17:05:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 17:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 17:05:37 [DEBUG   ] spawn_process: at 2018-11-15 17:05:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 17:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 17:05:37 [DEBUG   ] spawn_process: at 2018-11-15 17:05:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 17:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 17:05:37 [DEBUG   ] spawn_process: at 2018-11-15 17:05:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 17:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 17:05:37 [DEBUG   ] spawn_process: at 2018-11-15 17:05:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 17:05:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 17:05:37 [DEBUG   ] spawn_process: at 2018-11-15 17:05:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 17:05:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 17:05:45 [DEBUG   ] Got command RPT from MCS: ref #516682
2018-11-15 17:05:45 [DEBUG   ] summary = ERROR
2018-11-15 17:05:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516682  13 58437 61545138 A  ERRORERROR'
2018-11-15 17:05:45 [DEBUG   ] Got command RPT from MCS: ref #516683
2018-11-15 17:05:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 17:05:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516683  77 58437 61545138 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 17:05:57 [DEBUG   ] Got command BAM from MCS: ref #516699
2018-11-15 17:05:57 [INFO    ] Finished processing BAM request
2018-11-15 17:05:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:05:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516699   8 58437 61557034 A  ERROR'
2018-11-15 17:05:57 [DEBUG   ] Got command BAM from MCS: ref #516700
2018-11-15 17:05:57 [INFO    ] Finished processing BAM request
2018-11-15 17:05:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:05:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516700   8 58437 61557038 A  ERROR'
2018-11-15 17:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 17:05:57 [DEBUG   ] spawn_process: at 2018-11-15 17:05:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 17:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 17:05:57 [DEBUG   ] spawn_process: at 2018-11-15 17:05:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 17:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 17:05:57 [DEBUG   ] spawn_process: at 2018-11-15 17:05:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 17:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 17:05:57 [DEBUG   ] spawn_process: at 2018-11-15 17:05:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 17:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 17:05:57 [DEBUG   ] spawn_process: at 2018-11-15 17:05:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 17:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 17:05:57 [DEBUG   ] spawn_process: at 2018-11-15 17:05:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 17:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 17:05:57 [DEBUG   ] spawn_process: at 2018-11-15 17:05:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 17:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 17:05:57 [DEBUG   ] spawn_process: at 2018-11-15 17:05:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 17:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 17:05:57 [DEBUG   ] spawn_process: at 2018-11-15 17:05:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 17:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 17:05:57 [DEBUG   ] spawn_process: at 2018-11-15 17:05:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 17:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 17:05:57 [DEBUG   ] spawn_process: at 2018-11-15 17:05:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 17:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 17:05:57 [DEBUG   ] spawn_process: at 2018-11-15 17:05:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 17:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 17:05:57 [DEBUG   ] spawn_process: at 2018-11-15 17:05:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 17:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 17:05:57 [DEBUG   ] spawn_process: at 2018-11-15 17:05:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 17:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 17:05:57 [DEBUG   ] spawn_process: at 2018-11-15 17:05:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 17:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 17:05:57 [DEBUG   ] spawn_process: at 2018-11-15 17:05:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 17:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 17:05:57 [DEBUG   ] spawn_process: at 2018-11-15 17:05:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 17:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 17:05:57 [DEBUG   ] spawn_process: at 2018-11-15 17:05:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 17:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 17:05:57 [DEBUG   ] spawn_process: at 2018-11-15 17:05:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 17:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 17:05:57 [DEBUG   ] spawn_process: at 2018-11-15 17:05:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 17:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 17:05:57 [DEBUG   ] spawn_process: at 2018-11-15 17:05:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 17:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 17:05:57 [DEBUG   ] spawn_process: at 2018-11-15 17:05:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 17:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 17:05:57 [DEBUG   ] spawn_process: at 2018-11-15 17:05:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 17:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 17:05:57 [DEBUG   ] spawn_process: at 2018-11-15 17:05:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 17:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 17:05:57 [DEBUG   ] spawn_process: at 2018-11-15 17:05:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 17:05:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 17:05:57 [DEBUG   ] spawn_process: at 2018-11-15 17:05:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 17:05:59 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 17:06:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 17:06:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:06:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-11-15 17:06:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 17:06:04 [WARNING ] (13, 1, 'bot')
2018-11-15 17:06:04 [WARNING ] (13, 1, 'bot')
2018-11-15 17:06:04 [WARNING ] (13, 1, 'bot')
2018-11-15 17:06:04 [WARNING ] (13, 1, 'bot')
2018-11-15 17:06:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:06:04 [DEBUG   ] Finished updating board flags in 1.186 seconds
2018-11-15 17:06:18 [DEBUG   ] Got command BAM from MCS: ref #516701
2018-11-15 17:06:18 [INFO    ] Finished processing BAM request
2018-11-15 17:06:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:06:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516701   8 58437 61578030 A  ERROR'
2018-11-15 17:06:18 [DEBUG   ] Got command BAM from MCS: ref #516702
2018-11-15 17:06:18 [INFO    ] Finished processing BAM request
2018-11-15 17:06:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:06:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516702   8 58437 61578034 A  ERROR'
2018-11-15 17:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 17:06:18 [DEBUG   ] spawn_process: at 2018-11-15 17:06:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 17:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 17:06:18 [DEBUG   ] spawn_process: at 2018-11-15 17:06:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 17:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 17:06:18 [DEBUG   ] spawn_process: at 2018-11-15 17:06:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 17:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 17:06:18 [DEBUG   ] spawn_process: at 2018-11-15 17:06:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 17:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 17:06:18 [DEBUG   ] spawn_process: at 2018-11-15 17:06:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 17:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 17:06:18 [DEBUG   ] spawn_process: at 2018-11-15 17:06:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 17:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 17:06:18 [DEBUG   ] spawn_process: at 2018-11-15 17:06:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 17:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 17:06:18 [DEBUG   ] spawn_process: at 2018-11-15 17:06:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 17:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 17:06:18 [DEBUG   ] spawn_process: at 2018-11-15 17:06:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 17:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 17:06:18 [DEBUG   ] spawn_process: at 2018-11-15 17:06:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 17:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 17:06:18 [DEBUG   ] spawn_process: at 2018-11-15 17:06:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 17:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 17:06:18 [DEBUG   ] spawn_process: at 2018-11-15 17:06:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 17:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 17:06:18 [DEBUG   ] spawn_process: at 2018-11-15 17:06:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 17:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 17:06:18 [DEBUG   ] spawn_process: at 2018-11-15 17:06:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 17:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 17:06:18 [DEBUG   ] spawn_process: at 2018-11-15 17:06:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 17:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 17:06:18 [DEBUG   ] spawn_process: at 2018-11-15 17:06:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 17:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 17:06:18 [DEBUG   ] spawn_process: at 2018-11-15 17:06:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 17:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 17:06:18 [DEBUG   ] spawn_process: at 2018-11-15 17:06:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 17:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 17:06:18 [DEBUG   ] spawn_process: at 2018-11-15 17:06:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 17:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 17:06:18 [DEBUG   ] spawn_process: at 2018-11-15 17:06:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 17:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 17:06:18 [DEBUG   ] spawn_process: at 2018-11-15 17:06:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 17:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 17:06:18 [DEBUG   ] spawn_process: at 2018-11-15 17:06:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 17:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 17:06:18 [DEBUG   ] spawn_process: at 2018-11-15 17:06:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 17:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 17:06:18 [DEBUG   ] spawn_process: at 2018-11-15 17:06:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 17:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 17:06:18 [DEBUG   ] spawn_process: at 2018-11-15 17:06:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 17:06:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 17:06:18 [DEBUG   ] spawn_process: at 2018-11-15 17:06:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 17:06:19 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 17:06:39 [DEBUG   ] Got command BAM from MCS: ref #516704
2018-11-15 17:06:39 [INFO    ] Finished processing BAM request
2018-11-15 17:06:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:06:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516704   8 58437 61599029 A  ERROR'
2018-11-15 17:06:39 [DEBUG   ] Got command BAM from MCS: ref #516703
2018-11-15 17:06:39 [INFO    ] Finished processing BAM request
2018-11-15 17:06:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:06:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516703   8 58437 61599033 A  ERROR'
2018-11-15 17:06:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 17:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 17:06:39 [DEBUG   ] spawn_process: at 2018-11-15 17:06:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 17:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 17:06:39 [DEBUG   ] spawn_process: at 2018-11-15 17:06:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 17:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 17:06:39 [DEBUG   ] spawn_process: at 2018-11-15 17:06:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 17:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 17:06:39 [DEBUG   ] spawn_process: at 2018-11-15 17:06:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 17:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 17:06:39 [DEBUG   ] spawn_process: at 2018-11-15 17:06:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 17:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 17:06:39 [DEBUG   ] spawn_process: at 2018-11-15 17:06:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 17:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 17:06:39 [DEBUG   ] spawn_process: at 2018-11-15 17:06:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 17:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 17:06:39 [DEBUG   ] spawn_process: at 2018-11-15 17:06:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 17:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 17:06:39 [DEBUG   ] spawn_process: at 2018-11-15 17:06:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 17:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 17:06:39 [DEBUG   ] spawn_process: at 2018-11-15 17:06:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 17:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 17:06:39 [DEBUG   ] spawn_process: at 2018-11-15 17:06:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 17:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 17:06:39 [DEBUG   ] spawn_process: at 2018-11-15 17:06:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 17:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 17:06:39 [DEBUG   ] spawn_process: at 2018-11-15 17:06:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 17:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 17:06:39 [DEBUG   ] spawn_process: at 2018-11-15 17:06:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 17:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 17:06:39 [DEBUG   ] spawn_process: at 2018-11-15 17:06:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 17:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 17:06:39 [DEBUG   ] spawn_process: at 2018-11-15 17:06:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 17:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 17:06:39 [DEBUG   ] spawn_process: at 2018-11-15 17:06:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 17:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 17:06:39 [DEBUG   ] spawn_process: at 2018-11-15 17:06:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 17:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 17:06:39 [DEBUG   ] spawn_process: at 2018-11-15 17:06:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 17:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 17:06:39 [DEBUG   ] spawn_process: at 2018-11-15 17:06:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 17:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 17:06:39 [DEBUG   ] spawn_process: at 2018-11-15 17:06:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 17:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 17:06:39 [DEBUG   ] spawn_process: at 2018-11-15 17:06:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 17:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 17:06:39 [DEBUG   ] spawn_process: at 2018-11-15 17:06:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 17:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 17:06:39 [DEBUG   ] spawn_process: at 2018-11-15 17:06:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 17:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 17:06:39 [DEBUG   ] spawn_process: at 2018-11-15 17:06:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 17:06:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 17:06:39 [DEBUG   ] spawn_process: at 2018-11-15 17:06:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 17:06:59 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 17:07:00 [DEBUG   ] Got command BAM from MCS: ref #516706
2018-11-15 17:07:00 [INFO    ] Finished processing BAM request
2018-11-15 17:07:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:07:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516706   8 58437 61620029 A  ERROR'
2018-11-15 17:07:00 [DEBUG   ] Got command BAM from MCS: ref #516705
2018-11-15 17:07:00 [INFO    ] Finished processing BAM request
2018-11-15 17:07:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:07:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516705   8 58437 61620033 A  ERROR'
2018-11-15 17:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 17:07:00 [DEBUG   ] spawn_process: at 2018-11-15 17:07:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 17:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 17:07:00 [DEBUG   ] spawn_process: at 2018-11-15 17:07:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 17:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 17:07:00 [DEBUG   ] spawn_process: at 2018-11-15 17:07:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 17:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 17:07:00 [DEBUG   ] spawn_process: at 2018-11-15 17:07:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 17:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 17:07:00 [DEBUG   ] spawn_process: at 2018-11-15 17:07:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 17:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 17:07:00 [DEBUG   ] spawn_process: at 2018-11-15 17:07:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 17:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 17:07:00 [DEBUG   ] spawn_process: at 2018-11-15 17:07:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 17:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 17:07:00 [DEBUG   ] spawn_process: at 2018-11-15 17:07:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 17:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 17:07:00 [DEBUG   ] spawn_process: at 2018-11-15 17:07:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 17:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 17:07:00 [DEBUG   ] spawn_process: at 2018-11-15 17:07:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 17:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 17:07:00 [DEBUG   ] spawn_process: at 2018-11-15 17:07:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 17:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 17:07:00 [DEBUG   ] spawn_process: at 2018-11-15 17:07:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 17:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 17:07:00 [DEBUG   ] spawn_process: at 2018-11-15 17:07:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 17:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 17:07:00 [DEBUG   ] spawn_process: at 2018-11-15 17:07:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 17:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 17:07:00 [DEBUG   ] spawn_process: at 2018-11-15 17:07:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 17:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 17:07:00 [DEBUG   ] spawn_process: at 2018-11-15 17:07:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 17:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 17:07:00 [DEBUG   ] spawn_process: at 2018-11-15 17:07:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 17:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 17:07:00 [DEBUG   ] spawn_process: at 2018-11-15 17:07:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 17:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 17:07:00 [DEBUG   ] spawn_process: at 2018-11-15 17:07:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 17:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 17:07:00 [DEBUG   ] spawn_process: at 2018-11-15 17:07:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 17:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 17:07:00 [DEBUG   ] spawn_process: at 2018-11-15 17:07:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 17:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 17:07:00 [DEBUG   ] spawn_process: at 2018-11-15 17:07:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 17:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 17:07:00 [DEBUG   ] spawn_process: at 2018-11-15 17:07:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 17:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 17:07:00 [DEBUG   ] spawn_process: at 2018-11-15 17:07:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 17:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 17:07:00 [DEBUG   ] spawn_process: at 2018-11-15 17:07:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 17:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 17:07:00 [DEBUG   ] spawn_process: at 2018-11-15 17:07:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 17:07:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-11-15 17:07:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-15 17:07:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:07:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 17:07:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 17:07:04 [WARNING ] (13, 1, 'bot')
2018-11-15 17:07:04 [WARNING ] (13, 1, 'bot')
2018-11-15 17:07:04 [WARNING ] (13, 1, 'bot')
2018-11-15 17:07:04 [WARNING ] (13, 1, 'bot')
2018-11-15 17:07:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:07:04 [DEBUG   ] Finished updating board flags in 1.014 seconds
2018-11-15 17:07:19 [DEBUG   ] Finished updating ant stats in 0.394 seconds
2018-11-15 17:07:21 [DEBUG   ] Got command BAM from MCS: ref #516708
2018-11-15 17:07:21 [INFO    ] Finished processing BAM request
2018-11-15 17:07:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:07:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516708   8 58437 61641025 A  ERROR'
2018-11-15 17:07:21 [DEBUG   ] Got command BAM from MCS: ref #516707
2018-11-15 17:07:21 [INFO    ] Finished processing BAM request
2018-11-15 17:07:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:07:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516707   8 58437 61641029 A  ERROR'
2018-11-15 17:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 17:07:21 [DEBUG   ] spawn_process: at 2018-11-15 17:07:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 17:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 17:07:21 [DEBUG   ] spawn_process: at 2018-11-15 17:07:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 17:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 17:07:21 [DEBUG   ] spawn_process: at 2018-11-15 17:07:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 17:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 17:07:21 [DEBUG   ] spawn_process: at 2018-11-15 17:07:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 17:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 17:07:21 [DEBUG   ] spawn_process: at 2018-11-15 17:07:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 17:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 17:07:21 [DEBUG   ] spawn_process: at 2018-11-15 17:07:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 17:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 17:07:21 [DEBUG   ] spawn_process: at 2018-11-15 17:07:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 17:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 17:07:21 [DEBUG   ] spawn_process: at 2018-11-15 17:07:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 17:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 17:07:21 [DEBUG   ] spawn_process: at 2018-11-15 17:07:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 17:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 17:07:21 [DEBUG   ] spawn_process: at 2018-11-15 17:07:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 17:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 17:07:21 [DEBUG   ] spawn_process: at 2018-11-15 17:07:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 17:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 17:07:21 [DEBUG   ] spawn_process: at 2018-11-15 17:07:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 17:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 17:07:21 [DEBUG   ] spawn_process: at 2018-11-15 17:07:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 17:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 17:07:21 [DEBUG   ] spawn_process: at 2018-11-15 17:07:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 17:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 17:07:21 [DEBUG   ] spawn_process: at 2018-11-15 17:07:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 17:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 17:07:21 [DEBUG   ] spawn_process: at 2018-11-15 17:07:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 17:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 17:07:21 [DEBUG   ] spawn_process: at 2018-11-15 17:07:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 17:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 17:07:21 [DEBUG   ] spawn_process: at 2018-11-15 17:07:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 17:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 17:07:21 [DEBUG   ] spawn_process: at 2018-11-15 17:07:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 17:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 17:07:21 [DEBUG   ] spawn_process: at 2018-11-15 17:07:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 17:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 17:07:21 [DEBUG   ] spawn_process: at 2018-11-15 17:07:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 17:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 17:07:21 [DEBUG   ] spawn_process: at 2018-11-15 17:07:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 17:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 17:07:21 [DEBUG   ] spawn_process: at 2018-11-15 17:07:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 17:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 17:07:21 [DEBUG   ] spawn_process: at 2018-11-15 17:07:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 17:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 17:07:21 [DEBUG   ] spawn_process: at 2018-11-15 17:07:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 17:07:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 17:07:21 [DEBUG   ] spawn_process: at 2018-11-15 17:07:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 17:07:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 17:07:42 [DEBUG   ] Got command BAM from MCS: ref #516710
2018-11-15 17:07:42 [INFO    ] Finished processing BAM request
2018-11-15 17:07:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:07:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516710   8 58437 61662025 A  ERROR'
2018-11-15 17:07:42 [DEBUG   ] Got command BAM from MCS: ref #516709
2018-11-15 17:07:42 [INFO    ] Finished processing BAM request
2018-11-15 17:07:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:07:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516709   8 58437 61662029 A  ERROR'
2018-11-15 17:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 17:07:42 [DEBUG   ] spawn_process: at 2018-11-15 17:07:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 17:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 17:07:42 [DEBUG   ] spawn_process: at 2018-11-15 17:07:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 17:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 17:07:42 [DEBUG   ] spawn_process: at 2018-11-15 17:07:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 17:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 17:07:42 [DEBUG   ] spawn_process: at 2018-11-15 17:07:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 17:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 17:07:42 [DEBUG   ] spawn_process: at 2018-11-15 17:07:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 17:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 17:07:42 [DEBUG   ] spawn_process: at 2018-11-15 17:07:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 17:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 17:07:42 [DEBUG   ] spawn_process: at 2018-11-15 17:07:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 17:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 17:07:42 [DEBUG   ] spawn_process: at 2018-11-15 17:07:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 17:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 17:07:42 [DEBUG   ] spawn_process: at 2018-11-15 17:07:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 17:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 17:07:42 [DEBUG   ] spawn_process: at 2018-11-15 17:07:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 17:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 17:07:42 [DEBUG   ] spawn_process: at 2018-11-15 17:07:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 17:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 17:07:42 [DEBUG   ] spawn_process: at 2018-11-15 17:07:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 17:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 17:07:42 [DEBUG   ] spawn_process: at 2018-11-15 17:07:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 17:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 17:07:42 [DEBUG   ] spawn_process: at 2018-11-15 17:07:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 17:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 17:07:42 [DEBUG   ] spawn_process: at 2018-11-15 17:07:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 17:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 17:07:42 [DEBUG   ] spawn_process: at 2018-11-15 17:07:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 17:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 17:07:42 [DEBUG   ] spawn_process: at 2018-11-15 17:07:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 17:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 17:07:42 [DEBUG   ] spawn_process: at 2018-11-15 17:07:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 17:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 17:07:42 [DEBUG   ] spawn_process: at 2018-11-15 17:07:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 17:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 17:07:42 [DEBUG   ] spawn_process: at 2018-11-15 17:07:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 17:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 17:07:42 [DEBUG   ] spawn_process: at 2018-11-15 17:07:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 17:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 17:07:42 [DEBUG   ] spawn_process: at 2018-11-15 17:07:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 17:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 17:07:42 [DEBUG   ] spawn_process: at 2018-11-15 17:07:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 17:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 17:07:42 [DEBUG   ] spawn_process: at 2018-11-15 17:07:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 17:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 17:07:42 [DEBUG   ] spawn_process: at 2018-11-15 17:07:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 17:07:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 17:07:42 [DEBUG   ] spawn_process: at 2018-11-15 17:07:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 17:08:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 17:08:03 [DEBUG   ] Got command BAM from MCS: ref #516712
2018-11-15 17:08:03 [INFO    ] Finished processing BAM request
2018-11-15 17:08:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:08:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516712   8 58437 61683033 A  ERROR'
2018-11-15 17:08:03 [DEBUG   ] Got command BAM from MCS: ref #516711
2018-11-15 17:08:03 [INFO    ] Finished processing BAM request
2018-11-15 17:08:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:08:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516711   8 58437 61683037 A  ERROR'
2018-11-15 17:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 17:08:03 [DEBUG   ] spawn_process: at 2018-11-15 17:08:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 17:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 17:08:03 [DEBUG   ] spawn_process: at 2018-11-15 17:08:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 17:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 17:08:03 [DEBUG   ] spawn_process: at 2018-11-15 17:08:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 17:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 17:08:03 [DEBUG   ] spawn_process: at 2018-11-15 17:08:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 17:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 17:08:03 [DEBUG   ] spawn_process: at 2018-11-15 17:08:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 17:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 17:08:03 [DEBUG   ] spawn_process: at 2018-11-15 17:08:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 17:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 17:08:03 [DEBUG   ] spawn_process: at 2018-11-15 17:08:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 17:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 17:08:03 [DEBUG   ] spawn_process: at 2018-11-15 17:08:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 17:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 17:08:03 [DEBUG   ] spawn_process: at 2018-11-15 17:08:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 17:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 17:08:03 [DEBUG   ] spawn_process: at 2018-11-15 17:08:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 17:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 17:08:03 [DEBUG   ] spawn_process: at 2018-11-15 17:08:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 17:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 17:08:03 [DEBUG   ] spawn_process: at 2018-11-15 17:08:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 17:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 17:08:03 [DEBUG   ] spawn_process: at 2018-11-15 17:08:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 17:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 17:08:03 [DEBUG   ] spawn_process: at 2018-11-15 17:08:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 17:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 17:08:03 [DEBUG   ] spawn_process: at 2018-11-15 17:08:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 17:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 17:08:03 [DEBUG   ] spawn_process: at 2018-11-15 17:08:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 17:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 17:08:03 [DEBUG   ] spawn_process: at 2018-11-15 17:08:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 17:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 17:08:03 [DEBUG   ] spawn_process: at 2018-11-15 17:08:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 17:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 17:08:03 [DEBUG   ] spawn_process: at 2018-11-15 17:08:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 17:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 17:08:03 [DEBUG   ] spawn_process: at 2018-11-15 17:08:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 17:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 17:08:03 [DEBUG   ] spawn_process: at 2018-11-15 17:08:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 17:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 17:08:03 [DEBUG   ] spawn_process: at 2018-11-15 17:08:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 17:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 17:08:03 [DEBUG   ] spawn_process: at 2018-11-15 17:08:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 17:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 17:08:03 [DEBUG   ] spawn_process: at 2018-11-15 17:08:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 17:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 17:08:03 [DEBUG   ] spawn_process: at 2018-11-15 17:08:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 17:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 17:08:03 [DEBUG   ] spawn_process: at 2018-11-15 17:08:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 17:08:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 17:08:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:08:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 17:08:04 [WARNING ] (13, 1, 'bot')
2018-11-15 17:08:04 [WARNING ] (13, 1, 'bot')
2018-11-15 17:08:04 [WARNING ] (13, 1, 'bot')
2018-11-15 17:08:04 [WARNING ] (13, 1, 'bot')
2018-11-15 17:08:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:08:04 [DEBUG   ] Finished updating board flags in 0.981 seconds
2018-11-15 17:08:20 [DEBUG   ] Got command RPT from MCS: ref #516715
2018-11-15 17:08:20 [DEBUG   ] summary = ERROR
2018-11-15 17:08:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516715  13 58437 61700189 A  ERRORERROR'
2018-11-15 17:08:20 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-15 17:08:20 [DEBUG   ] Got command RPT from MCS: ref #516716
2018-11-15 17:08:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 17:08:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516716  77 58437 61700393 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 17:08:20 [DEBUG   ] Got command RPT from MCS: ref #516717
2018-11-15 17:08:20 [DEBUG   ] summary = ERROR
2018-11-15 17:08:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516717  13 58437 61700585 A  ERRORERROR'
2018-11-15 17:08:20 [DEBUG   ] Got command RPT from MCS: ref #516719
2018-11-15 17:08:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 17:08:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516719  77 58437 61700789 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 17:08:20 [DEBUG   ] Got command RPT from MCS: ref #516721
2018-11-15 17:08:20 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 17:08:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516721  12 58437 61700993 A  ERRORB¢ff'
2018-11-15 17:08:25 [DEBUG   ] Got command BAM from MCS: ref #516725
2018-11-15 17:08:25 [INFO    ] Finished processing BAM request
2018-11-15 17:08:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:08:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516725   8 58437 61705029 A  ERROR'
2018-11-15 17:08:25 [DEBUG   ] Got command BAM from MCS: ref #516726
2018-11-15 17:08:25 [INFO    ] Finished processing BAM request
2018-11-15 17:08:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:08:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516726   8 58437 61705033 A  ERROR'
2018-11-15 17:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 17:08:25 [DEBUG   ] spawn_process: at 2018-11-15 17:08:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 17:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 17:08:25 [DEBUG   ] spawn_process: at 2018-11-15 17:08:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 17:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 17:08:25 [DEBUG   ] spawn_process: at 2018-11-15 17:08:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 17:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 17:08:25 [DEBUG   ] spawn_process: at 2018-11-15 17:08:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 17:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 17:08:25 [DEBUG   ] spawn_process: at 2018-11-15 17:08:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 17:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 17:08:25 [DEBUG   ] spawn_process: at 2018-11-15 17:08:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 17:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 17:08:25 [DEBUG   ] spawn_process: at 2018-11-15 17:08:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 17:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 17:08:25 [DEBUG   ] spawn_process: at 2018-11-15 17:08:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 17:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 17:08:25 [DEBUG   ] spawn_process: at 2018-11-15 17:08:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 17:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 17:08:25 [DEBUG   ] spawn_process: at 2018-11-15 17:08:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 17:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 17:08:25 [DEBUG   ] spawn_process: at 2018-11-15 17:08:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 17:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 17:08:25 [DEBUG   ] spawn_process: at 2018-11-15 17:08:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 17:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 17:08:25 [DEBUG   ] spawn_process: at 2018-11-15 17:08:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 17:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 17:08:25 [DEBUG   ] spawn_process: at 2018-11-15 17:08:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 17:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 17:08:25 [DEBUG   ] spawn_process: at 2018-11-15 17:08:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 17:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 17:08:25 [DEBUG   ] spawn_process: at 2018-11-15 17:08:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 17:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 17:08:25 [DEBUG   ] spawn_process: at 2018-11-15 17:08:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 17:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 17:08:25 [DEBUG   ] spawn_process: at 2018-11-15 17:08:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 17:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 17:08:25 [DEBUG   ] spawn_process: at 2018-11-15 17:08:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 17:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 17:08:25 [DEBUG   ] spawn_process: at 2018-11-15 17:08:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 17:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 17:08:25 [DEBUG   ] spawn_process: at 2018-11-15 17:08:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 17:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 17:08:25 [DEBUG   ] spawn_process: at 2018-11-15 17:08:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 17:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 17:08:25 [DEBUG   ] spawn_process: at 2018-11-15 17:08:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 17:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 17:08:25 [DEBUG   ] spawn_process: at 2018-11-15 17:08:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 17:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 17:08:25 [DEBUG   ] spawn_process: at 2018-11-15 17:08:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 17:08:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 17:08:25 [DEBUG   ] spawn_process: at 2018-11-15 17:08:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 17:08:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 17:08:47 [DEBUG   ] Got command BAM from MCS: ref #516731
2018-11-15 17:08:47 [INFO    ] Finished processing BAM request
2018-11-15 17:08:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:08:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516731   8 58437 61727029 A  ERROR'
2018-11-15 17:08:47 [DEBUG   ] Got command BAM from MCS: ref #516732
2018-11-15 17:08:47 [INFO    ] Finished processing BAM request
2018-11-15 17:08:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:08:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516732   8 58437 61727033 A  ERROR'
2018-11-15 17:08:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 17:08:47 [DEBUG   ] spawn_process: at 2018-11-15 17:08:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 17:08:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 17:08:47 [DEBUG   ] spawn_process: at 2018-11-15 17:08:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 17:08:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 17:08:47 [DEBUG   ] spawn_process: at 2018-11-15 17:08:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 17:08:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 17:08:47 [DEBUG   ] spawn_process: at 2018-11-15 17:08:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 17:08:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 17:08:47 [DEBUG   ] spawn_process: at 2018-11-15 17:08:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 17:08:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 17:08:47 [DEBUG   ] spawn_process: at 2018-11-15 17:08:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 17:08:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 17:08:47 [DEBUG   ] spawn_process: at 2018-11-15 17:08:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 17:08:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 17:08:47 [DEBUG   ] spawn_process: at 2018-11-15 17:08:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 17:08:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 17:08:47 [DEBUG   ] spawn_process: at 2018-11-15 17:08:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 17:08:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 17:08:47 [DEBUG   ] spawn_process: at 2018-11-15 17:08:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 17:08:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 17:08:47 [DEBUG   ] spawn_process: at 2018-11-15 17:08:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 17:08:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 17:08:47 [DEBUG   ] spawn_process: at 2018-11-15 17:08:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 17:08:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 17:08:47 [DEBUG   ] spawn_process: at 2018-11-15 17:08:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 17:08:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 17:08:47 [DEBUG   ] spawn_process: at 2018-11-15 17:08:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 17:08:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 17:08:47 [DEBUG   ] spawn_process: at 2018-11-15 17:08:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 17:08:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 17:08:47 [DEBUG   ] spawn_process: at 2018-11-15 17:08:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 17:08:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 17:08:47 [DEBUG   ] spawn_process: at 2018-11-15 17:08:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 17:08:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 17:08:47 [DEBUG   ] spawn_process: at 2018-11-15 17:08:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 17:08:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 17:08:47 [DEBUG   ] spawn_process: at 2018-11-15 17:08:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 17:08:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 17:08:47 [DEBUG   ] spawn_process: at 2018-11-15 17:08:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 17:08:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 17:08:47 [DEBUG   ] spawn_process: at 2018-11-15 17:08:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 17:08:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 17:08:47 [DEBUG   ] spawn_process: at 2018-11-15 17:08:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 17:08:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 17:08:47 [DEBUG   ] spawn_process: at 2018-11-15 17:08:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 17:08:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 17:08:47 [DEBUG   ] spawn_process: at 2018-11-15 17:08:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 17:08:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 17:08:47 [DEBUG   ] spawn_process: at 2018-11-15 17:08:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 17:08:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 17:08:47 [DEBUG   ] spawn_process: at 2018-11-15 17:08:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 17:09:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 17:09:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 17:09:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-11-15 17:09:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 17:09:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:09:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-15 17:09:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 17:09:05 [WARNING ] (13, 1, 'bot')
2018-11-15 17:09:05 [WARNING ] (13, 1, 'bot')
2018-11-15 17:09:05 [WARNING ] (13, 1, 'bot')
2018-11-15 17:09:05 [WARNING ] (13, 1, 'bot')
2018-11-15 17:09:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:09:05 [DEBUG   ] Finished updating board flags in 1.364 seconds
2018-11-15 17:09:09 [DEBUG   ] Got command BAM from MCS: ref #516733
2018-11-15 17:09:09 [INFO    ] Finished processing BAM request
2018-11-15 17:09:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:09:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516733   8 58437 61749033 A  ERROR'
2018-11-15 17:09:09 [DEBUG   ] Got command BAM from MCS: ref #516734
2018-11-15 17:09:09 [INFO    ] Finished processing BAM request
2018-11-15 17:09:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:09:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516734   8 58437 61749037 A  ERROR'
2018-11-15 17:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 17:09:09 [DEBUG   ] spawn_process: at 2018-11-15 17:09:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 17:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 17:09:09 [DEBUG   ] spawn_process: at 2018-11-15 17:09:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 17:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 17:09:09 [DEBUG   ] spawn_process: at 2018-11-15 17:09:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 17:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 17:09:09 [DEBUG   ] spawn_process: at 2018-11-15 17:09:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 17:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 17:09:09 [DEBUG   ] spawn_process: at 2018-11-15 17:09:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 17:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 17:09:09 [DEBUG   ] spawn_process: at 2018-11-15 17:09:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 17:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 17:09:09 [DEBUG   ] spawn_process: at 2018-11-15 17:09:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 17:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 17:09:09 [DEBUG   ] spawn_process: at 2018-11-15 17:09:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 17:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 17:09:09 [DEBUG   ] spawn_process: at 2018-11-15 17:09:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 17:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 17:09:09 [DEBUG   ] spawn_process: at 2018-11-15 17:09:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 17:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 17:09:09 [DEBUG   ] spawn_process: at 2018-11-15 17:09:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 17:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 17:09:09 [DEBUG   ] spawn_process: at 2018-11-15 17:09:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 17:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 17:09:09 [DEBUG   ] spawn_process: at 2018-11-15 17:09:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 17:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 17:09:09 [DEBUG   ] spawn_process: at 2018-11-15 17:09:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 17:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 17:09:09 [DEBUG   ] spawn_process: at 2018-11-15 17:09:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 17:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 17:09:09 [DEBUG   ] spawn_process: at 2018-11-15 17:09:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 17:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 17:09:09 [DEBUG   ] spawn_process: at 2018-11-15 17:09:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 17:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 17:09:09 [DEBUG   ] spawn_process: at 2018-11-15 17:09:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 17:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 17:09:09 [DEBUG   ] spawn_process: at 2018-11-15 17:09:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 17:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 17:09:09 [DEBUG   ] spawn_process: at 2018-11-15 17:09:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 17:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 17:09:09 [DEBUG   ] spawn_process: at 2018-11-15 17:09:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 17:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 17:09:09 [DEBUG   ] spawn_process: at 2018-11-15 17:09:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 17:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 17:09:09 [DEBUG   ] spawn_process: at 2018-11-15 17:09:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 17:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 17:09:09 [DEBUG   ] spawn_process: at 2018-11-15 17:09:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 17:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 17:09:09 [DEBUG   ] spawn_process: at 2018-11-15 17:09:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 17:09:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 17:09:09 [DEBUG   ] spawn_process: at 2018-11-15 17:09:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 17:09:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 17:09:31 [DEBUG   ] Got command BAM from MCS: ref #516736
2018-11-15 17:09:31 [INFO    ] Finished processing BAM request
2018-11-15 17:09:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:09:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516736   8 58437 61771025 A  ERROR'
2018-11-15 17:09:31 [DEBUG   ] Got command BAM from MCS: ref #516735
2018-11-15 17:09:31 [INFO    ] Finished processing BAM request
2018-11-15 17:09:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:09:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516735   8 58437 61771029 A  ERROR'
2018-11-15 17:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 17:09:31 [DEBUG   ] spawn_process: at 2018-11-15 17:09:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 17:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 17:09:31 [DEBUG   ] spawn_process: at 2018-11-15 17:09:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 17:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 17:09:31 [DEBUG   ] spawn_process: at 2018-11-15 17:09:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 17:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 17:09:31 [DEBUG   ] spawn_process: at 2018-11-15 17:09:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 17:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 17:09:31 [DEBUG   ] spawn_process: at 2018-11-15 17:09:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 17:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 17:09:31 [DEBUG   ] spawn_process: at 2018-11-15 17:09:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 17:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 17:09:31 [DEBUG   ] spawn_process: at 2018-11-15 17:09:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 17:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 17:09:31 [DEBUG   ] spawn_process: at 2018-11-15 17:09:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 17:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 17:09:31 [DEBUG   ] spawn_process: at 2018-11-15 17:09:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 17:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 17:09:31 [DEBUG   ] spawn_process: at 2018-11-15 17:09:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 17:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 17:09:31 [DEBUG   ] spawn_process: at 2018-11-15 17:09:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 17:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 17:09:31 [DEBUG   ] spawn_process: at 2018-11-15 17:09:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 17:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 17:09:31 [DEBUG   ] spawn_process: at 2018-11-15 17:09:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 17:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 17:09:31 [DEBUG   ] spawn_process: at 2018-11-15 17:09:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 17:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 17:09:31 [DEBUG   ] spawn_process: at 2018-11-15 17:09:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 17:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 17:09:31 [DEBUG   ] spawn_process: at 2018-11-15 17:09:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 17:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 17:09:31 [DEBUG   ] spawn_process: at 2018-11-15 17:09:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 17:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 17:09:31 [DEBUG   ] spawn_process: at 2018-11-15 17:09:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 17:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 17:09:31 [DEBUG   ] spawn_process: at 2018-11-15 17:09:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 17:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 17:09:31 [DEBUG   ] spawn_process: at 2018-11-15 17:09:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 17:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 17:09:31 [DEBUG   ] spawn_process: at 2018-11-15 17:09:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 17:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 17:09:31 [DEBUG   ] spawn_process: at 2018-11-15 17:09:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 17:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 17:09:31 [DEBUG   ] spawn_process: at 2018-11-15 17:09:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 17:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 17:09:31 [DEBUG   ] spawn_process: at 2018-11-15 17:09:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 17:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 17:09:31 [DEBUG   ] spawn_process: at 2018-11-15 17:09:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 17:09:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 17:09:31 [DEBUG   ] spawn_process: at 2018-11-15 17:09:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 17:09:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 17:09:53 [DEBUG   ] Got command BAM from MCS: ref #516738
2018-11-15 17:09:53 [INFO    ] Finished processing BAM request
2018-11-15 17:09:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:09:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516738   8 58437 61793029 A  ERROR'
2018-11-15 17:09:53 [DEBUG   ] Got command BAM from MCS: ref #516737
2018-11-15 17:09:53 [INFO    ] Finished processing BAM request
2018-11-15 17:09:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:09:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516737   8 58437 61793033 A  ERROR'
2018-11-15 17:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 17:09:53 [DEBUG   ] spawn_process: at 2018-11-15 17:09:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 17:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 17:09:53 [DEBUG   ] spawn_process: at 2018-11-15 17:09:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 17:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 17:09:53 [DEBUG   ] spawn_process: at 2018-11-15 17:09:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 17:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 17:09:53 [DEBUG   ] spawn_process: at 2018-11-15 17:09:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 17:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 17:09:53 [DEBUG   ] spawn_process: at 2018-11-15 17:09:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 17:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 17:09:53 [DEBUG   ] spawn_process: at 2018-11-15 17:09:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 17:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 17:09:53 [DEBUG   ] spawn_process: at 2018-11-15 17:09:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 17:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 17:09:53 [DEBUG   ] spawn_process: at 2018-11-15 17:09:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 17:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 17:09:53 [DEBUG   ] spawn_process: at 2018-11-15 17:09:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 17:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 17:09:53 [DEBUG   ] spawn_process: at 2018-11-15 17:09:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 17:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 17:09:53 [DEBUG   ] spawn_process: at 2018-11-15 17:09:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 17:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 17:09:53 [DEBUG   ] spawn_process: at 2018-11-15 17:09:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 17:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 17:09:53 [DEBUG   ] spawn_process: at 2018-11-15 17:09:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 17:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 17:09:53 [DEBUG   ] spawn_process: at 2018-11-15 17:09:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 17:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 17:09:53 [DEBUG   ] spawn_process: at 2018-11-15 17:09:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 17:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 17:09:53 [DEBUG   ] spawn_process: at 2018-11-15 17:09:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 17:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 17:09:53 [DEBUG   ] spawn_process: at 2018-11-15 17:09:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 17:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 17:09:53 [DEBUG   ] spawn_process: at 2018-11-15 17:09:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 17:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 17:09:53 [DEBUG   ] spawn_process: at 2018-11-15 17:09:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 17:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 17:09:53 [DEBUG   ] spawn_process: at 2018-11-15 17:09:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 17:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 17:09:53 [DEBUG   ] spawn_process: at 2018-11-15 17:09:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 17:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 17:09:53 [DEBUG   ] spawn_process: at 2018-11-15 17:09:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 17:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 17:09:53 [DEBUG   ] spawn_process: at 2018-11-15 17:09:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 17:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 17:09:53 [DEBUG   ] spawn_process: at 2018-11-15 17:09:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 17:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 17:09:53 [DEBUG   ] spawn_process: at 2018-11-15 17:09:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 17:09:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 17:09:53 [DEBUG   ] spawn_process: at 2018-11-15 17:09:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 17:10:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 17:10:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-11-15 17:10:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 17:10:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 17:10:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:10:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 17:10:05 [WARNING ] (13, 1, 'bot')
2018-11-15 17:10:05 [WARNING ] (13, 1, 'bot')
2018-11-15 17:10:05 [WARNING ] (13, 1, 'bot')
2018-11-15 17:10:05 [WARNING ] (13, 1, 'bot')
2018-11-15 17:10:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:10:05 [DEBUG   ] Finished updating board flags in 1.279 seconds
2018-11-15 17:10:15 [DEBUG   ] Got command BAM from MCS: ref #516739
2018-11-15 17:10:15 [INFO    ] Finished processing BAM request
2018-11-15 17:10:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:10:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516739   8 58437 61815033 A  ERROR'
2018-11-15 17:10:15 [DEBUG   ] Got command BAM from MCS: ref #516740
2018-11-15 17:10:15 [INFO    ] Finished processing BAM request
2018-11-15 17:10:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:10:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516740   8 58437 61815037 A  ERROR'
2018-11-15 17:10:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 17:10:15 [DEBUG   ] spawn_process: at 2018-11-15 17:10:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 17:10:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 17:10:15 [DEBUG   ] spawn_process: at 2018-11-15 17:10:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 17:10:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 17:10:15 [DEBUG   ] spawn_process: at 2018-11-15 17:10:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 17:10:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 17:10:15 [DEBUG   ] spawn_process: at 2018-11-15 17:10:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 17:10:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 17:10:15 [DEBUG   ] spawn_process: at 2018-11-15 17:10:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 17:10:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 17:10:15 [DEBUG   ] spawn_process: at 2018-11-15 17:10:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 17:10:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 17:10:15 [DEBUG   ] spawn_process: at 2018-11-15 17:10:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 17:10:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 17:10:15 [DEBUG   ] spawn_process: at 2018-11-15 17:10:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 17:10:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 17:10:15 [DEBUG   ] spawn_process: at 2018-11-15 17:10:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 17:10:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 17:10:15 [DEBUG   ] spawn_process: at 2018-11-15 17:10:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 17:10:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 17:10:15 [DEBUG   ] spawn_process: at 2018-11-15 17:10:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 17:10:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 17:10:15 [DEBUG   ] spawn_process: at 2018-11-15 17:10:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 17:10:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 17:10:15 [DEBUG   ] spawn_process: at 2018-11-15 17:10:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 17:10:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 17:10:15 [DEBUG   ] spawn_process: at 2018-11-15 17:10:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 17:10:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 17:10:15 [DEBUG   ] spawn_process: at 2018-11-15 17:10:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 17:10:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 17:10:15 [DEBUG   ] spawn_process: at 2018-11-15 17:10:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 17:10:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 17:10:15 [DEBUG   ] spawn_process: at 2018-11-15 17:10:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 17:10:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 17:10:15 [DEBUG   ] spawn_process: at 2018-11-15 17:10:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 17:10:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 17:10:15 [DEBUG   ] spawn_process: at 2018-11-15 17:10:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 17:10:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 17:10:15 [DEBUG   ] spawn_process: at 2018-11-15 17:10:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 17:10:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 17:10:15 [DEBUG   ] spawn_process: at 2018-11-15 17:10:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 17:10:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 17:10:15 [DEBUG   ] spawn_process: at 2018-11-15 17:10:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 17:10:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 17:10:15 [DEBUG   ] spawn_process: at 2018-11-15 17:10:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 17:10:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 17:10:15 [DEBUG   ] spawn_process: at 2018-11-15 17:10:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 17:10:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 17:10:15 [DEBUG   ] spawn_process: at 2018-11-15 17:10:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 17:10:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 17:10:15 [DEBUG   ] spawn_process: at 2018-11-15 17:10:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 17:10:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 17:10:37 [DEBUG   ] Got command BAM from MCS: ref #516741
2018-11-15 17:10:37 [INFO    ] Finished processing BAM request
2018-11-15 17:10:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516741   8 58437 61837033 A  ERROR'
2018-11-15 17:10:37 [DEBUG   ] Got command BAM from MCS: ref #516742
2018-11-15 17:10:37 [INFO    ] Finished processing BAM request
2018-11-15 17:10:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:10:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516742   8 58437 61837037 A  ERROR'
2018-11-15 17:10:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 17:10:37 [DEBUG   ] spawn_process: at 2018-11-15 17:10:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 17:10:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 17:10:37 [DEBUG   ] spawn_process: at 2018-11-15 17:10:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 17:10:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 17:10:37 [DEBUG   ] spawn_process: at 2018-11-15 17:10:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 17:10:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 17:10:37 [DEBUG   ] spawn_process: at 2018-11-15 17:10:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 17:10:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 17:10:37 [DEBUG   ] spawn_process: at 2018-11-15 17:10:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 17:10:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 17:10:37 [DEBUG   ] spawn_process: at 2018-11-15 17:10:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 17:10:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 17:10:37 [DEBUG   ] spawn_process: at 2018-11-15 17:10:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 17:10:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 17:10:37 [DEBUG   ] spawn_process: at 2018-11-15 17:10:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 17:10:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 17:10:37 [DEBUG   ] spawn_process: at 2018-11-15 17:10:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 17:10:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 17:10:37 [DEBUG   ] spawn_process: at 2018-11-15 17:10:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 17:10:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 17:10:37 [DEBUG   ] spawn_process: at 2018-11-15 17:10:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 17:10:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 17:10:37 [DEBUG   ] spawn_process: at 2018-11-15 17:10:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 17:10:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 17:10:37 [DEBUG   ] spawn_process: at 2018-11-15 17:10:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 17:10:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 17:10:37 [DEBUG   ] spawn_process: at 2018-11-15 17:10:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 17:10:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 17:10:37 [DEBUG   ] spawn_process: at 2018-11-15 17:10:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 17:10:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 17:10:37 [DEBUG   ] spawn_process: at 2018-11-15 17:10:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 17:10:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 17:10:37 [DEBUG   ] spawn_process: at 2018-11-15 17:10:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 17:10:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 17:10:37 [DEBUG   ] spawn_process: at 2018-11-15 17:10:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 17:10:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 17:10:37 [DEBUG   ] spawn_process: at 2018-11-15 17:10:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 17:10:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 17:10:37 [DEBUG   ] spawn_process: at 2018-11-15 17:10:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 17:10:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 17:10:37 [DEBUG   ] spawn_process: at 2018-11-15 17:10:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 17:10:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 17:10:37 [DEBUG   ] spawn_process: at 2018-11-15 17:10:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 17:10:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 17:10:37 [DEBUG   ] spawn_process: at 2018-11-15 17:10:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 17:10:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 17:10:37 [DEBUG   ] spawn_process: at 2018-11-15 17:10:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 17:10:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 17:10:37 [DEBUG   ] spawn_process: at 2018-11-15 17:10:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 17:10:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 17:10:37 [DEBUG   ] spawn_process: at 2018-11-15 17:10:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 17:10:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 17:10:45 [DEBUG   ] Got command RPT from MCS: ref #516743
2018-11-15 17:10:45 [DEBUG   ] summary = ERROR
2018-11-15 17:10:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516743  13 58437 61845145 A  ERRORERROR'
2018-11-15 17:10:45 [DEBUG   ] Got command RPT from MCS: ref #516744
2018-11-15 17:10:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 17:10:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516744  77 58437 61845146 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 17:10:59 [DEBUG   ] Got command BAM from MCS: ref #516761
2018-11-15 17:10:59 [INFO    ] Finished processing BAM request
2018-11-15 17:10:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:10:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516761   8 58437 61859025 A  ERROR'
2018-11-15 17:10:59 [DEBUG   ] Got command BAM from MCS: ref #516760
2018-11-15 17:10:59 [INFO    ] Finished processing BAM request
2018-11-15 17:10:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:10:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516760   8 58437 61859029 A  ERROR'
2018-11-15 17:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 17:10:59 [DEBUG   ] spawn_process: at 2018-11-15 17:10:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 17:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 17:10:59 [DEBUG   ] spawn_process: at 2018-11-15 17:10:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 17:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 17:10:59 [DEBUG   ] spawn_process: at 2018-11-15 17:10:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 17:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 17:10:59 [DEBUG   ] spawn_process: at 2018-11-15 17:10:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 17:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 17:10:59 [DEBUG   ] spawn_process: at 2018-11-15 17:10:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 17:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 17:10:59 [DEBUG   ] spawn_process: at 2018-11-15 17:10:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 17:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 17:10:59 [DEBUG   ] spawn_process: at 2018-11-15 17:10:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 17:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 17:10:59 [DEBUG   ] spawn_process: at 2018-11-15 17:10:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 17:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 17:10:59 [DEBUG   ] spawn_process: at 2018-11-15 17:10:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 17:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 17:10:59 [DEBUG   ] spawn_process: at 2018-11-15 17:10:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 17:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 17:10:59 [DEBUG   ] spawn_process: at 2018-11-15 17:10:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 17:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 17:10:59 [DEBUG   ] spawn_process: at 2018-11-15 17:10:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 17:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 17:10:59 [DEBUG   ] spawn_process: at 2018-11-15 17:10:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 17:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 17:10:59 [DEBUG   ] spawn_process: at 2018-11-15 17:10:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 17:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 17:10:59 [DEBUG   ] spawn_process: at 2018-11-15 17:10:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 17:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 17:10:59 [DEBUG   ] spawn_process: at 2018-11-15 17:10:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 17:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 17:10:59 [DEBUG   ] spawn_process: at 2018-11-15 17:10:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 17:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 17:10:59 [DEBUG   ] spawn_process: at 2018-11-15 17:10:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 17:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 17:10:59 [DEBUG   ] spawn_process: at 2018-11-15 17:10:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 17:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 17:10:59 [DEBUG   ] spawn_process: at 2018-11-15 17:10:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 17:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 17:10:59 [DEBUG   ] spawn_process: at 2018-11-15 17:10:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 17:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 17:10:59 [DEBUG   ] spawn_process: at 2018-11-15 17:10:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 17:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 17:10:59 [DEBUG   ] spawn_process: at 2018-11-15 17:10:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 17:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 17:10:59 [DEBUG   ] spawn_process: at 2018-11-15 17:10:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 17:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 17:10:59 [DEBUG   ] spawn_process: at 2018-11-15 17:10:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 17:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 17:10:59 [DEBUG   ] spawn_process: at 2018-11-15 17:10:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 17:11:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 17:11:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:11:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 17:11:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 17:11:05 [WARNING ] (13, 1, 'bot')
2018-11-15 17:11:05 [WARNING ] (13, 1, 'bot')
2018-11-15 17:11:05 [WARNING ] (13, 1, 'bot')
2018-11-15 17:11:05 [WARNING ] (13, 1, 'bot')
2018-11-15 17:11:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:11:05 [DEBUG   ] Finished updating board flags in 1.121 seconds
2018-11-15 17:11:20 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 17:11:21 [DEBUG   ] Got command BAM from MCS: ref #516762
2018-11-15 17:11:21 [INFO    ] Finished processing BAM request
2018-11-15 17:11:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:11:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516762   8 58437 61881033 A  ERROR'
2018-11-15 17:11:21 [DEBUG   ] Got command BAM from MCS: ref #516763
2018-11-15 17:11:21 [INFO    ] Finished processing BAM request
2018-11-15 17:11:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:11:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516763   8 58437 61881037 A  ERROR'
2018-11-15 17:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 17:11:21 [DEBUG   ] spawn_process: at 2018-11-15 17:11:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 17:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 17:11:22 [DEBUG   ] spawn_process: at 2018-11-15 17:11:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 17:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 17:11:22 [DEBUG   ] spawn_process: at 2018-11-15 17:11:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 17:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 17:11:22 [DEBUG   ] spawn_process: at 2018-11-15 17:11:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 17:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 17:11:22 [DEBUG   ] spawn_process: at 2018-11-15 17:11:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 17:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 17:11:22 [DEBUG   ] spawn_process: at 2018-11-15 17:11:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 17:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 17:11:22 [DEBUG   ] spawn_process: at 2018-11-15 17:11:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 17:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 17:11:22 [DEBUG   ] spawn_process: at 2018-11-15 17:11:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 17:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 17:11:22 [DEBUG   ] spawn_process: at 2018-11-15 17:11:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 17:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 17:11:22 [DEBUG   ] spawn_process: at 2018-11-15 17:11:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 17:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 17:11:22 [DEBUG   ] spawn_process: at 2018-11-15 17:11:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 17:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 17:11:22 [DEBUG   ] spawn_process: at 2018-11-15 17:11:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 17:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 17:11:22 [DEBUG   ] spawn_process: at 2018-11-15 17:11:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 17:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 17:11:22 [DEBUG   ] spawn_process: at 2018-11-15 17:11:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 17:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 17:11:22 [DEBUG   ] spawn_process: at 2018-11-15 17:11:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 17:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 17:11:22 [DEBUG   ] spawn_process: at 2018-11-15 17:11:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 17:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 17:11:22 [DEBUG   ] spawn_process: at 2018-11-15 17:11:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 17:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 17:11:22 [DEBUG   ] spawn_process: at 2018-11-15 17:11:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 17:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 17:11:22 [DEBUG   ] spawn_process: at 2018-11-15 17:11:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 17:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 17:11:22 [DEBUG   ] spawn_process: at 2018-11-15 17:11:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 17:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 17:11:22 [DEBUG   ] spawn_process: at 2018-11-15 17:11:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 17:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 17:11:22 [DEBUG   ] spawn_process: at 2018-11-15 17:11:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 17:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 17:11:22 [DEBUG   ] spawn_process: at 2018-11-15 17:11:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 17:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 17:11:22 [DEBUG   ] spawn_process: at 2018-11-15 17:11:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 17:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 17:11:22 [DEBUG   ] spawn_process: at 2018-11-15 17:11:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 17:11:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 17:11:22 [DEBUG   ] spawn_process: at 2018-11-15 17:11:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 17:11:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 17:11:43 [DEBUG   ] Got command BAM from MCS: ref #516768
2018-11-15 17:11:43 [INFO    ] Finished processing BAM request
2018-11-15 17:11:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:11:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516768   8 58437 61903033 A  ERROR'
2018-11-15 17:11:43 [DEBUG   ] Got command BAM from MCS: ref #516769
2018-11-15 17:11:43 [INFO    ] Finished processing BAM request
2018-11-15 17:11:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:11:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516769   8 58437 61903037 A  ERROR'
2018-11-15 17:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 17:11:43 [DEBUG   ] spawn_process: at 2018-11-15 17:11:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 17:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 17:11:43 [DEBUG   ] spawn_process: at 2018-11-15 17:11:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 17:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 17:11:43 [DEBUG   ] spawn_process: at 2018-11-15 17:11:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 17:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 17:11:43 [DEBUG   ] spawn_process: at 2018-11-15 17:11:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 17:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 17:11:43 [DEBUG   ] spawn_process: at 2018-11-15 17:11:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 17:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 17:11:43 [DEBUG   ] spawn_process: at 2018-11-15 17:11:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 17:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 17:11:43 [DEBUG   ] spawn_process: at 2018-11-15 17:11:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 17:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 17:11:43 [DEBUG   ] spawn_process: at 2018-11-15 17:11:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 17:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 17:11:43 [DEBUG   ] spawn_process: at 2018-11-15 17:11:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 17:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 17:11:43 [DEBUG   ] spawn_process: at 2018-11-15 17:11:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 17:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 17:11:43 [DEBUG   ] spawn_process: at 2018-11-15 17:11:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 17:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 17:11:43 [DEBUG   ] spawn_process: at 2018-11-15 17:11:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 17:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 17:11:43 [DEBUG   ] spawn_process: at 2018-11-15 17:11:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 17:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 17:11:43 [DEBUG   ] spawn_process: at 2018-11-15 17:11:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 17:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 17:11:43 [DEBUG   ] spawn_process: at 2018-11-15 17:11:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 17:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 17:11:43 [DEBUG   ] spawn_process: at 2018-11-15 17:11:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 17:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 17:11:43 [DEBUG   ] spawn_process: at 2018-11-15 17:11:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 17:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 17:11:43 [DEBUG   ] spawn_process: at 2018-11-15 17:11:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 17:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 17:11:43 [DEBUG   ] spawn_process: at 2018-11-15 17:11:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 17:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 17:11:43 [DEBUG   ] spawn_process: at 2018-11-15 17:11:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 17:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 17:11:43 [DEBUG   ] spawn_process: at 2018-11-15 17:11:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 17:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 17:11:43 [DEBUG   ] spawn_process: at 2018-11-15 17:11:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 17:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 17:11:43 [DEBUG   ] spawn_process: at 2018-11-15 17:11:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 17:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 17:11:43 [DEBUG   ] spawn_process: at 2018-11-15 17:11:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 17:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 17:11:43 [DEBUG   ] spawn_process: at 2018-11-15 17:11:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 17:11:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 17:11:43 [DEBUG   ] spawn_process: at 2018-11-15 17:11:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 17:12:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 17:12:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-11-15 17:12:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 17:12:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-11-15 17:12:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:12:05 [DEBUG   ] Got command BAM from MCS: ref #516771
2018-11-15 17:12:05 [INFO    ] Finished processing BAM request
2018-11-15 17:12:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:12:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516771   8 58437 61925029 A  ERROR'
2018-11-15 17:12:05 [DEBUG   ] Got command BAM from MCS: ref #516770
2018-11-15 17:12:05 [INFO    ] Finished processing BAM request
2018-11-15 17:12:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:12:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516770   8 58437 61925037 A  ERROR'
2018-11-15 17:12:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 17:12:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 17:12:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 17:12:05 [WARNING ] (13, 1, 'bot')
2018-11-15 17:12:05 [WARNING ] (13, 1, 'bot')
2018-11-15 17:12:05 [WARNING ] (13, 1, 'bot')
2018-11-15 17:12:05 [WARNING ] (13, 1, 'bot')
2018-11-15 17:12:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:12:05 [DEBUG   ] Finished updating board flags in 1.012 seconds
2018-11-15 17:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 17:12:05 [DEBUG   ] spawn_process: at 2018-11-15 17:12:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 17:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 17:12:05 [DEBUG   ] spawn_process: at 2018-11-15 17:12:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 17:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 17:12:05 [DEBUG   ] spawn_process: at 2018-11-15 17:12:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 17:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 17:12:05 [DEBUG   ] spawn_process: at 2018-11-15 17:12:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 17:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 17:12:05 [DEBUG   ] spawn_process: at 2018-11-15 17:12:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 17:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 17:12:05 [DEBUG   ] spawn_process: at 2018-11-15 17:12:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 17:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 17:12:05 [DEBUG   ] spawn_process: at 2018-11-15 17:12:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 17:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 17:12:05 [DEBUG   ] spawn_process: at 2018-11-15 17:12:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 17:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 17:12:05 [DEBUG   ] spawn_process: at 2018-11-15 17:12:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 17:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 17:12:05 [DEBUG   ] spawn_process: at 2018-11-15 17:12:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 17:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 17:12:05 [DEBUG   ] spawn_process: at 2018-11-15 17:12:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 17:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 17:12:05 [DEBUG   ] spawn_process: at 2018-11-15 17:12:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 17:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 17:12:05 [DEBUG   ] spawn_process: at 2018-11-15 17:12:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 17:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 17:12:05 [DEBUG   ] spawn_process: at 2018-11-15 17:12:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 17:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 17:12:05 [DEBUG   ] spawn_process: at 2018-11-15 17:12:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 17:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 17:12:05 [DEBUG   ] spawn_process: at 2018-11-15 17:12:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 17:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 17:12:05 [DEBUG   ] spawn_process: at 2018-11-15 17:12:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 17:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 17:12:05 [DEBUG   ] spawn_process: at 2018-11-15 17:12:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 17:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 17:12:05 [DEBUG   ] spawn_process: at 2018-11-15 17:12:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 17:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 17:12:05 [DEBUG   ] spawn_process: at 2018-11-15 17:12:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 17:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 17:12:05 [DEBUG   ] spawn_process: at 2018-11-15 17:12:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 17:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 17:12:05 [DEBUG   ] spawn_process: at 2018-11-15 17:12:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 17:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 17:12:05 [DEBUG   ] spawn_process: at 2018-11-15 17:12:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 17:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 17:12:05 [DEBUG   ] spawn_process: at 2018-11-15 17:12:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 17:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 17:12:05 [DEBUG   ] spawn_process: at 2018-11-15 17:12:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 17:12:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 17:12:05 [DEBUG   ] spawn_process: at 2018-11-15 17:12:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 17:12:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 17:12:27 [DEBUG   ] Got command BAM from MCS: ref #516773
2018-11-15 17:12:27 [INFO    ] Finished processing BAM request
2018-11-15 17:12:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:12:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516773   8 58437 61947033 A  ERROR'
2018-11-15 17:12:27 [DEBUG   ] Got command BAM from MCS: ref #516772
2018-11-15 17:12:27 [INFO    ] Finished processing BAM request
2018-11-15 17:12:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:12:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516772   8 58437 61947037 A  ERROR'
2018-11-15 17:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 17:12:27 [DEBUG   ] spawn_process: at 2018-11-15 17:12:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 17:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 17:12:27 [DEBUG   ] spawn_process: at 2018-11-15 17:12:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 17:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 17:12:27 [DEBUG   ] spawn_process: at 2018-11-15 17:12:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 17:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 17:12:27 [DEBUG   ] spawn_process: at 2018-11-15 17:12:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 17:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 17:12:27 [DEBUG   ] spawn_process: at 2018-11-15 17:12:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 17:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 17:12:27 [DEBUG   ] spawn_process: at 2018-11-15 17:12:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 17:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 17:12:27 [DEBUG   ] spawn_process: at 2018-11-15 17:12:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 17:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 17:12:27 [DEBUG   ] spawn_process: at 2018-11-15 17:12:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 17:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 17:12:27 [DEBUG   ] spawn_process: at 2018-11-15 17:12:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 17:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 17:12:27 [DEBUG   ] spawn_process: at 2018-11-15 17:12:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 17:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 17:12:27 [DEBUG   ] spawn_process: at 2018-11-15 17:12:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 17:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 17:12:27 [DEBUG   ] spawn_process: at 2018-11-15 17:12:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 17:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 17:12:27 [DEBUG   ] spawn_process: at 2018-11-15 17:12:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 17:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 17:12:27 [DEBUG   ] spawn_process: at 2018-11-15 17:12:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 17:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 17:12:27 [DEBUG   ] spawn_process: at 2018-11-15 17:12:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 17:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 17:12:27 [DEBUG   ] spawn_process: at 2018-11-15 17:12:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 17:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 17:12:27 [DEBUG   ] spawn_process: at 2018-11-15 17:12:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 17:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 17:12:27 [DEBUG   ] spawn_process: at 2018-11-15 17:12:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 17:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 17:12:27 [DEBUG   ] spawn_process: at 2018-11-15 17:12:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 17:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 17:12:27 [DEBUG   ] spawn_process: at 2018-11-15 17:12:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 17:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 17:12:27 [DEBUG   ] spawn_process: at 2018-11-15 17:12:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 17:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 17:12:27 [DEBUG   ] spawn_process: at 2018-11-15 17:12:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 17:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 17:12:27 [DEBUG   ] spawn_process: at 2018-11-15 17:12:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 17:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 17:12:27 [DEBUG   ] spawn_process: at 2018-11-15 17:12:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 17:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 17:12:27 [DEBUG   ] spawn_process: at 2018-11-15 17:12:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 17:12:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 17:12:27 [DEBUG   ] spawn_process: at 2018-11-15 17:12:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 17:12:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 17:12:49 [DEBUG   ] Got command BAM from MCS: ref #516775
2018-11-15 17:12:49 [INFO    ] Finished processing BAM request
2018-11-15 17:12:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:12:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516775   8 58437 61969025 A  ERROR'
2018-11-15 17:12:49 [DEBUG   ] Got command BAM from MCS: ref #516774
2018-11-15 17:12:49 [INFO    ] Finished processing BAM request
2018-11-15 17:12:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:12:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516774   8 58437 61969029 A  ERROR'
2018-11-15 17:12:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 17:12:49 [DEBUG   ] spawn_process: at 2018-11-15 17:12:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 17:12:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 17:12:49 [DEBUG   ] spawn_process: at 2018-11-15 17:12:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 17:12:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 17:12:49 [DEBUG   ] spawn_process: at 2018-11-15 17:12:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 17:12:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 17:12:49 [DEBUG   ] spawn_process: at 2018-11-15 17:12:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 17:12:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 17:12:49 [DEBUG   ] spawn_process: at 2018-11-15 17:12:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 17:12:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 17:12:49 [DEBUG   ] spawn_process: at 2018-11-15 17:12:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 17:12:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 17:12:49 [DEBUG   ] spawn_process: at 2018-11-15 17:12:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 17:12:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 17:12:49 [DEBUG   ] spawn_process: at 2018-11-15 17:12:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 17:12:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 17:12:49 [DEBUG   ] spawn_process: at 2018-11-15 17:12:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 17:12:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 17:12:49 [DEBUG   ] spawn_process: at 2018-11-15 17:12:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 17:12:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 17:12:49 [DEBUG   ] spawn_process: at 2018-11-15 17:12:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 17:12:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 17:12:49 [DEBUG   ] spawn_process: at 2018-11-15 17:12:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 17:12:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 17:12:49 [DEBUG   ] spawn_process: at 2018-11-15 17:12:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 17:12:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 17:12:49 [DEBUG   ] spawn_process: at 2018-11-15 17:12:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 17:12:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 17:12:49 [DEBUG   ] spawn_process: at 2018-11-15 17:12:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 17:12:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 17:12:49 [DEBUG   ] spawn_process: at 2018-11-15 17:12:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 17:12:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 17:12:49 [DEBUG   ] spawn_process: at 2018-11-15 17:12:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 17:12:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 17:12:49 [DEBUG   ] spawn_process: at 2018-11-15 17:12:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 17:12:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 17:12:49 [DEBUG   ] spawn_process: at 2018-11-15 17:12:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 17:12:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 17:12:49 [DEBUG   ] spawn_process: at 2018-11-15 17:12:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 17:12:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 17:12:49 [DEBUG   ] spawn_process: at 2018-11-15 17:12:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 17:12:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 17:12:49 [DEBUG   ] spawn_process: at 2018-11-15 17:12:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 17:12:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 17:12:49 [DEBUG   ] spawn_process: at 2018-11-15 17:12:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 17:12:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 17:12:49 [DEBUG   ] spawn_process: at 2018-11-15 17:12:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 17:12:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 17:12:49 [DEBUG   ] spawn_process: at 2018-11-15 17:12:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 17:12:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 17:12:49 [DEBUG   ] spawn_process: at 2018-11-15 17:12:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 17:13:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 17:13:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 17:13:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:13:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-11-15 17:13:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 17:13:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 17:13:05 [WARNING ] (13, 1, 'bot')
2018-11-15 17:13:05 [WARNING ] (13, 1, 'bot')
2018-11-15 17:13:05 [WARNING ] (13, 1, 'bot')
2018-11-15 17:13:05 [WARNING ] (13, 1, 'bot')
2018-11-15 17:13:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:13:05 [DEBUG   ] Finished updating board flags in 1.000 seconds
2018-11-15 17:13:11 [DEBUG   ] Got command BAM from MCS: ref #516777
2018-11-15 17:13:11 [INFO    ] Finished processing BAM request
2018-11-15 17:13:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:13:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516777   8 58437 61991033 A  ERROR'
2018-11-15 17:13:11 [DEBUG   ] Got command BAM from MCS: ref #516776
2018-11-15 17:13:11 [INFO    ] Finished processing BAM request
2018-11-15 17:13:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:13:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516776   8 58437 61991037 A  ERROR'
2018-11-15 17:13:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 17:13:11 [DEBUG   ] spawn_process: at 2018-11-15 17:13:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 17:13:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 17:13:12 [DEBUG   ] spawn_process: at 2018-11-15 17:13:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 17:13:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 17:13:12 [DEBUG   ] spawn_process: at 2018-11-15 17:13:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 17:13:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 17:13:12 [DEBUG   ] spawn_process: at 2018-11-15 17:13:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 17:13:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 17:13:12 [DEBUG   ] spawn_process: at 2018-11-15 17:13:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 17:13:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 17:13:12 [DEBUG   ] spawn_process: at 2018-11-15 17:13:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 17:13:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 17:13:12 [DEBUG   ] spawn_process: at 2018-11-15 17:13:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 17:13:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 17:13:12 [DEBUG   ] spawn_process: at 2018-11-15 17:13:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 17:13:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 17:13:12 [DEBUG   ] spawn_process: at 2018-11-15 17:13:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 17:13:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 17:13:12 [DEBUG   ] spawn_process: at 2018-11-15 17:13:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 17:13:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 17:13:12 [DEBUG   ] spawn_process: at 2018-11-15 17:13:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 17:13:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 17:13:12 [DEBUG   ] spawn_process: at 2018-11-15 17:13:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 17:13:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 17:13:12 [DEBUG   ] spawn_process: at 2018-11-15 17:13:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 17:13:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 17:13:12 [DEBUG   ] spawn_process: at 2018-11-15 17:13:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 17:13:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 17:13:12 [DEBUG   ] spawn_process: at 2018-11-15 17:13:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 17:13:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 17:13:12 [DEBUG   ] spawn_process: at 2018-11-15 17:13:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 17:13:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 17:13:12 [DEBUG   ] spawn_process: at 2018-11-15 17:13:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 17:13:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 17:13:12 [DEBUG   ] spawn_process: at 2018-11-15 17:13:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 17:13:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 17:13:12 [DEBUG   ] spawn_process: at 2018-11-15 17:13:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 17:13:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 17:13:12 [DEBUG   ] spawn_process: at 2018-11-15 17:13:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 17:13:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 17:13:12 [DEBUG   ] spawn_process: at 2018-11-15 17:13:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 17:13:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 17:13:12 [DEBUG   ] spawn_process: at 2018-11-15 17:13:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 17:13:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 17:13:12 [DEBUG   ] spawn_process: at 2018-11-15 17:13:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 17:13:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 17:13:12 [DEBUG   ] spawn_process: at 2018-11-15 17:13:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 17:13:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 17:13:12 [DEBUG   ] spawn_process: at 2018-11-15 17:13:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 17:13:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 17:13:12 [DEBUG   ] spawn_process: at 2018-11-15 17:13:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 17:13:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 17:13:20 [DEBUG   ] Got command RPT from MCS: ref #516778
2018-11-15 17:13:20 [DEBUG   ] summary = ERROR
2018-11-15 17:13:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516778  13 58437 62000277 A  ERRORERROR'
2018-11-15 17:13:20 [DEBUG   ] Got command RPT from MCS: ref #516779
2018-11-15 17:13:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 17:13:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516779  77 58437 62000469 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 17:13:20 [DEBUG   ] Got command RPT from MCS: ref #516780
2018-11-15 17:13:20 [DEBUG   ] summary = ERROR
2018-11-15 17:13:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516780  13 58437 62000673 A  ERRORERROR'
2018-11-15 17:13:20 [DEBUG   ] Got command RPT from MCS: ref #516781
2018-11-15 17:13:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 17:13:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516781  77 58437 62000877 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 17:13:21 [DEBUG   ] Got command RPT from MCS: ref #516782
2018-11-15 17:13:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 17:13:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516782  12 58437 62001069 A  ERRORB£ff'
2018-11-15 17:13:33 [DEBUG   ] Got command BAM from MCS: ref #516783
2018-11-15 17:13:33 [INFO    ] Finished processing BAM request
2018-11-15 17:13:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:13:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516783   8 58437 62013025 A  ERROR'
2018-11-15 17:13:33 [DEBUG   ] Got command BAM from MCS: ref #516784
2018-11-15 17:13:33 [INFO    ] Finished processing BAM request
2018-11-15 17:13:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:13:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516784   8 58437 62013029 A  ERROR'
2018-11-15 17:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 17:13:33 [DEBUG   ] spawn_process: at 2018-11-15 17:13:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 17:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 17:13:33 [DEBUG   ] spawn_process: at 2018-11-15 17:13:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 17:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 17:13:33 [DEBUG   ] spawn_process: at 2018-11-15 17:13:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 17:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 17:13:33 [DEBUG   ] spawn_process: at 2018-11-15 17:13:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 17:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 17:13:33 [DEBUG   ] spawn_process: at 2018-11-15 17:13:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 17:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 17:13:33 [DEBUG   ] spawn_process: at 2018-11-15 17:13:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 17:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 17:13:33 [DEBUG   ] spawn_process: at 2018-11-15 17:13:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 17:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 17:13:33 [DEBUG   ] spawn_process: at 2018-11-15 17:13:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 17:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 17:13:33 [DEBUG   ] spawn_process: at 2018-11-15 17:13:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 17:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 17:13:33 [DEBUG   ] spawn_process: at 2018-11-15 17:13:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 17:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 17:13:33 [DEBUG   ] spawn_process: at 2018-11-15 17:13:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 17:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 17:13:33 [DEBUG   ] spawn_process: at 2018-11-15 17:13:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 17:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 17:13:33 [DEBUG   ] spawn_process: at 2018-11-15 17:13:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 17:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 17:13:33 [DEBUG   ] spawn_process: at 2018-11-15 17:13:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 17:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 17:13:33 [DEBUG   ] spawn_process: at 2018-11-15 17:13:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 17:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 17:13:33 [DEBUG   ] spawn_process: at 2018-11-15 17:13:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 17:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 17:13:33 [DEBUG   ] spawn_process: at 2018-11-15 17:13:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 17:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 17:13:33 [DEBUG   ] spawn_process: at 2018-11-15 17:13:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 17:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 17:13:33 [DEBUG   ] spawn_process: at 2018-11-15 17:13:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 17:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 17:13:33 [DEBUG   ] spawn_process: at 2018-11-15 17:13:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 17:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 17:13:33 [DEBUG   ] spawn_process: at 2018-11-15 17:13:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 17:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 17:13:33 [DEBUG   ] spawn_process: at 2018-11-15 17:13:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 17:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 17:13:33 [DEBUG   ] spawn_process: at 2018-11-15 17:13:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 17:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 17:13:33 [DEBUG   ] spawn_process: at 2018-11-15 17:13:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 17:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 17:13:33 [DEBUG   ] spawn_process: at 2018-11-15 17:13:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 17:13:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 17:13:33 [DEBUG   ] spawn_process: at 2018-11-15 17:13:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 17:13:40 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 17:13:55 [DEBUG   ] Got command BAM from MCS: ref #516785
2018-11-15 17:13:55 [INFO    ] Finished processing BAM request
2018-11-15 17:13:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:13:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516785   8 58437 62035033 A  ERROR'
2018-11-15 17:13:55 [DEBUG   ] Got command BAM from MCS: ref #516786
2018-11-15 17:13:55 [INFO    ] Finished processing BAM request
2018-11-15 17:13:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:13:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516786   8 58437 62035037 A  ERROR'
2018-11-15 17:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 17:13:55 [DEBUG   ] spawn_process: at 2018-11-15 17:13:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 17:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 17:13:55 [DEBUG   ] spawn_process: at 2018-11-15 17:13:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 17:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 17:13:55 [DEBUG   ] spawn_process: at 2018-11-15 17:13:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 17:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 17:13:55 [DEBUG   ] spawn_process: at 2018-11-15 17:13:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 17:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 17:13:55 [DEBUG   ] spawn_process: at 2018-11-15 17:13:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 17:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 17:13:55 [DEBUG   ] spawn_process: at 2018-11-15 17:13:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 17:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 17:13:55 [DEBUG   ] spawn_process: at 2018-11-15 17:13:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 17:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 17:13:55 [DEBUG   ] spawn_process: at 2018-11-15 17:13:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 17:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 17:13:55 [DEBUG   ] spawn_process: at 2018-11-15 17:13:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 17:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 17:13:55 [DEBUG   ] spawn_process: at 2018-11-15 17:13:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 17:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 17:13:55 [DEBUG   ] spawn_process: at 2018-11-15 17:13:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 17:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 17:13:55 [DEBUG   ] spawn_process: at 2018-11-15 17:13:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 17:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 17:13:55 [DEBUG   ] spawn_process: at 2018-11-15 17:13:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 17:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 17:13:55 [DEBUG   ] spawn_process: at 2018-11-15 17:13:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 17:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 17:13:55 [DEBUG   ] spawn_process: at 2018-11-15 17:13:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 17:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 17:13:55 [DEBUG   ] spawn_process: at 2018-11-15 17:13:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 17:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 17:13:55 [DEBUG   ] spawn_process: at 2018-11-15 17:13:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 17:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 17:13:55 [DEBUG   ] spawn_process: at 2018-11-15 17:13:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 17:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 17:13:55 [DEBUG   ] spawn_process: at 2018-11-15 17:13:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 17:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 17:13:55 [DEBUG   ] spawn_process: at 2018-11-15 17:13:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 17:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 17:13:55 [DEBUG   ] spawn_process: at 2018-11-15 17:13:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 17:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 17:13:55 [DEBUG   ] spawn_process: at 2018-11-15 17:13:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 17:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 17:13:55 [DEBUG   ] spawn_process: at 2018-11-15 17:13:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 17:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 17:13:55 [DEBUG   ] spawn_process: at 2018-11-15 17:13:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 17:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 17:13:55 [DEBUG   ] spawn_process: at 2018-11-15 17:13:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 17:13:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 17:13:55 [DEBUG   ] spawn_process: at 2018-11-15 17:13:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 17:14:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 17:14:04 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-15 17:14:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2018-11-15 17:14:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:14:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 17:14:05 [WARNING ] (13, 1, 'bot')
2018-11-15 17:14:05 [WARNING ] (13, 1, 'bot')
2018-11-15 17:14:05 [WARNING ] (13, 1, 'bot')
2018-11-15 17:14:05 [WARNING ] (13, 1, 'bot')
2018-11-15 17:14:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:14:05 [DEBUG   ] Finished updating board flags in 1.015 seconds
2018-11-15 17:14:17 [DEBUG   ] Got command BAM from MCS: ref #516788
2018-11-15 17:14:17 [INFO    ] Finished processing BAM request
2018-11-15 17:14:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:14:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516788   8 58437 62057033 A  ERROR'
2018-11-15 17:14:17 [DEBUG   ] Got command BAM from MCS: ref #516787
2018-11-15 17:14:17 [INFO    ] Finished processing BAM request
2018-11-15 17:14:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:14:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516787   8 58437 62057037 A  ERROR'
2018-11-15 17:14:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 17:14:17 [DEBUG   ] spawn_process: at 2018-11-15 17:14:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 17:14:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 17:14:17 [DEBUG   ] spawn_process: at 2018-11-15 17:14:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 17:14:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 17:14:17 [DEBUG   ] spawn_process: at 2018-11-15 17:14:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 17:14:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 17:14:17 [DEBUG   ] spawn_process: at 2018-11-15 17:14:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 17:14:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 17:14:17 [DEBUG   ] spawn_process: at 2018-11-15 17:14:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 17:14:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 17:14:17 [DEBUG   ] spawn_process: at 2018-11-15 17:14:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 17:14:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 17:14:17 [DEBUG   ] spawn_process: at 2018-11-15 17:14:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 17:14:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 17:14:17 [DEBUG   ] spawn_process: at 2018-11-15 17:14:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 17:14:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 17:14:17 [DEBUG   ] spawn_process: at 2018-11-15 17:14:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 17:14:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 17:14:17 [DEBUG   ] spawn_process: at 2018-11-15 17:14:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 17:14:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 17:14:17 [DEBUG   ] spawn_process: at 2018-11-15 17:14:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 17:14:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 17:14:17 [DEBUG   ] spawn_process: at 2018-11-15 17:14:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 17:14:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 17:14:17 [DEBUG   ] spawn_process: at 2018-11-15 17:14:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 17:14:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 17:14:17 [DEBUG   ] spawn_process: at 2018-11-15 17:14:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 17:14:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 17:14:17 [DEBUG   ] spawn_process: at 2018-11-15 17:14:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 17:14:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 17:14:17 [DEBUG   ] spawn_process: at 2018-11-15 17:14:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 17:14:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 17:14:17 [DEBUG   ] spawn_process: at 2018-11-15 17:14:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 17:14:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 17:14:17 [DEBUG   ] spawn_process: at 2018-11-15 17:14:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 17:14:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 17:14:17 [DEBUG   ] spawn_process: at 2018-11-15 17:14:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 17:14:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 17:14:17 [DEBUG   ] spawn_process: at 2018-11-15 17:14:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 17:14:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 17:14:17 [DEBUG   ] spawn_process: at 2018-11-15 17:14:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 17:14:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 17:14:17 [DEBUG   ] spawn_process: at 2018-11-15 17:14:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 17:14:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 17:14:17 [DEBUG   ] spawn_process: at 2018-11-15 17:14:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 17:14:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 17:14:17 [DEBUG   ] spawn_process: at 2018-11-15 17:14:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 17:14:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 17:14:17 [DEBUG   ] spawn_process: at 2018-11-15 17:14:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 17:14:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 17:14:17 [DEBUG   ] spawn_process: at 2018-11-15 17:14:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 17:14:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 17:14:39 [DEBUG   ] Got command BAM from MCS: ref #516793
2018-11-15 17:14:39 [INFO    ] Finished processing BAM request
2018-11-15 17:14:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:14:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516793   8 58437 62079033 A  ERROR'
2018-11-15 17:14:39 [DEBUG   ] Got command BAM from MCS: ref #516794
2018-11-15 17:14:39 [INFO    ] Finished processing BAM request
2018-11-15 17:14:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:14:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516794   8 58437 62079037 A  ERROR'
2018-11-15 17:14:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 17:14:39 [DEBUG   ] spawn_process: at 2018-11-15 17:14:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 17:14:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 17:14:39 [DEBUG   ] spawn_process: at 2018-11-15 17:14:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 17:14:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 17:14:39 [DEBUG   ] spawn_process: at 2018-11-15 17:14:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 17:14:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 17:14:39 [DEBUG   ] spawn_process: at 2018-11-15 17:14:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 17:14:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 17:14:39 [DEBUG   ] spawn_process: at 2018-11-15 17:14:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 17:14:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 17:14:39 [DEBUG   ] spawn_process: at 2018-11-15 17:14:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 17:14:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 17:14:39 [DEBUG   ] spawn_process: at 2018-11-15 17:14:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 17:14:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 17:14:39 [DEBUG   ] spawn_process: at 2018-11-15 17:14:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 17:14:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 17:14:39 [DEBUG   ] spawn_process: at 2018-11-15 17:14:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 17:14:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 17:14:39 [DEBUG   ] spawn_process: at 2018-11-15 17:14:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 17:14:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 17:14:39 [DEBUG   ] spawn_process: at 2018-11-15 17:14:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 17:14:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 17:14:39 [DEBUG   ] spawn_process: at 2018-11-15 17:14:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 17:14:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 17:14:39 [DEBUG   ] spawn_process: at 2018-11-15 17:14:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 17:14:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 17:14:39 [DEBUG   ] spawn_process: at 2018-11-15 17:14:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 17:14:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 17:14:39 [DEBUG   ] spawn_process: at 2018-11-15 17:14:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 17:14:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 17:14:39 [DEBUG   ] spawn_process: at 2018-11-15 17:14:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 17:14:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 17:14:39 [DEBUG   ] spawn_process: at 2018-11-15 17:14:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 17:14:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 17:14:39 [DEBUG   ] spawn_process: at 2018-11-15 17:14:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 17:14:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 17:14:39 [DEBUG   ] spawn_process: at 2018-11-15 17:14:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 17:14:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 17:14:39 [DEBUG   ] spawn_process: at 2018-11-15 17:14:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 17:14:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 17:14:39 [DEBUG   ] spawn_process: at 2018-11-15 17:14:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 17:14:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 17:14:39 [DEBUG   ] spawn_process: at 2018-11-15 17:14:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 17:14:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 17:14:39 [DEBUG   ] spawn_process: at 2018-11-15 17:14:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 17:14:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 17:14:39 [DEBUG   ] spawn_process: at 2018-11-15 17:14:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 17:14:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 17:14:39 [DEBUG   ] spawn_process: at 2018-11-15 17:14:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 17:14:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 17:14:39 [DEBUG   ] spawn_process: at 2018-11-15 17:14:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 17:14:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 17:15:00 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-15 17:15:01 [DEBUG   ] Got command BAM from MCS: ref #516795
2018-11-15 17:15:01 [INFO    ] Finished processing BAM request
2018-11-15 17:15:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:15:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516795   8 58437 62101029 A  ERROR'
2018-11-15 17:15:01 [DEBUG   ] Got command BAM from MCS: ref #516796
2018-11-15 17:15:01 [INFO    ] Finished processing BAM request
2018-11-15 17:15:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:15:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516796   8 58437 62101033 A  ERROR'
2018-11-15 17:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 17:15:01 [DEBUG   ] spawn_process: at 2018-11-15 17:15:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 17:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 17:15:01 [DEBUG   ] spawn_process: at 2018-11-15 17:15:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 17:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 17:15:01 [DEBUG   ] spawn_process: at 2018-11-15 17:15:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 17:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 17:15:01 [DEBUG   ] spawn_process: at 2018-11-15 17:15:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 17:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 17:15:01 [DEBUG   ] spawn_process: at 2018-11-15 17:15:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 17:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 17:15:01 [DEBUG   ] spawn_process: at 2018-11-15 17:15:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 17:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 17:15:01 [DEBUG   ] spawn_process: at 2018-11-15 17:15:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 17:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 17:15:01 [DEBUG   ] spawn_process: at 2018-11-15 17:15:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 17:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 17:15:01 [DEBUG   ] spawn_process: at 2018-11-15 17:15:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 17:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 17:15:01 [DEBUG   ] spawn_process: at 2018-11-15 17:15:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 17:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 17:15:01 [DEBUG   ] spawn_process: at 2018-11-15 17:15:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 17:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 17:15:01 [DEBUG   ] spawn_process: at 2018-11-15 17:15:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 17:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 17:15:01 [DEBUG   ] spawn_process: at 2018-11-15 17:15:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 17:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 17:15:01 [DEBUG   ] spawn_process: at 2018-11-15 17:15:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 17:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 17:15:01 [DEBUG   ] spawn_process: at 2018-11-15 17:15:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 17:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 17:15:01 [DEBUG   ] spawn_process: at 2018-11-15 17:15:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 17:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 17:15:01 [DEBUG   ] spawn_process: at 2018-11-15 17:15:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 17:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 17:15:01 [DEBUG   ] spawn_process: at 2018-11-15 17:15:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 17:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 17:15:01 [DEBUG   ] spawn_process: at 2018-11-15 17:15:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 17:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 17:15:01 [DEBUG   ] spawn_process: at 2018-11-15 17:15:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 17:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 17:15:01 [DEBUG   ] spawn_process: at 2018-11-15 17:15:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 17:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 17:15:01 [DEBUG   ] spawn_process: at 2018-11-15 17:15:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 17:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 17:15:01 [DEBUG   ] spawn_process: at 2018-11-15 17:15:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 17:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 17:15:01 [DEBUG   ] spawn_process: at 2018-11-15 17:15:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 17:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 17:15:01 [DEBUG   ] spawn_process: at 2018-11-15 17:15:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 17:15:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 17:15:01 [DEBUG   ] spawn_process: at 2018-11-15 17:15:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 17:15:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:15:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 17:15:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 17:15:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 17:15:05 [WARNING ] (13, 1, 'bot')
2018-11-15 17:15:05 [WARNING ] (13, 1, 'bot')
2018-11-15 17:15:05 [WARNING ] (13, 1, 'bot')
2018-11-15 17:15:05 [WARNING ] (13, 1, 'bot')
2018-11-15 17:15:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:15:05 [DEBUG   ] Finished updating board flags in 0.986 seconds
2018-11-15 17:15:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 17:15:23 [DEBUG   ] Got command BAM from MCS: ref #516798
2018-11-15 17:15:23 [INFO    ] Finished processing BAM request
2018-11-15 17:15:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:15:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516798   8 58437 62123025 A  ERROR'
2018-11-15 17:15:23 [DEBUG   ] Got command BAM from MCS: ref #516797
2018-11-15 17:15:23 [INFO    ] Finished processing BAM request
2018-11-15 17:15:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:15:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516797   8 58437 62123029 A  ERROR'
2018-11-15 17:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 17:15:23 [DEBUG   ] spawn_process: at 2018-11-15 17:15:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 17:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 17:15:23 [DEBUG   ] spawn_process: at 2018-11-15 17:15:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 17:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 17:15:23 [DEBUG   ] spawn_process: at 2018-11-15 17:15:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 17:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 17:15:23 [DEBUG   ] spawn_process: at 2018-11-15 17:15:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 17:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 17:15:23 [DEBUG   ] spawn_process: at 2018-11-15 17:15:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 17:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 17:15:23 [DEBUG   ] spawn_process: at 2018-11-15 17:15:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 17:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 17:15:23 [DEBUG   ] spawn_process: at 2018-11-15 17:15:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 17:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 17:15:23 [DEBUG   ] spawn_process: at 2018-11-15 17:15:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 17:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 17:15:23 [DEBUG   ] spawn_process: at 2018-11-15 17:15:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 17:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 17:15:23 [DEBUG   ] spawn_process: at 2018-11-15 17:15:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 17:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 17:15:23 [DEBUG   ] spawn_process: at 2018-11-15 17:15:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 17:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 17:15:23 [DEBUG   ] spawn_process: at 2018-11-15 17:15:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 17:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 17:15:23 [DEBUG   ] spawn_process: at 2018-11-15 17:15:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 17:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 17:15:23 [DEBUG   ] spawn_process: at 2018-11-15 17:15:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 17:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 17:15:23 [DEBUG   ] spawn_process: at 2018-11-15 17:15:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 17:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 17:15:23 [DEBUG   ] spawn_process: at 2018-11-15 17:15:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 17:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 17:15:23 [DEBUG   ] spawn_process: at 2018-11-15 17:15:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 17:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 17:15:23 [DEBUG   ] spawn_process: at 2018-11-15 17:15:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 17:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 17:15:23 [DEBUG   ] spawn_process: at 2018-11-15 17:15:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 17:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 17:15:23 [DEBUG   ] spawn_process: at 2018-11-15 17:15:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 17:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 17:15:23 [DEBUG   ] spawn_process: at 2018-11-15 17:15:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 17:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 17:15:23 [DEBUG   ] spawn_process: at 2018-11-15 17:15:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 17:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 17:15:23 [DEBUG   ] spawn_process: at 2018-11-15 17:15:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 17:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 17:15:23 [DEBUG   ] spawn_process: at 2018-11-15 17:15:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 17:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 17:15:23 [DEBUG   ] spawn_process: at 2018-11-15 17:15:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 17:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 17:15:23 [DEBUG   ] spawn_process: at 2018-11-15 17:15:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 17:15:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 17:15:45 [DEBUG   ] Got command BAM from MCS: ref #516800
2018-11-15 17:15:45 [INFO    ] Finished processing BAM request
2018-11-15 17:15:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:15:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516800   8 58437 62145025 A  ERROR'
2018-11-15 17:15:45 [DEBUG   ] Got command BAM from MCS: ref #516799
2018-11-15 17:15:45 [INFO    ] Finished processing BAM request
2018-11-15 17:15:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:15:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516799   8 58437 62145029 A  ERROR'
2018-11-15 17:15:45 [DEBUG   ] Got command RPT from MCS: ref #516801
2018-11-15 17:15:45 [DEBUG   ] summary = ERROR
2018-11-15 17:15:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516801  13 58437 62145137 A  ERRORERROR'
2018-11-15 17:15:45 [DEBUG   ] Got command RPT from MCS: ref #516802
2018-11-15 17:15:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 17:15:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516802  77 58437 62145138 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 17:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 17:15:45 [DEBUG   ] spawn_process: at 2018-11-15 17:15:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 17:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 17:15:45 [DEBUG   ] spawn_process: at 2018-11-15 17:15:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 17:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 17:15:45 [DEBUG   ] spawn_process: at 2018-11-15 17:15:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 17:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 17:15:45 [DEBUG   ] spawn_process: at 2018-11-15 17:15:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 17:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 17:15:45 [DEBUG   ] spawn_process: at 2018-11-15 17:15:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 17:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 17:15:45 [DEBUG   ] spawn_process: at 2018-11-15 17:15:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 17:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 17:15:45 [DEBUG   ] spawn_process: at 2018-11-15 17:15:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 17:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 17:15:45 [DEBUG   ] spawn_process: at 2018-11-15 17:15:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 17:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 17:15:45 [DEBUG   ] spawn_process: at 2018-11-15 17:15:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 17:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 17:15:45 [DEBUG   ] spawn_process: at 2018-11-15 17:15:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 17:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 17:15:45 [DEBUG   ] spawn_process: at 2018-11-15 17:15:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 17:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 17:15:45 [DEBUG   ] spawn_process: at 2018-11-15 17:15:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 17:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 17:15:45 [DEBUG   ] spawn_process: at 2018-11-15 17:15:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 17:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 17:15:45 [DEBUG   ] spawn_process: at 2018-11-15 17:15:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 17:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 17:15:45 [DEBUG   ] spawn_process: at 2018-11-15 17:15:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 17:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 17:15:45 [DEBUG   ] spawn_process: at 2018-11-15 17:15:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 17:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 17:15:45 [DEBUG   ] spawn_process: at 2018-11-15 17:15:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 17:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 17:15:45 [DEBUG   ] spawn_process: at 2018-11-15 17:15:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 17:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 17:15:45 [DEBUG   ] spawn_process: at 2018-11-15 17:15:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 17:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 17:15:45 [DEBUG   ] spawn_process: at 2018-11-15 17:15:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 17:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 17:15:45 [DEBUG   ] spawn_process: at 2018-11-15 17:15:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 17:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 17:15:45 [DEBUG   ] spawn_process: at 2018-11-15 17:15:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 17:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 17:15:45 [DEBUG   ] spawn_process: at 2018-11-15 17:15:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 17:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 17:15:45 [DEBUG   ] spawn_process: at 2018-11-15 17:15:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 17:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 17:15:45 [DEBUG   ] spawn_process: at 2018-11-15 17:15:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 17:15:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 17:15:45 [DEBUG   ] spawn_process: at 2018-11-15 17:15:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 17:16:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 17:16:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-11-15 17:16:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:16:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 17:16:05 [WARNING ] (13, 1, 'bot')
2018-11-15 17:16:05 [WARNING ] (13, 1, 'bot')
2018-11-15 17:16:05 [WARNING ] (13, 1, 'bot')
2018-11-15 17:16:05 [WARNING ] (13, 1, 'bot')
2018-11-15 17:16:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:16:05 [DEBUG   ] Finished updating board flags in 1.265 seconds
2018-11-15 17:16:07 [DEBUG   ] Got command BAM from MCS: ref #516818
2018-11-15 17:16:07 [INFO    ] Finished processing BAM request
2018-11-15 17:16:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:16:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516818   8 58437 62167029 A  ERROR'
2018-11-15 17:16:07 [DEBUG   ] Got command BAM from MCS: ref #516819
2018-11-15 17:16:07 [INFO    ] Finished processing BAM request
2018-11-15 17:16:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:16:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516819   8 58437 62167033 A  ERROR'
2018-11-15 17:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 17:16:07 [DEBUG   ] spawn_process: at 2018-11-15 17:16:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 17:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 17:16:07 [DEBUG   ] spawn_process: at 2018-11-15 17:16:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 17:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 17:16:07 [DEBUG   ] spawn_process: at 2018-11-15 17:16:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 17:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 17:16:07 [DEBUG   ] spawn_process: at 2018-11-15 17:16:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 17:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 17:16:07 [DEBUG   ] spawn_process: at 2018-11-15 17:16:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 17:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 17:16:07 [DEBUG   ] spawn_process: at 2018-11-15 17:16:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 17:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 17:16:07 [DEBUG   ] spawn_process: at 2018-11-15 17:16:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 17:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 17:16:07 [DEBUG   ] spawn_process: at 2018-11-15 17:16:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 17:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 17:16:07 [DEBUG   ] spawn_process: at 2018-11-15 17:16:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 17:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 17:16:07 [DEBUG   ] spawn_process: at 2018-11-15 17:16:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 17:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 17:16:07 [DEBUG   ] spawn_process: at 2018-11-15 17:16:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 17:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 17:16:07 [DEBUG   ] spawn_process: at 2018-11-15 17:16:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 17:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 17:16:07 [DEBUG   ] spawn_process: at 2018-11-15 17:16:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 17:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 17:16:07 [DEBUG   ] spawn_process: at 2018-11-15 17:16:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 17:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 17:16:07 [DEBUG   ] spawn_process: at 2018-11-15 17:16:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 17:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 17:16:07 [DEBUG   ] spawn_process: at 2018-11-15 17:16:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 17:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 17:16:07 [DEBUG   ] spawn_process: at 2018-11-15 17:16:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 17:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 17:16:07 [DEBUG   ] spawn_process: at 2018-11-15 17:16:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 17:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 17:16:07 [DEBUG   ] spawn_process: at 2018-11-15 17:16:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 17:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 17:16:07 [DEBUG   ] spawn_process: at 2018-11-15 17:16:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 17:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 17:16:07 [DEBUG   ] spawn_process: at 2018-11-15 17:16:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 17:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 17:16:07 [DEBUG   ] spawn_process: at 2018-11-15 17:16:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 17:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 17:16:07 [DEBUG   ] spawn_process: at 2018-11-15 17:16:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 17:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 17:16:07 [DEBUG   ] spawn_process: at 2018-11-15 17:16:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 17:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 17:16:07 [DEBUG   ] spawn_process: at 2018-11-15 17:16:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 17:16:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 17:16:07 [DEBUG   ] spawn_process: at 2018-11-15 17:16:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 17:16:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 17:16:29 [DEBUG   ] Got command BAM from MCS: ref #516820
2018-11-15 17:16:29 [INFO    ] Finished processing BAM request
2018-11-15 17:16:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:16:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516820   8 58437 62189033 A  ERROR'
2018-11-15 17:16:29 [DEBUG   ] Got command BAM from MCS: ref #516821
2018-11-15 17:16:29 [INFO    ] Finished processing BAM request
2018-11-15 17:16:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:16:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516821   8 58437 62189037 A  ERROR'
2018-11-15 17:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 17:16:29 [DEBUG   ] spawn_process: at 2018-11-15 17:16:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 17:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 17:16:29 [DEBUG   ] spawn_process: at 2018-11-15 17:16:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 17:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 17:16:29 [DEBUG   ] spawn_process: at 2018-11-15 17:16:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 17:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 17:16:29 [DEBUG   ] spawn_process: at 2018-11-15 17:16:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 17:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 17:16:29 [DEBUG   ] spawn_process: at 2018-11-15 17:16:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 17:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 17:16:29 [DEBUG   ] spawn_process: at 2018-11-15 17:16:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 17:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 17:16:29 [DEBUG   ] spawn_process: at 2018-11-15 17:16:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 17:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 17:16:29 [DEBUG   ] spawn_process: at 2018-11-15 17:16:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 17:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 17:16:29 [DEBUG   ] spawn_process: at 2018-11-15 17:16:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 17:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 17:16:29 [DEBUG   ] spawn_process: at 2018-11-15 17:16:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 17:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 17:16:29 [DEBUG   ] spawn_process: at 2018-11-15 17:16:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 17:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 17:16:29 [DEBUG   ] spawn_process: at 2018-11-15 17:16:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 17:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 17:16:29 [DEBUG   ] spawn_process: at 2018-11-15 17:16:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 17:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 17:16:29 [DEBUG   ] spawn_process: at 2018-11-15 17:16:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 17:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 17:16:29 [DEBUG   ] spawn_process: at 2018-11-15 17:16:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 17:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 17:16:29 [DEBUG   ] spawn_process: at 2018-11-15 17:16:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 17:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 17:16:29 [DEBUG   ] spawn_process: at 2018-11-15 17:16:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 17:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 17:16:29 [DEBUG   ] spawn_process: at 2018-11-15 17:16:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 17:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 17:16:29 [DEBUG   ] spawn_process: at 2018-11-15 17:16:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 17:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 17:16:29 [DEBUG   ] spawn_process: at 2018-11-15 17:16:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 17:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 17:16:29 [DEBUG   ] spawn_process: at 2018-11-15 17:16:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 17:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 17:16:29 [DEBUG   ] spawn_process: at 2018-11-15 17:16:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 17:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 17:16:29 [DEBUG   ] spawn_process: at 2018-11-15 17:16:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 17:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 17:16:29 [DEBUG   ] spawn_process: at 2018-11-15 17:16:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 17:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 17:16:29 [DEBUG   ] spawn_process: at 2018-11-15 17:16:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 17:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 17:16:29 [DEBUG   ] spawn_process: at 2018-11-15 17:16:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 17:16:40 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-15 17:16:51 [DEBUG   ] Got command BAM from MCS: ref #516823
2018-11-15 17:16:51 [INFO    ] Finished processing BAM request
2018-11-15 17:16:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:16:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516823   8 58437 62211029 A  ERROR'
2018-11-15 17:16:51 [DEBUG   ] Got command BAM from MCS: ref #516822
2018-11-15 17:16:51 [INFO    ] Finished processing BAM request
2018-11-15 17:16:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:16:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516822   8 58437 62211033 A  ERROR'
2018-11-15 17:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 17:16:51 [DEBUG   ] spawn_process: at 2018-11-15 17:16:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 17:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 17:16:51 [DEBUG   ] spawn_process: at 2018-11-15 17:16:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 17:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 17:16:51 [DEBUG   ] spawn_process: at 2018-11-15 17:16:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 17:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 17:16:51 [DEBUG   ] spawn_process: at 2018-11-15 17:16:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 17:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 17:16:51 [DEBUG   ] spawn_process: at 2018-11-15 17:16:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 17:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 17:16:51 [DEBUG   ] spawn_process: at 2018-11-15 17:16:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 17:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 17:16:51 [DEBUG   ] spawn_process: at 2018-11-15 17:16:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 17:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 17:16:51 [DEBUG   ] spawn_process: at 2018-11-15 17:16:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 17:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 17:16:51 [DEBUG   ] spawn_process: at 2018-11-15 17:16:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 17:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 17:16:51 [DEBUG   ] spawn_process: at 2018-11-15 17:16:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 17:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 17:16:51 [DEBUG   ] spawn_process: at 2018-11-15 17:16:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 17:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 17:16:51 [DEBUG   ] spawn_process: at 2018-11-15 17:16:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 17:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 17:16:51 [DEBUG   ] spawn_process: at 2018-11-15 17:16:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 17:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 17:16:51 [DEBUG   ] spawn_process: at 2018-11-15 17:16:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 17:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 17:16:51 [DEBUG   ] spawn_process: at 2018-11-15 17:16:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 17:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 17:16:51 [DEBUG   ] spawn_process: at 2018-11-15 17:16:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 17:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 17:16:51 [DEBUG   ] spawn_process: at 2018-11-15 17:16:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 17:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 17:16:51 [DEBUG   ] spawn_process: at 2018-11-15 17:16:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 17:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 17:16:51 [DEBUG   ] spawn_process: at 2018-11-15 17:16:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 17:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 17:16:51 [DEBUG   ] spawn_process: at 2018-11-15 17:16:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 17:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 17:16:51 [DEBUG   ] spawn_process: at 2018-11-15 17:16:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 17:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 17:16:51 [DEBUG   ] spawn_process: at 2018-11-15 17:16:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 17:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 17:16:51 [DEBUG   ] spawn_process: at 2018-11-15 17:16:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 17:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 17:16:51 [DEBUG   ] spawn_process: at 2018-11-15 17:16:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 17:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 17:16:51 [DEBUG   ] spawn_process: at 2018-11-15 17:16:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 17:16:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 17:16:51 [DEBUG   ] spawn_process: at 2018-11-15 17:16:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 17:17:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 17:17:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 17:17:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:17:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-15 17:17:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-15 17:17:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 17:17:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 17:17:05 [WARNING ] (13, 1, 'bot')
2018-11-15 17:17:05 [WARNING ] (13, 1, 'bot')
2018-11-15 17:17:05 [WARNING ] (13, 1, 'bot')
2018-11-15 17:17:05 [WARNING ] (13, 1, 'bot')
2018-11-15 17:17:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:17:05 [DEBUG   ] Finished updating board flags in 1.198 seconds
2018-11-15 17:17:13 [DEBUG   ] Got command BAM from MCS: ref #516824
2018-11-15 17:17:13 [INFO    ] Finished processing BAM request
2018-11-15 17:17:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:17:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516824   8 58437 62233025 A  ERROR'
2018-11-15 17:17:13 [DEBUG   ] Got command BAM from MCS: ref #516825
2018-11-15 17:17:13 [INFO    ] Finished processing BAM request
2018-11-15 17:17:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:17:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516825   8 58437 62233029 A  ERROR'
2018-11-15 17:17:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 17:17:13 [DEBUG   ] spawn_process: at 2018-11-15 17:17:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 17:17:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 17:17:13 [DEBUG   ] spawn_process: at 2018-11-15 17:17:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 17:17:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 17:17:13 [DEBUG   ] spawn_process: at 2018-11-15 17:17:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 17:17:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 17:17:13 [DEBUG   ] spawn_process: at 2018-11-15 17:17:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 17:17:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 17:17:13 [DEBUG   ] spawn_process: at 2018-11-15 17:17:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 17:17:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 17:17:13 [DEBUG   ] spawn_process: at 2018-11-15 17:17:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 17:17:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 17:17:13 [DEBUG   ] spawn_process: at 2018-11-15 17:17:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 17:17:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 17:17:13 [DEBUG   ] spawn_process: at 2018-11-15 17:17:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 17:17:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 17:17:13 [DEBUG   ] spawn_process: at 2018-11-15 17:17:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 17:17:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 17:17:13 [DEBUG   ] spawn_process: at 2018-11-15 17:17:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 17:17:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 17:17:13 [DEBUG   ] spawn_process: at 2018-11-15 17:17:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 17:17:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 17:17:13 [DEBUG   ] spawn_process: at 2018-11-15 17:17:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 17:17:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 17:17:13 [DEBUG   ] spawn_process: at 2018-11-15 17:17:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 17:17:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 17:17:13 [DEBUG   ] spawn_process: at 2018-11-15 17:17:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 17:17:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 17:17:13 [DEBUG   ] spawn_process: at 2018-11-15 17:17:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 17:17:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 17:17:13 [DEBUG   ] spawn_process: at 2018-11-15 17:17:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 17:17:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 17:17:13 [DEBUG   ] spawn_process: at 2018-11-15 17:17:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 17:17:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 17:17:13 [DEBUG   ] spawn_process: at 2018-11-15 17:17:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 17:17:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 17:17:13 [DEBUG   ] spawn_process: at 2018-11-15 17:17:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 17:17:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 17:17:13 [DEBUG   ] spawn_process: at 2018-11-15 17:17:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 17:17:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 17:17:13 [DEBUG   ] spawn_process: at 2018-11-15 17:17:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 17:17:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 17:17:13 [DEBUG   ] spawn_process: at 2018-11-15 17:17:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 17:17:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 17:17:13 [DEBUG   ] spawn_process: at 2018-11-15 17:17:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 17:17:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 17:17:13 [DEBUG   ] spawn_process: at 2018-11-15 17:17:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 17:17:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 17:17:13 [DEBUG   ] spawn_process: at 2018-11-15 17:17:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 17:17:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 17:17:13 [DEBUG   ] spawn_process: at 2018-11-15 17:17:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 17:17:20 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2018-11-15 17:17:35 [DEBUG   ] Got command BAM from MCS: ref #516830
2018-11-15 17:17:35 [INFO    ] Finished processing BAM request
2018-11-15 17:17:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516830   8 58437 62255029 A  ERROR'
2018-11-15 17:17:35 [DEBUG   ] Got command BAM from MCS: ref #516831
2018-11-15 17:17:35 [INFO    ] Finished processing BAM request
2018-11-15 17:17:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:17:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516831   8 58437 62255033 A  ERROR'
2018-11-15 17:17:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 17:17:35 [DEBUG   ] spawn_process: at 2018-11-15 17:17:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 17:17:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 17:17:35 [DEBUG   ] spawn_process: at 2018-11-15 17:17:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 17:17:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 17:17:35 [DEBUG   ] spawn_process: at 2018-11-15 17:17:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 17:17:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 17:17:35 [DEBUG   ] spawn_process: at 2018-11-15 17:17:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 17:17:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 17:17:35 [DEBUG   ] spawn_process: at 2018-11-15 17:17:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 17:17:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 17:17:35 [DEBUG   ] spawn_process: at 2018-11-15 17:17:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 17:17:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 17:17:35 [DEBUG   ] spawn_process: at 2018-11-15 17:17:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 17:17:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 17:17:35 [DEBUG   ] spawn_process: at 2018-11-15 17:17:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 17:17:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 17:17:35 [DEBUG   ] spawn_process: at 2018-11-15 17:17:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 17:17:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 17:17:35 [DEBUG   ] spawn_process: at 2018-11-15 17:17:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 17:17:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 17:17:35 [DEBUG   ] spawn_process: at 2018-11-15 17:17:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 17:17:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 17:17:35 [DEBUG   ] spawn_process: at 2018-11-15 17:17:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 17:17:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 17:17:35 [DEBUG   ] spawn_process: at 2018-11-15 17:17:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 17:17:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 17:17:35 [DEBUG   ] spawn_process: at 2018-11-15 17:17:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 17:17:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 17:17:35 [DEBUG   ] spawn_process: at 2018-11-15 17:17:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 17:17:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 17:17:35 [DEBUG   ] spawn_process: at 2018-11-15 17:17:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 17:17:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 17:17:35 [DEBUG   ] spawn_process: at 2018-11-15 17:17:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 17:17:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 17:17:35 [DEBUG   ] spawn_process: at 2018-11-15 17:17:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 17:17:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 17:17:35 [DEBUG   ] spawn_process: at 2018-11-15 17:17:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 17:17:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 17:17:35 [DEBUG   ] spawn_process: at 2018-11-15 17:17:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 17:17:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 17:17:35 [DEBUG   ] spawn_process: at 2018-11-15 17:17:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 17:17:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 17:17:35 [DEBUG   ] spawn_process: at 2018-11-15 17:17:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 17:17:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 17:17:35 [DEBUG   ] spawn_process: at 2018-11-15 17:17:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 17:17:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 17:17:35 [DEBUG   ] spawn_process: at 2018-11-15 17:17:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 17:17:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 17:17:35 [DEBUG   ] spawn_process: at 2018-11-15 17:17:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 17:17:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 17:17:35 [DEBUG   ] spawn_process: at 2018-11-15 17:17:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 17:17:40 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 17:17:57 [DEBUG   ] Got command BAM from MCS: ref #516833
2018-11-15 17:17:57 [INFO    ] Finished processing BAM request
2018-11-15 17:17:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:17:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516833   8 58437 62277025 A  ERROR'
2018-11-15 17:17:57 [DEBUG   ] Got command BAM from MCS: ref #516832
2018-11-15 17:17:57 [INFO    ] Finished processing BAM request
2018-11-15 17:17:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:17:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516832   8 58437 62277029 A  ERROR'
2018-11-15 17:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 17:17:57 [DEBUG   ] spawn_process: at 2018-11-15 17:17:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 17:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 17:17:57 [DEBUG   ] spawn_process: at 2018-11-15 17:17:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 17:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 17:17:57 [DEBUG   ] spawn_process: at 2018-11-15 17:17:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 17:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 17:17:57 [DEBUG   ] spawn_process: at 2018-11-15 17:17:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 17:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 17:17:57 [DEBUG   ] spawn_process: at 2018-11-15 17:17:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 17:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 17:17:57 [DEBUG   ] spawn_process: at 2018-11-15 17:17:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 17:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 17:17:57 [DEBUG   ] spawn_process: at 2018-11-15 17:17:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 17:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 17:17:57 [DEBUG   ] spawn_process: at 2018-11-15 17:17:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 17:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 17:17:57 [DEBUG   ] spawn_process: at 2018-11-15 17:17:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 17:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 17:17:57 [DEBUG   ] spawn_process: at 2018-11-15 17:17:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 17:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 17:17:57 [DEBUG   ] spawn_process: at 2018-11-15 17:17:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 17:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 17:17:57 [DEBUG   ] spawn_process: at 2018-11-15 17:17:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 17:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 17:17:57 [DEBUG   ] spawn_process: at 2018-11-15 17:17:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 17:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 17:17:57 [DEBUG   ] spawn_process: at 2018-11-15 17:17:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 17:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 17:17:57 [DEBUG   ] spawn_process: at 2018-11-15 17:17:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 17:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 17:17:57 [DEBUG   ] spawn_process: at 2018-11-15 17:17:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 17:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 17:17:57 [DEBUG   ] spawn_process: at 2018-11-15 17:17:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 17:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 17:17:57 [DEBUG   ] spawn_process: at 2018-11-15 17:17:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 17:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 17:17:57 [DEBUG   ] spawn_process: at 2018-11-15 17:17:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 17:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 17:17:57 [DEBUG   ] spawn_process: at 2018-11-15 17:17:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 17:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 17:17:57 [DEBUG   ] spawn_process: at 2018-11-15 17:17:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 17:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 17:17:57 [DEBUG   ] spawn_process: at 2018-11-15 17:17:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 17:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 17:17:57 [DEBUG   ] spawn_process: at 2018-11-15 17:17:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 17:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 17:17:57 [DEBUG   ] spawn_process: at 2018-11-15 17:17:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 17:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 17:17:57 [DEBUG   ] spawn_process: at 2018-11-15 17:17:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 17:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 17:17:57 [DEBUG   ] spawn_process: at 2018-11-15 17:17:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 17:18:00 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 17:18:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-15 17:18:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 17:18:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:18:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-15 17:18:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 17:18:05 [WARNING ] (13, 1, 'bot')
2018-11-15 17:18:05 [WARNING ] (13, 1, 'bot')
2018-11-15 17:18:05 [WARNING ] (13, 1, 'bot')
2018-11-15 17:18:05 [WARNING ] (13, 1, 'bot')
2018-11-15 17:18:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:18:05 [DEBUG   ] Finished updating board flags in 1.014 seconds
2018-11-15 17:18:19 [DEBUG   ] Got command BAM from MCS: ref #516836
2018-11-15 17:18:19 [INFO    ] Finished processing BAM request
2018-11-15 17:18:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:18:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516836   8 58437 62299025 A  ERROR'
2018-11-15 17:18:19 [DEBUG   ] Got command BAM from MCS: ref #516837
2018-11-15 17:18:19 [INFO    ] Finished processing BAM request
2018-11-15 17:18:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:18:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516837   8 58437 62299029 A  ERROR'
2018-11-15 17:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 17:18:19 [DEBUG   ] spawn_process: at 2018-11-15 17:18:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 17:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 17:18:19 [DEBUG   ] spawn_process: at 2018-11-15 17:18:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 17:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 17:18:19 [DEBUG   ] spawn_process: at 2018-11-15 17:18:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 17:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 17:18:19 [DEBUG   ] spawn_process: at 2018-11-15 17:18:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 17:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 17:18:19 [DEBUG   ] spawn_process: at 2018-11-15 17:18:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 17:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 17:18:19 [DEBUG   ] spawn_process: at 2018-11-15 17:18:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 17:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 17:18:19 [DEBUG   ] spawn_process: at 2018-11-15 17:18:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 17:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 17:18:19 [DEBUG   ] spawn_process: at 2018-11-15 17:18:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 17:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 17:18:19 [DEBUG   ] spawn_process: at 2018-11-15 17:18:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 17:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 17:18:19 [DEBUG   ] spawn_process: at 2018-11-15 17:18:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 17:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 17:18:19 [DEBUG   ] spawn_process: at 2018-11-15 17:18:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 17:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 17:18:19 [DEBUG   ] spawn_process: at 2018-11-15 17:18:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 17:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 17:18:19 [DEBUG   ] spawn_process: at 2018-11-15 17:18:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 17:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 17:18:19 [DEBUG   ] spawn_process: at 2018-11-15 17:18:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 17:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 17:18:19 [DEBUG   ] spawn_process: at 2018-11-15 17:18:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 17:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 17:18:19 [DEBUG   ] spawn_process: at 2018-11-15 17:18:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 17:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 17:18:19 [DEBUG   ] spawn_process: at 2018-11-15 17:18:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 17:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 17:18:19 [DEBUG   ] spawn_process: at 2018-11-15 17:18:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 17:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 17:18:19 [DEBUG   ] spawn_process: at 2018-11-15 17:18:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 17:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 17:18:19 [DEBUG   ] spawn_process: at 2018-11-15 17:18:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 17:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 17:18:19 [DEBUG   ] spawn_process: at 2018-11-15 17:18:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 17:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 17:18:19 [DEBUG   ] spawn_process: at 2018-11-15 17:18:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 17:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 17:18:19 [DEBUG   ] spawn_process: at 2018-11-15 17:18:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 17:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 17:18:19 [DEBUG   ] spawn_process: at 2018-11-15 17:18:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 17:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 17:18:19 [DEBUG   ] spawn_process: at 2018-11-15 17:18:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 17:18:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 17:18:19 [DEBUG   ] spawn_process: at 2018-11-15 17:18:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 17:18:20 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 17:18:20 [DEBUG   ] Got command RPT from MCS: ref #516838
2018-11-15 17:18:20 [DEBUG   ] summary = ERROR
2018-11-15 17:18:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516838  13 58437 62300361 A  ERRORERROR'
2018-11-15 17:18:20 [DEBUG   ] Got command RPT from MCS: ref #516839
2018-11-15 17:18:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 17:18:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516839  77 58437 62300553 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 17:18:20 [DEBUG   ] Got command RPT from MCS: ref #516840
2018-11-15 17:18:20 [DEBUG   ] summary = ERROR
2018-11-15 17:18:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516840  13 58437 62300757 A  ERRORERROR'
2018-11-15 17:18:20 [DEBUG   ] Got command RPT from MCS: ref #516842
2018-11-15 17:18:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 17:18:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516842  77 58437 62300961 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 17:18:21 [DEBUG   ] Got command RPT from MCS: ref #516843
2018-11-15 17:18:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 17:18:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516843  12 58437 62301165 A  ERRORB£ff'
2018-11-15 17:18:40 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 17:18:41 [DEBUG   ] Got command BAM from MCS: ref #516848
2018-11-15 17:18:41 [INFO    ] Finished processing BAM request
2018-11-15 17:18:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:18:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516848   8 58437 62321033 A  ERROR'
2018-11-15 17:18:41 [DEBUG   ] Got command BAM from MCS: ref #516849
2018-11-15 17:18:41 [INFO    ] Finished processing BAM request
2018-11-15 17:18:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:18:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516849   8 58437 62321037 A  ERROR'
2018-11-15 17:18:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 17:18:41 [DEBUG   ] spawn_process: at 2018-11-15 17:18:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 17:18:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 17:18:41 [DEBUG   ] spawn_process: at 2018-11-15 17:18:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 17:18:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 17:18:41 [DEBUG   ] spawn_process: at 2018-11-15 17:18:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 17:18:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 17:18:41 [DEBUG   ] spawn_process: at 2018-11-15 17:18:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 17:18:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 17:18:41 [DEBUG   ] spawn_process: at 2018-11-15 17:18:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 17:18:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 17:18:41 [DEBUG   ] spawn_process: at 2018-11-15 17:18:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 17:18:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 17:18:41 [DEBUG   ] spawn_process: at 2018-11-15 17:18:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 17:18:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 17:18:41 [DEBUG   ] spawn_process: at 2018-11-15 17:18:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 17:18:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 17:18:41 [DEBUG   ] spawn_process: at 2018-11-15 17:18:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 17:18:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 17:18:41 [DEBUG   ] spawn_process: at 2018-11-15 17:18:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 17:18:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 17:18:41 [DEBUG   ] spawn_process: at 2018-11-15 17:18:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 17:18:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 17:18:41 [DEBUG   ] spawn_process: at 2018-11-15 17:18:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 17:18:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 17:18:41 [DEBUG   ] spawn_process: at 2018-11-15 17:18:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 17:18:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 17:18:41 [DEBUG   ] spawn_process: at 2018-11-15 17:18:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 17:18:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 17:18:41 [DEBUG   ] spawn_process: at 2018-11-15 17:18:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 17:18:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 17:18:41 [DEBUG   ] spawn_process: at 2018-11-15 17:18:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 17:18:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 17:18:41 [DEBUG   ] spawn_process: at 2018-11-15 17:18:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 17:18:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 17:18:41 [DEBUG   ] spawn_process: at 2018-11-15 17:18:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 17:18:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 17:18:41 [DEBUG   ] spawn_process: at 2018-11-15 17:18:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 17:18:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 17:18:41 [DEBUG   ] spawn_process: at 2018-11-15 17:18:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 17:18:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 17:18:41 [DEBUG   ] spawn_process: at 2018-11-15 17:18:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 17:18:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 17:18:41 [DEBUG   ] spawn_process: at 2018-11-15 17:18:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 17:18:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 17:18:41 [DEBUG   ] spawn_process: at 2018-11-15 17:18:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 17:18:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 17:18:41 [DEBUG   ] spawn_process: at 2018-11-15 17:18:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 17:18:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 17:18:41 [DEBUG   ] spawn_process: at 2018-11-15 17:18:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 17:18:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 17:18:41 [DEBUG   ] spawn_process: at 2018-11-15 17:18:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 17:19:00 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 17:19:03 [DEBUG   ] Got command BAM from MCS: ref #516851
2018-11-15 17:19:03 [INFO    ] Finished processing BAM request
2018-11-15 17:19:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:19:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516851   8 58437 62343025 A  ERROR'
2018-11-15 17:19:03 [DEBUG   ] Got command BAM from MCS: ref #516850
2018-11-15 17:19:03 [INFO    ] Finished processing BAM request
2018-11-15 17:19:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:19:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516850   8 58437 62343029 A  ERROR'
2018-11-15 17:19:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 17:19:03 [DEBUG   ] spawn_process: at 2018-11-15 17:19:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 17:19:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 17:19:03 [DEBUG   ] spawn_process: at 2018-11-15 17:19:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 17:19:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 17:19:03 [DEBUG   ] spawn_process: at 2018-11-15 17:19:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 17:19:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 17:19:03 [DEBUG   ] spawn_process: at 2018-11-15 17:19:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 17:19:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 17:19:03 [DEBUG   ] spawn_process: at 2018-11-15 17:19:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 17:19:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 17:19:03 [DEBUG   ] spawn_process: at 2018-11-15 17:19:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 17:19:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 17:19:03 [DEBUG   ] spawn_process: at 2018-11-15 17:19:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 17:19:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 17:19:03 [DEBUG   ] spawn_process: at 2018-11-15 17:19:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 17:19:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 17:19:03 [DEBUG   ] spawn_process: at 2018-11-15 17:19:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 17:19:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 17:19:03 [DEBUG   ] spawn_process: at 2018-11-15 17:19:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 17:19:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 17:19:03 [DEBUG   ] spawn_process: at 2018-11-15 17:19:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 17:19:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 17:19:03 [DEBUG   ] spawn_process: at 2018-11-15 17:19:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 17:19:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 17:19:03 [DEBUG   ] spawn_process: at 2018-11-15 17:19:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 17:19:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 17:19:03 [DEBUG   ] spawn_process: at 2018-11-15 17:19:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 17:19:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 17:19:03 [DEBUG   ] spawn_process: at 2018-11-15 17:19:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 17:19:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 17:19:03 [DEBUG   ] spawn_process: at 2018-11-15 17:19:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 17:19:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 17:19:03 [DEBUG   ] spawn_process: at 2018-11-15 17:19:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 17:19:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 17:19:03 [DEBUG   ] spawn_process: at 2018-11-15 17:19:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 17:19:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 17:19:03 [DEBUG   ] spawn_process: at 2018-11-15 17:19:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 17:19:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 17:19:03 [DEBUG   ] spawn_process: at 2018-11-15 17:19:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 17:19:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 17:19:03 [DEBUG   ] spawn_process: at 2018-11-15 17:19:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 17:19:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 17:19:03 [DEBUG   ] spawn_process: at 2018-11-15 17:19:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 17:19:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 17:19:03 [DEBUG   ] spawn_process: at 2018-11-15 17:19:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 17:19:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 17:19:03 [DEBUG   ] spawn_process: at 2018-11-15 17:19:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 17:19:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 17:19:03 [DEBUG   ] spawn_process: at 2018-11-15 17:19:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 17:19:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 17:19:03 [DEBUG   ] spawn_process: at 2018-11-15 17:19:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 17:19:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 17:19:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:19:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-15 17:19:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 17:19:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 17:19:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 17:19:05 [WARNING ] (13, 1, 'bot')
2018-11-15 17:19:05 [WARNING ] (13, 1, 'bot')
2018-11-15 17:19:05 [WARNING ] (13, 1, 'bot')
2018-11-15 17:19:05 [WARNING ] (13, 1, 'bot')
2018-11-15 17:19:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:19:05 [DEBUG   ] Finished updating board flags in 0.973 seconds
2018-11-15 17:19:20 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 17:19:25 [DEBUG   ] Got command BAM from MCS: ref #516852
2018-11-15 17:19:25 [INFO    ] Finished processing BAM request
2018-11-15 17:19:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:19:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516852   8 58437 62365025 A  ERROR'
2018-11-15 17:19:25 [DEBUG   ] Got command BAM from MCS: ref #516853
2018-11-15 17:19:25 [INFO    ] Finished processing BAM request
2018-11-15 17:19:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:19:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516853   8 58437 62365029 A  ERROR'
2018-11-15 17:19:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 17:19:25 [DEBUG   ] spawn_process: at 2018-11-15 17:19:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 17:19:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 17:19:25 [DEBUG   ] spawn_process: at 2018-11-15 17:19:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 17:19:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 17:19:25 [DEBUG   ] spawn_process: at 2018-11-15 17:19:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 17:19:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 17:19:25 [DEBUG   ] spawn_process: at 2018-11-15 17:19:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 17:19:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 17:19:25 [DEBUG   ] spawn_process: at 2018-11-15 17:19:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 17:19:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 17:19:25 [DEBUG   ] spawn_process: at 2018-11-15 17:19:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 17:19:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 17:19:25 [DEBUG   ] spawn_process: at 2018-11-15 17:19:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 17:19:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 17:19:25 [DEBUG   ] spawn_process: at 2018-11-15 17:19:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 17:19:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 17:19:25 [DEBUG   ] spawn_process: at 2018-11-15 17:19:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 17:19:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 17:19:25 [DEBUG   ] spawn_process: at 2018-11-15 17:19:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 17:19:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 17:19:25 [DEBUG   ] spawn_process: at 2018-11-15 17:19:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 17:19:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 17:19:25 [DEBUG   ] spawn_process: at 2018-11-15 17:19:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 17:19:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 17:19:25 [DEBUG   ] spawn_process: at 2018-11-15 17:19:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 17:19:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 17:19:25 [DEBUG   ] spawn_process: at 2018-11-15 17:19:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 17:19:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 17:19:25 [DEBUG   ] spawn_process: at 2018-11-15 17:19:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 17:19:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 17:19:25 [DEBUG   ] spawn_process: at 2018-11-15 17:19:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 17:19:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 17:19:25 [DEBUG   ] spawn_process: at 2018-11-15 17:19:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 17:19:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 17:19:25 [DEBUG   ] spawn_process: at 2018-11-15 17:19:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 17:19:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 17:19:25 [DEBUG   ] spawn_process: at 2018-11-15 17:19:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 17:19:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 17:19:25 [DEBUG   ] spawn_process: at 2018-11-15 17:19:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 17:19:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 17:19:25 [DEBUG   ] spawn_process: at 2018-11-15 17:19:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 17:19:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 17:19:25 [DEBUG   ] spawn_process: at 2018-11-15 17:19:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 17:19:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 17:19:25 [DEBUG   ] spawn_process: at 2018-11-15 17:19:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 17:19:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 17:19:25 [DEBUG   ] spawn_process: at 2018-11-15 17:19:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 17:19:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 17:19:25 [DEBUG   ] spawn_process: at 2018-11-15 17:19:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 17:19:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 17:19:25 [DEBUG   ] spawn_process: at 2018-11-15 17:19:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 17:19:40 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 17:19:48 [DEBUG   ] Got command BAM from MCS: ref #516855
2018-11-15 17:19:48 [INFO    ] Finished processing BAM request
2018-11-15 17:19:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:19:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516855   8 58437 62388025 A  ERROR'
2018-11-15 17:19:48 [DEBUG   ] Got command BAM from MCS: ref #516854
2018-11-15 17:19:48 [INFO    ] Finished processing BAM request
2018-11-15 17:19:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:19:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516854   8 58437 62388029 A  ERROR'
2018-11-15 17:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 17:19:48 [DEBUG   ] spawn_process: at 2018-11-15 17:19:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 17:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 17:19:48 [DEBUG   ] spawn_process: at 2018-11-15 17:19:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 17:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 17:19:48 [DEBUG   ] spawn_process: at 2018-11-15 17:19:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 17:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 17:19:48 [DEBUG   ] spawn_process: at 2018-11-15 17:19:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 17:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 17:19:48 [DEBUG   ] spawn_process: at 2018-11-15 17:19:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 17:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 17:19:48 [DEBUG   ] spawn_process: at 2018-11-15 17:19:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 17:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 17:19:48 [DEBUG   ] spawn_process: at 2018-11-15 17:19:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 17:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 17:19:48 [DEBUG   ] spawn_process: at 2018-11-15 17:19:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 17:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 17:19:48 [DEBUG   ] spawn_process: at 2018-11-15 17:19:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 17:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 17:19:48 [DEBUG   ] spawn_process: at 2018-11-15 17:19:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 17:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 17:19:48 [DEBUG   ] spawn_process: at 2018-11-15 17:19:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 17:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 17:19:48 [DEBUG   ] spawn_process: at 2018-11-15 17:19:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 17:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 17:19:48 [DEBUG   ] spawn_process: at 2018-11-15 17:19:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 17:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 17:19:48 [DEBUG   ] spawn_process: at 2018-11-15 17:19:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 17:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 17:19:48 [DEBUG   ] spawn_process: at 2018-11-15 17:19:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 17:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 17:19:48 [DEBUG   ] spawn_process: at 2018-11-15 17:19:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 17:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 17:19:48 [DEBUG   ] spawn_process: at 2018-11-15 17:19:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 17:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 17:19:48 [DEBUG   ] spawn_process: at 2018-11-15 17:19:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 17:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 17:19:48 [DEBUG   ] spawn_process: at 2018-11-15 17:19:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 17:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 17:19:48 [DEBUG   ] spawn_process: at 2018-11-15 17:19:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 17:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 17:19:48 [DEBUG   ] spawn_process: at 2018-11-15 17:19:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 17:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 17:19:48 [DEBUG   ] spawn_process: at 2018-11-15 17:19:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 17:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 17:19:48 [DEBUG   ] spawn_process: at 2018-11-15 17:19:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 17:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 17:19:48 [DEBUG   ] spawn_process: at 2018-11-15 17:19:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 17:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 17:19:48 [DEBUG   ] spawn_process: at 2018-11-15 17:19:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 17:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 17:19:48 [DEBUG   ] spawn_process: at 2018-11-15 17:19:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 17:20:00 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 17:20:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:20:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 17:20:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 17:20:06 [WARNING ] (13, 1, 'bot')
2018-11-15 17:20:06 [WARNING ] (13, 1, 'bot')
2018-11-15 17:20:06 [WARNING ] (13, 1, 'bot')
2018-11-15 17:20:06 [WARNING ] (13, 1, 'bot')
2018-11-15 17:20:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:20:06 [DEBUG   ] Finished updating board flags in 1.377 seconds
2018-11-15 17:20:11 [DEBUG   ] Got command BAM from MCS: ref #516856
2018-11-15 17:20:11 [INFO    ] Finished processing BAM request
2018-11-15 17:20:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:20:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516856   8 58437 62411033 A  ERROR'
2018-11-15 17:20:11 [DEBUG   ] Got command BAM from MCS: ref #516857
2018-11-15 17:20:11 [INFO    ] Finished processing BAM request
2018-11-15 17:20:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:20:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516857   8 58437 62411037 A  ERROR'
2018-11-15 17:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 17:20:11 [DEBUG   ] spawn_process: at 2018-11-15 17:20:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 17:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 17:20:11 [DEBUG   ] spawn_process: at 2018-11-15 17:20:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 17:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 17:20:11 [DEBUG   ] spawn_process: at 2018-11-15 17:20:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 17:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 17:20:11 [DEBUG   ] spawn_process: at 2018-11-15 17:20:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 17:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 17:20:11 [DEBUG   ] spawn_process: at 2018-11-15 17:20:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 17:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 17:20:11 [DEBUG   ] spawn_process: at 2018-11-15 17:20:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 17:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 17:20:11 [DEBUG   ] spawn_process: at 2018-11-15 17:20:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 17:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 17:20:11 [DEBUG   ] spawn_process: at 2018-11-15 17:20:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 17:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 17:20:11 [DEBUG   ] spawn_process: at 2018-11-15 17:20:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 17:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 17:20:11 [DEBUG   ] spawn_process: at 2018-11-15 17:20:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 17:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 17:20:11 [DEBUG   ] spawn_process: at 2018-11-15 17:20:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 17:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 17:20:11 [DEBUG   ] spawn_process: at 2018-11-15 17:20:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 17:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 17:20:11 [DEBUG   ] spawn_process: at 2018-11-15 17:20:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 17:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 17:20:11 [DEBUG   ] spawn_process: at 2018-11-15 17:20:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 17:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 17:20:11 [DEBUG   ] spawn_process: at 2018-11-15 17:20:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 17:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 17:20:11 [DEBUG   ] spawn_process: at 2018-11-15 17:20:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 17:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 17:20:11 [DEBUG   ] spawn_process: at 2018-11-15 17:20:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 17:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 17:20:11 [DEBUG   ] spawn_process: at 2018-11-15 17:20:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 17:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 17:20:11 [DEBUG   ] spawn_process: at 2018-11-15 17:20:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 17:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 17:20:11 [DEBUG   ] spawn_process: at 2018-11-15 17:20:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 17:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 17:20:11 [DEBUG   ] spawn_process: at 2018-11-15 17:20:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 17:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 17:20:11 [DEBUG   ] spawn_process: at 2018-11-15 17:20:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 17:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 17:20:11 [DEBUG   ] spawn_process: at 2018-11-15 17:20:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 17:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 17:20:11 [DEBUG   ] spawn_process: at 2018-11-15 17:20:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 17:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 17:20:11 [DEBUG   ] spawn_process: at 2018-11-15 17:20:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 17:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 17:20:11 [DEBUG   ] spawn_process: at 2018-11-15 17:20:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 17:20:20 [DEBUG   ] Finished updating ant stats in 0.390 seconds
2018-11-15 17:20:34 [DEBUG   ] Got command BAM from MCS: ref #516863
2018-11-15 17:20:34 [INFO    ] Finished processing BAM request
2018-11-15 17:20:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:20:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516863   8 58437 62434033 A  ERROR'
2018-11-15 17:20:34 [DEBUG   ] Got command BAM from MCS: ref #516862
2018-11-15 17:20:34 [INFO    ] Finished processing BAM request
2018-11-15 17:20:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:20:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516862   8 58437 62434037 A  ERROR'
2018-11-15 17:20:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 17:20:34 [DEBUG   ] spawn_process: at 2018-11-15 17:20:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 17:20:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 17:20:34 [DEBUG   ] spawn_process: at 2018-11-15 17:20:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 17:20:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 17:20:34 [DEBUG   ] spawn_process: at 2018-11-15 17:20:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 17:20:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 17:20:34 [DEBUG   ] spawn_process: at 2018-11-15 17:20:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 17:20:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 17:20:34 [DEBUG   ] spawn_process: at 2018-11-15 17:20:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 17:20:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 17:20:34 [DEBUG   ] spawn_process: at 2018-11-15 17:20:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 17:20:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 17:20:34 [DEBUG   ] spawn_process: at 2018-11-15 17:20:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 17:20:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 17:20:34 [DEBUG   ] spawn_process: at 2018-11-15 17:20:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 17:20:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 17:20:34 [DEBUG   ] spawn_process: at 2018-11-15 17:20:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 17:20:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 17:20:34 [DEBUG   ] spawn_process: at 2018-11-15 17:20:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 17:20:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 17:20:34 [DEBUG   ] spawn_process: at 2018-11-15 17:20:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 17:20:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 17:20:34 [DEBUG   ] spawn_process: at 2018-11-15 17:20:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 17:20:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 17:20:34 [DEBUG   ] spawn_process: at 2018-11-15 17:20:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 17:20:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 17:20:34 [DEBUG   ] spawn_process: at 2018-11-15 17:20:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 17:20:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 17:20:34 [DEBUG   ] spawn_process: at 2018-11-15 17:20:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 17:20:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 17:20:34 [DEBUG   ] spawn_process: at 2018-11-15 17:20:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 17:20:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 17:20:34 [DEBUG   ] spawn_process: at 2018-11-15 17:20:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 17:20:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 17:20:34 [DEBUG   ] spawn_process: at 2018-11-15 17:20:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 17:20:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 17:20:34 [DEBUG   ] spawn_process: at 2018-11-15 17:20:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 17:20:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 17:20:34 [DEBUG   ] spawn_process: at 2018-11-15 17:20:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 17:20:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 17:20:34 [DEBUG   ] spawn_process: at 2018-11-15 17:20:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 17:20:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 17:20:34 [DEBUG   ] spawn_process: at 2018-11-15 17:20:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 17:20:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 17:20:34 [DEBUG   ] spawn_process: at 2018-11-15 17:20:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 17:20:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 17:20:34 [DEBUG   ] spawn_process: at 2018-11-15 17:20:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 17:20:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 17:20:34 [DEBUG   ] spawn_process: at 2018-11-15 17:20:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 17:20:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 17:20:34 [DEBUG   ] spawn_process: at 2018-11-15 17:20:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 17:20:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 17:20:45 [DEBUG   ] Got command RPT from MCS: ref #516864
2018-11-15 17:20:45 [DEBUG   ] summary = ERROR
2018-11-15 17:20:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516864  13 58437 62445149 A  ERRORERROR'
2018-11-15 17:20:45 [DEBUG   ] Got command RPT from MCS: ref #516865
2018-11-15 17:20:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 17:20:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516865  77 58437 62445150 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 17:20:57 [DEBUG   ] Got command BAM from MCS: ref #516881
2018-11-15 17:20:57 [INFO    ] Finished processing BAM request
2018-11-15 17:20:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:20:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516881   8 58437 62457033 A  ERROR'
2018-11-15 17:20:57 [DEBUG   ] Got command BAM from MCS: ref #516882
2018-11-15 17:20:57 [INFO    ] Finished processing BAM request
2018-11-15 17:20:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:20:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516882   8 58437 62457037 A  ERROR'
2018-11-15 17:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 17:20:57 [DEBUG   ] spawn_process: at 2018-11-15 17:20:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 17:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 17:20:57 [DEBUG   ] spawn_process: at 2018-11-15 17:20:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 17:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 17:20:57 [DEBUG   ] spawn_process: at 2018-11-15 17:20:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 17:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 17:20:57 [DEBUG   ] spawn_process: at 2018-11-15 17:20:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 17:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 17:20:57 [DEBUG   ] spawn_process: at 2018-11-15 17:20:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 17:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 17:20:57 [DEBUG   ] spawn_process: at 2018-11-15 17:20:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 17:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 17:20:57 [DEBUG   ] spawn_process: at 2018-11-15 17:20:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 17:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 17:20:57 [DEBUG   ] spawn_process: at 2018-11-15 17:20:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 17:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 17:20:57 [DEBUG   ] spawn_process: at 2018-11-15 17:20:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 17:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 17:20:57 [DEBUG   ] spawn_process: at 2018-11-15 17:20:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 17:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 17:20:57 [DEBUG   ] spawn_process: at 2018-11-15 17:20:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 17:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 17:20:57 [DEBUG   ] spawn_process: at 2018-11-15 17:20:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 17:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 17:20:57 [DEBUG   ] spawn_process: at 2018-11-15 17:20:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 17:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 17:20:57 [DEBUG   ] spawn_process: at 2018-11-15 17:20:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 17:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 17:20:57 [DEBUG   ] spawn_process: at 2018-11-15 17:20:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 17:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 17:20:57 [DEBUG   ] spawn_process: at 2018-11-15 17:20:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 17:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 17:20:57 [DEBUG   ] spawn_process: at 2018-11-15 17:20:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 17:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 17:20:57 [DEBUG   ] spawn_process: at 2018-11-15 17:20:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 17:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 17:20:57 [DEBUG   ] spawn_process: at 2018-11-15 17:20:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 17:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 17:20:57 [DEBUG   ] spawn_process: at 2018-11-15 17:20:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 17:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 17:20:57 [DEBUG   ] spawn_process: at 2018-11-15 17:20:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 17:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 17:20:57 [DEBUG   ] spawn_process: at 2018-11-15 17:20:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 17:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 17:20:57 [DEBUG   ] spawn_process: at 2018-11-15 17:20:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 17:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 17:20:57 [DEBUG   ] spawn_process: at 2018-11-15 17:20:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 17:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 17:20:57 [DEBUG   ] spawn_process: at 2018-11-15 17:20:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 17:20:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 17:20:57 [DEBUG   ] spawn_process: at 2018-11-15 17:20:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 17:21:01 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-15 17:21:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:21:06 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-15 17:21:06 [WARNING ] (13, 1, 'bot')
2018-11-15 17:21:06 [WARNING ] (13, 1, 'bot')
2018-11-15 17:21:06 [WARNING ] (13, 1, 'bot')
2018-11-15 17:21:06 [WARNING ] (13, 1, 'bot')
2018-11-15 17:21:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:21:06 [DEBUG   ] Finished updating board flags in 1.187 seconds
2018-11-15 17:21:20 [DEBUG   ] Got command BAM from MCS: ref #516884
2018-11-15 17:21:20 [INFO    ] Finished processing BAM request
2018-11-15 17:21:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:21:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516884   8 58437 62480025 A  ERROR'
2018-11-15 17:21:20 [DEBUG   ] Got command BAM from MCS: ref #516883
2018-11-15 17:21:20 [INFO    ] Finished processing BAM request
2018-11-15 17:21:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:21:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516883   8 58437 62480029 A  ERROR'
2018-11-15 17:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 17:21:20 [DEBUG   ] spawn_process: at 2018-11-15 17:21:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 17:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 17:21:20 [DEBUG   ] spawn_process: at 2018-11-15 17:21:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 17:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 17:21:20 [DEBUG   ] spawn_process: at 2018-11-15 17:21:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 17:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 17:21:20 [DEBUG   ] spawn_process: at 2018-11-15 17:21:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 17:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 17:21:20 [DEBUG   ] spawn_process: at 2018-11-15 17:21:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 17:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 17:21:20 [DEBUG   ] spawn_process: at 2018-11-15 17:21:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 17:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 17:21:20 [DEBUG   ] spawn_process: at 2018-11-15 17:21:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 17:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 17:21:20 [DEBUG   ] spawn_process: at 2018-11-15 17:21:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 17:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 17:21:20 [DEBUG   ] spawn_process: at 2018-11-15 17:21:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 17:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 17:21:20 [DEBUG   ] spawn_process: at 2018-11-15 17:21:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 17:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 17:21:20 [DEBUG   ] spawn_process: at 2018-11-15 17:21:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 17:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 17:21:20 [DEBUG   ] spawn_process: at 2018-11-15 17:21:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 17:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 17:21:20 [DEBUG   ] spawn_process: at 2018-11-15 17:21:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 17:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 17:21:20 [DEBUG   ] spawn_process: at 2018-11-15 17:21:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 17:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 17:21:20 [DEBUG   ] spawn_process: at 2018-11-15 17:21:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 17:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 17:21:20 [DEBUG   ] spawn_process: at 2018-11-15 17:21:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 17:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 17:21:20 [DEBUG   ] spawn_process: at 2018-11-15 17:21:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 17:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 17:21:20 [DEBUG   ] spawn_process: at 2018-11-15 17:21:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 17:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 17:21:20 [DEBUG   ] spawn_process: at 2018-11-15 17:21:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 17:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 17:21:20 [DEBUG   ] spawn_process: at 2018-11-15 17:21:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 17:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 17:21:20 [DEBUG   ] spawn_process: at 2018-11-15 17:21:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 17:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 17:21:20 [DEBUG   ] spawn_process: at 2018-11-15 17:21:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 17:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 17:21:20 [DEBUG   ] spawn_process: at 2018-11-15 17:21:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 17:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 17:21:20 [DEBUG   ] spawn_process: at 2018-11-15 17:21:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 17:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 17:21:20 [DEBUG   ] spawn_process: at 2018-11-15 17:21:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 17:21:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 17:21:20 [DEBUG   ] spawn_process: at 2018-11-15 17:21:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 17:21:21 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 17:21:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 17:21:43 [DEBUG   ] Got command BAM from MCS: ref #516885
2018-11-15 17:21:43 [INFO    ] Finished processing BAM request
2018-11-15 17:21:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:21:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516885   8 58437 62503025 A  ERROR'
2018-11-15 17:21:43 [DEBUG   ] Got command BAM from MCS: ref #516886
2018-11-15 17:21:43 [INFO    ] Finished processing BAM request
2018-11-15 17:21:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:21:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516886   8 58437 62503029 A  ERROR'
2018-11-15 17:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 17:21:43 [DEBUG   ] spawn_process: at 2018-11-15 17:21:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 17:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 17:21:43 [DEBUG   ] spawn_process: at 2018-11-15 17:21:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 17:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 17:21:43 [DEBUG   ] spawn_process: at 2018-11-15 17:21:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 17:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 17:21:43 [DEBUG   ] spawn_process: at 2018-11-15 17:21:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 17:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 17:21:43 [DEBUG   ] spawn_process: at 2018-11-15 17:21:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 17:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 17:21:43 [DEBUG   ] spawn_process: at 2018-11-15 17:21:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 17:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 17:21:43 [DEBUG   ] spawn_process: at 2018-11-15 17:21:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 17:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 17:21:43 [DEBUG   ] spawn_process: at 2018-11-15 17:21:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 17:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 17:21:43 [DEBUG   ] spawn_process: at 2018-11-15 17:21:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 17:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 17:21:43 [DEBUG   ] spawn_process: at 2018-11-15 17:21:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 17:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 17:21:43 [DEBUG   ] spawn_process: at 2018-11-15 17:21:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 17:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 17:21:43 [DEBUG   ] spawn_process: at 2018-11-15 17:21:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 17:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 17:21:43 [DEBUG   ] spawn_process: at 2018-11-15 17:21:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 17:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 17:21:43 [DEBUG   ] spawn_process: at 2018-11-15 17:21:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 17:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 17:21:43 [DEBUG   ] spawn_process: at 2018-11-15 17:21:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 17:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 17:21:43 [DEBUG   ] spawn_process: at 2018-11-15 17:21:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 17:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 17:21:43 [DEBUG   ] spawn_process: at 2018-11-15 17:21:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 17:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 17:21:43 [DEBUG   ] spawn_process: at 2018-11-15 17:21:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 17:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 17:21:43 [DEBUG   ] spawn_process: at 2018-11-15 17:21:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 17:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 17:21:43 [DEBUG   ] spawn_process: at 2018-11-15 17:21:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 17:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 17:21:43 [DEBUG   ] spawn_process: at 2018-11-15 17:21:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 17:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 17:21:43 [DEBUG   ] spawn_process: at 2018-11-15 17:21:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 17:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 17:21:43 [DEBUG   ] spawn_process: at 2018-11-15 17:21:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 17:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 17:21:43 [DEBUG   ] spawn_process: at 2018-11-15 17:21:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 17:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 17:21:43 [DEBUG   ] spawn_process: at 2018-11-15 17:21:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 17:21:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 17:21:43 [DEBUG   ] spawn_process: at 2018-11-15 17:21:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 17:22:01 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 17:22:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 17:22:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:22:06 [DEBUG   ] Got command BAM from MCS: ref #516888
2018-11-15 17:22:06 [INFO    ] Finished processing BAM request
2018-11-15 17:22:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:22:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516888   8 58437 62526029 A  ERROR'
2018-11-15 17:22:06 [DEBUG   ] Got command BAM from MCS: ref #516887
2018-11-15 17:22:06 [INFO    ] Finished processing BAM request
2018-11-15 17:22:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:22:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516887   8 58437 62526037 A  ERROR'
2018-11-15 17:22:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-11-15 17:22:06 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-15 17:22:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 17:22:06 [WARNING ] (13, 1, 'bot')
2018-11-15 17:22:06 [WARNING ] (13, 1, 'bot')
2018-11-15 17:22:06 [WARNING ] (13, 1, 'bot')
2018-11-15 17:22:06 [WARNING ] (13, 1, 'bot')
2018-11-15 17:22:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:22:06 [DEBUG   ] Finished updating board flags in 1.003 seconds
2018-11-15 17:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 17:22:06 [DEBUG   ] spawn_process: at 2018-11-15 17:22:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 17:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 17:22:06 [DEBUG   ] spawn_process: at 2018-11-15 17:22:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 17:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 17:22:06 [DEBUG   ] spawn_process: at 2018-11-15 17:22:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 17:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 17:22:06 [DEBUG   ] spawn_process: at 2018-11-15 17:22:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 17:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 17:22:06 [DEBUG   ] spawn_process: at 2018-11-15 17:22:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 17:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 17:22:06 [DEBUG   ] spawn_process: at 2018-11-15 17:22:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 17:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 17:22:06 [DEBUG   ] spawn_process: at 2018-11-15 17:22:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 17:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 17:22:06 [DEBUG   ] spawn_process: at 2018-11-15 17:22:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 17:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 17:22:06 [DEBUG   ] spawn_process: at 2018-11-15 17:22:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 17:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 17:22:06 [DEBUG   ] spawn_process: at 2018-11-15 17:22:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 17:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 17:22:06 [DEBUG   ] spawn_process: at 2018-11-15 17:22:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 17:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 17:22:06 [DEBUG   ] spawn_process: at 2018-11-15 17:22:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 17:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 17:22:06 [DEBUG   ] spawn_process: at 2018-11-15 17:22:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 17:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 17:22:06 [DEBUG   ] spawn_process: at 2018-11-15 17:22:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 17:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 17:22:06 [DEBUG   ] spawn_process: at 2018-11-15 17:22:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 17:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 17:22:06 [DEBUG   ] spawn_process: at 2018-11-15 17:22:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 17:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 17:22:06 [DEBUG   ] spawn_process: at 2018-11-15 17:22:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 17:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 17:22:06 [DEBUG   ] spawn_process: at 2018-11-15 17:22:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 17:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 17:22:06 [DEBUG   ] spawn_process: at 2018-11-15 17:22:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 17:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 17:22:06 [DEBUG   ] spawn_process: at 2018-11-15 17:22:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 17:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 17:22:06 [DEBUG   ] spawn_process: at 2018-11-15 17:22:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 17:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 17:22:06 [DEBUG   ] spawn_process: at 2018-11-15 17:22:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 17:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 17:22:06 [DEBUG   ] spawn_process: at 2018-11-15 17:22:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 17:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 17:22:06 [DEBUG   ] spawn_process: at 2018-11-15 17:22:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 17:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 17:22:06 [DEBUG   ] spawn_process: at 2018-11-15 17:22:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 17:22:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 17:22:06 [DEBUG   ] spawn_process: at 2018-11-15 17:22:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 17:22:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 17:22:29 [DEBUG   ] Got command BAM from MCS: ref #516890
2018-11-15 17:22:29 [INFO    ] Finished processing BAM request
2018-11-15 17:22:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:22:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516890   8 58437 62549025 A  ERROR'
2018-11-15 17:22:29 [DEBUG   ] Got command BAM from MCS: ref #516889
2018-11-15 17:22:29 [INFO    ] Finished processing BAM request
2018-11-15 17:22:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:22:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516889   8 58437 62549029 A  ERROR'
2018-11-15 17:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 17:22:29 [DEBUG   ] spawn_process: at 2018-11-15 17:22:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 17:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 17:22:29 [DEBUG   ] spawn_process: at 2018-11-15 17:22:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 17:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 17:22:29 [DEBUG   ] spawn_process: at 2018-11-15 17:22:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 17:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 17:22:29 [DEBUG   ] spawn_process: at 2018-11-15 17:22:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 17:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 17:22:29 [DEBUG   ] spawn_process: at 2018-11-15 17:22:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 17:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 17:22:29 [DEBUG   ] spawn_process: at 2018-11-15 17:22:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 17:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 17:22:29 [DEBUG   ] spawn_process: at 2018-11-15 17:22:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 17:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 17:22:29 [DEBUG   ] spawn_process: at 2018-11-15 17:22:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 17:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 17:22:29 [DEBUG   ] spawn_process: at 2018-11-15 17:22:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 17:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 17:22:29 [DEBUG   ] spawn_process: at 2018-11-15 17:22:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 17:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 17:22:29 [DEBUG   ] spawn_process: at 2018-11-15 17:22:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 17:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 17:22:29 [DEBUG   ] spawn_process: at 2018-11-15 17:22:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 17:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 17:22:29 [DEBUG   ] spawn_process: at 2018-11-15 17:22:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 17:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 17:22:29 [DEBUG   ] spawn_process: at 2018-11-15 17:22:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 17:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 17:22:29 [DEBUG   ] spawn_process: at 2018-11-15 17:22:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 17:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 17:22:29 [DEBUG   ] spawn_process: at 2018-11-15 17:22:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 17:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 17:22:29 [DEBUG   ] spawn_process: at 2018-11-15 17:22:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 17:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 17:22:29 [DEBUG   ] spawn_process: at 2018-11-15 17:22:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 17:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 17:22:29 [DEBUG   ] spawn_process: at 2018-11-15 17:22:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 17:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 17:22:29 [DEBUG   ] spawn_process: at 2018-11-15 17:22:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 17:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 17:22:29 [DEBUG   ] spawn_process: at 2018-11-15 17:22:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 17:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 17:22:29 [DEBUG   ] spawn_process: at 2018-11-15 17:22:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 17:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 17:22:29 [DEBUG   ] spawn_process: at 2018-11-15 17:22:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 17:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 17:22:29 [DEBUG   ] spawn_process: at 2018-11-15 17:22:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 17:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 17:22:29 [DEBUG   ] spawn_process: at 2018-11-15 17:22:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 17:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 17:22:29 [DEBUG   ] spawn_process: at 2018-11-15 17:22:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 17:22:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 17:22:52 [DEBUG   ] Got command BAM from MCS: ref #516892
2018-11-15 17:22:52 [INFO    ] Finished processing BAM request
2018-11-15 17:22:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:22:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516892   8 58437 62572049 A  ERROR'
2018-11-15 17:22:52 [DEBUG   ] Got command BAM from MCS: ref #516891
2018-11-15 17:22:52 [INFO    ] Finished processing BAM request
2018-11-15 17:22:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:22:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516891   8 58437 62572057 A  ERROR'
2018-11-15 17:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 17:22:52 [DEBUG   ] spawn_process: at 2018-11-15 17:22:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 17:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 17:22:52 [DEBUG   ] spawn_process: at 2018-11-15 17:22:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 17:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 17:22:52 [DEBUG   ] spawn_process: at 2018-11-15 17:22:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 17:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 17:22:52 [DEBUG   ] spawn_process: at 2018-11-15 17:22:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 17:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 17:22:52 [DEBUG   ] spawn_process: at 2018-11-15 17:22:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 17:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 17:22:52 [DEBUG   ] spawn_process: at 2018-11-15 17:22:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 17:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 17:22:52 [DEBUG   ] spawn_process: at 2018-11-15 17:22:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 17:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 17:22:52 [DEBUG   ] spawn_process: at 2018-11-15 17:22:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 17:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 17:22:52 [DEBUG   ] spawn_process: at 2018-11-15 17:22:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 17:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 17:22:52 [DEBUG   ] spawn_process: at 2018-11-15 17:22:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 17:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 17:22:52 [DEBUG   ] spawn_process: at 2018-11-15 17:22:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 17:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 17:22:52 [DEBUG   ] spawn_process: at 2018-11-15 17:22:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 17:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 17:22:52 [DEBUG   ] spawn_process: at 2018-11-15 17:22:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 17:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 17:22:52 [DEBUG   ] spawn_process: at 2018-11-15 17:22:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 17:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 17:22:52 [DEBUG   ] spawn_process: at 2018-11-15 17:22:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 17:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 17:22:52 [DEBUG   ] spawn_process: at 2018-11-15 17:22:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 17:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 17:22:52 [DEBUG   ] spawn_process: at 2018-11-15 17:22:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 17:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 17:22:52 [DEBUG   ] spawn_process: at 2018-11-15 17:22:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 17:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 17:22:52 [DEBUG   ] spawn_process: at 2018-11-15 17:22:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 17:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 17:22:52 [DEBUG   ] spawn_process: at 2018-11-15 17:22:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 17:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 17:22:52 [DEBUG   ] spawn_process: at 2018-11-15 17:22:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 17:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 17:22:52 [DEBUG   ] spawn_process: at 2018-11-15 17:22:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 17:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 17:22:52 [DEBUG   ] spawn_process: at 2018-11-15 17:22:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 17:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 17:22:52 [DEBUG   ] spawn_process: at 2018-11-15 17:22:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 17:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 17:22:52 [DEBUG   ] spawn_process: at 2018-11-15 17:22:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 17:22:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 17:22:52 [DEBUG   ] spawn_process: at 2018-11-15 17:22:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 17:23:01 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-15 17:23:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 17:23:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 17:23:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:23:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-15 17:23:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 17:23:06 [WARNING ] (13, 1, 'bot')
2018-11-15 17:23:06 [WARNING ] (13, 1, 'bot')
2018-11-15 17:23:06 [WARNING ] (13, 1, 'bot')
2018-11-15 17:23:06 [WARNING ] (13, 1, 'bot')
2018-11-15 17:23:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:23:06 [DEBUG   ] Finished updating board flags in 1.005 seconds
2018-11-15 17:23:15 [DEBUG   ] Got command BAM from MCS: ref #516894
2018-11-15 17:23:15 [INFO    ] Finished processing BAM request
2018-11-15 17:23:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:23:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516894   8 58437 62595029 A  ERROR'
2018-11-15 17:23:15 [DEBUG   ] Got command BAM from MCS: ref #516893
2018-11-15 17:23:15 [INFO    ] Finished processing BAM request
2018-11-15 17:23:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:23:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516893   8 58437 62595033 A  ERROR'
2018-11-15 17:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 17:23:15 [DEBUG   ] spawn_process: at 2018-11-15 17:23:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 17:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 17:23:15 [DEBUG   ] spawn_process: at 2018-11-15 17:23:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 17:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 17:23:15 [DEBUG   ] spawn_process: at 2018-11-15 17:23:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 17:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 17:23:15 [DEBUG   ] spawn_process: at 2018-11-15 17:23:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 17:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 17:23:15 [DEBUG   ] spawn_process: at 2018-11-15 17:23:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 17:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 17:23:15 [DEBUG   ] spawn_process: at 2018-11-15 17:23:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 17:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 17:23:15 [DEBUG   ] spawn_process: at 2018-11-15 17:23:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 17:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 17:23:15 [DEBUG   ] spawn_process: at 2018-11-15 17:23:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 17:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 17:23:15 [DEBUG   ] spawn_process: at 2018-11-15 17:23:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 17:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 17:23:15 [DEBUG   ] spawn_process: at 2018-11-15 17:23:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 17:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 17:23:15 [DEBUG   ] spawn_process: at 2018-11-15 17:23:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 17:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 17:23:15 [DEBUG   ] spawn_process: at 2018-11-15 17:23:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 17:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 17:23:15 [DEBUG   ] spawn_process: at 2018-11-15 17:23:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 17:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 17:23:15 [DEBUG   ] spawn_process: at 2018-11-15 17:23:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 17:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 17:23:15 [DEBUG   ] spawn_process: at 2018-11-15 17:23:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 17:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 17:23:15 [DEBUG   ] spawn_process: at 2018-11-15 17:23:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 17:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 17:23:15 [DEBUG   ] spawn_process: at 2018-11-15 17:23:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 17:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 17:23:15 [DEBUG   ] spawn_process: at 2018-11-15 17:23:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 17:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 17:23:15 [DEBUG   ] spawn_process: at 2018-11-15 17:23:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 17:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 17:23:15 [DEBUG   ] spawn_process: at 2018-11-15 17:23:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 17:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 17:23:15 [DEBUG   ] spawn_process: at 2018-11-15 17:23:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 17:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 17:23:15 [DEBUG   ] spawn_process: at 2018-11-15 17:23:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 17:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 17:23:15 [DEBUG   ] spawn_process: at 2018-11-15 17:23:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 17:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 17:23:15 [DEBUG   ] spawn_process: at 2018-11-15 17:23:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 17:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 17:23:15 [DEBUG   ] spawn_process: at 2018-11-15 17:23:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 17:23:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 17:23:15 [DEBUG   ] spawn_process: at 2018-11-15 17:23:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 17:23:20 [DEBUG   ] Got command RPT from MCS: ref #516895
2018-11-15 17:23:20 [DEBUG   ] summary = ERROR
2018-11-15 17:23:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516895  13 58437 62600437 A  ERRORERROR'
2018-11-15 17:23:20 [DEBUG   ] Got command RPT from MCS: ref #516896
2018-11-15 17:23:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 17:23:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516896  77 58437 62600641 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 17:23:20 [DEBUG   ] Got command RPT from MCS: ref #516897
2018-11-15 17:23:20 [DEBUG   ] summary = ERROR
2018-11-15 17:23:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516897  13 58437 62600845 A  ERRORERROR'
2018-11-15 17:23:21 [DEBUG   ] Got command RPT from MCS: ref #516898
2018-11-15 17:23:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 17:23:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516898  77 58437 62601037 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 17:23:21 [DEBUG   ] Got command RPT from MCS: ref #516899
2018-11-15 17:23:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 17:23:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516899  12 58437 62601241 A  ERRORB¢ff'
2018-11-15 17:23:21 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2018-11-15 17:23:38 [DEBUG   ] Got command BAM from MCS: ref #516905
2018-11-15 17:23:38 [INFO    ] Finished processing BAM request
2018-11-15 17:23:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:23:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516905   8 58437 62618025 A  ERROR'
2018-11-15 17:23:38 [DEBUG   ] Got command BAM from MCS: ref #516904
2018-11-15 17:23:38 [INFO    ] Finished processing BAM request
2018-11-15 17:23:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:23:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516904   8 58437 62618029 A  ERROR'
2018-11-15 17:23:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 17:23:38 [DEBUG   ] spawn_process: at 2018-11-15 17:23:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 17:23:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 17:23:38 [DEBUG   ] spawn_process: at 2018-11-15 17:23:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 17:23:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 17:23:38 [DEBUG   ] spawn_process: at 2018-11-15 17:23:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 17:23:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 17:23:38 [DEBUG   ] spawn_process: at 2018-11-15 17:23:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 17:23:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 17:23:38 [DEBUG   ] spawn_process: at 2018-11-15 17:23:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 17:23:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 17:23:38 [DEBUG   ] spawn_process: at 2018-11-15 17:23:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 17:23:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 17:23:38 [DEBUG   ] spawn_process: at 2018-11-15 17:23:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 17:23:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 17:23:38 [DEBUG   ] spawn_process: at 2018-11-15 17:23:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 17:23:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 17:23:38 [DEBUG   ] spawn_process: at 2018-11-15 17:23:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 17:23:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 17:23:38 [DEBUG   ] spawn_process: at 2018-11-15 17:23:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 17:23:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 17:23:38 [DEBUG   ] spawn_process: at 2018-11-15 17:23:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 17:23:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 17:23:38 [DEBUG   ] spawn_process: at 2018-11-15 17:23:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 17:23:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 17:23:38 [DEBUG   ] spawn_process: at 2018-11-15 17:23:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 17:23:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 17:23:38 [DEBUG   ] spawn_process: at 2018-11-15 17:23:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 17:23:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 17:23:38 [DEBUG   ] spawn_process: at 2018-11-15 17:23:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 17:23:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 17:23:38 [DEBUG   ] spawn_process: at 2018-11-15 17:23:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 17:23:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 17:23:38 [DEBUG   ] spawn_process: at 2018-11-15 17:23:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 17:23:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 17:23:38 [DEBUG   ] spawn_process: at 2018-11-15 17:23:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 17:23:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 17:23:38 [DEBUG   ] spawn_process: at 2018-11-15 17:23:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 17:23:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 17:23:38 [DEBUG   ] spawn_process: at 2018-11-15 17:23:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 17:23:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 17:23:38 [DEBUG   ] spawn_process: at 2018-11-15 17:23:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 17:23:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 17:23:38 [DEBUG   ] spawn_process: at 2018-11-15 17:23:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 17:23:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 17:23:38 [DEBUG   ] spawn_process: at 2018-11-15 17:23:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 17:23:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 17:23:38 [DEBUG   ] spawn_process: at 2018-11-15 17:23:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 17:23:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 17:23:38 [DEBUG   ] spawn_process: at 2018-11-15 17:23:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 17:23:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 17:23:38 [DEBUG   ] spawn_process: at 2018-11-15 17:23:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 17:23:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 17:24:01 [DEBUG   ] Got command BAM from MCS: ref #516907
2018-11-15 17:24:01 [INFO    ] Finished processing BAM request
2018-11-15 17:24:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:24:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516907   8 58437 62641033 A  ERROR'
2018-11-15 17:24:01 [DEBUG   ] Got command BAM from MCS: ref #516906
2018-11-15 17:24:01 [INFO    ] Finished processing BAM request
2018-11-15 17:24:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:24:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516906   8 58437 62641037 A  ERROR'
2018-11-15 17:24:01 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 17:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 17:24:01 [DEBUG   ] spawn_process: at 2018-11-15 17:24:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 17:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 17:24:01 [DEBUG   ] spawn_process: at 2018-11-15 17:24:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 17:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 17:24:01 [DEBUG   ] spawn_process: at 2018-11-15 17:24:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 17:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 17:24:01 [DEBUG   ] spawn_process: at 2018-11-15 17:24:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 17:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 17:24:01 [DEBUG   ] spawn_process: at 2018-11-15 17:24:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 17:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 17:24:01 [DEBUG   ] spawn_process: at 2018-11-15 17:24:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 17:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 17:24:01 [DEBUG   ] spawn_process: at 2018-11-15 17:24:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 17:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 17:24:01 [DEBUG   ] spawn_process: at 2018-11-15 17:24:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 17:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 17:24:01 [DEBUG   ] spawn_process: at 2018-11-15 17:24:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 17:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 17:24:01 [DEBUG   ] spawn_process: at 2018-11-15 17:24:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 17:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 17:24:01 [DEBUG   ] spawn_process: at 2018-11-15 17:24:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 17:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 17:24:01 [DEBUG   ] spawn_process: at 2018-11-15 17:24:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 17:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 17:24:01 [DEBUG   ] spawn_process: at 2018-11-15 17:24:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 17:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 17:24:01 [DEBUG   ] spawn_process: at 2018-11-15 17:24:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 17:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 17:24:01 [DEBUG   ] spawn_process: at 2018-11-15 17:24:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 17:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 17:24:01 [DEBUG   ] spawn_process: at 2018-11-15 17:24:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 17:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 17:24:01 [DEBUG   ] spawn_process: at 2018-11-15 17:24:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 17:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 17:24:01 [DEBUG   ] spawn_process: at 2018-11-15 17:24:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 17:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 17:24:01 [DEBUG   ] spawn_process: at 2018-11-15 17:24:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 17:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 17:24:01 [DEBUG   ] spawn_process: at 2018-11-15 17:24:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 17:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 17:24:01 [DEBUG   ] spawn_process: at 2018-11-15 17:24:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 17:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 17:24:01 [DEBUG   ] spawn_process: at 2018-11-15 17:24:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 17:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 17:24:01 [DEBUG   ] spawn_process: at 2018-11-15 17:24:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 17:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 17:24:01 [DEBUG   ] spawn_process: at 2018-11-15 17:24:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 17:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 17:24:01 [DEBUG   ] spawn_process: at 2018-11-15 17:24:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 17:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 17:24:01 [DEBUG   ] spawn_process: at 2018-11-15 17:24:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 17:24:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:24:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-11-15 17:24:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 17:24:06 [WARNING ] (13, 1, 'bot')
2018-11-15 17:24:06 [WARNING ] (13, 1, 'bot')
2018-11-15 17:24:06 [WARNING ] (13, 1, 'bot')
2018-11-15 17:24:06 [WARNING ] (13, 1, 'bot')
2018-11-15 17:24:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:24:06 [DEBUG   ] Finished updating board flags in 1.011 seconds
2018-11-15 17:24:21 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 17:24:24 [DEBUG   ] Got command BAM from MCS: ref #516909
2018-11-15 17:24:24 [INFO    ] Finished processing BAM request
2018-11-15 17:24:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:24:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516909   8 58437 62664025 A  ERROR'
2018-11-15 17:24:24 [DEBUG   ] Got command BAM from MCS: ref #516908
2018-11-15 17:24:24 [INFO    ] Finished processing BAM request
2018-11-15 17:24:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:24:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516908   8 58437 62664029 A  ERROR'
2018-11-15 17:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 17:24:24 [DEBUG   ] spawn_process: at 2018-11-15 17:24:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 17:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 17:24:24 [DEBUG   ] spawn_process: at 2018-11-15 17:24:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 17:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 17:24:24 [DEBUG   ] spawn_process: at 2018-11-15 17:24:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 17:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 17:24:24 [DEBUG   ] spawn_process: at 2018-11-15 17:24:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 17:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 17:24:24 [DEBUG   ] spawn_process: at 2018-11-15 17:24:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 17:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 17:24:24 [DEBUG   ] spawn_process: at 2018-11-15 17:24:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 17:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 17:24:24 [DEBUG   ] spawn_process: at 2018-11-15 17:24:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 17:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 17:24:24 [DEBUG   ] spawn_process: at 2018-11-15 17:24:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 17:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 17:24:24 [DEBUG   ] spawn_process: at 2018-11-15 17:24:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 17:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 17:24:24 [DEBUG   ] spawn_process: at 2018-11-15 17:24:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 17:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 17:24:24 [DEBUG   ] spawn_process: at 2018-11-15 17:24:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 17:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 17:24:24 [DEBUG   ] spawn_process: at 2018-11-15 17:24:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 17:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 17:24:24 [DEBUG   ] spawn_process: at 2018-11-15 17:24:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 17:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 17:24:24 [DEBUG   ] spawn_process: at 2018-11-15 17:24:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 17:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 17:24:24 [DEBUG   ] spawn_process: at 2018-11-15 17:24:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 17:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 17:24:24 [DEBUG   ] spawn_process: at 2018-11-15 17:24:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 17:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 17:24:24 [DEBUG   ] spawn_process: at 2018-11-15 17:24:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 17:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 17:24:24 [DEBUG   ] spawn_process: at 2018-11-15 17:24:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 17:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 17:24:24 [DEBUG   ] spawn_process: at 2018-11-15 17:24:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 17:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 17:24:24 [DEBUG   ] spawn_process: at 2018-11-15 17:24:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 17:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 17:24:24 [DEBUG   ] spawn_process: at 2018-11-15 17:24:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 17:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 17:24:24 [DEBUG   ] spawn_process: at 2018-11-15 17:24:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 17:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 17:24:24 [DEBUG   ] spawn_process: at 2018-11-15 17:24:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 17:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 17:24:24 [DEBUG   ] spawn_process: at 2018-11-15 17:24:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 17:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 17:24:24 [DEBUG   ] spawn_process: at 2018-11-15 17:24:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 17:24:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 17:24:24 [DEBUG   ] spawn_process: at 2018-11-15 17:24:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 17:24:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 17:24:47 [DEBUG   ] Got command BAM from MCS: ref #516911
2018-11-15 17:24:47 [INFO    ] Finished processing BAM request
2018-11-15 17:24:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:24:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516911   8 58437 62687033 A  ERROR'
2018-11-15 17:24:47 [DEBUG   ] Got command BAM from MCS: ref #516910
2018-11-15 17:24:47 [INFO    ] Finished processing BAM request
2018-11-15 17:24:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:24:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516910   8 58437 62687037 A  ERROR'
2018-11-15 17:24:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 17:24:47 [DEBUG   ] spawn_process: at 2018-11-15 17:24:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 17:24:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 17:24:47 [DEBUG   ] spawn_process: at 2018-11-15 17:24:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 17:24:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 17:24:47 [DEBUG   ] spawn_process: at 2018-11-15 17:24:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 17:24:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 17:24:47 [DEBUG   ] spawn_process: at 2018-11-15 17:24:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 17:24:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 17:24:47 [DEBUG   ] spawn_process: at 2018-11-15 17:24:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 17:24:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 17:24:47 [DEBUG   ] spawn_process: at 2018-11-15 17:24:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 17:24:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 17:24:47 [DEBUG   ] spawn_process: at 2018-11-15 17:24:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 17:24:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 17:24:47 [DEBUG   ] spawn_process: at 2018-11-15 17:24:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 17:24:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 17:24:47 [DEBUG   ] spawn_process: at 2018-11-15 17:24:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 17:24:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 17:24:47 [DEBUG   ] spawn_process: at 2018-11-15 17:24:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 17:24:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 17:24:47 [DEBUG   ] spawn_process: at 2018-11-15 17:24:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 17:24:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 17:24:47 [DEBUG   ] spawn_process: at 2018-11-15 17:24:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 17:24:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 17:24:47 [DEBUG   ] spawn_process: at 2018-11-15 17:24:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 17:24:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 17:24:47 [DEBUG   ] spawn_process: at 2018-11-15 17:24:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 17:24:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 17:24:47 [DEBUG   ] spawn_process: at 2018-11-15 17:24:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 17:24:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 17:24:47 [DEBUG   ] spawn_process: at 2018-11-15 17:24:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 17:24:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 17:24:47 [DEBUG   ] spawn_process: at 2018-11-15 17:24:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 17:24:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 17:24:47 [DEBUG   ] spawn_process: at 2018-11-15 17:24:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 17:24:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 17:24:47 [DEBUG   ] spawn_process: at 2018-11-15 17:24:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 17:24:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 17:24:47 [DEBUG   ] spawn_process: at 2018-11-15 17:24:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 17:24:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 17:24:47 [DEBUG   ] spawn_process: at 2018-11-15 17:24:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 17:24:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 17:24:47 [DEBUG   ] spawn_process: at 2018-11-15 17:24:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 17:24:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 17:24:47 [DEBUG   ] spawn_process: at 2018-11-15 17:24:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 17:24:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 17:24:47 [DEBUG   ] spawn_process: at 2018-11-15 17:24:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 17:24:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 17:24:47 [DEBUG   ] spawn_process: at 2018-11-15 17:24:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 17:24:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 17:24:47 [DEBUG   ] spawn_process: at 2018-11-15 17:24:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 17:25:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 17:25:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:25:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-15 17:25:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 17:25:06 [WARNING ] (13, 1, 'bot')
2018-11-15 17:25:06 [WARNING ] (13, 1, 'bot')
2018-11-15 17:25:06 [WARNING ] (13, 1, 'bot')
2018-11-15 17:25:06 [WARNING ] (13, 1, 'bot')
2018-11-15 17:25:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:25:06 [DEBUG   ] Finished updating board flags in 1.054 seconds
2018-11-15 17:25:10 [DEBUG   ] Got command BAM from MCS: ref #516912
2018-11-15 17:25:10 [INFO    ] Finished processing BAM request
2018-11-15 17:25:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:25:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516912   8 58437 62710033 A  ERROR'
2018-11-15 17:25:10 [DEBUG   ] Got command BAM from MCS: ref #516913
2018-11-15 17:25:10 [INFO    ] Finished processing BAM request
2018-11-15 17:25:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:25:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516913   8 58437 62710037 A  ERROR'
2018-11-15 17:25:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 17:25:10 [DEBUG   ] spawn_process: at 2018-11-15 17:25:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 17:25:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 17:25:10 [DEBUG   ] spawn_process: at 2018-11-15 17:25:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 17:25:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 17:25:10 [DEBUG   ] spawn_process: at 2018-11-15 17:25:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 17:25:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 17:25:10 [DEBUG   ] spawn_process: at 2018-11-15 17:25:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 17:25:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 17:25:10 [DEBUG   ] spawn_process: at 2018-11-15 17:25:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 17:25:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 17:25:10 [DEBUG   ] spawn_process: at 2018-11-15 17:25:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 17:25:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 17:25:10 [DEBUG   ] spawn_process: at 2018-11-15 17:25:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 17:25:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 17:25:10 [DEBUG   ] spawn_process: at 2018-11-15 17:25:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 17:25:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 17:25:10 [DEBUG   ] spawn_process: at 2018-11-15 17:25:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 17:25:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 17:25:10 [DEBUG   ] spawn_process: at 2018-11-15 17:25:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 17:25:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 17:25:10 [DEBUG   ] spawn_process: at 2018-11-15 17:25:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 17:25:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 17:25:10 [DEBUG   ] spawn_process: at 2018-11-15 17:25:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 17:25:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 17:25:10 [DEBUG   ] spawn_process: at 2018-11-15 17:25:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 17:25:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 17:25:10 [DEBUG   ] spawn_process: at 2018-11-15 17:25:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 17:25:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 17:25:10 [DEBUG   ] spawn_process: at 2018-11-15 17:25:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 17:25:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 17:25:10 [DEBUG   ] spawn_process: at 2018-11-15 17:25:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 17:25:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 17:25:10 [DEBUG   ] spawn_process: at 2018-11-15 17:25:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 17:25:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 17:25:10 [DEBUG   ] spawn_process: at 2018-11-15 17:25:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 17:25:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 17:25:10 [DEBUG   ] spawn_process: at 2018-11-15 17:25:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 17:25:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 17:25:10 [DEBUG   ] spawn_process: at 2018-11-15 17:25:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 17:25:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 17:25:10 [DEBUG   ] spawn_process: at 2018-11-15 17:25:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 17:25:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 17:25:10 [DEBUG   ] spawn_process: at 2018-11-15 17:25:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 17:25:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 17:25:10 [DEBUG   ] spawn_process: at 2018-11-15 17:25:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 17:25:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 17:25:10 [DEBUG   ] spawn_process: at 2018-11-15 17:25:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 17:25:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 17:25:10 [DEBUG   ] spawn_process: at 2018-11-15 17:25:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 17:25:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 17:25:10 [DEBUG   ] spawn_process: at 2018-11-15 17:25:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 17:25:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 17:25:33 [DEBUG   ] Got command BAM from MCS: ref #516915
2018-11-15 17:25:33 [INFO    ] Finished processing BAM request
2018-11-15 17:25:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:25:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516915   8 58437 62733029 A  ERROR'
2018-11-15 17:25:33 [DEBUG   ] Got command BAM from MCS: ref #516914
2018-11-15 17:25:33 [INFO    ] Finished processing BAM request
2018-11-15 17:25:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:25:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516914   8 58437 62733033 A  ERROR'
2018-11-15 17:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 17:25:33 [DEBUG   ] spawn_process: at 2018-11-15 17:25:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 17:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 17:25:33 [DEBUG   ] spawn_process: at 2018-11-15 17:25:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 17:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 17:25:33 [DEBUG   ] spawn_process: at 2018-11-15 17:25:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 17:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 17:25:33 [DEBUG   ] spawn_process: at 2018-11-15 17:25:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 17:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 17:25:33 [DEBUG   ] spawn_process: at 2018-11-15 17:25:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 17:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 17:25:33 [DEBUG   ] spawn_process: at 2018-11-15 17:25:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 17:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 17:25:33 [DEBUG   ] spawn_process: at 2018-11-15 17:25:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 17:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 17:25:33 [DEBUG   ] spawn_process: at 2018-11-15 17:25:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 17:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 17:25:33 [DEBUG   ] spawn_process: at 2018-11-15 17:25:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 17:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 17:25:33 [DEBUG   ] spawn_process: at 2018-11-15 17:25:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 17:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 17:25:33 [DEBUG   ] spawn_process: at 2018-11-15 17:25:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 17:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 17:25:33 [DEBUG   ] spawn_process: at 2018-11-15 17:25:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 17:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 17:25:33 [DEBUG   ] spawn_process: at 2018-11-15 17:25:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 17:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 17:25:33 [DEBUG   ] spawn_process: at 2018-11-15 17:25:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 17:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 17:25:33 [DEBUG   ] spawn_process: at 2018-11-15 17:25:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 17:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 17:25:33 [DEBUG   ] spawn_process: at 2018-11-15 17:25:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 17:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 17:25:33 [DEBUG   ] spawn_process: at 2018-11-15 17:25:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 17:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 17:25:33 [DEBUG   ] spawn_process: at 2018-11-15 17:25:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 17:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 17:25:33 [DEBUG   ] spawn_process: at 2018-11-15 17:25:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 17:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 17:25:33 [DEBUG   ] spawn_process: at 2018-11-15 17:25:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 17:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 17:25:33 [DEBUG   ] spawn_process: at 2018-11-15 17:25:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 17:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 17:25:33 [DEBUG   ] spawn_process: at 2018-11-15 17:25:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 17:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 17:25:33 [DEBUG   ] spawn_process: at 2018-11-15 17:25:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 17:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 17:25:33 [DEBUG   ] spawn_process: at 2018-11-15 17:25:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 17:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 17:25:33 [DEBUG   ] spawn_process: at 2018-11-15 17:25:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 17:25:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 17:25:33 [DEBUG   ] spawn_process: at 2018-11-15 17:25:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 17:25:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 17:25:45 [DEBUG   ] Got command RPT from MCS: ref #516916
2018-11-15 17:25:45 [DEBUG   ] summary = ERROR
2018-11-15 17:25:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516916  13 58437 62745149 A  ERRORERROR'
2018-11-15 17:25:45 [DEBUG   ] Got command RPT from MCS: ref #516917
2018-11-15 17:25:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 17:25:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516917  77 58437 62745150 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 17:25:56 [DEBUG   ] Got command BAM from MCS: ref #516934
2018-11-15 17:25:56 [INFO    ] Finished processing BAM request
2018-11-15 17:25:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:25:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516934   8 58437 62756029 A  ERROR'
2018-11-15 17:25:56 [DEBUG   ] Got command BAM from MCS: ref #516933
2018-11-15 17:25:56 [INFO    ] Finished processing BAM request
2018-11-15 17:25:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:25:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516933   8 58437 62756033 A  ERROR'
2018-11-15 17:25:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 17:25:56 [DEBUG   ] spawn_process: at 2018-11-15 17:25:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 17:25:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 17:25:56 [DEBUG   ] spawn_process: at 2018-11-15 17:25:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 17:25:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 17:25:56 [DEBUG   ] spawn_process: at 2018-11-15 17:25:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 17:25:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 17:25:56 [DEBUG   ] spawn_process: at 2018-11-15 17:25:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 17:25:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 17:25:56 [DEBUG   ] spawn_process: at 2018-11-15 17:25:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 17:25:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 17:25:56 [DEBUG   ] spawn_process: at 2018-11-15 17:25:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 17:25:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 17:25:56 [DEBUG   ] spawn_process: at 2018-11-15 17:25:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 17:25:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 17:25:56 [DEBUG   ] spawn_process: at 2018-11-15 17:25:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 17:25:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 17:25:56 [DEBUG   ] spawn_process: at 2018-11-15 17:25:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 17:25:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 17:25:56 [DEBUG   ] spawn_process: at 2018-11-15 17:25:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 17:25:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 17:25:56 [DEBUG   ] spawn_process: at 2018-11-15 17:25:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 17:25:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 17:25:56 [DEBUG   ] spawn_process: at 2018-11-15 17:25:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 17:25:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 17:25:56 [DEBUG   ] spawn_process: at 2018-11-15 17:25:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 17:25:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 17:25:56 [DEBUG   ] spawn_process: at 2018-11-15 17:25:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 17:25:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 17:25:56 [DEBUG   ] spawn_process: at 2018-11-15 17:25:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 17:25:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 17:25:56 [DEBUG   ] spawn_process: at 2018-11-15 17:25:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 17:25:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 17:25:56 [DEBUG   ] spawn_process: at 2018-11-15 17:25:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 17:25:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 17:25:56 [DEBUG   ] spawn_process: at 2018-11-15 17:25:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 17:25:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 17:25:56 [DEBUG   ] spawn_process: at 2018-11-15 17:25:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 17:25:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 17:25:56 [DEBUG   ] spawn_process: at 2018-11-15 17:25:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 17:25:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 17:25:56 [DEBUG   ] spawn_process: at 2018-11-15 17:25:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 17:25:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 17:25:56 [DEBUG   ] spawn_process: at 2018-11-15 17:25:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 17:25:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 17:25:56 [DEBUG   ] spawn_process: at 2018-11-15 17:25:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 17:25:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 17:25:56 [DEBUG   ] spawn_process: at 2018-11-15 17:25:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 17:25:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 17:25:56 [DEBUG   ] spawn_process: at 2018-11-15 17:25:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 17:25:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 17:25:56 [DEBUG   ] spawn_process: at 2018-11-15 17:25:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 17:26:01 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 17:26:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 17:26:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:26:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-11-15 17:26:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 17:26:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 17:26:07 [WARNING ] (13, 1, 'bot')
2018-11-15 17:26:07 [WARNING ] (13, 1, 'bot')
2018-11-15 17:26:07 [WARNING ] (13, 1, 'bot')
2018-11-15 17:26:07 [WARNING ] (13, 1, 'bot')
2018-11-15 17:26:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:26:07 [DEBUG   ] Finished updating board flags in 2.026 seconds
2018-11-15 17:26:19 [DEBUG   ] Got command BAM from MCS: ref #516935
2018-11-15 17:26:19 [INFO    ] Finished processing BAM request
2018-11-15 17:26:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:26:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516935   8 58437 62779025 A  ERROR'
2018-11-15 17:26:19 [DEBUG   ] Got command BAM from MCS: ref #516936
2018-11-15 17:26:19 [INFO    ] Finished processing BAM request
2018-11-15 17:26:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:26:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516936   8 58437 62779029 A  ERROR'
2018-11-15 17:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 17:26:19 [DEBUG   ] spawn_process: at 2018-11-15 17:26:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 17:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 17:26:19 [DEBUG   ] spawn_process: at 2018-11-15 17:26:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 17:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 17:26:19 [DEBUG   ] spawn_process: at 2018-11-15 17:26:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 17:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 17:26:19 [DEBUG   ] spawn_process: at 2018-11-15 17:26:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 17:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 17:26:19 [DEBUG   ] spawn_process: at 2018-11-15 17:26:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 17:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 17:26:19 [DEBUG   ] spawn_process: at 2018-11-15 17:26:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 17:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 17:26:19 [DEBUG   ] spawn_process: at 2018-11-15 17:26:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 17:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 17:26:19 [DEBUG   ] spawn_process: at 2018-11-15 17:26:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 17:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 17:26:19 [DEBUG   ] spawn_process: at 2018-11-15 17:26:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 17:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 17:26:19 [DEBUG   ] spawn_process: at 2018-11-15 17:26:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 17:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 17:26:19 [DEBUG   ] spawn_process: at 2018-11-15 17:26:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 17:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 17:26:19 [DEBUG   ] spawn_process: at 2018-11-15 17:26:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 17:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 17:26:19 [DEBUG   ] spawn_process: at 2018-11-15 17:26:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 17:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 17:26:19 [DEBUG   ] spawn_process: at 2018-11-15 17:26:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 17:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 17:26:19 [DEBUG   ] spawn_process: at 2018-11-15 17:26:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 17:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 17:26:19 [DEBUG   ] spawn_process: at 2018-11-15 17:26:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 17:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 17:26:19 [DEBUG   ] spawn_process: at 2018-11-15 17:26:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 17:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 17:26:19 [DEBUG   ] spawn_process: at 2018-11-15 17:26:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 17:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 17:26:19 [DEBUG   ] spawn_process: at 2018-11-15 17:26:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 17:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 17:26:19 [DEBUG   ] spawn_process: at 2018-11-15 17:26:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 17:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 17:26:19 [DEBUG   ] spawn_process: at 2018-11-15 17:26:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 17:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 17:26:19 [DEBUG   ] spawn_process: at 2018-11-15 17:26:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 17:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 17:26:19 [DEBUG   ] spawn_process: at 2018-11-15 17:26:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 17:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 17:26:19 [DEBUG   ] spawn_process: at 2018-11-15 17:26:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 17:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 17:26:19 [DEBUG   ] spawn_process: at 2018-11-15 17:26:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 17:26:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 17:26:19 [DEBUG   ] spawn_process: at 2018-11-15 17:26:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 17:26:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 17:26:41 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 17:26:42 [DEBUG   ] Got command BAM from MCS: ref #516942
2018-11-15 17:26:42 [INFO    ] Finished processing BAM request
2018-11-15 17:26:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:26:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516942   8 58437 62802033 A  ERROR'
2018-11-15 17:26:42 [DEBUG   ] Got command BAM from MCS: ref #516941
2018-11-15 17:26:42 [INFO    ] Finished processing BAM request
2018-11-15 17:26:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:26:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516941   8 58437 62802037 A  ERROR'
2018-11-15 17:26:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 17:26:42 [DEBUG   ] spawn_process: at 2018-11-15 17:26:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 17:26:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 17:26:42 [DEBUG   ] spawn_process: at 2018-11-15 17:26:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 17:26:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 17:26:42 [DEBUG   ] spawn_process: at 2018-11-15 17:26:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 17:26:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 17:26:42 [DEBUG   ] spawn_process: at 2018-11-15 17:26:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 17:26:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 17:26:42 [DEBUG   ] spawn_process: at 2018-11-15 17:26:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 17:26:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 17:26:42 [DEBUG   ] spawn_process: at 2018-11-15 17:26:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 17:26:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 17:26:42 [DEBUG   ] spawn_process: at 2018-11-15 17:26:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 17:26:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 17:26:42 [DEBUG   ] spawn_process: at 2018-11-15 17:26:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 17:26:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 17:26:42 [DEBUG   ] spawn_process: at 2018-11-15 17:26:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 17:26:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 17:26:42 [DEBUG   ] spawn_process: at 2018-11-15 17:26:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 17:26:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 17:26:42 [DEBUG   ] spawn_process: at 2018-11-15 17:26:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 17:26:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 17:26:42 [DEBUG   ] spawn_process: at 2018-11-15 17:26:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 17:26:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 17:26:42 [DEBUG   ] spawn_process: at 2018-11-15 17:26:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 17:26:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 17:26:42 [DEBUG   ] spawn_process: at 2018-11-15 17:26:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 17:26:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 17:26:42 [DEBUG   ] spawn_process: at 2018-11-15 17:26:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 17:26:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 17:26:42 [DEBUG   ] spawn_process: at 2018-11-15 17:26:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 17:26:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 17:26:42 [DEBUG   ] spawn_process: at 2018-11-15 17:26:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 17:26:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 17:26:42 [DEBUG   ] spawn_process: at 2018-11-15 17:26:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 17:26:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 17:26:42 [DEBUG   ] spawn_process: at 2018-11-15 17:26:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 17:26:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 17:26:42 [DEBUG   ] spawn_process: at 2018-11-15 17:26:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 17:26:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 17:26:42 [DEBUG   ] spawn_process: at 2018-11-15 17:26:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 17:26:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 17:26:42 [DEBUG   ] spawn_process: at 2018-11-15 17:26:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 17:26:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 17:26:42 [DEBUG   ] spawn_process: at 2018-11-15 17:26:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 17:26:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 17:26:42 [DEBUG   ] spawn_process: at 2018-11-15 17:26:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 17:26:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 17:26:42 [DEBUG   ] spawn_process: at 2018-11-15 17:26:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 17:26:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 17:26:42 [DEBUG   ] spawn_process: at 2018-11-15 17:26:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 17:27:01 [DEBUG   ] Finished updating ant stats in 0.613 seconds
2018-11-15 17:27:05 [DEBUG   ] Got command BAM from MCS: ref #516944
2018-11-15 17:27:05 [INFO    ] Finished processing BAM request
2018-11-15 17:27:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:27:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516944   8 58437 62825029 A  ERROR'
2018-11-15 17:27:05 [DEBUG   ] Got command BAM from MCS: ref #516943
2018-11-15 17:27:05 [INFO    ] Finished processing BAM request
2018-11-15 17:27:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:27:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516943   8 58437 62825033 A  ERROR'
2018-11-15 17:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 17:27:05 [DEBUG   ] spawn_process: at 2018-11-15 17:27:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 17:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 17:27:05 [DEBUG   ] spawn_process: at 2018-11-15 17:27:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 17:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 17:27:05 [DEBUG   ] spawn_process: at 2018-11-15 17:27:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 17:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 17:27:05 [DEBUG   ] spawn_process: at 2018-11-15 17:27:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 17:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 17:27:05 [DEBUG   ] spawn_process: at 2018-11-15 17:27:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 17:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 17:27:05 [DEBUG   ] spawn_process: at 2018-11-15 17:27:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 17:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 17:27:05 [DEBUG   ] spawn_process: at 2018-11-15 17:27:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 17:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 17:27:05 [DEBUG   ] spawn_process: at 2018-11-15 17:27:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 17:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 17:27:05 [DEBUG   ] spawn_process: at 2018-11-15 17:27:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 17:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 17:27:05 [DEBUG   ] spawn_process: at 2018-11-15 17:27:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 17:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 17:27:05 [DEBUG   ] spawn_process: at 2018-11-15 17:27:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 17:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 17:27:05 [DEBUG   ] spawn_process: at 2018-11-15 17:27:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 17:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 17:27:05 [DEBUG   ] spawn_process: at 2018-11-15 17:27:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 17:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 17:27:05 [DEBUG   ] spawn_process: at 2018-11-15 17:27:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 17:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 17:27:05 [DEBUG   ] spawn_process: at 2018-11-15 17:27:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 17:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 17:27:05 [DEBUG   ] spawn_process: at 2018-11-15 17:27:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 17:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 17:27:05 [DEBUG   ] spawn_process: at 2018-11-15 17:27:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 17:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 17:27:05 [DEBUG   ] spawn_process: at 2018-11-15 17:27:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 17:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 17:27:05 [DEBUG   ] spawn_process: at 2018-11-15 17:27:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 17:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 17:27:05 [DEBUG   ] spawn_process: at 2018-11-15 17:27:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 17:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 17:27:05 [DEBUG   ] spawn_process: at 2018-11-15 17:27:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 17:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 17:27:05 [DEBUG   ] spawn_process: at 2018-11-15 17:27:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 17:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 17:27:05 [DEBUG   ] spawn_process: at 2018-11-15 17:27:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 17:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 17:27:05 [DEBUG   ] spawn_process: at 2018-11-15 17:27:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 17:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 17:27:05 [DEBUG   ] spawn_process: at 2018-11-15 17:27:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 17:27:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 17:27:05 [DEBUG   ] spawn_process: at 2018-11-15 17:27:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 17:27:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-11-15 17:27:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:27:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 17:27:06 [WARNING ] (13, 1, 'bot')
2018-11-15 17:27:06 [WARNING ] (13, 1, 'bot')
2018-11-15 17:27:06 [WARNING ] (13, 1, 'bot')
2018-11-15 17:27:06 [WARNING ] (13, 1, 'bot')
2018-11-15 17:27:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:27:06 [DEBUG   ] Finished updating board flags in 1.354 seconds
2018-11-15 17:27:21 [DEBUG   ] Finished updating ant stats in 0.590 seconds
2018-11-15 17:27:28 [DEBUG   ] Got command BAM from MCS: ref #516945
2018-11-15 17:27:28 [INFO    ] Finished processing BAM request
2018-11-15 17:27:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:27:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516945   8 58437 62848033 A  ERROR'
2018-11-15 17:27:28 [DEBUG   ] Got command BAM from MCS: ref #516946
2018-11-15 17:27:28 [INFO    ] Finished processing BAM request
2018-11-15 17:27:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:27:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516946   8 58437 62848037 A  ERROR'
2018-11-15 17:27:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 17:27:28 [DEBUG   ] spawn_process: at 2018-11-15 17:27:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 17:27:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 17:27:28 [DEBUG   ] spawn_process: at 2018-11-15 17:27:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 17:27:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 17:27:28 [DEBUG   ] spawn_process: at 2018-11-15 17:27:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 17:27:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 17:27:28 [DEBUG   ] spawn_process: at 2018-11-15 17:27:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 17:27:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 17:27:28 [DEBUG   ] spawn_process: at 2018-11-15 17:27:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 17:27:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 17:27:28 [DEBUG   ] spawn_process: at 2018-11-15 17:27:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 17:27:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 17:27:28 [DEBUG   ] spawn_process: at 2018-11-15 17:27:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 17:27:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 17:27:28 [DEBUG   ] spawn_process: at 2018-11-15 17:27:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 17:27:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 17:27:28 [DEBUG   ] spawn_process: at 2018-11-15 17:27:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 17:27:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 17:27:28 [DEBUG   ] spawn_process: at 2018-11-15 17:27:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 17:27:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 17:27:28 [DEBUG   ] spawn_process: at 2018-11-15 17:27:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 17:27:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 17:27:28 [DEBUG   ] spawn_process: at 2018-11-15 17:27:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 17:27:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 17:27:28 [DEBUG   ] spawn_process: at 2018-11-15 17:27:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 17:27:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 17:27:28 [DEBUG   ] spawn_process: at 2018-11-15 17:27:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 17:27:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 17:27:28 [DEBUG   ] spawn_process: at 2018-11-15 17:27:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 17:27:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 17:27:28 [DEBUG   ] spawn_process: at 2018-11-15 17:27:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 17:27:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 17:27:28 [DEBUG   ] spawn_process: at 2018-11-15 17:27:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 17:27:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 17:27:28 [DEBUG   ] spawn_process: at 2018-11-15 17:27:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 17:27:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 17:27:28 [DEBUG   ] spawn_process: at 2018-11-15 17:27:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 17:27:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 17:27:28 [DEBUG   ] spawn_process: at 2018-11-15 17:27:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 17:27:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 17:27:28 [DEBUG   ] spawn_process: at 2018-11-15 17:27:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 17:27:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 17:27:28 [DEBUG   ] spawn_process: at 2018-11-15 17:27:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 17:27:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 17:27:28 [DEBUG   ] spawn_process: at 2018-11-15 17:27:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 17:27:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 17:27:28 [DEBUG   ] spawn_process: at 2018-11-15 17:27:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 17:27:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 17:27:28 [DEBUG   ] spawn_process: at 2018-11-15 17:27:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 17:27:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 17:27:28 [DEBUG   ] spawn_process: at 2018-11-15 17:27:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 17:27:41 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 17:27:51 [DEBUG   ] Got command BAM from MCS: ref #516947
2018-11-15 17:27:51 [INFO    ] Finished processing BAM request
2018-11-15 17:27:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:27:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516947   8 58437 62871029 A  ERROR'
2018-11-15 17:27:51 [DEBUG   ] Got command BAM from MCS: ref #516948
2018-11-15 17:27:51 [INFO    ] Finished processing BAM request
2018-11-15 17:27:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:27:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516948   8 58437 62871033 A  ERROR'
2018-11-15 17:27:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 17:27:51 [DEBUG   ] spawn_process: at 2018-11-15 17:27:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 17:27:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 17:27:51 [DEBUG   ] spawn_process: at 2018-11-15 17:27:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 17:27:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 17:27:51 [DEBUG   ] spawn_process: at 2018-11-15 17:27:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 17:27:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 17:27:51 [DEBUG   ] spawn_process: at 2018-11-15 17:27:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 17:27:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 17:27:51 [DEBUG   ] spawn_process: at 2018-11-15 17:27:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 17:27:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 17:27:51 [DEBUG   ] spawn_process: at 2018-11-15 17:27:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 17:27:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 17:27:51 [DEBUG   ] spawn_process: at 2018-11-15 17:27:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 17:27:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 17:27:51 [DEBUG   ] spawn_process: at 2018-11-15 17:27:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 17:27:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 17:27:51 [DEBUG   ] spawn_process: at 2018-11-15 17:27:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 17:27:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 17:27:51 [DEBUG   ] spawn_process: at 2018-11-15 17:27:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 17:27:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 17:27:51 [DEBUG   ] spawn_process: at 2018-11-15 17:27:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 17:27:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 17:27:51 [DEBUG   ] spawn_process: at 2018-11-15 17:27:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 17:27:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 17:27:51 [DEBUG   ] spawn_process: at 2018-11-15 17:27:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 17:27:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 17:27:51 [DEBUG   ] spawn_process: at 2018-11-15 17:27:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 17:27:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 17:27:51 [DEBUG   ] spawn_process: at 2018-11-15 17:27:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 17:27:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 17:27:51 [DEBUG   ] spawn_process: at 2018-11-15 17:27:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 17:27:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 17:27:51 [DEBUG   ] spawn_process: at 2018-11-15 17:27:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 17:27:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 17:27:51 [DEBUG   ] spawn_process: at 2018-11-15 17:27:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 17:27:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 17:27:51 [DEBUG   ] spawn_process: at 2018-11-15 17:27:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 17:27:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 17:27:51 [DEBUG   ] spawn_process: at 2018-11-15 17:27:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 17:27:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 17:27:51 [DEBUG   ] spawn_process: at 2018-11-15 17:27:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 17:27:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 17:27:51 [DEBUG   ] spawn_process: at 2018-11-15 17:27:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 17:27:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 17:27:51 [DEBUG   ] spawn_process: at 2018-11-15 17:27:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 17:27:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 17:27:51 [DEBUG   ] spawn_process: at 2018-11-15 17:27:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 17:27:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 17:27:51 [DEBUG   ] spawn_process: at 2018-11-15 17:27:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 17:27:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 17:27:51 [DEBUG   ] spawn_process: at 2018-11-15 17:27:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 17:28:01 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 17:28:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 17:28:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-15 17:28:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 17:28:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:28:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 17:28:06 [WARNING ] (13, 1, 'bot')
2018-11-15 17:28:06 [WARNING ] (13, 1, 'bot')
2018-11-15 17:28:06 [WARNING ] (13, 1, 'bot')
2018-11-15 17:28:06 [WARNING ] (13, 1, 'bot')
2018-11-15 17:28:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:28:06 [DEBUG   ] Finished updating board flags in 1.224 seconds
2018-11-15 17:28:15 [DEBUG   ] Got command BAM from MCS: ref #516951
2018-11-15 17:28:15 [INFO    ] Finished processing BAM request
2018-11-15 17:28:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:28:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516951   8 58437 62895025 A  ERROR'
2018-11-15 17:28:15 [DEBUG   ] Got command BAM from MCS: ref #516952
2018-11-15 17:28:15 [INFO    ] Finished processing BAM request
2018-11-15 17:28:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:28:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516952   8 58437 62895029 A  ERROR'
2018-11-15 17:28:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 17:28:15 [DEBUG   ] spawn_process: at 2018-11-15 17:28:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 17:28:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 17:28:15 [DEBUG   ] spawn_process: at 2018-11-15 17:28:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 17:28:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 17:28:15 [DEBUG   ] spawn_process: at 2018-11-15 17:28:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 17:28:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 17:28:15 [DEBUG   ] spawn_process: at 2018-11-15 17:28:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 17:28:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 17:28:15 [DEBUG   ] spawn_process: at 2018-11-15 17:28:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 17:28:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 17:28:15 [DEBUG   ] spawn_process: at 2018-11-15 17:28:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 17:28:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 17:28:15 [DEBUG   ] spawn_process: at 2018-11-15 17:28:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 17:28:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 17:28:15 [DEBUG   ] spawn_process: at 2018-11-15 17:28:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 17:28:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 17:28:15 [DEBUG   ] spawn_process: at 2018-11-15 17:28:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 17:28:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 17:28:15 [DEBUG   ] spawn_process: at 2018-11-15 17:28:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 17:28:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 17:28:15 [DEBUG   ] spawn_process: at 2018-11-15 17:28:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 17:28:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 17:28:15 [DEBUG   ] spawn_process: at 2018-11-15 17:28:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 17:28:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 17:28:15 [DEBUG   ] spawn_process: at 2018-11-15 17:28:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 17:28:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 17:28:15 [DEBUG   ] spawn_process: at 2018-11-15 17:28:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 17:28:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 17:28:15 [DEBUG   ] spawn_process: at 2018-11-15 17:28:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 17:28:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 17:28:15 [DEBUG   ] spawn_process: at 2018-11-15 17:28:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 17:28:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 17:28:15 [DEBUG   ] spawn_process: at 2018-11-15 17:28:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 17:28:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 17:28:15 [DEBUG   ] spawn_process: at 2018-11-15 17:28:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 17:28:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 17:28:15 [DEBUG   ] spawn_process: at 2018-11-15 17:28:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 17:28:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 17:28:15 [DEBUG   ] spawn_process: at 2018-11-15 17:28:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 17:28:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 17:28:15 [DEBUG   ] spawn_process: at 2018-11-15 17:28:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 17:28:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 17:28:15 [DEBUG   ] spawn_process: at 2018-11-15 17:28:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 17:28:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 17:28:15 [DEBUG   ] spawn_process: at 2018-11-15 17:28:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 17:28:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 17:28:15 [DEBUG   ] spawn_process: at 2018-11-15 17:28:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 17:28:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 17:28:15 [DEBUG   ] spawn_process: at 2018-11-15 17:28:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 17:28:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 17:28:15 [DEBUG   ] spawn_process: at 2018-11-15 17:28:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 17:28:20 [DEBUG   ] Got command RPT from MCS: ref #516953
2018-11-15 17:28:20 [DEBUG   ] summary = ERROR
2018-11-15 17:28:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516953  13 58437 62900521 A  ERRORERROR'
2018-11-15 17:28:20 [DEBUG   ] Got command RPT from MCS: ref #516954
2018-11-15 17:28:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 17:28:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516954  77 58437 62900725 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 17:28:20 [DEBUG   ] Got command RPT from MCS: ref #516955
2018-11-15 17:28:20 [DEBUG   ] summary = ERROR
2018-11-15 17:28:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516955  13 58437 62900925 A  ERRORERROR'
2018-11-15 17:28:21 [DEBUG   ] Got command RPT from MCS: ref #516957
2018-11-15 17:28:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 17:28:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516957  77 58437 62901129 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 17:28:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 17:28:21 [DEBUG   ] Got command RPT from MCS: ref #516958
2018-11-15 17:28:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 17:28:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516958  12 58437 62901333 A  ERRORB¢ff'
2018-11-15 17:28:39 [DEBUG   ] Got command BAM from MCS: ref #516964
2018-11-15 17:28:39 [INFO    ] Finished processing BAM request
2018-11-15 17:28:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516964   8 58437 62919029 A  ERROR'
2018-11-15 17:28:39 [DEBUG   ] Got command BAM from MCS: ref #516963
2018-11-15 17:28:39 [INFO    ] Finished processing BAM request
2018-11-15 17:28:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516963   8 58437 62919033 A  ERROR'
2018-11-15 17:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 17:28:39 [DEBUG   ] spawn_process: at 2018-11-15 17:28:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 17:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 17:28:39 [DEBUG   ] spawn_process: at 2018-11-15 17:28:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 17:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 17:28:39 [DEBUG   ] spawn_process: at 2018-11-15 17:28:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 17:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 17:28:39 [DEBUG   ] spawn_process: at 2018-11-15 17:28:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 17:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 17:28:39 [DEBUG   ] spawn_process: at 2018-11-15 17:28:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 17:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 17:28:39 [DEBUG   ] spawn_process: at 2018-11-15 17:28:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 17:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 17:28:39 [DEBUG   ] spawn_process: at 2018-11-15 17:28:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 17:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 17:28:39 [DEBUG   ] spawn_process: at 2018-11-15 17:28:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 17:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 17:28:39 [DEBUG   ] spawn_process: at 2018-11-15 17:28:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 17:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 17:28:39 [DEBUG   ] spawn_process: at 2018-11-15 17:28:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 17:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 17:28:39 [DEBUG   ] spawn_process: at 2018-11-15 17:28:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 17:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 17:28:39 [DEBUG   ] spawn_process: at 2018-11-15 17:28:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 17:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 17:28:39 [DEBUG   ] spawn_process: at 2018-11-15 17:28:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 17:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 17:28:39 [DEBUG   ] spawn_process: at 2018-11-15 17:28:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 17:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 17:28:39 [DEBUG   ] spawn_process: at 2018-11-15 17:28:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 17:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 17:28:39 [DEBUG   ] spawn_process: at 2018-11-15 17:28:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 17:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 17:28:39 [DEBUG   ] spawn_process: at 2018-11-15 17:28:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 17:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 17:28:39 [DEBUG   ] spawn_process: at 2018-11-15 17:28:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 17:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 17:28:39 [DEBUG   ] spawn_process: at 2018-11-15 17:28:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 17:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 17:28:39 [DEBUG   ] spawn_process: at 2018-11-15 17:28:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 17:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 17:28:39 [DEBUG   ] spawn_process: at 2018-11-15 17:28:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 17:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 17:28:39 [DEBUG   ] spawn_process: at 2018-11-15 17:28:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 17:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 17:28:39 [DEBUG   ] spawn_process: at 2018-11-15 17:28:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 17:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 17:28:39 [DEBUG   ] spawn_process: at 2018-11-15 17:28:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 17:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 17:28:39 [DEBUG   ] spawn_process: at 2018-11-15 17:28:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 17:28:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 17:28:39 [DEBUG   ] spawn_process: at 2018-11-15 17:28:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 17:28:41 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 17:29:01 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 17:29:03 [DEBUG   ] Got command BAM from MCS: ref #516966
2018-11-15 17:29:03 [INFO    ] Finished processing BAM request
2018-11-15 17:29:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:29:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516966   8 58437 62943033 A  ERROR'
2018-11-15 17:29:03 [DEBUG   ] Got command BAM from MCS: ref #516965
2018-11-15 17:29:03 [INFO    ] Finished processing BAM request
2018-11-15 17:29:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:29:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516965   8 58437 62943037 A  ERROR'
2018-11-15 17:29:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 17:29:03 [DEBUG   ] spawn_process: at 2018-11-15 17:29:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 17:29:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 17:29:03 [DEBUG   ] spawn_process: at 2018-11-15 17:29:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 17:29:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 17:29:03 [DEBUG   ] spawn_process: at 2018-11-15 17:29:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 17:29:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 17:29:03 [DEBUG   ] spawn_process: at 2018-11-15 17:29:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 17:29:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 17:29:03 [DEBUG   ] spawn_process: at 2018-11-15 17:29:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 17:29:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 17:29:03 [DEBUG   ] spawn_process: at 2018-11-15 17:29:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 17:29:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 17:29:03 [DEBUG   ] spawn_process: at 2018-11-15 17:29:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 17:29:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 17:29:03 [DEBUG   ] spawn_process: at 2018-11-15 17:29:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 17:29:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 17:29:03 [DEBUG   ] spawn_process: at 2018-11-15 17:29:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 17:29:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 17:29:03 [DEBUG   ] spawn_process: at 2018-11-15 17:29:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 17:29:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 17:29:03 [DEBUG   ] spawn_process: at 2018-11-15 17:29:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 17:29:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 17:29:03 [DEBUG   ] spawn_process: at 2018-11-15 17:29:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 17:29:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 17:29:03 [DEBUG   ] spawn_process: at 2018-11-15 17:29:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 17:29:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 17:29:03 [DEBUG   ] spawn_process: at 2018-11-15 17:29:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 17:29:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 17:29:03 [DEBUG   ] spawn_process: at 2018-11-15 17:29:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 17:29:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 17:29:03 [DEBUG   ] spawn_process: at 2018-11-15 17:29:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 17:29:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 17:29:03 [DEBUG   ] spawn_process: at 2018-11-15 17:29:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 17:29:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 17:29:03 [DEBUG   ] spawn_process: at 2018-11-15 17:29:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 17:29:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 17:29:03 [DEBUG   ] spawn_process: at 2018-11-15 17:29:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 17:29:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 17:29:03 [DEBUG   ] spawn_process: at 2018-11-15 17:29:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 17:29:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 17:29:03 [DEBUG   ] spawn_process: at 2018-11-15 17:29:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 17:29:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 17:29:03 [DEBUG   ] spawn_process: at 2018-11-15 17:29:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 17:29:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 17:29:03 [DEBUG   ] spawn_process: at 2018-11-15 17:29:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 17:29:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 17:29:03 [DEBUG   ] spawn_process: at 2018-11-15 17:29:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 17:29:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 17:29:03 [DEBUG   ] spawn_process: at 2018-11-15 17:29:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 17:29:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 17:29:03 [DEBUG   ] spawn_process: at 2018-11-15 17:29:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 17:29:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-11-15 17:29:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:29:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 17:29:06 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-15 17:29:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 17:29:06 [WARNING ] (13, 1, 'bot')
2018-11-15 17:29:06 [WARNING ] (13, 1, 'bot')
2018-11-15 17:29:06 [WARNING ] (13, 1, 'bot')
2018-11-15 17:29:06 [WARNING ] (13, 1, 'bot')
2018-11-15 17:29:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:29:06 [DEBUG   ] Finished updating board flags in 1.211 seconds
2018-11-15 17:29:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 17:29:27 [DEBUG   ] Got command BAM from MCS: ref #516972
2018-11-15 17:29:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:29:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516972   8 58437 62967025 A  ERROR'
2018-11-15 17:29:27 [DEBUG   ] Got command BAM from MCS: ref #516971
2018-11-15 17:29:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:29:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516971   8 58437 62967029 A  ERROR'
2018-11-15 17:29:27 [INFO    ] Finished processing BAM request
2018-11-15 17:29:27 [INFO    ] Finished processing BAM request
2018-11-15 17:29:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 17:29:27 [DEBUG   ] spawn_process: at 2018-11-15 17:29:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 17:29:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 17:29:27 [DEBUG   ] spawn_process: at 2018-11-15 17:29:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 17:29:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 17:29:27 [DEBUG   ] spawn_process: at 2018-11-15 17:29:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 17:29:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 17:29:27 [DEBUG   ] spawn_process: at 2018-11-15 17:29:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 17:29:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 17:29:27 [DEBUG   ] spawn_process: at 2018-11-15 17:29:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 17:29:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 17:29:27 [DEBUG   ] spawn_process: at 2018-11-15 17:29:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 17:29:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 17:29:27 [DEBUG   ] spawn_process: at 2018-11-15 17:29:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 17:29:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 17:29:27 [DEBUG   ] spawn_process: at 2018-11-15 17:29:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 17:29:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 17:29:27 [DEBUG   ] spawn_process: at 2018-11-15 17:29:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 17:29:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 17:29:27 [DEBUG   ] spawn_process: at 2018-11-15 17:29:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 17:29:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 17:29:27 [DEBUG   ] spawn_process: at 2018-11-15 17:29:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 17:29:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 17:29:27 [DEBUG   ] spawn_process: at 2018-11-15 17:29:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 17:29:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 17:29:27 [DEBUG   ] spawn_process: at 2018-11-15 17:29:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 17:29:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 17:29:27 [DEBUG   ] spawn_process: at 2018-11-15 17:29:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 17:29:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 17:29:27 [DEBUG   ] spawn_process: at 2018-11-15 17:29:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 17:29:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 17:29:27 [DEBUG   ] spawn_process: at 2018-11-15 17:29:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 17:29:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 17:29:27 [DEBUG   ] spawn_process: at 2018-11-15 17:29:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 17:29:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 17:29:27 [DEBUG   ] spawn_process: at 2018-11-15 17:29:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 17:29:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 17:29:27 [DEBUG   ] spawn_process: at 2018-11-15 17:29:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 17:29:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 17:29:27 [DEBUG   ] spawn_process: at 2018-11-15 17:29:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 17:29:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 17:29:27 [DEBUG   ] spawn_process: at 2018-11-15 17:29:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 17:29:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 17:29:27 [DEBUG   ] spawn_process: at 2018-11-15 17:29:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 17:29:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 17:29:27 [DEBUG   ] spawn_process: at 2018-11-15 17:29:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 17:29:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 17:29:27 [DEBUG   ] spawn_process: at 2018-11-15 17:29:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 17:29:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 17:29:27 [DEBUG   ] spawn_process: at 2018-11-15 17:29:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 17:29:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 17:29:27 [DEBUG   ] spawn_process: at 2018-11-15 17:29:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 17:29:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 17:29:51 [DEBUG   ] Got command BAM from MCS: ref #516973
2018-11-15 17:29:51 [INFO    ] Finished processing BAM request
2018-11-15 17:29:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:29:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516973   8 58437 62991025 A  ERROR'
2018-11-15 17:29:51 [DEBUG   ] Got command BAM from MCS: ref #516974
2018-11-15 17:29:51 [INFO    ] Finished processing BAM request
2018-11-15 17:29:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:29:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516974   8 58437 62991029 A  ERROR'
2018-11-15 17:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 17:29:51 [DEBUG   ] spawn_process: at 2018-11-15 17:29:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 17:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 17:29:51 [DEBUG   ] spawn_process: at 2018-11-15 17:29:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 17:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 17:29:51 [DEBUG   ] spawn_process: at 2018-11-15 17:29:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 17:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 17:29:51 [DEBUG   ] spawn_process: at 2018-11-15 17:29:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 17:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 17:29:51 [DEBUG   ] spawn_process: at 2018-11-15 17:29:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 17:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 17:29:51 [DEBUG   ] spawn_process: at 2018-11-15 17:29:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 17:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 17:29:51 [DEBUG   ] spawn_process: at 2018-11-15 17:29:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 17:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 17:29:51 [DEBUG   ] spawn_process: at 2018-11-15 17:29:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 17:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 17:29:51 [DEBUG   ] spawn_process: at 2018-11-15 17:29:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 17:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 17:29:51 [DEBUG   ] spawn_process: at 2018-11-15 17:29:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 17:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 17:29:51 [DEBUG   ] spawn_process: at 2018-11-15 17:29:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 17:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 17:29:51 [DEBUG   ] spawn_process: at 2018-11-15 17:29:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 17:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 17:29:51 [DEBUG   ] spawn_process: at 2018-11-15 17:29:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 17:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 17:29:51 [DEBUG   ] spawn_process: at 2018-11-15 17:29:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 17:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 17:29:51 [DEBUG   ] spawn_process: at 2018-11-15 17:29:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 17:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 17:29:51 [DEBUG   ] spawn_process: at 2018-11-15 17:29:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 17:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 17:29:51 [DEBUG   ] spawn_process: at 2018-11-15 17:29:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 17:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 17:29:51 [DEBUG   ] spawn_process: at 2018-11-15 17:29:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 17:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 17:29:51 [DEBUG   ] spawn_process: at 2018-11-15 17:29:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 17:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 17:29:51 [DEBUG   ] spawn_process: at 2018-11-15 17:29:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 17:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 17:29:51 [DEBUG   ] spawn_process: at 2018-11-15 17:29:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 17:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 17:29:51 [DEBUG   ] spawn_process: at 2018-11-15 17:29:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 17:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 17:29:51 [DEBUG   ] spawn_process: at 2018-11-15 17:29:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 17:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 17:29:51 [DEBUG   ] spawn_process: at 2018-11-15 17:29:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 17:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 17:29:51 [DEBUG   ] spawn_process: at 2018-11-15 17:29:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 17:29:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 17:29:51 [DEBUG   ] spawn_process: at 2018-11-15 17:29:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 17:30:01 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 17:30:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 17:30:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-11-15 17:30:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 17:30:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-15 17:30:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2018-11-15 17:30:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:30:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-15 17:30:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 17:30:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 17:30:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 17:30:07 [WARNING ] (13, 1, 'bot')
2018-11-15 17:30:07 [WARNING ] (13, 1, 'bot')
2018-11-15 17:30:07 [WARNING ] (13, 1, 'bot')
2018-11-15 17:30:07 [WARNING ] (13, 1, 'bot')
2018-11-15 17:30:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:30:07 [DEBUG   ] Finished updating board flags in 1.605 seconds
2018-11-15 17:30:15 [DEBUG   ] Got command BAM from MCS: ref #516976
2018-11-15 17:30:15 [INFO    ] Finished processing BAM request
2018-11-15 17:30:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:30:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516976   8 58437 63015025 A  ERROR'
2018-11-15 17:30:15 [DEBUG   ] Got command BAM from MCS: ref #516975
2018-11-15 17:30:15 [INFO    ] Finished processing BAM request
2018-11-15 17:30:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:30:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516975   8 58437 63015029 A  ERROR'
2018-11-15 17:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 17:30:15 [DEBUG   ] spawn_process: at 2018-11-15 17:30:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 17:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 17:30:15 [DEBUG   ] spawn_process: at 2018-11-15 17:30:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 17:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 17:30:15 [DEBUG   ] spawn_process: at 2018-11-15 17:30:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 17:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 17:30:15 [DEBUG   ] spawn_process: at 2018-11-15 17:30:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 17:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 17:30:15 [DEBUG   ] spawn_process: at 2018-11-15 17:30:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 17:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 17:30:15 [DEBUG   ] spawn_process: at 2018-11-15 17:30:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 17:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 17:30:15 [DEBUG   ] spawn_process: at 2018-11-15 17:30:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 17:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 17:30:15 [DEBUG   ] spawn_process: at 2018-11-15 17:30:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 17:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 17:30:15 [DEBUG   ] spawn_process: at 2018-11-15 17:30:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 17:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 17:30:15 [DEBUG   ] spawn_process: at 2018-11-15 17:30:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 17:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 17:30:15 [DEBUG   ] spawn_process: at 2018-11-15 17:30:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 17:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 17:30:15 [DEBUG   ] spawn_process: at 2018-11-15 17:30:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 17:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 17:30:15 [DEBUG   ] spawn_process: at 2018-11-15 17:30:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 17:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 17:30:15 [DEBUG   ] spawn_process: at 2018-11-15 17:30:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 17:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 17:30:15 [DEBUG   ] spawn_process: at 2018-11-15 17:30:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 17:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 17:30:15 [DEBUG   ] spawn_process: at 2018-11-15 17:30:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 17:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 17:30:15 [DEBUG   ] spawn_process: at 2018-11-15 17:30:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 17:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 17:30:15 [DEBUG   ] spawn_process: at 2018-11-15 17:30:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 17:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 17:30:15 [DEBUG   ] spawn_process: at 2018-11-15 17:30:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 17:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 17:30:15 [DEBUG   ] spawn_process: at 2018-11-15 17:30:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 17:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 17:30:15 [DEBUG   ] spawn_process: at 2018-11-15 17:30:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 17:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 17:30:15 [DEBUG   ] spawn_process: at 2018-11-15 17:30:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 17:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 17:30:15 [DEBUG   ] spawn_process: at 2018-11-15 17:30:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 17:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 17:30:15 [DEBUG   ] spawn_process: at 2018-11-15 17:30:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 17:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 17:30:15 [DEBUG   ] spawn_process: at 2018-11-15 17:30:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 17:30:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 17:30:15 [DEBUG   ] spawn_process: at 2018-11-15 17:30:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 17:30:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 17:30:39 [DEBUG   ] Got command BAM from MCS: ref #516978
2018-11-15 17:30:39 [INFO    ] Finished processing BAM request
2018-11-15 17:30:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:30:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516978   8 58437 63039025 A  ERROR'
2018-11-15 17:30:39 [DEBUG   ] Got command BAM from MCS: ref #516977
2018-11-15 17:30:39 [INFO    ] Finished processing BAM request
2018-11-15 17:30:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:30:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516977   8 58437 63039029 A  ERROR'
2018-11-15 17:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 17:30:39 [DEBUG   ] spawn_process: at 2018-11-15 17:30:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 17:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 17:30:39 [DEBUG   ] spawn_process: at 2018-11-15 17:30:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 17:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 17:30:39 [DEBUG   ] spawn_process: at 2018-11-15 17:30:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 17:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 17:30:39 [DEBUG   ] spawn_process: at 2018-11-15 17:30:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 17:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 17:30:39 [DEBUG   ] spawn_process: at 2018-11-15 17:30:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 17:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 17:30:39 [DEBUG   ] spawn_process: at 2018-11-15 17:30:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 17:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 17:30:39 [DEBUG   ] spawn_process: at 2018-11-15 17:30:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 17:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 17:30:39 [DEBUG   ] spawn_process: at 2018-11-15 17:30:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 17:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 17:30:39 [DEBUG   ] spawn_process: at 2018-11-15 17:30:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 17:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 17:30:39 [DEBUG   ] spawn_process: at 2018-11-15 17:30:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 17:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 17:30:39 [DEBUG   ] spawn_process: at 2018-11-15 17:30:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 17:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 17:30:39 [DEBUG   ] spawn_process: at 2018-11-15 17:30:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 17:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 17:30:39 [DEBUG   ] spawn_process: at 2018-11-15 17:30:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 17:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 17:30:39 [DEBUG   ] spawn_process: at 2018-11-15 17:30:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 17:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 17:30:39 [DEBUG   ] spawn_process: at 2018-11-15 17:30:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 17:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 17:30:39 [DEBUG   ] spawn_process: at 2018-11-15 17:30:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 17:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 17:30:39 [DEBUG   ] spawn_process: at 2018-11-15 17:30:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 17:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 17:30:39 [DEBUG   ] spawn_process: at 2018-11-15 17:30:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 17:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 17:30:39 [DEBUG   ] spawn_process: at 2018-11-15 17:30:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 17:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 17:30:39 [DEBUG   ] spawn_process: at 2018-11-15 17:30:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 17:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 17:30:39 [DEBUG   ] spawn_process: at 2018-11-15 17:30:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 17:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 17:30:39 [DEBUG   ] spawn_process: at 2018-11-15 17:30:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 17:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 17:30:39 [DEBUG   ] spawn_process: at 2018-11-15 17:30:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 17:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 17:30:39 [DEBUG   ] spawn_process: at 2018-11-15 17:30:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 17:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 17:30:39 [DEBUG   ] spawn_process: at 2018-11-15 17:30:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 17:30:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 17:30:39 [DEBUG   ] spawn_process: at 2018-11-15 17:30:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 17:30:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 17:30:45 [DEBUG   ] Got command RPT from MCS: ref #516979
2018-11-15 17:30:45 [DEBUG   ] summary = ERROR
2018-11-15 17:30:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516979  13 58437 63045149 A  ERRORERROR'
2018-11-15 17:30:45 [DEBUG   ] Got command RPT from MCS: ref #516980
2018-11-15 17:30:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 17:30:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   516980  77 58437 63045150 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 17:31:01 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 17:31:03 [DEBUG   ] Got command BAM from MCS: ref #516996
2018-11-15 17:31:03 [INFO    ] Finished processing BAM request
2018-11-15 17:31:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:31:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516996   8 58437 63063033 A  ERROR'
2018-11-15 17:31:03 [DEBUG   ] Got command BAM from MCS: ref #516997
2018-11-15 17:31:03 [INFO    ] Finished processing BAM request
2018-11-15 17:31:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:31:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516997   8 58437 63063037 A  ERROR'
2018-11-15 17:31:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 17:31:03 [DEBUG   ] spawn_process: at 2018-11-15 17:31:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 17:31:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 17:31:03 [DEBUG   ] spawn_process: at 2018-11-15 17:31:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 17:31:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 17:31:03 [DEBUG   ] spawn_process: at 2018-11-15 17:31:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 17:31:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 17:31:03 [DEBUG   ] spawn_process: at 2018-11-15 17:31:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 17:31:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 17:31:03 [DEBUG   ] spawn_process: at 2018-11-15 17:31:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 17:31:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 17:31:03 [DEBUG   ] spawn_process: at 2018-11-15 17:31:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 17:31:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 17:31:03 [DEBUG   ] spawn_process: at 2018-11-15 17:31:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 17:31:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 17:31:03 [DEBUG   ] spawn_process: at 2018-11-15 17:31:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 17:31:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 17:31:03 [DEBUG   ] spawn_process: at 2018-11-15 17:31:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 17:31:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 17:31:03 [DEBUG   ] spawn_process: at 2018-11-15 17:31:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 17:31:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 17:31:03 [DEBUG   ] spawn_process: at 2018-11-15 17:31:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 17:31:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 17:31:03 [DEBUG   ] spawn_process: at 2018-11-15 17:31:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 17:31:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 17:31:03 [DEBUG   ] spawn_process: at 2018-11-15 17:31:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 17:31:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 17:31:03 [DEBUG   ] spawn_process: at 2018-11-15 17:31:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 17:31:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 17:31:03 [DEBUG   ] spawn_process: at 2018-11-15 17:31:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 17:31:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 17:31:03 [DEBUG   ] spawn_process: at 2018-11-15 17:31:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 17:31:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 17:31:03 [DEBUG   ] spawn_process: at 2018-11-15 17:31:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 17:31:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 17:31:03 [DEBUG   ] spawn_process: at 2018-11-15 17:31:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 17:31:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 17:31:03 [DEBUG   ] spawn_process: at 2018-11-15 17:31:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 17:31:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 17:31:03 [DEBUG   ] spawn_process: at 2018-11-15 17:31:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 17:31:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 17:31:03 [DEBUG   ] spawn_process: at 2018-11-15 17:31:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 17:31:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 17:31:03 [DEBUG   ] spawn_process: at 2018-11-15 17:31:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 17:31:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 17:31:03 [DEBUG   ] spawn_process: at 2018-11-15 17:31:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 17:31:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 17:31:03 [DEBUG   ] spawn_process: at 2018-11-15 17:31:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 17:31:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 17:31:03 [DEBUG   ] spawn_process: at 2018-11-15 17:31:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 17:31:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 17:31:03 [DEBUG   ] spawn_process: at 2018-11-15 17:31:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 17:31:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-11-15 17:31:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:31:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-11-15 17:31:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 17:31:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 17:31:06 [WARNING ] (13, 1, 'bot')
2018-11-15 17:31:06 [WARNING ] (13, 1, 'bot')
2018-11-15 17:31:06 [WARNING ] (13, 1, 'bot')
2018-11-15 17:31:06 [WARNING ] (13, 1, 'bot')
2018-11-15 17:31:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:31:06 [DEBUG   ] Finished updating board flags in 1.187 seconds
2018-11-15 17:31:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 17:31:27 [DEBUG   ] Got command BAM from MCS: ref #516999
2018-11-15 17:31:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:31:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516999   8 58437 63087025 A  ERROR'
2018-11-15 17:31:27 [DEBUG   ] Got command BAM from MCS: ref #516998
2018-11-15 17:31:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:31:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   516998   8 58437 63087029 A  ERROR'
2018-11-15 17:31:27 [INFO    ] Finished processing BAM request
2018-11-15 17:31:27 [INFO    ] Finished processing BAM request
2018-11-15 17:31:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 17:31:27 [DEBUG   ] spawn_process: at 2018-11-15 17:31:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 17:31:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 17:31:27 [DEBUG   ] spawn_process: at 2018-11-15 17:31:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 17:31:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 17:31:27 [DEBUG   ] spawn_process: at 2018-11-15 17:31:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 17:31:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 17:31:27 [DEBUG   ] spawn_process: at 2018-11-15 17:31:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 17:31:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 17:31:27 [DEBUG   ] spawn_process: at 2018-11-15 17:31:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 17:31:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 17:31:27 [DEBUG   ] spawn_process: at 2018-11-15 17:31:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 17:31:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 17:31:27 [DEBUG   ] spawn_process: at 2018-11-15 17:31:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 17:31:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 17:31:27 [DEBUG   ] spawn_process: at 2018-11-15 17:31:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 17:31:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 17:31:27 [DEBUG   ] spawn_process: at 2018-11-15 17:31:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 17:31:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 17:31:27 [DEBUG   ] spawn_process: at 2018-11-15 17:31:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 17:31:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 17:31:27 [DEBUG   ] spawn_process: at 2018-11-15 17:31:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 17:31:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 17:31:27 [DEBUG   ] spawn_process: at 2018-11-15 17:31:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 17:31:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 17:31:27 [DEBUG   ] spawn_process: at 2018-11-15 17:31:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 17:31:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 17:31:27 [DEBUG   ] spawn_process: at 2018-11-15 17:31:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 17:31:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 17:31:27 [DEBUG   ] spawn_process: at 2018-11-15 17:31:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 17:31:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 17:31:27 [DEBUG   ] spawn_process: at 2018-11-15 17:31:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 17:31:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 17:31:27 [DEBUG   ] spawn_process: at 2018-11-15 17:31:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 17:31:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 17:31:27 [DEBUG   ] spawn_process: at 2018-11-15 17:31:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 17:31:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 17:31:27 [DEBUG   ] spawn_process: at 2018-11-15 17:31:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 17:31:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 17:31:27 [DEBUG   ] spawn_process: at 2018-11-15 17:31:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 17:31:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 17:31:27 [DEBUG   ] spawn_process: at 2018-11-15 17:31:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 17:31:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 17:31:27 [DEBUG   ] spawn_process: at 2018-11-15 17:31:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 17:31:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 17:31:27 [DEBUG   ] spawn_process: at 2018-11-15 17:31:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 17:31:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 17:31:27 [DEBUG   ] spawn_process: at 2018-11-15 17:31:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 17:31:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 17:31:27 [DEBUG   ] spawn_process: at 2018-11-15 17:31:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 17:31:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 17:31:27 [DEBUG   ] spawn_process: at 2018-11-15 17:31:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 17:31:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 17:31:51 [DEBUG   ] Got command BAM from MCS: ref #517001
2018-11-15 17:31:51 [INFO    ] Finished processing BAM request
2018-11-15 17:31:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:31:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517001   8 58437 63111025 A  ERROR'
2018-11-15 17:31:51 [DEBUG   ] Got command BAM from MCS: ref #517000
2018-11-15 17:31:51 [INFO    ] Finished processing BAM request
2018-11-15 17:31:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:31:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517000   8 58437 63111029 A  ERROR'
2018-11-15 17:31:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 17:31:51 [DEBUG   ] spawn_process: at 2018-11-15 17:31:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 17:31:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 17:31:51 [DEBUG   ] spawn_process: at 2018-11-15 17:31:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 17:31:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 17:31:51 [DEBUG   ] spawn_process: at 2018-11-15 17:31:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 17:31:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 17:31:51 [DEBUG   ] spawn_process: at 2018-11-15 17:31:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 17:31:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 17:31:51 [DEBUG   ] spawn_process: at 2018-11-15 17:31:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 17:31:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 17:31:51 [DEBUG   ] spawn_process: at 2018-11-15 17:31:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 17:31:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 17:31:51 [DEBUG   ] spawn_process: at 2018-11-15 17:31:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 17:31:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 17:31:51 [DEBUG   ] spawn_process: at 2018-11-15 17:31:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 17:31:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 17:31:51 [DEBUG   ] spawn_process: at 2018-11-15 17:31:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 17:31:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 17:31:51 [DEBUG   ] spawn_process: at 2018-11-15 17:31:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 17:31:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 17:31:51 [DEBUG   ] spawn_process: at 2018-11-15 17:31:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 17:31:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 17:31:51 [DEBUG   ] spawn_process: at 2018-11-15 17:31:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 17:31:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 17:31:51 [DEBUG   ] spawn_process: at 2018-11-15 17:31:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 17:31:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 17:31:51 [DEBUG   ] spawn_process: at 2018-11-15 17:31:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 17:31:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 17:31:51 [DEBUG   ] spawn_process: at 2018-11-15 17:31:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 17:31:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 17:31:51 [DEBUG   ] spawn_process: at 2018-11-15 17:31:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 17:31:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 17:31:51 [DEBUG   ] spawn_process: at 2018-11-15 17:31:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 17:31:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 17:31:51 [DEBUG   ] spawn_process: at 2018-11-15 17:31:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 17:31:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 17:31:51 [DEBUG   ] spawn_process: at 2018-11-15 17:31:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 17:31:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 17:31:51 [DEBUG   ] spawn_process: at 2018-11-15 17:31:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 17:31:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 17:31:51 [DEBUG   ] spawn_process: at 2018-11-15 17:31:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 17:31:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 17:31:51 [DEBUG   ] spawn_process: at 2018-11-15 17:31:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 17:31:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 17:31:51 [DEBUG   ] spawn_process: at 2018-11-15 17:31:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 17:31:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 17:31:51 [DEBUG   ] spawn_process: at 2018-11-15 17:31:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 17:31:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 17:31:51 [DEBUG   ] spawn_process: at 2018-11-15 17:31:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 17:31:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 17:31:51 [DEBUG   ] spawn_process: at 2018-11-15 17:31:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 17:32:01 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 17:32:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:32:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 17:32:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 17:32:06 [WARNING ] (13, 1, 'bot')
2018-11-15 17:32:06 [WARNING ] (13, 1, 'bot')
2018-11-15 17:32:06 [WARNING ] (13, 1, 'bot')
2018-11-15 17:32:06 [WARNING ] (13, 1, 'bot')
2018-11-15 17:32:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:32:06 [DEBUG   ] Finished updating board flags in 1.017 seconds
2018-11-15 17:32:15 [DEBUG   ] Got command BAM from MCS: ref #517002
2018-11-15 17:32:15 [INFO    ] Finished processing BAM request
2018-11-15 17:32:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:32:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517002   8 58437 63135029 A  ERROR'
2018-11-15 17:32:15 [DEBUG   ] Got command BAM from MCS: ref #517003
2018-11-15 17:32:15 [INFO    ] Finished processing BAM request
2018-11-15 17:32:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:32:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517003   8 58437 63135033 A  ERROR'
2018-11-15 17:32:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 17:32:15 [DEBUG   ] spawn_process: at 2018-11-15 17:32:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 17:32:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 17:32:15 [DEBUG   ] spawn_process: at 2018-11-15 17:32:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 17:32:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 17:32:15 [DEBUG   ] spawn_process: at 2018-11-15 17:32:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 17:32:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 17:32:15 [DEBUG   ] spawn_process: at 2018-11-15 17:32:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 17:32:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 17:32:15 [DEBUG   ] spawn_process: at 2018-11-15 17:32:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 17:32:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 17:32:15 [DEBUG   ] spawn_process: at 2018-11-15 17:32:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 17:32:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 17:32:15 [DEBUG   ] spawn_process: at 2018-11-15 17:32:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 17:32:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 17:32:15 [DEBUG   ] spawn_process: at 2018-11-15 17:32:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 17:32:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 17:32:15 [DEBUG   ] spawn_process: at 2018-11-15 17:32:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 17:32:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 17:32:15 [DEBUG   ] spawn_process: at 2018-11-15 17:32:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 17:32:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 17:32:15 [DEBUG   ] spawn_process: at 2018-11-15 17:32:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 17:32:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 17:32:15 [DEBUG   ] spawn_process: at 2018-11-15 17:32:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 17:32:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 17:32:15 [DEBUG   ] spawn_process: at 2018-11-15 17:32:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 17:32:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 17:32:15 [DEBUG   ] spawn_process: at 2018-11-15 17:32:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 17:32:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 17:32:15 [DEBUG   ] spawn_process: at 2018-11-15 17:32:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 17:32:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 17:32:15 [DEBUG   ] spawn_process: at 2018-11-15 17:32:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 17:32:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 17:32:15 [DEBUG   ] spawn_process: at 2018-11-15 17:32:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 17:32:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 17:32:15 [DEBUG   ] spawn_process: at 2018-11-15 17:32:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 17:32:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 17:32:15 [DEBUG   ] spawn_process: at 2018-11-15 17:32:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 17:32:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 17:32:15 [DEBUG   ] spawn_process: at 2018-11-15 17:32:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 17:32:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 17:32:15 [DEBUG   ] spawn_process: at 2018-11-15 17:32:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 17:32:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 17:32:15 [DEBUG   ] spawn_process: at 2018-11-15 17:32:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 17:32:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 17:32:15 [DEBUG   ] spawn_process: at 2018-11-15 17:32:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 17:32:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 17:32:15 [DEBUG   ] spawn_process: at 2018-11-15 17:32:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 17:32:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 17:32:15 [DEBUG   ] spawn_process: at 2018-11-15 17:32:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 17:32:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 17:32:15 [DEBUG   ] spawn_process: at 2018-11-15 17:32:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 17:32:21 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-11-15 17:32:39 [DEBUG   ] Got command BAM from MCS: ref #517009
2018-11-15 17:32:39 [INFO    ] Finished processing BAM request
2018-11-15 17:32:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:32:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517009   8 58437 63159029 A  ERROR'
2018-11-15 17:32:39 [DEBUG   ] Got command BAM from MCS: ref #517008
2018-11-15 17:32:39 [INFO    ] Finished processing BAM request
2018-11-15 17:32:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:32:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517008   8 58437 63159033 A  ERROR'
2018-11-15 17:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 17:32:39 [DEBUG   ] spawn_process: at 2018-11-15 17:32:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 17:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 17:32:39 [DEBUG   ] spawn_process: at 2018-11-15 17:32:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 17:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 17:32:39 [DEBUG   ] spawn_process: at 2018-11-15 17:32:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 17:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 17:32:39 [DEBUG   ] spawn_process: at 2018-11-15 17:32:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 17:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 17:32:39 [DEBUG   ] spawn_process: at 2018-11-15 17:32:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 17:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 17:32:39 [DEBUG   ] spawn_process: at 2018-11-15 17:32:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 17:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 17:32:39 [DEBUG   ] spawn_process: at 2018-11-15 17:32:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 17:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 17:32:39 [DEBUG   ] spawn_process: at 2018-11-15 17:32:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 17:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 17:32:39 [DEBUG   ] spawn_process: at 2018-11-15 17:32:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 17:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 17:32:39 [DEBUG   ] spawn_process: at 2018-11-15 17:32:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 17:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 17:32:39 [DEBUG   ] spawn_process: at 2018-11-15 17:32:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 17:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 17:32:39 [DEBUG   ] spawn_process: at 2018-11-15 17:32:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 17:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 17:32:39 [DEBUG   ] spawn_process: at 2018-11-15 17:32:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 17:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 17:32:39 [DEBUG   ] spawn_process: at 2018-11-15 17:32:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 17:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 17:32:39 [DEBUG   ] spawn_process: at 2018-11-15 17:32:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 17:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 17:32:39 [DEBUG   ] spawn_process: at 2018-11-15 17:32:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 17:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 17:32:39 [DEBUG   ] spawn_process: at 2018-11-15 17:32:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 17:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 17:32:39 [DEBUG   ] spawn_process: at 2018-11-15 17:32:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 17:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 17:32:39 [DEBUG   ] spawn_process: at 2018-11-15 17:32:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 17:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 17:32:39 [DEBUG   ] spawn_process: at 2018-11-15 17:32:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 17:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 17:32:39 [DEBUG   ] spawn_process: at 2018-11-15 17:32:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 17:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 17:32:39 [DEBUG   ] spawn_process: at 2018-11-15 17:32:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 17:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 17:32:39 [DEBUG   ] spawn_process: at 2018-11-15 17:32:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 17:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 17:32:39 [DEBUG   ] spawn_process: at 2018-11-15 17:32:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 17:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 17:32:39 [DEBUG   ] spawn_process: at 2018-11-15 17:32:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 17:32:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 17:32:39 [DEBUG   ] spawn_process: at 2018-11-15 17:32:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 17:32:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 17:33:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 17:33:03 [DEBUG   ] Got command BAM from MCS: ref #517011
2018-11-15 17:33:03 [INFO    ] Finished processing BAM request
2018-11-15 17:33:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:33:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517011   8 58437 63183029 A  ERROR'
2018-11-15 17:33:03 [DEBUG   ] Got command BAM from MCS: ref #517010
2018-11-15 17:33:03 [INFO    ] Finished processing BAM request
2018-11-15 17:33:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:33:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517010   8 58437 63183033 A  ERROR'
2018-11-15 17:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 17:33:03 [DEBUG   ] spawn_process: at 2018-11-15 17:33:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 17:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 17:33:03 [DEBUG   ] spawn_process: at 2018-11-15 17:33:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 17:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 17:33:03 [DEBUG   ] spawn_process: at 2018-11-15 17:33:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 17:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 17:33:03 [DEBUG   ] spawn_process: at 2018-11-15 17:33:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 17:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 17:33:03 [DEBUG   ] spawn_process: at 2018-11-15 17:33:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 17:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 17:33:03 [DEBUG   ] spawn_process: at 2018-11-15 17:33:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 17:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 17:33:03 [DEBUG   ] spawn_process: at 2018-11-15 17:33:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 17:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 17:33:03 [DEBUG   ] spawn_process: at 2018-11-15 17:33:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 17:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 17:33:03 [DEBUG   ] spawn_process: at 2018-11-15 17:33:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 17:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 17:33:03 [DEBUG   ] spawn_process: at 2018-11-15 17:33:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 17:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 17:33:03 [DEBUG   ] spawn_process: at 2018-11-15 17:33:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 17:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 17:33:03 [DEBUG   ] spawn_process: at 2018-11-15 17:33:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 17:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 17:33:03 [DEBUG   ] spawn_process: at 2018-11-15 17:33:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 17:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 17:33:03 [DEBUG   ] spawn_process: at 2018-11-15 17:33:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 17:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 17:33:03 [DEBUG   ] spawn_process: at 2018-11-15 17:33:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 17:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 17:33:03 [DEBUG   ] spawn_process: at 2018-11-15 17:33:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 17:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 17:33:03 [DEBUG   ] spawn_process: at 2018-11-15 17:33:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 17:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 17:33:03 [DEBUG   ] spawn_process: at 2018-11-15 17:33:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 17:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 17:33:03 [DEBUG   ] spawn_process: at 2018-11-15 17:33:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 17:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 17:33:03 [DEBUG   ] spawn_process: at 2018-11-15 17:33:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 17:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 17:33:03 [DEBUG   ] spawn_process: at 2018-11-15 17:33:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 17:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 17:33:03 [DEBUG   ] spawn_process: at 2018-11-15 17:33:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 17:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 17:33:03 [DEBUG   ] spawn_process: at 2018-11-15 17:33:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 17:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 17:33:03 [DEBUG   ] spawn_process: at 2018-11-15 17:33:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 17:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 17:33:03 [DEBUG   ] spawn_process: at 2018-11-15 17:33:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 17:33:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 17:33:03 [DEBUG   ] spawn_process: at 2018-11-15 17:33:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 17:33:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-11-15 17:33:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 17:33:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:33:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-11-15 17:33:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-11-15 17:33:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 17:33:06 [WARNING ] (13, 1, 'bot')
2018-11-15 17:33:06 [WARNING ] (13, 1, 'bot')
2018-11-15 17:33:06 [WARNING ] (13, 1, 'bot')
2018-11-15 17:33:06 [WARNING ] (13, 1, 'bot')
2018-11-15 17:33:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:33:06 [DEBUG   ] Finished updating board flags in 0.960 seconds
2018-11-15 17:33:20 [DEBUG   ] Got command RPT from MCS: ref #517012
2018-11-15 17:33:20 [DEBUG   ] summary = ERROR
2018-11-15 17:33:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517012  13 58437 63200609 A  ERRORERROR'
2018-11-15 17:33:20 [DEBUG   ] Got command RPT from MCS: ref #517013
2018-11-15 17:33:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 17:33:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517013  77 58437 63200813 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 17:33:21 [DEBUG   ] Got command RPT from MCS: ref #517014
2018-11-15 17:33:21 [DEBUG   ] summary = ERROR
2018-11-15 17:33:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517014  13 58437 63201017 A  ERRORERROR'
2018-11-15 17:33:21 [DEBUG   ] Got command RPT from MCS: ref #517015
2018-11-15 17:33:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 17:33:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517015  77 58437 63201221 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 17:33:21 [DEBUG   ] Got command RPT from MCS: ref #517016
2018-11-15 17:33:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 17:33:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517016  12 58437 63201413 A  ERRORB£ff'
2018-11-15 17:33:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 17:33:27 [DEBUG   ] Got command BAM from MCS: ref #517018
2018-11-15 17:33:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:33:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517018   8 58437 63207033 A  ERROR'
2018-11-15 17:33:27 [DEBUG   ] Got command BAM from MCS: ref #517017
2018-11-15 17:33:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:33:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517017   8 58437 63207037 A  ERROR'
2018-11-15 17:33:27 [INFO    ] Finished processing BAM request
2018-11-15 17:33:27 [INFO    ] Finished processing BAM request
2018-11-15 17:33:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 17:33:27 [DEBUG   ] spawn_process: at 2018-11-15 17:33:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 17:33:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 17:33:27 [DEBUG   ] spawn_process: at 2018-11-15 17:33:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 17:33:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 17:33:27 [DEBUG   ] spawn_process: at 2018-11-15 17:33:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 17:33:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 17:33:27 [DEBUG   ] spawn_process: at 2018-11-15 17:33:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 17:33:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 17:33:27 [DEBUG   ] spawn_process: at 2018-11-15 17:33:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 17:33:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 17:33:27 [DEBUG   ] spawn_process: at 2018-11-15 17:33:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 17:33:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 17:33:27 [DEBUG   ] spawn_process: at 2018-11-15 17:33:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 17:33:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 17:33:27 [DEBUG   ] spawn_process: at 2018-11-15 17:33:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 17:33:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 17:33:27 [DEBUG   ] spawn_process: at 2018-11-15 17:33:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 17:33:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 17:33:27 [DEBUG   ] spawn_process: at 2018-11-15 17:33:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 17:33:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 17:33:27 [DEBUG   ] spawn_process: at 2018-11-15 17:33:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 17:33:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 17:33:27 [DEBUG   ] spawn_process: at 2018-11-15 17:33:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 17:33:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 17:33:27 [DEBUG   ] spawn_process: at 2018-11-15 17:33:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 17:33:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 17:33:27 [DEBUG   ] spawn_process: at 2018-11-15 17:33:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 17:33:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 17:33:27 [DEBUG   ] spawn_process: at 2018-11-15 17:33:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 17:33:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 17:33:27 [DEBUG   ] spawn_process: at 2018-11-15 17:33:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 17:33:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 17:33:27 [DEBUG   ] spawn_process: at 2018-11-15 17:33:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 17:33:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 17:33:27 [DEBUG   ] spawn_process: at 2018-11-15 17:33:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 17:33:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 17:33:27 [DEBUG   ] spawn_process: at 2018-11-15 17:33:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 17:33:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 17:33:27 [DEBUG   ] spawn_process: at 2018-11-15 17:33:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 17:33:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 17:33:27 [DEBUG   ] spawn_process: at 2018-11-15 17:33:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 17:33:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 17:33:27 [DEBUG   ] spawn_process: at 2018-11-15 17:33:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 17:33:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 17:33:27 [DEBUG   ] spawn_process: at 2018-11-15 17:33:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 17:33:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 17:33:27 [DEBUG   ] spawn_process: at 2018-11-15 17:33:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 17:33:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 17:33:27 [DEBUG   ] spawn_process: at 2018-11-15 17:33:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 17:33:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 17:33:27 [DEBUG   ] spawn_process: at 2018-11-15 17:33:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 17:33:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 17:33:51 [DEBUG   ] Got command BAM from MCS: ref #517019
2018-11-15 17:33:51 [INFO    ] Finished processing BAM request
2018-11-15 17:33:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:33:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517019   8 58437 63231033 A  ERROR'
2018-11-15 17:33:51 [DEBUG   ] Got command BAM from MCS: ref #517020
2018-11-15 17:33:51 [INFO    ] Finished processing BAM request
2018-11-15 17:33:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:33:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517020   8 58437 63231037 A  ERROR'
2018-11-15 17:33:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 17:33:51 [DEBUG   ] spawn_process: at 2018-11-15 17:33:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 17:33:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 17:33:51 [DEBUG   ] spawn_process: at 2018-11-15 17:33:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 17:33:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 17:33:51 [DEBUG   ] spawn_process: at 2018-11-15 17:33:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 17:33:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 17:33:51 [DEBUG   ] spawn_process: at 2018-11-15 17:33:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 17:33:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 17:33:51 [DEBUG   ] spawn_process: at 2018-11-15 17:33:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 17:33:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 17:33:51 [DEBUG   ] spawn_process: at 2018-11-15 17:33:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 17:33:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 17:33:51 [DEBUG   ] spawn_process: at 2018-11-15 17:33:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 17:33:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 17:33:51 [DEBUG   ] spawn_process: at 2018-11-15 17:33:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 17:33:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 17:33:51 [DEBUG   ] spawn_process: at 2018-11-15 17:33:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 17:33:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 17:33:51 [DEBUG   ] spawn_process: at 2018-11-15 17:33:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 17:33:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 17:33:51 [DEBUG   ] spawn_process: at 2018-11-15 17:33:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 17:33:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 17:33:51 [DEBUG   ] spawn_process: at 2018-11-15 17:33:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 17:33:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 17:33:51 [DEBUG   ] spawn_process: at 2018-11-15 17:33:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 17:33:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 17:33:51 [DEBUG   ] spawn_process: at 2018-11-15 17:33:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 17:33:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 17:33:51 [DEBUG   ] spawn_process: at 2018-11-15 17:33:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 17:33:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 17:33:51 [DEBUG   ] spawn_process: at 2018-11-15 17:33:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 17:33:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 17:33:51 [DEBUG   ] spawn_process: at 2018-11-15 17:33:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 17:33:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 17:33:51 [DEBUG   ] spawn_process: at 2018-11-15 17:33:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 17:33:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 17:33:51 [DEBUG   ] spawn_process: at 2018-11-15 17:33:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 17:33:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 17:33:51 [DEBUG   ] spawn_process: at 2018-11-15 17:33:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 17:33:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 17:33:51 [DEBUG   ] spawn_process: at 2018-11-15 17:33:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 17:33:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 17:33:51 [DEBUG   ] spawn_process: at 2018-11-15 17:33:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 17:33:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 17:33:51 [DEBUG   ] spawn_process: at 2018-11-15 17:33:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 17:33:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 17:33:51 [DEBUG   ] spawn_process: at 2018-11-15 17:33:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 17:33:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 17:33:51 [DEBUG   ] spawn_process: at 2018-11-15 17:33:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 17:33:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 17:33:51 [DEBUG   ] spawn_process: at 2018-11-15 17:33:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 17:34:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 17:34:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 17:34:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:34:07 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 17:34:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 17:34:07 [WARNING ] (13, 1, 'bot')
2018-11-15 17:34:07 [WARNING ] (13, 1, 'bot')
2018-11-15 17:34:07 [WARNING ] (13, 1, 'bot')
2018-11-15 17:34:07 [WARNING ] (13, 1, 'bot')
2018-11-15 17:34:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:34:07 [DEBUG   ] Finished updating board flags in 1.371 seconds
2018-11-15 17:34:15 [DEBUG   ] Got command BAM from MCS: ref #517021
2018-11-15 17:34:15 [INFO    ] Finished processing BAM request
2018-11-15 17:34:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:34:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517021   8 58437 63255025 A  ERROR'
2018-11-15 17:34:15 [DEBUG   ] Got command BAM from MCS: ref #517022
2018-11-15 17:34:15 [INFO    ] Finished processing BAM request
2018-11-15 17:34:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:34:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517022   8 58437 63255029 A  ERROR'
2018-11-15 17:34:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 17:34:15 [DEBUG   ] spawn_process: at 2018-11-15 17:34:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 17:34:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 17:34:15 [DEBUG   ] spawn_process: at 2018-11-15 17:34:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 17:34:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 17:34:15 [DEBUG   ] spawn_process: at 2018-11-15 17:34:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 17:34:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 17:34:15 [DEBUG   ] spawn_process: at 2018-11-15 17:34:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 17:34:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 17:34:15 [DEBUG   ] spawn_process: at 2018-11-15 17:34:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 17:34:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 17:34:15 [DEBUG   ] spawn_process: at 2018-11-15 17:34:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 17:34:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 17:34:15 [DEBUG   ] spawn_process: at 2018-11-15 17:34:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 17:34:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 17:34:15 [DEBUG   ] spawn_process: at 2018-11-15 17:34:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 17:34:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 17:34:15 [DEBUG   ] spawn_process: at 2018-11-15 17:34:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 17:34:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 17:34:15 [DEBUG   ] spawn_process: at 2018-11-15 17:34:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 17:34:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 17:34:15 [DEBUG   ] spawn_process: at 2018-11-15 17:34:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 17:34:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 17:34:15 [DEBUG   ] spawn_process: at 2018-11-15 17:34:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 17:34:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 17:34:15 [DEBUG   ] spawn_process: at 2018-11-15 17:34:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 17:34:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 17:34:15 [DEBUG   ] spawn_process: at 2018-11-15 17:34:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 17:34:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 17:34:15 [DEBUG   ] spawn_process: at 2018-11-15 17:34:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 17:34:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 17:34:15 [DEBUG   ] spawn_process: at 2018-11-15 17:34:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 17:34:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 17:34:15 [DEBUG   ] spawn_process: at 2018-11-15 17:34:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 17:34:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 17:34:15 [DEBUG   ] spawn_process: at 2018-11-15 17:34:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 17:34:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 17:34:15 [DEBUG   ] spawn_process: at 2018-11-15 17:34:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 17:34:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 17:34:15 [DEBUG   ] spawn_process: at 2018-11-15 17:34:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 17:34:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 17:34:15 [DEBUG   ] spawn_process: at 2018-11-15 17:34:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 17:34:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 17:34:15 [DEBUG   ] spawn_process: at 2018-11-15 17:34:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 17:34:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 17:34:15 [DEBUG   ] spawn_process: at 2018-11-15 17:34:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 17:34:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 17:34:15 [DEBUG   ] spawn_process: at 2018-11-15 17:34:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 17:34:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 17:34:15 [DEBUG   ] spawn_process: at 2018-11-15 17:34:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 17:34:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 17:34:15 [DEBUG   ] spawn_process: at 2018-11-15 17:34:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 17:34:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 17:34:39 [DEBUG   ] Got command BAM from MCS: ref #517023
2018-11-15 17:34:39 [INFO    ] Finished processing BAM request
2018-11-15 17:34:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:34:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517023   8 58437 63279033 A  ERROR'
2018-11-15 17:34:39 [DEBUG   ] Got command BAM from MCS: ref #517024
2018-11-15 17:34:39 [INFO    ] Finished processing BAM request
2018-11-15 17:34:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:34:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517024   8 58437 63279037 A  ERROR'
2018-11-15 17:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 17:34:39 [DEBUG   ] spawn_process: at 2018-11-15 17:34:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 17:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 17:34:39 [DEBUG   ] spawn_process: at 2018-11-15 17:34:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 17:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 17:34:39 [DEBUG   ] spawn_process: at 2018-11-15 17:34:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 17:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 17:34:39 [DEBUG   ] spawn_process: at 2018-11-15 17:34:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 17:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 17:34:39 [DEBUG   ] spawn_process: at 2018-11-15 17:34:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 17:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 17:34:39 [DEBUG   ] spawn_process: at 2018-11-15 17:34:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 17:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 17:34:39 [DEBUG   ] spawn_process: at 2018-11-15 17:34:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 17:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 17:34:39 [DEBUG   ] spawn_process: at 2018-11-15 17:34:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 17:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 17:34:39 [DEBUG   ] spawn_process: at 2018-11-15 17:34:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 17:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 17:34:39 [DEBUG   ] spawn_process: at 2018-11-15 17:34:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 17:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 17:34:39 [DEBUG   ] spawn_process: at 2018-11-15 17:34:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 17:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 17:34:39 [DEBUG   ] spawn_process: at 2018-11-15 17:34:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 17:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 17:34:39 [DEBUG   ] spawn_process: at 2018-11-15 17:34:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 17:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 17:34:39 [DEBUG   ] spawn_process: at 2018-11-15 17:34:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 17:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 17:34:39 [DEBUG   ] spawn_process: at 2018-11-15 17:34:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 17:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 17:34:39 [DEBUG   ] spawn_process: at 2018-11-15 17:34:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 17:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 17:34:39 [DEBUG   ] spawn_process: at 2018-11-15 17:34:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 17:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 17:34:39 [DEBUG   ] spawn_process: at 2018-11-15 17:34:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 17:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 17:34:39 [DEBUG   ] spawn_process: at 2018-11-15 17:34:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 17:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 17:34:39 [DEBUG   ] spawn_process: at 2018-11-15 17:34:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 17:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 17:34:39 [DEBUG   ] spawn_process: at 2018-11-15 17:34:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 17:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 17:34:39 [DEBUG   ] spawn_process: at 2018-11-15 17:34:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 17:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 17:34:39 [DEBUG   ] spawn_process: at 2018-11-15 17:34:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 17:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 17:34:39 [DEBUG   ] spawn_process: at 2018-11-15 17:34:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 17:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 17:34:39 [DEBUG   ] spawn_process: at 2018-11-15 17:34:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 17:34:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 17:34:39 [DEBUG   ] spawn_process: at 2018-11-15 17:34:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 17:34:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 17:35:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 17:35:03 [DEBUG   ] Got command BAM from MCS: ref #517026
2018-11-15 17:35:03 [INFO    ] Finished processing BAM request
2018-11-15 17:35:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:35:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517026   8 58437 63303033 A  ERROR'
2018-11-15 17:35:03 [DEBUG   ] Got command BAM from MCS: ref #517025
2018-11-15 17:35:03 [INFO    ] Finished processing BAM request
2018-11-15 17:35:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:35:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517025   8 58437 63303037 A  ERROR'
2018-11-15 17:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 17:35:03 [DEBUG   ] spawn_process: at 2018-11-15 17:35:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 17:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 17:35:03 [DEBUG   ] spawn_process: at 2018-11-15 17:35:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 17:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 17:35:03 [DEBUG   ] spawn_process: at 2018-11-15 17:35:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 17:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 17:35:03 [DEBUG   ] spawn_process: at 2018-11-15 17:35:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 17:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 17:35:03 [DEBUG   ] spawn_process: at 2018-11-15 17:35:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 17:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 17:35:03 [DEBUG   ] spawn_process: at 2018-11-15 17:35:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 17:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 17:35:03 [DEBUG   ] spawn_process: at 2018-11-15 17:35:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 17:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 17:35:03 [DEBUG   ] spawn_process: at 2018-11-15 17:35:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 17:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 17:35:03 [DEBUG   ] spawn_process: at 2018-11-15 17:35:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 17:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 17:35:03 [DEBUG   ] spawn_process: at 2018-11-15 17:35:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 17:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 17:35:03 [DEBUG   ] spawn_process: at 2018-11-15 17:35:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 17:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 17:35:03 [DEBUG   ] spawn_process: at 2018-11-15 17:35:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 17:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 17:35:03 [DEBUG   ] spawn_process: at 2018-11-15 17:35:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 17:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 17:35:03 [DEBUG   ] spawn_process: at 2018-11-15 17:35:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 17:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 17:35:03 [DEBUG   ] spawn_process: at 2018-11-15 17:35:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 17:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 17:35:03 [DEBUG   ] spawn_process: at 2018-11-15 17:35:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 17:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 17:35:03 [DEBUG   ] spawn_process: at 2018-11-15 17:35:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 17:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 17:35:03 [DEBUG   ] spawn_process: at 2018-11-15 17:35:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 17:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 17:35:03 [DEBUG   ] spawn_process: at 2018-11-15 17:35:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 17:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 17:35:03 [DEBUG   ] spawn_process: at 2018-11-15 17:35:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 17:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 17:35:03 [DEBUG   ] spawn_process: at 2018-11-15 17:35:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 17:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 17:35:03 [DEBUG   ] spawn_process: at 2018-11-15 17:35:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 17:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 17:35:03 [DEBUG   ] spawn_process: at 2018-11-15 17:35:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 17:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 17:35:03 [DEBUG   ] spawn_process: at 2018-11-15 17:35:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 17:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 17:35:03 [DEBUG   ] spawn_process: at 2018-11-15 17:35:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 17:35:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 17:35:03 [DEBUG   ] spawn_process: at 2018-11-15 17:35:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 17:35:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:35:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 17:35:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 17:35:07 [WARNING ] (13, 1, 'bot')
2018-11-15 17:35:07 [WARNING ] (13, 1, 'bot')
2018-11-15 17:35:07 [WARNING ] (13, 1, 'bot')
2018-11-15 17:35:07 [WARNING ] (13, 1, 'bot')
2018-11-15 17:35:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:35:07 [DEBUG   ] Finished updating board flags in 1.197 seconds
2018-11-15 17:35:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 17:35:28 [DEBUG   ] Got command BAM from MCS: ref #517032
2018-11-15 17:35:28 [INFO    ] Finished processing BAM request
2018-11-15 17:35:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:35:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517032   8 58437 63328029 A  ERROR'
2018-11-15 17:35:28 [DEBUG   ] Got command BAM from MCS: ref #517031
2018-11-15 17:35:28 [INFO    ] Finished processing BAM request
2018-11-15 17:35:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:35:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517031   8 58437 63328033 A  ERROR'
2018-11-15 17:35:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 17:35:28 [DEBUG   ] spawn_process: at 2018-11-15 17:35:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 17:35:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 17:35:28 [DEBUG   ] spawn_process: at 2018-11-15 17:35:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 17:35:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 17:35:28 [DEBUG   ] spawn_process: at 2018-11-15 17:35:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 17:35:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 17:35:28 [DEBUG   ] spawn_process: at 2018-11-15 17:35:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 17:35:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 17:35:28 [DEBUG   ] spawn_process: at 2018-11-15 17:35:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 17:35:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 17:35:28 [DEBUG   ] spawn_process: at 2018-11-15 17:35:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 17:35:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 17:35:28 [DEBUG   ] spawn_process: at 2018-11-15 17:35:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 17:35:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 17:35:28 [DEBUG   ] spawn_process: at 2018-11-15 17:35:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 17:35:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 17:35:28 [DEBUG   ] spawn_process: at 2018-11-15 17:35:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 17:35:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 17:35:28 [DEBUG   ] spawn_process: at 2018-11-15 17:35:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 17:35:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 17:35:28 [DEBUG   ] spawn_process: at 2018-11-15 17:35:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 17:35:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 17:35:28 [DEBUG   ] spawn_process: at 2018-11-15 17:35:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 17:35:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 17:35:28 [DEBUG   ] spawn_process: at 2018-11-15 17:35:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 17:35:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 17:35:28 [DEBUG   ] spawn_process: at 2018-11-15 17:35:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 17:35:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 17:35:28 [DEBUG   ] spawn_process: at 2018-11-15 17:35:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 17:35:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 17:35:28 [DEBUG   ] spawn_process: at 2018-11-15 17:35:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 17:35:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 17:35:28 [DEBUG   ] spawn_process: at 2018-11-15 17:35:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 17:35:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 17:35:28 [DEBUG   ] spawn_process: at 2018-11-15 17:35:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 17:35:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 17:35:28 [DEBUG   ] spawn_process: at 2018-11-15 17:35:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 17:35:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 17:35:28 [DEBUG   ] spawn_process: at 2018-11-15 17:35:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 17:35:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 17:35:28 [DEBUG   ] spawn_process: at 2018-11-15 17:35:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 17:35:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 17:35:28 [DEBUG   ] spawn_process: at 2018-11-15 17:35:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 17:35:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 17:35:28 [DEBUG   ] spawn_process: at 2018-11-15 17:35:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 17:35:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 17:35:28 [DEBUG   ] spawn_process: at 2018-11-15 17:35:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 17:35:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 17:35:28 [DEBUG   ] spawn_process: at 2018-11-15 17:35:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 17:35:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 17:35:28 [DEBUG   ] spawn_process: at 2018-11-15 17:35:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 17:35:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 17:35:45 [DEBUG   ] Got command RPT from MCS: ref #517033
2018-11-15 17:35:45 [DEBUG   ] summary = ERROR
2018-11-15 17:35:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517033  13 58437 63345149 A  ERRORERROR'
2018-11-15 17:35:45 [DEBUG   ] Got command RPT from MCS: ref #517034
2018-11-15 17:35:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 17:35:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517034  77 58437 63345150 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 17:35:53 [DEBUG   ] Got command BAM from MCS: ref #517050
2018-11-15 17:35:53 [INFO    ] Finished processing BAM request
2018-11-15 17:35:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:35:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517050   8 58437 63353025 A  ERROR'
2018-11-15 17:35:53 [DEBUG   ] Got command BAM from MCS: ref #517051
2018-11-15 17:35:53 [INFO    ] Finished processing BAM request
2018-11-15 17:35:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:35:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517051   8 58437 63353033 A  ERROR'
2018-11-15 17:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 17:35:53 [DEBUG   ] spawn_process: at 2018-11-15 17:35:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 17:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 17:35:53 [DEBUG   ] spawn_process: at 2018-11-15 17:35:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 17:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 17:35:53 [DEBUG   ] spawn_process: at 2018-11-15 17:35:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 17:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 17:35:53 [DEBUG   ] spawn_process: at 2018-11-15 17:35:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 17:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 17:35:53 [DEBUG   ] spawn_process: at 2018-11-15 17:35:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 17:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 17:35:53 [DEBUG   ] spawn_process: at 2018-11-15 17:35:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 17:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 17:35:53 [DEBUG   ] spawn_process: at 2018-11-15 17:35:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 17:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 17:35:53 [DEBUG   ] spawn_process: at 2018-11-15 17:35:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 17:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 17:35:53 [DEBUG   ] spawn_process: at 2018-11-15 17:35:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 17:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 17:35:53 [DEBUG   ] spawn_process: at 2018-11-15 17:35:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 17:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 17:35:53 [DEBUG   ] spawn_process: at 2018-11-15 17:35:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 17:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 17:35:53 [DEBUG   ] spawn_process: at 2018-11-15 17:35:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 17:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 17:35:53 [DEBUG   ] spawn_process: at 2018-11-15 17:35:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 17:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 17:35:53 [DEBUG   ] spawn_process: at 2018-11-15 17:35:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 17:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 17:35:53 [DEBUG   ] spawn_process: at 2018-11-15 17:35:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 17:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 17:35:53 [DEBUG   ] spawn_process: at 2018-11-15 17:35:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 17:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 17:35:53 [DEBUG   ] spawn_process: at 2018-11-15 17:35:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 17:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 17:35:53 [DEBUG   ] spawn_process: at 2018-11-15 17:35:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 17:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 17:35:53 [DEBUG   ] spawn_process: at 2018-11-15 17:35:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 17:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 17:35:53 [DEBUG   ] spawn_process: at 2018-11-15 17:35:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 17:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 17:35:53 [DEBUG   ] spawn_process: at 2018-11-15 17:35:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 17:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 17:35:53 [DEBUG   ] spawn_process: at 2018-11-15 17:35:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 17:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 17:35:53 [DEBUG   ] spawn_process: at 2018-11-15 17:35:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 17:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 17:35:53 [DEBUG   ] spawn_process: at 2018-11-15 17:35:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 17:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 17:35:53 [DEBUG   ] spawn_process: at 2018-11-15 17:35:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 17:35:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 17:35:53 [DEBUG   ] spawn_process: at 2018-11-15 17:35:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 17:36:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 17:36:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:36:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 17:36:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 17:36:07 [WARNING ] (13, 1, 'bot')
2018-11-15 17:36:07 [WARNING ] (13, 1, 'bot')
2018-11-15 17:36:07 [WARNING ] (13, 1, 'bot')
2018-11-15 17:36:07 [WARNING ] (13, 1, 'bot')
2018-11-15 17:36:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:36:07 [DEBUG   ] Finished updating board flags in 1.438 seconds
2018-11-15 17:36:18 [DEBUG   ] Got command BAM from MCS: ref #517053
2018-11-15 17:36:18 [INFO    ] Finished processing BAM request
2018-11-15 17:36:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:36:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517053   8 58437 63378025 A  ERROR'
2018-11-15 17:36:18 [DEBUG   ] Got command BAM from MCS: ref #517052
2018-11-15 17:36:18 [INFO    ] Finished processing BAM request
2018-11-15 17:36:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:36:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517052   8 58437 63378029 A  ERROR'
2018-11-15 17:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 17:36:18 [DEBUG   ] spawn_process: at 2018-11-15 17:36:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 17:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 17:36:18 [DEBUG   ] spawn_process: at 2018-11-15 17:36:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 17:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 17:36:18 [DEBUG   ] spawn_process: at 2018-11-15 17:36:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 17:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 17:36:18 [DEBUG   ] spawn_process: at 2018-11-15 17:36:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 17:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 17:36:18 [DEBUG   ] spawn_process: at 2018-11-15 17:36:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 17:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 17:36:18 [DEBUG   ] spawn_process: at 2018-11-15 17:36:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 17:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 17:36:18 [DEBUG   ] spawn_process: at 2018-11-15 17:36:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 17:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 17:36:18 [DEBUG   ] spawn_process: at 2018-11-15 17:36:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 17:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 17:36:18 [DEBUG   ] spawn_process: at 2018-11-15 17:36:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 17:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 17:36:18 [DEBUG   ] spawn_process: at 2018-11-15 17:36:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 17:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 17:36:18 [DEBUG   ] spawn_process: at 2018-11-15 17:36:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 17:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 17:36:18 [DEBUG   ] spawn_process: at 2018-11-15 17:36:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 17:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 17:36:18 [DEBUG   ] spawn_process: at 2018-11-15 17:36:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 17:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 17:36:18 [DEBUG   ] spawn_process: at 2018-11-15 17:36:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 17:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 17:36:18 [DEBUG   ] spawn_process: at 2018-11-15 17:36:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 17:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 17:36:18 [DEBUG   ] spawn_process: at 2018-11-15 17:36:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 17:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 17:36:18 [DEBUG   ] spawn_process: at 2018-11-15 17:36:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 17:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 17:36:18 [DEBUG   ] spawn_process: at 2018-11-15 17:36:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 17:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 17:36:18 [DEBUG   ] spawn_process: at 2018-11-15 17:36:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 17:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 17:36:18 [DEBUG   ] spawn_process: at 2018-11-15 17:36:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 17:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 17:36:18 [DEBUG   ] spawn_process: at 2018-11-15 17:36:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 17:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 17:36:18 [DEBUG   ] spawn_process: at 2018-11-15 17:36:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 17:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 17:36:18 [DEBUG   ] spawn_process: at 2018-11-15 17:36:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 17:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 17:36:18 [DEBUG   ] spawn_process: at 2018-11-15 17:36:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 17:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 17:36:18 [DEBUG   ] spawn_process: at 2018-11-15 17:36:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 17:36:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 17:36:18 [DEBUG   ] spawn_process: at 2018-11-15 17:36:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 17:36:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 17:36:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 17:36:43 [DEBUG   ] Got command BAM from MCS: ref #517054
2018-11-15 17:36:43 [INFO    ] Finished processing BAM request
2018-11-15 17:36:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:36:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517054   8 58437 63403029 A  ERROR'
2018-11-15 17:36:43 [DEBUG   ] Got command BAM from MCS: ref #517055
2018-11-15 17:36:43 [INFO    ] Finished processing BAM request
2018-11-15 17:36:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:36:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517055   8 58437 63403033 A  ERROR'
2018-11-15 17:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 17:36:43 [DEBUG   ] spawn_process: at 2018-11-15 17:36:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 17:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 17:36:43 [DEBUG   ] spawn_process: at 2018-11-15 17:36:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 17:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 17:36:43 [DEBUG   ] spawn_process: at 2018-11-15 17:36:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 17:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 17:36:43 [DEBUG   ] spawn_process: at 2018-11-15 17:36:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 17:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 17:36:43 [DEBUG   ] spawn_process: at 2018-11-15 17:36:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 17:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 17:36:43 [DEBUG   ] spawn_process: at 2018-11-15 17:36:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 17:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 17:36:43 [DEBUG   ] spawn_process: at 2018-11-15 17:36:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 17:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 17:36:43 [DEBUG   ] spawn_process: at 2018-11-15 17:36:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 17:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 17:36:43 [DEBUG   ] spawn_process: at 2018-11-15 17:36:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 17:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 17:36:43 [DEBUG   ] spawn_process: at 2018-11-15 17:36:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 17:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 17:36:43 [DEBUG   ] spawn_process: at 2018-11-15 17:36:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 17:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 17:36:43 [DEBUG   ] spawn_process: at 2018-11-15 17:36:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 17:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 17:36:43 [DEBUG   ] spawn_process: at 2018-11-15 17:36:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 17:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 17:36:43 [DEBUG   ] spawn_process: at 2018-11-15 17:36:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 17:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 17:36:43 [DEBUG   ] spawn_process: at 2018-11-15 17:36:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 17:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 17:36:43 [DEBUG   ] spawn_process: at 2018-11-15 17:36:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 17:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 17:36:43 [DEBUG   ] spawn_process: at 2018-11-15 17:36:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 17:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 17:36:43 [DEBUG   ] spawn_process: at 2018-11-15 17:36:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 17:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 17:36:43 [DEBUG   ] spawn_process: at 2018-11-15 17:36:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 17:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 17:36:43 [DEBUG   ] spawn_process: at 2018-11-15 17:36:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 17:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 17:36:43 [DEBUG   ] spawn_process: at 2018-11-15 17:36:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 17:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 17:36:43 [DEBUG   ] spawn_process: at 2018-11-15 17:36:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 17:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 17:36:43 [DEBUG   ] spawn_process: at 2018-11-15 17:36:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 17:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 17:36:43 [DEBUG   ] spawn_process: at 2018-11-15 17:36:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 17:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 17:36:43 [DEBUG   ] spawn_process: at 2018-11-15 17:36:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 17:36:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 17:36:43 [DEBUG   ] spawn_process: at 2018-11-15 17:36:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 17:37:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 17:37:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 17:37:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:37:08 [DEBUG   ] Got command BAM from MCS: ref #517057
2018-11-15 17:37:08 [INFO    ] Finished processing BAM request
2018-11-15 17:37:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:37:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517057   8 58437 63428029 A  ERROR'
2018-11-15 17:37:08 [DEBUG   ] Got command BAM from MCS: ref #517056
2018-11-15 17:37:08 [INFO    ] Finished processing BAM request
2018-11-15 17:37:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:37:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517056   8 58437 63428033 A  ERROR'
2018-11-15 17:37:08 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 17:37:08 [WARNING ] (13, 1, 'bot')
2018-11-15 17:37:08 [WARNING ] (13, 1, 'bot')
2018-11-15 17:37:08 [WARNING ] (13, 1, 'bot')
2018-11-15 17:37:08 [WARNING ] (13, 1, 'bot')
2018-11-15 17:37:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:37:08 [DEBUG   ] Finished updating board flags in 2.058 seconds
2018-11-15 17:37:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 17:37:08 [DEBUG   ] spawn_process: at 2018-11-15 17:37:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 17:37:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 17:37:08 [DEBUG   ] spawn_process: at 2018-11-15 17:37:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 17:37:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 17:37:08 [DEBUG   ] spawn_process: at 2018-11-15 17:37:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 17:37:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 17:37:08 [DEBUG   ] spawn_process: at 2018-11-15 17:37:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 17:37:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 17:37:08 [DEBUG   ] spawn_process: at 2018-11-15 17:37:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 17:37:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 17:37:08 [DEBUG   ] spawn_process: at 2018-11-15 17:37:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 17:37:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 17:37:08 [DEBUG   ] spawn_process: at 2018-11-15 17:37:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 17:37:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 17:37:08 [DEBUG   ] spawn_process: at 2018-11-15 17:37:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 17:37:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 17:37:08 [DEBUG   ] spawn_process: at 2018-11-15 17:37:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 17:37:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 17:37:08 [DEBUG   ] spawn_process: at 2018-11-15 17:37:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 17:37:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 17:37:08 [DEBUG   ] spawn_process: at 2018-11-15 17:37:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 17:37:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 17:37:08 [DEBUG   ] spawn_process: at 2018-11-15 17:37:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 17:37:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 17:37:08 [DEBUG   ] spawn_process: at 2018-11-15 17:37:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 17:37:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 17:37:08 [DEBUG   ] spawn_process: at 2018-11-15 17:37:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 17:37:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 17:37:08 [DEBUG   ] spawn_process: at 2018-11-15 17:37:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 17:37:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 17:37:08 [DEBUG   ] spawn_process: at 2018-11-15 17:37:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 17:37:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 17:37:08 [DEBUG   ] spawn_process: at 2018-11-15 17:37:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 17:37:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 17:37:08 [DEBUG   ] spawn_process: at 2018-11-15 17:37:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 17:37:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 17:37:08 [DEBUG   ] spawn_process: at 2018-11-15 17:37:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 17:37:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 17:37:08 [DEBUG   ] spawn_process: at 2018-11-15 17:37:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 17:37:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 17:37:08 [DEBUG   ] spawn_process: at 2018-11-15 17:37:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 17:37:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 17:37:08 [DEBUG   ] spawn_process: at 2018-11-15 17:37:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 17:37:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 17:37:08 [DEBUG   ] spawn_process: at 2018-11-15 17:37:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 17:37:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 17:37:08 [DEBUG   ] spawn_process: at 2018-11-15 17:37:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 17:37:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 17:37:08 [DEBUG   ] spawn_process: at 2018-11-15 17:37:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 17:37:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 17:37:08 [DEBUG   ] spawn_process: at 2018-11-15 17:37:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 17:37:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 17:37:33 [DEBUG   ] Got command BAM from MCS: ref #517059
2018-11-15 17:37:33 [INFO    ] Finished processing BAM request
2018-11-15 17:37:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:37:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517059   8 58437 63453025 A  ERROR'
2018-11-15 17:37:33 [DEBUG   ] Got command BAM from MCS: ref #517058
2018-11-15 17:37:33 [INFO    ] Finished processing BAM request
2018-11-15 17:37:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:37:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517058   8 58437 63453029 A  ERROR'
2018-11-15 17:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 17:37:33 [DEBUG   ] spawn_process: at 2018-11-15 17:37:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 17:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 17:37:33 [DEBUG   ] spawn_process: at 2018-11-15 17:37:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 17:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 17:37:33 [DEBUG   ] spawn_process: at 2018-11-15 17:37:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 17:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 17:37:33 [DEBUG   ] spawn_process: at 2018-11-15 17:37:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 17:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 17:37:33 [DEBUG   ] spawn_process: at 2018-11-15 17:37:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 17:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 17:37:33 [DEBUG   ] spawn_process: at 2018-11-15 17:37:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 17:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 17:37:33 [DEBUG   ] spawn_process: at 2018-11-15 17:37:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 17:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 17:37:33 [DEBUG   ] spawn_process: at 2018-11-15 17:37:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 17:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 17:37:33 [DEBUG   ] spawn_process: at 2018-11-15 17:37:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 17:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 17:37:33 [DEBUG   ] spawn_process: at 2018-11-15 17:37:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 17:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 17:37:33 [DEBUG   ] spawn_process: at 2018-11-15 17:37:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 17:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 17:37:33 [DEBUG   ] spawn_process: at 2018-11-15 17:37:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 17:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 17:37:33 [DEBUG   ] spawn_process: at 2018-11-15 17:37:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 17:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 17:37:33 [DEBUG   ] spawn_process: at 2018-11-15 17:37:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 17:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 17:37:33 [DEBUG   ] spawn_process: at 2018-11-15 17:37:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 17:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 17:37:33 [DEBUG   ] spawn_process: at 2018-11-15 17:37:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 17:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 17:37:33 [DEBUG   ] spawn_process: at 2018-11-15 17:37:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 17:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 17:37:33 [DEBUG   ] spawn_process: at 2018-11-15 17:37:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 17:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 17:37:33 [DEBUG   ] spawn_process: at 2018-11-15 17:37:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 17:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 17:37:33 [DEBUG   ] spawn_process: at 2018-11-15 17:37:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 17:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 17:37:33 [DEBUG   ] spawn_process: at 2018-11-15 17:37:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 17:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 17:37:33 [DEBUG   ] spawn_process: at 2018-11-15 17:37:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 17:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 17:37:33 [DEBUG   ] spawn_process: at 2018-11-15 17:37:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 17:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 17:37:33 [DEBUG   ] spawn_process: at 2018-11-15 17:37:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 17:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 17:37:33 [DEBUG   ] spawn_process: at 2018-11-15 17:37:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 17:37:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 17:37:33 [DEBUG   ] spawn_process: at 2018-11-15 17:37:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 17:37:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 17:37:58 [DEBUG   ] Got command BAM from MCS: ref #517060
2018-11-15 17:37:58 [INFO    ] Finished processing BAM request
2018-11-15 17:37:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:37:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517060   8 58437 63478033 A  ERROR'
2018-11-15 17:37:58 [DEBUG   ] Got command BAM from MCS: ref #517061
2018-11-15 17:37:58 [INFO    ] Finished processing BAM request
2018-11-15 17:37:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:37:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517061   8 58437 63478037 A  ERROR'
2018-11-15 17:37:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 17:37:58 [DEBUG   ] spawn_process: at 2018-11-15 17:37:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 17:37:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 17:37:58 [DEBUG   ] spawn_process: at 2018-11-15 17:37:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 17:37:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 17:37:58 [DEBUG   ] spawn_process: at 2018-11-15 17:37:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 17:37:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 17:37:58 [DEBUG   ] spawn_process: at 2018-11-15 17:37:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 17:37:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 17:37:58 [DEBUG   ] spawn_process: at 2018-11-15 17:37:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 17:37:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 17:37:58 [DEBUG   ] spawn_process: at 2018-11-15 17:37:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 17:37:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 17:37:58 [DEBUG   ] spawn_process: at 2018-11-15 17:37:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 17:37:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 17:37:58 [DEBUG   ] spawn_process: at 2018-11-15 17:37:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 17:37:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 17:37:58 [DEBUG   ] spawn_process: at 2018-11-15 17:37:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 17:37:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 17:37:58 [DEBUG   ] spawn_process: at 2018-11-15 17:37:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 17:37:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 17:37:58 [DEBUG   ] spawn_process: at 2018-11-15 17:37:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 17:37:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 17:37:58 [DEBUG   ] spawn_process: at 2018-11-15 17:37:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 17:37:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 17:37:58 [DEBUG   ] spawn_process: at 2018-11-15 17:37:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 17:37:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 17:37:58 [DEBUG   ] spawn_process: at 2018-11-15 17:37:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 17:37:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 17:37:58 [DEBUG   ] spawn_process: at 2018-11-15 17:37:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 17:37:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 17:37:58 [DEBUG   ] spawn_process: at 2018-11-15 17:37:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 17:37:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 17:37:58 [DEBUG   ] spawn_process: at 2018-11-15 17:37:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 17:37:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 17:37:58 [DEBUG   ] spawn_process: at 2018-11-15 17:37:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 17:37:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 17:37:58 [DEBUG   ] spawn_process: at 2018-11-15 17:37:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 17:37:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 17:37:58 [DEBUG   ] spawn_process: at 2018-11-15 17:37:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 17:37:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 17:37:58 [DEBUG   ] spawn_process: at 2018-11-15 17:37:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 17:37:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 17:37:58 [DEBUG   ] spawn_process: at 2018-11-15 17:37:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 17:37:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 17:37:58 [DEBUG   ] spawn_process: at 2018-11-15 17:37:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 17:37:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 17:37:58 [DEBUG   ] spawn_process: at 2018-11-15 17:37:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 17:37:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 17:37:58 [DEBUG   ] spawn_process: at 2018-11-15 17:37:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 17:37:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 17:37:58 [DEBUG   ] spawn_process: at 2018-11-15 17:37:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 17:38:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 17:38:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 17:38:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:38:08 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 17:38:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 17:38:08 [WARNING ] (13, 1, 'bot')
2018-11-15 17:38:08 [WARNING ] (13, 1, 'bot')
2018-11-15 17:38:08 [WARNING ] (13, 1, 'bot')
2018-11-15 17:38:08 [WARNING ] (13, 1, 'bot')
2018-11-15 17:38:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:38:08 [DEBUG   ] Finished updating board flags in 1.908 seconds
2018-11-15 17:38:20 [DEBUG   ] Got command RPT from MCS: ref #517064
2018-11-15 17:38:20 [DEBUG   ] summary = ERROR
2018-11-15 17:38:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517064  13 58437 63500697 A  ERRORERROR'
2018-11-15 17:38:20 [DEBUG   ] Got command RPT from MCS: ref #517065
2018-11-15 17:38:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 17:38:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517065  77 58437 63500901 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 17:38:21 [DEBUG   ] Got command RPT from MCS: ref #517066
2018-11-15 17:38:21 [DEBUG   ] summary = ERROR
2018-11-15 17:38:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517066  13 58437 63501106 A  ERRORERROR'
2018-11-15 17:38:21 [DEBUG   ] Got command RPT from MCS: ref #517068
2018-11-15 17:38:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 17:38:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517068  77 58437 63501297 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 17:38:21 [DEBUG   ] Got command RPT from MCS: ref #517069
2018-11-15 17:38:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 17:38:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517069  12 58437 63501501 A  ERRORB¢ff'
2018-11-15 17:38:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 17:38:23 [DEBUG   ] Got command BAM from MCS: ref #517074
2018-11-15 17:38:23 [INFO    ] Finished processing BAM request
2018-11-15 17:38:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:38:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517074   8 58437 63503029 A  ERROR'
2018-11-15 17:38:23 [DEBUG   ] Got command BAM from MCS: ref #517073
2018-11-15 17:38:23 [INFO    ] Finished processing BAM request
2018-11-15 17:38:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:38:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517073   8 58437 63503033 A  ERROR'
2018-11-15 17:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 17:38:23 [DEBUG   ] spawn_process: at 2018-11-15 17:38:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 17:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 17:38:23 [DEBUG   ] spawn_process: at 2018-11-15 17:38:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 17:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 17:38:23 [DEBUG   ] spawn_process: at 2018-11-15 17:38:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 17:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 17:38:23 [DEBUG   ] spawn_process: at 2018-11-15 17:38:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 17:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 17:38:23 [DEBUG   ] spawn_process: at 2018-11-15 17:38:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 17:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 17:38:23 [DEBUG   ] spawn_process: at 2018-11-15 17:38:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 17:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 17:38:23 [DEBUG   ] spawn_process: at 2018-11-15 17:38:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 17:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 17:38:23 [DEBUG   ] spawn_process: at 2018-11-15 17:38:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 17:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 17:38:23 [DEBUG   ] spawn_process: at 2018-11-15 17:38:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 17:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 17:38:23 [DEBUG   ] spawn_process: at 2018-11-15 17:38:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 17:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 17:38:23 [DEBUG   ] spawn_process: at 2018-11-15 17:38:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 17:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 17:38:23 [DEBUG   ] spawn_process: at 2018-11-15 17:38:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 17:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 17:38:23 [DEBUG   ] spawn_process: at 2018-11-15 17:38:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 17:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 17:38:23 [DEBUG   ] spawn_process: at 2018-11-15 17:38:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 17:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 17:38:23 [DEBUG   ] spawn_process: at 2018-11-15 17:38:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 17:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 17:38:23 [DEBUG   ] spawn_process: at 2018-11-15 17:38:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 17:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 17:38:23 [DEBUG   ] spawn_process: at 2018-11-15 17:38:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 17:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 17:38:23 [DEBUG   ] spawn_process: at 2018-11-15 17:38:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 17:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 17:38:23 [DEBUG   ] spawn_process: at 2018-11-15 17:38:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 17:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 17:38:23 [DEBUG   ] spawn_process: at 2018-11-15 17:38:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 17:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 17:38:23 [DEBUG   ] spawn_process: at 2018-11-15 17:38:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 17:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 17:38:23 [DEBUG   ] spawn_process: at 2018-11-15 17:38:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 17:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 17:38:23 [DEBUG   ] spawn_process: at 2018-11-15 17:38:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 17:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 17:38:23 [DEBUG   ] spawn_process: at 2018-11-15 17:38:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 17:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 17:38:23 [DEBUG   ] spawn_process: at 2018-11-15 17:38:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 17:38:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 17:38:23 [DEBUG   ] spawn_process: at 2018-11-15 17:38:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 17:38:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 17:38:48 [DEBUG   ] Got command BAM from MCS: ref #517080
2018-11-15 17:38:48 [INFO    ] Finished processing BAM request
2018-11-15 17:38:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:38:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517080   8 58437 63528033 A  ERROR'
2018-11-15 17:38:48 [DEBUG   ] Got command BAM from MCS: ref #517081
2018-11-15 17:38:48 [INFO    ] Finished processing BAM request
2018-11-15 17:38:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:38:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517081   8 58437 63528037 A  ERROR'
2018-11-15 17:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 17:38:48 [DEBUG   ] spawn_process: at 2018-11-15 17:38:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 17:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 17:38:48 [DEBUG   ] spawn_process: at 2018-11-15 17:38:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 17:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 17:38:48 [DEBUG   ] spawn_process: at 2018-11-15 17:38:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 17:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 17:38:48 [DEBUG   ] spawn_process: at 2018-11-15 17:38:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 17:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 17:38:48 [DEBUG   ] spawn_process: at 2018-11-15 17:38:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 17:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 17:38:48 [DEBUG   ] spawn_process: at 2018-11-15 17:38:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 17:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 17:38:48 [DEBUG   ] spawn_process: at 2018-11-15 17:38:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 17:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 17:38:48 [DEBUG   ] spawn_process: at 2018-11-15 17:38:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 17:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 17:38:48 [DEBUG   ] spawn_process: at 2018-11-15 17:38:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 17:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 17:38:48 [DEBUG   ] spawn_process: at 2018-11-15 17:38:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 17:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 17:38:48 [DEBUG   ] spawn_process: at 2018-11-15 17:38:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 17:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 17:38:48 [DEBUG   ] spawn_process: at 2018-11-15 17:38:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 17:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 17:38:48 [DEBUG   ] spawn_process: at 2018-11-15 17:38:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 17:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 17:38:48 [DEBUG   ] spawn_process: at 2018-11-15 17:38:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 17:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 17:38:48 [DEBUG   ] spawn_process: at 2018-11-15 17:38:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 17:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 17:38:48 [DEBUG   ] spawn_process: at 2018-11-15 17:38:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 17:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 17:38:48 [DEBUG   ] spawn_process: at 2018-11-15 17:38:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 17:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 17:38:48 [DEBUG   ] spawn_process: at 2018-11-15 17:38:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 17:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 17:38:48 [DEBUG   ] spawn_process: at 2018-11-15 17:38:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 17:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 17:38:48 [DEBUG   ] spawn_process: at 2018-11-15 17:38:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 17:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 17:38:48 [DEBUG   ] spawn_process: at 2018-11-15 17:38:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 17:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 17:38:48 [DEBUG   ] spawn_process: at 2018-11-15 17:38:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 17:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 17:38:48 [DEBUG   ] spawn_process: at 2018-11-15 17:38:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 17:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 17:38:48 [DEBUG   ] spawn_process: at 2018-11-15 17:38:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 17:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 17:38:48 [DEBUG   ] spawn_process: at 2018-11-15 17:38:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 17:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 17:38:48 [DEBUG   ] spawn_process: at 2018-11-15 17:38:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 17:39:02 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-15 17:39:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 17:39:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:39:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-11-15 17:39:07 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-15 17:39:07 [WARNING ] (13, 1, 'bot')
2018-11-15 17:39:07 [WARNING ] (13, 1, 'bot')
2018-11-15 17:39:07 [WARNING ] (13, 1, 'bot')
2018-11-15 17:39:07 [WARNING ] (13, 1, 'bot')
2018-11-15 17:39:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:39:07 [DEBUG   ] Finished updating board flags in 1.259 seconds
2018-11-15 17:39:13 [DEBUG   ] Got command BAM from MCS: ref #517083
2018-11-15 17:39:13 [INFO    ] Finished processing BAM request
2018-11-15 17:39:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:39:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517083   8 58437 63553029 A  ERROR'
2018-11-15 17:39:13 [DEBUG   ] Got command BAM from MCS: ref #517082
2018-11-15 17:39:13 [INFO    ] Finished processing BAM request
2018-11-15 17:39:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:39:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517082   8 58437 63553033 A  ERROR'
2018-11-15 17:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 17:39:13 [DEBUG   ] spawn_process: at 2018-11-15 17:39:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 17:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 17:39:13 [DEBUG   ] spawn_process: at 2018-11-15 17:39:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 17:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 17:39:13 [DEBUG   ] spawn_process: at 2018-11-15 17:39:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 17:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 17:39:13 [DEBUG   ] spawn_process: at 2018-11-15 17:39:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 17:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 17:39:13 [DEBUG   ] spawn_process: at 2018-11-15 17:39:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 17:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 17:39:13 [DEBUG   ] spawn_process: at 2018-11-15 17:39:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 17:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 17:39:13 [DEBUG   ] spawn_process: at 2018-11-15 17:39:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 17:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 17:39:13 [DEBUG   ] spawn_process: at 2018-11-15 17:39:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 17:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 17:39:13 [DEBUG   ] spawn_process: at 2018-11-15 17:39:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 17:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 17:39:13 [DEBUG   ] spawn_process: at 2018-11-15 17:39:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 17:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 17:39:13 [DEBUG   ] spawn_process: at 2018-11-15 17:39:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 17:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 17:39:13 [DEBUG   ] spawn_process: at 2018-11-15 17:39:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 17:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 17:39:13 [DEBUG   ] spawn_process: at 2018-11-15 17:39:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 17:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 17:39:13 [DEBUG   ] spawn_process: at 2018-11-15 17:39:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 17:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 17:39:13 [DEBUG   ] spawn_process: at 2018-11-15 17:39:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 17:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 17:39:13 [DEBUG   ] spawn_process: at 2018-11-15 17:39:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 17:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 17:39:13 [DEBUG   ] spawn_process: at 2018-11-15 17:39:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 17:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 17:39:13 [DEBUG   ] spawn_process: at 2018-11-15 17:39:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 17:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 17:39:13 [DEBUG   ] spawn_process: at 2018-11-15 17:39:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 17:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 17:39:13 [DEBUG   ] spawn_process: at 2018-11-15 17:39:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 17:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 17:39:13 [DEBUG   ] spawn_process: at 2018-11-15 17:39:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 17:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 17:39:13 [DEBUG   ] spawn_process: at 2018-11-15 17:39:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 17:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 17:39:13 [DEBUG   ] spawn_process: at 2018-11-15 17:39:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 17:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 17:39:13 [DEBUG   ] spawn_process: at 2018-11-15 17:39:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 17:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 17:39:13 [DEBUG   ] spawn_process: at 2018-11-15 17:39:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 17:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 17:39:13 [DEBUG   ] spawn_process: at 2018-11-15 17:39:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 17:39:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 17:39:38 [DEBUG   ] Got command BAM from MCS: ref #517085
2018-11-15 17:39:38 [INFO    ] Finished processing BAM request
2018-11-15 17:39:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:39:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517085   8 58437 63578033 A  ERROR'
2018-11-15 17:39:38 [DEBUG   ] Got command BAM from MCS: ref #517084
2018-11-15 17:39:38 [INFO    ] Finished processing BAM request
2018-11-15 17:39:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:39:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517084   8 58437 63578037 A  ERROR'
2018-11-15 17:39:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 17:39:38 [DEBUG   ] spawn_process: at 2018-11-15 17:39:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 17:39:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 17:39:38 [DEBUG   ] spawn_process: at 2018-11-15 17:39:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 17:39:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 17:39:38 [DEBUG   ] spawn_process: at 2018-11-15 17:39:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 17:39:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 17:39:38 [DEBUG   ] spawn_process: at 2018-11-15 17:39:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 17:39:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 17:39:38 [DEBUG   ] spawn_process: at 2018-11-15 17:39:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 17:39:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 17:39:38 [DEBUG   ] spawn_process: at 2018-11-15 17:39:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 17:39:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 17:39:38 [DEBUG   ] spawn_process: at 2018-11-15 17:39:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 17:39:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 17:39:38 [DEBUG   ] spawn_process: at 2018-11-15 17:39:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 17:39:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 17:39:38 [DEBUG   ] spawn_process: at 2018-11-15 17:39:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 17:39:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 17:39:38 [DEBUG   ] spawn_process: at 2018-11-15 17:39:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 17:39:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 17:39:38 [DEBUG   ] spawn_process: at 2018-11-15 17:39:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 17:39:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 17:39:38 [DEBUG   ] spawn_process: at 2018-11-15 17:39:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 17:39:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 17:39:38 [DEBUG   ] spawn_process: at 2018-11-15 17:39:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 17:39:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 17:39:38 [DEBUG   ] spawn_process: at 2018-11-15 17:39:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 17:39:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 17:39:38 [DEBUG   ] spawn_process: at 2018-11-15 17:39:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 17:39:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 17:39:38 [DEBUG   ] spawn_process: at 2018-11-15 17:39:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 17:39:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 17:39:38 [DEBUG   ] spawn_process: at 2018-11-15 17:39:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 17:39:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 17:39:38 [DEBUG   ] spawn_process: at 2018-11-15 17:39:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 17:39:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 17:39:38 [DEBUG   ] spawn_process: at 2018-11-15 17:39:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 17:39:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 17:39:38 [DEBUG   ] spawn_process: at 2018-11-15 17:39:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 17:39:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 17:39:38 [DEBUG   ] spawn_process: at 2018-11-15 17:39:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 17:39:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 17:39:38 [DEBUG   ] spawn_process: at 2018-11-15 17:39:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 17:39:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 17:39:38 [DEBUG   ] spawn_process: at 2018-11-15 17:39:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 17:39:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 17:39:38 [DEBUG   ] spawn_process: at 2018-11-15 17:39:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 17:39:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 17:39:38 [DEBUG   ] spawn_process: at 2018-11-15 17:39:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 17:39:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 17:39:38 [DEBUG   ] spawn_process: at 2018-11-15 17:39:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 17:39:42 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-15 17:40:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 17:40:03 [DEBUG   ] Got command BAM from MCS: ref #517086
2018-11-15 17:40:03 [INFO    ] Finished processing BAM request
2018-11-15 17:40:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:40:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517086   8 58437 63603029 A  ERROR'
2018-11-15 17:40:03 [DEBUG   ] Got command BAM from MCS: ref #517087
2018-11-15 17:40:03 [INFO    ] Finished processing BAM request
2018-11-15 17:40:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:40:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517087   8 58437 63603033 A  ERROR'
2018-11-15 17:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 17:40:03 [DEBUG   ] spawn_process: at 2018-11-15 17:40:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 17:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 17:40:03 [DEBUG   ] spawn_process: at 2018-11-15 17:40:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 17:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 17:40:03 [DEBUG   ] spawn_process: at 2018-11-15 17:40:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 17:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 17:40:03 [DEBUG   ] spawn_process: at 2018-11-15 17:40:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 17:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 17:40:03 [DEBUG   ] spawn_process: at 2018-11-15 17:40:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 17:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 17:40:03 [DEBUG   ] spawn_process: at 2018-11-15 17:40:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 17:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 17:40:03 [DEBUG   ] spawn_process: at 2018-11-15 17:40:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 17:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 17:40:03 [DEBUG   ] spawn_process: at 2018-11-15 17:40:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 17:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 17:40:03 [DEBUG   ] spawn_process: at 2018-11-15 17:40:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 17:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 17:40:03 [DEBUG   ] spawn_process: at 2018-11-15 17:40:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 17:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 17:40:03 [DEBUG   ] spawn_process: at 2018-11-15 17:40:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 17:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 17:40:03 [DEBUG   ] spawn_process: at 2018-11-15 17:40:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 17:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 17:40:03 [DEBUG   ] spawn_process: at 2018-11-15 17:40:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 17:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 17:40:03 [DEBUG   ] spawn_process: at 2018-11-15 17:40:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 17:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 17:40:03 [DEBUG   ] spawn_process: at 2018-11-15 17:40:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 17:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 17:40:03 [DEBUG   ] spawn_process: at 2018-11-15 17:40:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 17:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 17:40:03 [DEBUG   ] spawn_process: at 2018-11-15 17:40:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 17:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 17:40:03 [DEBUG   ] spawn_process: at 2018-11-15 17:40:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 17:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 17:40:03 [DEBUG   ] spawn_process: at 2018-11-15 17:40:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 17:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 17:40:03 [DEBUG   ] spawn_process: at 2018-11-15 17:40:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 17:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 17:40:03 [DEBUG   ] spawn_process: at 2018-11-15 17:40:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 17:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 17:40:03 [DEBUG   ] spawn_process: at 2018-11-15 17:40:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 17:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 17:40:03 [DEBUG   ] spawn_process: at 2018-11-15 17:40:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 17:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 17:40:03 [DEBUG   ] spawn_process: at 2018-11-15 17:40:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 17:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 17:40:03 [DEBUG   ] spawn_process: at 2018-11-15 17:40:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 17:40:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 17:40:03 [DEBUG   ] spawn_process: at 2018-11-15 17:40:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 17:40:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:40:08 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 17:40:08 [WARNING ] (13, 1, 'bot')
2018-11-15 17:40:08 [WARNING ] (13, 1, 'bot')
2018-11-15 17:40:08 [WARNING ] (13, 1, 'bot')
2018-11-15 17:40:08 [WARNING ] (13, 1, 'bot')
2018-11-15 17:40:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:40:08 [DEBUG   ] Finished updating board flags in 1.759 seconds
2018-11-15 17:40:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 17:40:28 [DEBUG   ] Got command BAM from MCS: ref #517088
2018-11-15 17:40:28 [INFO    ] Finished processing BAM request
2018-11-15 17:40:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:40:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517088   8 58437 63628025 A  ERROR'
2018-11-15 17:40:28 [DEBUG   ] Got command BAM from MCS: ref #517089
2018-11-15 17:40:28 [INFO    ] Finished processing BAM request
2018-11-15 17:40:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:40:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517089   8 58437 63628029 A  ERROR'
2018-11-15 17:40:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 17:40:28 [DEBUG   ] spawn_process: at 2018-11-15 17:40:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 17:40:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 17:40:28 [DEBUG   ] spawn_process: at 2018-11-15 17:40:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 17:40:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 17:40:28 [DEBUG   ] spawn_process: at 2018-11-15 17:40:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 17:40:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 17:40:28 [DEBUG   ] spawn_process: at 2018-11-15 17:40:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 17:40:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 17:40:28 [DEBUG   ] spawn_process: at 2018-11-15 17:40:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 17:40:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 17:40:28 [DEBUG   ] spawn_process: at 2018-11-15 17:40:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 17:40:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 17:40:28 [DEBUG   ] spawn_process: at 2018-11-15 17:40:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 17:40:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 17:40:28 [DEBUG   ] spawn_process: at 2018-11-15 17:40:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 17:40:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 17:40:28 [DEBUG   ] spawn_process: at 2018-11-15 17:40:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 17:40:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 17:40:28 [DEBUG   ] spawn_process: at 2018-11-15 17:40:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 17:40:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 17:40:28 [DEBUG   ] spawn_process: at 2018-11-15 17:40:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 17:40:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 17:40:28 [DEBUG   ] spawn_process: at 2018-11-15 17:40:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 17:40:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 17:40:28 [DEBUG   ] spawn_process: at 2018-11-15 17:40:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 17:40:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 17:40:28 [DEBUG   ] spawn_process: at 2018-11-15 17:40:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 17:40:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 17:40:28 [DEBUG   ] spawn_process: at 2018-11-15 17:40:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 17:40:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 17:40:28 [DEBUG   ] spawn_process: at 2018-11-15 17:40:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 17:40:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 17:40:28 [DEBUG   ] spawn_process: at 2018-11-15 17:40:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 17:40:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 17:40:28 [DEBUG   ] spawn_process: at 2018-11-15 17:40:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 17:40:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 17:40:28 [DEBUG   ] spawn_process: at 2018-11-15 17:40:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 17:40:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 17:40:28 [DEBUG   ] spawn_process: at 2018-11-15 17:40:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 17:40:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 17:40:28 [DEBUG   ] spawn_process: at 2018-11-15 17:40:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 17:40:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 17:40:28 [DEBUG   ] spawn_process: at 2018-11-15 17:40:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 17:40:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 17:40:28 [DEBUG   ] spawn_process: at 2018-11-15 17:40:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 17:40:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 17:40:28 [DEBUG   ] spawn_process: at 2018-11-15 17:40:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 17:40:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 17:40:28 [DEBUG   ] spawn_process: at 2018-11-15 17:40:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 17:40:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 17:40:28 [DEBUG   ] spawn_process: at 2018-11-15 17:40:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 17:40:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 17:40:45 [DEBUG   ] Got command RPT from MCS: ref #517090
2018-11-15 17:40:45 [DEBUG   ] summary = ERROR
2018-11-15 17:40:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517090  13 58437 63645145 A  ERRORERROR'
2018-11-15 17:40:45 [DEBUG   ] Got command RPT from MCS: ref #517091
2018-11-15 17:40:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 17:40:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517091  77 58437 63645146 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 17:40:53 [DEBUG   ] Got command BAM from MCS: ref #517108
2018-11-15 17:40:53 [INFO    ] Finished processing BAM request
2018-11-15 17:40:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:40:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517108   8 58437 63653033 A  ERROR'
2018-11-15 17:40:53 [DEBUG   ] Got command BAM from MCS: ref #517107
2018-11-15 17:40:53 [INFO    ] Finished processing BAM request
2018-11-15 17:40:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:40:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517107   8 58437 63653037 A  ERROR'
2018-11-15 17:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 17:40:53 [DEBUG   ] spawn_process: at 2018-11-15 17:40:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 17:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 17:40:53 [DEBUG   ] spawn_process: at 2018-11-15 17:40:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 17:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 17:40:53 [DEBUG   ] spawn_process: at 2018-11-15 17:40:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 17:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 17:40:53 [DEBUG   ] spawn_process: at 2018-11-15 17:40:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 17:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 17:40:53 [DEBUG   ] spawn_process: at 2018-11-15 17:40:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 17:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 17:40:53 [DEBUG   ] spawn_process: at 2018-11-15 17:40:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 17:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 17:40:53 [DEBUG   ] spawn_process: at 2018-11-15 17:40:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 17:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 17:40:53 [DEBUG   ] spawn_process: at 2018-11-15 17:40:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 17:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 17:40:53 [DEBUG   ] spawn_process: at 2018-11-15 17:40:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 17:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 17:40:53 [DEBUG   ] spawn_process: at 2018-11-15 17:40:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 17:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 17:40:53 [DEBUG   ] spawn_process: at 2018-11-15 17:40:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 17:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 17:40:53 [DEBUG   ] spawn_process: at 2018-11-15 17:40:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 17:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 17:40:53 [DEBUG   ] spawn_process: at 2018-11-15 17:40:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 17:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 17:40:53 [DEBUG   ] spawn_process: at 2018-11-15 17:40:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 17:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 17:40:53 [DEBUG   ] spawn_process: at 2018-11-15 17:40:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 17:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 17:40:53 [DEBUG   ] spawn_process: at 2018-11-15 17:40:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 17:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 17:40:53 [DEBUG   ] spawn_process: at 2018-11-15 17:40:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 17:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 17:40:53 [DEBUG   ] spawn_process: at 2018-11-15 17:40:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 17:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 17:40:53 [DEBUG   ] spawn_process: at 2018-11-15 17:40:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 17:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 17:40:53 [DEBUG   ] spawn_process: at 2018-11-15 17:40:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 17:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 17:40:53 [DEBUG   ] spawn_process: at 2018-11-15 17:40:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 17:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 17:40:53 [DEBUG   ] spawn_process: at 2018-11-15 17:40:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 17:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 17:40:53 [DEBUG   ] spawn_process: at 2018-11-15 17:40:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 17:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 17:40:53 [DEBUG   ] spawn_process: at 2018-11-15 17:40:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 17:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 17:40:53 [DEBUG   ] spawn_process: at 2018-11-15 17:40:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 17:40:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 17:40:53 [DEBUG   ] spawn_process: at 2018-11-15 17:40:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 17:41:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 17:41:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:41:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-11-15 17:41:07 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-15 17:41:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 17:41:07 [WARNING ] (13, 1, 'bot')
2018-11-15 17:41:07 [WARNING ] (13, 1, 'bot')
2018-11-15 17:41:07 [WARNING ] (13, 1, 'bot')
2018-11-15 17:41:07 [WARNING ] (13, 1, 'bot')
2018-11-15 17:41:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:41:07 [DEBUG   ] Finished updating board flags in 1.035 seconds
2018-11-15 17:41:18 [DEBUG   ] Got command BAM from MCS: ref #517110
2018-11-15 17:41:18 [INFO    ] Finished processing BAM request
2018-11-15 17:41:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:41:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517110   8 58437 63678025 A  ERROR'
2018-11-15 17:41:18 [DEBUG   ] Got command BAM from MCS: ref #517109
2018-11-15 17:41:18 [INFO    ] Finished processing BAM request
2018-11-15 17:41:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:41:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517109   8 58437 63678029 A  ERROR'
2018-11-15 17:41:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 17:41:18 [DEBUG   ] spawn_process: at 2018-11-15 17:41:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 17:41:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 17:41:18 [DEBUG   ] spawn_process: at 2018-11-15 17:41:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 17:41:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 17:41:18 [DEBUG   ] spawn_process: at 2018-11-15 17:41:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 17:41:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 17:41:18 [DEBUG   ] spawn_process: at 2018-11-15 17:41:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 17:41:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 17:41:18 [DEBUG   ] spawn_process: at 2018-11-15 17:41:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 17:41:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 17:41:18 [DEBUG   ] spawn_process: at 2018-11-15 17:41:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 17:41:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 17:41:18 [DEBUG   ] spawn_process: at 2018-11-15 17:41:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 17:41:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 17:41:18 [DEBUG   ] spawn_process: at 2018-11-15 17:41:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 17:41:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 17:41:18 [DEBUG   ] spawn_process: at 2018-11-15 17:41:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 17:41:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 17:41:18 [DEBUG   ] spawn_process: at 2018-11-15 17:41:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 17:41:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 17:41:18 [DEBUG   ] spawn_process: at 2018-11-15 17:41:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 17:41:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 17:41:18 [DEBUG   ] spawn_process: at 2018-11-15 17:41:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 17:41:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 17:41:18 [DEBUG   ] spawn_process: at 2018-11-15 17:41:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 17:41:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 17:41:18 [DEBUG   ] spawn_process: at 2018-11-15 17:41:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 17:41:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 17:41:18 [DEBUG   ] spawn_process: at 2018-11-15 17:41:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 17:41:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 17:41:18 [DEBUG   ] spawn_process: at 2018-11-15 17:41:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 17:41:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 17:41:18 [DEBUG   ] spawn_process: at 2018-11-15 17:41:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 17:41:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 17:41:18 [DEBUG   ] spawn_process: at 2018-11-15 17:41:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 17:41:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 17:41:18 [DEBUG   ] spawn_process: at 2018-11-15 17:41:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 17:41:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 17:41:18 [DEBUG   ] spawn_process: at 2018-11-15 17:41:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 17:41:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 17:41:18 [DEBUG   ] spawn_process: at 2018-11-15 17:41:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 17:41:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 17:41:18 [DEBUG   ] spawn_process: at 2018-11-15 17:41:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 17:41:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 17:41:18 [DEBUG   ] spawn_process: at 2018-11-15 17:41:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 17:41:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 17:41:18 [DEBUG   ] spawn_process: at 2018-11-15 17:41:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 17:41:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 17:41:18 [DEBUG   ] spawn_process: at 2018-11-15 17:41:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 17:41:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 17:41:18 [DEBUG   ] spawn_process: at 2018-11-15 17:41:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 17:41:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 17:41:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 17:41:44 [DEBUG   ] Got command BAM from MCS: ref #517115
2018-11-15 17:41:44 [INFO    ] Finished processing BAM request
2018-11-15 17:41:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:41:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517115   8 58437 63704033 A  ERROR'
2018-11-15 17:41:44 [DEBUG   ] Got command BAM from MCS: ref #517116
2018-11-15 17:41:44 [INFO    ] Finished processing BAM request
2018-11-15 17:41:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:41:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517116   8 58437 63704037 A  ERROR'
2018-11-15 17:41:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 17:41:44 [DEBUG   ] spawn_process: at 2018-11-15 17:41:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 17:41:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 17:41:44 [DEBUG   ] spawn_process: at 2018-11-15 17:41:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 17:41:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 17:41:44 [DEBUG   ] spawn_process: at 2018-11-15 17:41:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 17:41:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 17:41:44 [DEBUG   ] spawn_process: at 2018-11-15 17:41:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 17:41:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 17:41:44 [DEBUG   ] spawn_process: at 2018-11-15 17:41:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 17:41:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 17:41:44 [DEBUG   ] spawn_process: at 2018-11-15 17:41:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 17:41:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 17:41:44 [DEBUG   ] spawn_process: at 2018-11-15 17:41:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 17:41:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 17:41:44 [DEBUG   ] spawn_process: at 2018-11-15 17:41:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 17:41:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 17:41:44 [DEBUG   ] spawn_process: at 2018-11-15 17:41:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 17:41:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 17:41:44 [DEBUG   ] spawn_process: at 2018-11-15 17:41:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 17:41:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 17:41:44 [DEBUG   ] spawn_process: at 2018-11-15 17:41:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 17:41:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 17:41:44 [DEBUG   ] spawn_process: at 2018-11-15 17:41:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 17:41:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 17:41:44 [DEBUG   ] spawn_process: at 2018-11-15 17:41:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 17:41:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 17:41:44 [DEBUG   ] spawn_process: at 2018-11-15 17:41:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 17:41:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 17:41:44 [DEBUG   ] spawn_process: at 2018-11-15 17:41:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 17:41:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 17:41:44 [DEBUG   ] spawn_process: at 2018-11-15 17:41:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 17:41:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 17:41:44 [DEBUG   ] spawn_process: at 2018-11-15 17:41:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 17:41:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 17:41:44 [DEBUG   ] spawn_process: at 2018-11-15 17:41:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 17:41:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 17:41:44 [DEBUG   ] spawn_process: at 2018-11-15 17:41:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 17:41:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 17:41:44 [DEBUG   ] spawn_process: at 2018-11-15 17:41:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 17:41:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 17:41:44 [DEBUG   ] spawn_process: at 2018-11-15 17:41:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 17:41:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 17:41:44 [DEBUG   ] spawn_process: at 2018-11-15 17:41:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 17:41:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 17:41:44 [DEBUG   ] spawn_process: at 2018-11-15 17:41:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 17:41:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 17:41:44 [DEBUG   ] spawn_process: at 2018-11-15 17:41:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 17:41:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 17:41:44 [DEBUG   ] spawn_process: at 2018-11-15 17:41:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 17:41:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 17:41:44 [DEBUG   ] spawn_process: at 2018-11-15 17:41:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 17:42:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 17:42:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 17:42:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:42:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-11-15 17:42:08 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 17:42:08 [WARNING ] (13, 1, 'bot')
2018-11-15 17:42:08 [WARNING ] (13, 1, 'bot')
2018-11-15 17:42:08 [WARNING ] (13, 1, 'bot')
2018-11-15 17:42:08 [WARNING ] (13, 1, 'bot')
2018-11-15 17:42:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:42:08 [DEBUG   ] Finished updating board flags in 2.034 seconds
2018-11-15 17:42:10 [DEBUG   ] Got command BAM from MCS: ref #517118
2018-11-15 17:42:10 [INFO    ] Finished processing BAM request
2018-11-15 17:42:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:42:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517118   8 58437 63730033 A  ERROR'
2018-11-15 17:42:10 [DEBUG   ] Got command BAM from MCS: ref #517117
2018-11-15 17:42:10 [INFO    ] Finished processing BAM request
2018-11-15 17:42:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:42:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517117   8 58437 63730037 A  ERROR'
2018-11-15 17:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 17:42:10 [DEBUG   ] spawn_process: at 2018-11-15 17:42:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 17:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 17:42:10 [DEBUG   ] spawn_process: at 2018-11-15 17:42:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 17:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 17:42:10 [DEBUG   ] spawn_process: at 2018-11-15 17:42:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 17:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 17:42:10 [DEBUG   ] spawn_process: at 2018-11-15 17:42:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 17:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 17:42:10 [DEBUG   ] spawn_process: at 2018-11-15 17:42:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 17:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 17:42:10 [DEBUG   ] spawn_process: at 2018-11-15 17:42:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 17:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 17:42:10 [DEBUG   ] spawn_process: at 2018-11-15 17:42:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 17:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 17:42:10 [DEBUG   ] spawn_process: at 2018-11-15 17:42:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 17:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 17:42:10 [DEBUG   ] spawn_process: at 2018-11-15 17:42:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 17:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 17:42:10 [DEBUG   ] spawn_process: at 2018-11-15 17:42:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 17:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 17:42:10 [DEBUG   ] spawn_process: at 2018-11-15 17:42:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 17:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 17:42:10 [DEBUG   ] spawn_process: at 2018-11-15 17:42:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 17:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 17:42:10 [DEBUG   ] spawn_process: at 2018-11-15 17:42:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 17:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 17:42:10 [DEBUG   ] spawn_process: at 2018-11-15 17:42:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 17:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 17:42:10 [DEBUG   ] spawn_process: at 2018-11-15 17:42:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 17:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 17:42:10 [DEBUG   ] spawn_process: at 2018-11-15 17:42:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 17:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 17:42:10 [DEBUG   ] spawn_process: at 2018-11-15 17:42:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 17:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 17:42:10 [DEBUG   ] spawn_process: at 2018-11-15 17:42:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 17:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 17:42:10 [DEBUG   ] spawn_process: at 2018-11-15 17:42:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 17:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 17:42:10 [DEBUG   ] spawn_process: at 2018-11-15 17:42:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 17:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 17:42:10 [DEBUG   ] spawn_process: at 2018-11-15 17:42:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 17:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 17:42:10 [DEBUG   ] spawn_process: at 2018-11-15 17:42:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 17:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 17:42:10 [DEBUG   ] spawn_process: at 2018-11-15 17:42:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 17:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 17:42:10 [DEBUG   ] spawn_process: at 2018-11-15 17:42:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 17:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 17:42:10 [DEBUG   ] spawn_process: at 2018-11-15 17:42:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 17:42:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 17:42:10 [DEBUG   ] spawn_process: at 2018-11-15 17:42:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 17:42:22 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-15 17:42:36 [DEBUG   ] Got command BAM from MCS: ref #517120
2018-11-15 17:42:36 [INFO    ] Finished processing BAM request
2018-11-15 17:42:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:42:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517120   8 58437 63756025 A  ERROR'
2018-11-15 17:42:36 [DEBUG   ] Got command BAM from MCS: ref #517119
2018-11-15 17:42:36 [INFO    ] Finished processing BAM request
2018-11-15 17:42:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:42:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517119   8 58437 63756029 A  ERROR'
2018-11-15 17:42:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 17:42:36 [DEBUG   ] spawn_process: at 2018-11-15 17:42:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 17:42:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 17:42:36 [DEBUG   ] spawn_process: at 2018-11-15 17:42:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 17:42:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 17:42:36 [DEBUG   ] spawn_process: at 2018-11-15 17:42:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 17:42:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 17:42:36 [DEBUG   ] spawn_process: at 2018-11-15 17:42:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 17:42:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 17:42:36 [DEBUG   ] spawn_process: at 2018-11-15 17:42:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 17:42:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 17:42:36 [DEBUG   ] spawn_process: at 2018-11-15 17:42:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 17:42:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 17:42:36 [DEBUG   ] spawn_process: at 2018-11-15 17:42:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 17:42:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 17:42:36 [DEBUG   ] spawn_process: at 2018-11-15 17:42:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 17:42:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 17:42:36 [DEBUG   ] spawn_process: at 2018-11-15 17:42:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 17:42:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 17:42:36 [DEBUG   ] spawn_process: at 2018-11-15 17:42:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 17:42:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 17:42:36 [DEBUG   ] spawn_process: at 2018-11-15 17:42:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 17:42:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 17:42:36 [DEBUG   ] spawn_process: at 2018-11-15 17:42:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 17:42:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 17:42:36 [DEBUG   ] spawn_process: at 2018-11-15 17:42:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 17:42:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 17:42:36 [DEBUG   ] spawn_process: at 2018-11-15 17:42:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 17:42:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 17:42:36 [DEBUG   ] spawn_process: at 2018-11-15 17:42:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 17:42:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 17:42:36 [DEBUG   ] spawn_process: at 2018-11-15 17:42:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 17:42:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 17:42:36 [DEBUG   ] spawn_process: at 2018-11-15 17:42:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 17:42:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 17:42:36 [DEBUG   ] spawn_process: at 2018-11-15 17:42:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 17:42:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 17:42:36 [DEBUG   ] spawn_process: at 2018-11-15 17:42:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 17:42:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 17:42:36 [DEBUG   ] spawn_process: at 2018-11-15 17:42:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 17:42:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 17:42:36 [DEBUG   ] spawn_process: at 2018-11-15 17:42:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 17:42:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 17:42:36 [DEBUG   ] spawn_process: at 2018-11-15 17:42:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 17:42:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 17:42:36 [DEBUG   ] spawn_process: at 2018-11-15 17:42:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 17:42:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 17:42:36 [DEBUG   ] spawn_process: at 2018-11-15 17:42:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 17:42:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 17:42:36 [DEBUG   ] spawn_process: at 2018-11-15 17:42:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 17:42:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 17:42:36 [DEBUG   ] spawn_process: at 2018-11-15 17:42:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 17:42:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 17:43:02 [DEBUG   ] Got command BAM from MCS: ref #517122
2018-11-15 17:43:02 [INFO    ] Finished processing BAM request
2018-11-15 17:43:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:43:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517122   8 58437 63782025 A  ERROR'
2018-11-15 17:43:02 [DEBUG   ] Got command BAM from MCS: ref #517121
2018-11-15 17:43:02 [INFO    ] Finished processing BAM request
2018-11-15 17:43:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:43:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517121   8 58437 63782029 A  ERROR'
2018-11-15 17:43:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 17:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 17:43:02 [DEBUG   ] spawn_process: at 2018-11-15 17:43:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 17:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 17:43:02 [DEBUG   ] spawn_process: at 2018-11-15 17:43:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 17:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 17:43:02 [DEBUG   ] spawn_process: at 2018-11-15 17:43:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 17:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 17:43:02 [DEBUG   ] spawn_process: at 2018-11-15 17:43:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 17:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 17:43:02 [DEBUG   ] spawn_process: at 2018-11-15 17:43:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 17:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 17:43:02 [DEBUG   ] spawn_process: at 2018-11-15 17:43:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 17:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 17:43:02 [DEBUG   ] spawn_process: at 2018-11-15 17:43:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 17:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 17:43:02 [DEBUG   ] spawn_process: at 2018-11-15 17:43:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 17:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 17:43:02 [DEBUG   ] spawn_process: at 2018-11-15 17:43:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 17:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 17:43:02 [DEBUG   ] spawn_process: at 2018-11-15 17:43:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 17:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 17:43:02 [DEBUG   ] spawn_process: at 2018-11-15 17:43:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 17:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 17:43:02 [DEBUG   ] spawn_process: at 2018-11-15 17:43:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 17:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 17:43:02 [DEBUG   ] spawn_process: at 2018-11-15 17:43:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 17:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 17:43:02 [DEBUG   ] spawn_process: at 2018-11-15 17:43:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 17:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 17:43:02 [DEBUG   ] spawn_process: at 2018-11-15 17:43:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 17:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 17:43:02 [DEBUG   ] spawn_process: at 2018-11-15 17:43:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 17:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 17:43:02 [DEBUG   ] spawn_process: at 2018-11-15 17:43:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 17:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 17:43:02 [DEBUG   ] spawn_process: at 2018-11-15 17:43:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 17:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 17:43:02 [DEBUG   ] spawn_process: at 2018-11-15 17:43:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 17:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 17:43:02 [DEBUG   ] spawn_process: at 2018-11-15 17:43:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 17:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 17:43:02 [DEBUG   ] spawn_process: at 2018-11-15 17:43:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 17:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 17:43:02 [DEBUG   ] spawn_process: at 2018-11-15 17:43:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 17:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 17:43:02 [DEBUG   ] spawn_process: at 2018-11-15 17:43:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 17:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 17:43:02 [DEBUG   ] spawn_process: at 2018-11-15 17:43:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 17:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 17:43:02 [DEBUG   ] spawn_process: at 2018-11-15 17:43:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 17:43:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 17:43:02 [DEBUG   ] spawn_process: at 2018-11-15 17:43:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 17:43:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 17:43:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:43:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-15 17:43:07 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-15 17:43:07 [WARNING ] (13, 1, 'bot')
2018-11-15 17:43:07 [WARNING ] (13, 1, 'bot')
2018-11-15 17:43:07 [WARNING ] (13, 1, 'bot')
2018-11-15 17:43:07 [WARNING ] (13, 1, 'bot')
2018-11-15 17:43:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:43:07 [DEBUG   ] Finished updating board flags in 0.982 seconds
2018-11-15 17:43:20 [DEBUG   ] Got command RPT from MCS: ref #517123
2018-11-15 17:43:20 [DEBUG   ] summary = ERROR
2018-11-15 17:43:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517123  13 58437 63800785 A  ERRORERROR'
2018-11-15 17:43:20 [DEBUG   ] Got command RPT from MCS: ref #517124
2018-11-15 17:43:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 17:43:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517124  77 58437 63800989 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 17:43:21 [DEBUG   ] Got command RPT from MCS: ref #517125
2018-11-15 17:43:21 [DEBUG   ] summary = ERROR
2018-11-15 17:43:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517125  13 58437 63801181 A  ERRORERROR'
2018-11-15 17:43:21 [DEBUG   ] Got command RPT from MCS: ref #517126
2018-11-15 17:43:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 17:43:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517126  77 58437 63801385 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 17:43:21 [DEBUG   ] Got command RPT from MCS: ref #517127
2018-11-15 17:43:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 17:43:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517127  12 58437 63801589 A  ERRORB¡ff'
2018-11-15 17:43:22 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-15 17:43:28 [DEBUG   ] Got command BAM from MCS: ref #517129
2018-11-15 17:43:28 [INFO    ] Finished processing BAM request
2018-11-15 17:43:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517129   8 58437 63808033 A  ERROR'
2018-11-15 17:43:28 [DEBUG   ] Got command BAM from MCS: ref #517128
2018-11-15 17:43:28 [INFO    ] Finished processing BAM request
2018-11-15 17:43:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517128   8 58437 63808037 A  ERROR'
2018-11-15 17:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 17:43:28 [DEBUG   ] spawn_process: at 2018-11-15 17:43:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 17:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 17:43:28 [DEBUG   ] spawn_process: at 2018-11-15 17:43:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 17:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 17:43:28 [DEBUG   ] spawn_process: at 2018-11-15 17:43:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 17:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 17:43:28 [DEBUG   ] spawn_process: at 2018-11-15 17:43:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 17:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 17:43:28 [DEBUG   ] spawn_process: at 2018-11-15 17:43:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 17:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 17:43:28 [DEBUG   ] spawn_process: at 2018-11-15 17:43:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 17:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 17:43:28 [DEBUG   ] spawn_process: at 2018-11-15 17:43:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 17:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 17:43:28 [DEBUG   ] spawn_process: at 2018-11-15 17:43:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 17:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 17:43:28 [DEBUG   ] spawn_process: at 2018-11-15 17:43:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 17:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 17:43:28 [DEBUG   ] spawn_process: at 2018-11-15 17:43:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 17:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 17:43:28 [DEBUG   ] spawn_process: at 2018-11-15 17:43:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 17:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 17:43:28 [DEBUG   ] spawn_process: at 2018-11-15 17:43:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 17:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 17:43:28 [DEBUG   ] spawn_process: at 2018-11-15 17:43:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 17:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 17:43:28 [DEBUG   ] spawn_process: at 2018-11-15 17:43:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 17:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 17:43:28 [DEBUG   ] spawn_process: at 2018-11-15 17:43:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 17:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 17:43:28 [DEBUG   ] spawn_process: at 2018-11-15 17:43:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 17:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 17:43:28 [DEBUG   ] spawn_process: at 2018-11-15 17:43:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 17:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 17:43:28 [DEBUG   ] spawn_process: at 2018-11-15 17:43:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 17:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 17:43:28 [DEBUG   ] spawn_process: at 2018-11-15 17:43:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 17:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 17:43:28 [DEBUG   ] spawn_process: at 2018-11-15 17:43:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 17:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 17:43:28 [DEBUG   ] spawn_process: at 2018-11-15 17:43:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 17:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 17:43:28 [DEBUG   ] spawn_process: at 2018-11-15 17:43:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 17:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 17:43:28 [DEBUG   ] spawn_process: at 2018-11-15 17:43:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 17:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 17:43:28 [DEBUG   ] spawn_process: at 2018-11-15 17:43:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 17:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 17:43:28 [DEBUG   ] spawn_process: at 2018-11-15 17:43:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 17:43:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 17:43:28 [DEBUG   ] spawn_process: at 2018-11-15 17:43:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 17:43:42 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 17:43:54 [DEBUG   ] Got command BAM from MCS: ref #517130
2018-11-15 17:43:54 [INFO    ] Finished processing BAM request
2018-11-15 17:43:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:43:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517130   8 58437 63834025 A  ERROR'
2018-11-15 17:43:54 [DEBUG   ] Got command BAM from MCS: ref #517131
2018-11-15 17:43:54 [INFO    ] Finished processing BAM request
2018-11-15 17:43:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:43:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517131   8 58437 63834029 A  ERROR'
2018-11-15 17:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 17:43:54 [DEBUG   ] spawn_process: at 2018-11-15 17:43:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 17:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 17:43:54 [DEBUG   ] spawn_process: at 2018-11-15 17:43:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 17:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 17:43:54 [DEBUG   ] spawn_process: at 2018-11-15 17:43:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 17:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 17:43:54 [DEBUG   ] spawn_process: at 2018-11-15 17:43:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 17:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 17:43:54 [DEBUG   ] spawn_process: at 2018-11-15 17:43:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 17:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 17:43:54 [DEBUG   ] spawn_process: at 2018-11-15 17:43:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 17:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 17:43:54 [DEBUG   ] spawn_process: at 2018-11-15 17:43:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 17:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 17:43:54 [DEBUG   ] spawn_process: at 2018-11-15 17:43:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 17:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 17:43:54 [DEBUG   ] spawn_process: at 2018-11-15 17:43:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 17:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 17:43:54 [DEBUG   ] spawn_process: at 2018-11-15 17:43:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 17:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 17:43:54 [DEBUG   ] spawn_process: at 2018-11-15 17:43:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 17:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 17:43:54 [DEBUG   ] spawn_process: at 2018-11-15 17:43:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 17:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 17:43:54 [DEBUG   ] spawn_process: at 2018-11-15 17:43:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 17:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 17:43:54 [DEBUG   ] spawn_process: at 2018-11-15 17:43:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 17:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 17:43:54 [DEBUG   ] spawn_process: at 2018-11-15 17:43:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 17:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 17:43:54 [DEBUG   ] spawn_process: at 2018-11-15 17:43:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 17:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 17:43:54 [DEBUG   ] spawn_process: at 2018-11-15 17:43:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 17:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 17:43:54 [DEBUG   ] spawn_process: at 2018-11-15 17:43:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 17:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 17:43:54 [DEBUG   ] spawn_process: at 2018-11-15 17:43:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 17:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 17:43:54 [DEBUG   ] spawn_process: at 2018-11-15 17:43:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 17:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 17:43:54 [DEBUG   ] spawn_process: at 2018-11-15 17:43:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 17:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 17:43:54 [DEBUG   ] spawn_process: at 2018-11-15 17:43:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 17:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 17:43:54 [DEBUG   ] spawn_process: at 2018-11-15 17:43:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 17:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 17:43:54 [DEBUG   ] spawn_process: at 2018-11-15 17:43:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 17:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 17:43:54 [DEBUG   ] spawn_process: at 2018-11-15 17:43:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 17:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 17:43:54 [DEBUG   ] spawn_process: at 2018-11-15 17:43:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 17:44:02 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 17:44:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 17:44:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2018-11-15 17:44:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 17:44:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:44:08 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-15 17:44:08 [WARNING ] (13, 1, 'bot')
2018-11-15 17:44:08 [WARNING ] (13, 1, 'bot')
2018-11-15 17:44:08 [WARNING ] (13, 1, 'bot')
2018-11-15 17:44:08 [WARNING ] (13, 1, 'bot')
2018-11-15 17:44:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:44:08 [DEBUG   ] Finished updating board flags in 1.352 seconds
2018-11-15 17:44:20 [DEBUG   ] Got command BAM from MCS: ref #517133
2018-11-15 17:44:20 [INFO    ] Finished processing BAM request
2018-11-15 17:44:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517133   8 58437 63860029 A  ERROR'
2018-11-15 17:44:20 [DEBUG   ] Got command BAM from MCS: ref #517132
2018-11-15 17:44:20 [INFO    ] Finished processing BAM request
2018-11-15 17:44:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:44:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517132   8 58437 63860033 A  ERROR'
2018-11-15 17:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 17:44:20 [DEBUG   ] spawn_process: at 2018-11-15 17:44:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 17:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 17:44:20 [DEBUG   ] spawn_process: at 2018-11-15 17:44:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 17:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 17:44:20 [DEBUG   ] spawn_process: at 2018-11-15 17:44:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 17:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 17:44:20 [DEBUG   ] spawn_process: at 2018-11-15 17:44:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 17:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 17:44:20 [DEBUG   ] spawn_process: at 2018-11-15 17:44:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 17:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 17:44:20 [DEBUG   ] spawn_process: at 2018-11-15 17:44:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 17:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 17:44:20 [DEBUG   ] spawn_process: at 2018-11-15 17:44:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 17:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 17:44:20 [DEBUG   ] spawn_process: at 2018-11-15 17:44:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 17:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 17:44:20 [DEBUG   ] spawn_process: at 2018-11-15 17:44:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 17:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 17:44:20 [DEBUG   ] spawn_process: at 2018-11-15 17:44:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 17:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 17:44:20 [DEBUG   ] spawn_process: at 2018-11-15 17:44:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 17:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 17:44:20 [DEBUG   ] spawn_process: at 2018-11-15 17:44:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 17:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 17:44:20 [DEBUG   ] spawn_process: at 2018-11-15 17:44:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 17:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 17:44:20 [DEBUG   ] spawn_process: at 2018-11-15 17:44:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 17:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 17:44:20 [DEBUG   ] spawn_process: at 2018-11-15 17:44:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 17:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 17:44:20 [DEBUG   ] spawn_process: at 2018-11-15 17:44:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 17:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 17:44:20 [DEBUG   ] spawn_process: at 2018-11-15 17:44:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 17:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 17:44:20 [DEBUG   ] spawn_process: at 2018-11-15 17:44:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 17:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 17:44:20 [DEBUG   ] spawn_process: at 2018-11-15 17:44:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 17:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 17:44:20 [DEBUG   ] spawn_process: at 2018-11-15 17:44:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 17:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 17:44:20 [DEBUG   ] spawn_process: at 2018-11-15 17:44:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 17:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 17:44:20 [DEBUG   ] spawn_process: at 2018-11-15 17:44:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 17:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 17:44:20 [DEBUG   ] spawn_process: at 2018-11-15 17:44:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 17:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 17:44:20 [DEBUG   ] spawn_process: at 2018-11-15 17:44:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 17:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 17:44:20 [DEBUG   ] spawn_process: at 2018-11-15 17:44:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 17:44:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 17:44:20 [DEBUG   ] spawn_process: at 2018-11-15 17:44:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 17:44:22 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 17:44:42 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 17:44:46 [DEBUG   ] Got command BAM from MCS: ref #517138
2018-11-15 17:44:46 [INFO    ] Finished processing BAM request
2018-11-15 17:44:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:44:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517138   8 58437 63886029 A  ERROR'
2018-11-15 17:44:46 [DEBUG   ] Got command BAM from MCS: ref #517139
2018-11-15 17:44:46 [INFO    ] Finished processing BAM request
2018-11-15 17:44:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:44:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517139   8 58437 63886033 A  ERROR'
2018-11-15 17:44:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 17:44:46 [DEBUG   ] spawn_process: at 2018-11-15 17:44:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 17:44:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 17:44:46 [DEBUG   ] spawn_process: at 2018-11-15 17:44:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 17:44:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 17:44:46 [DEBUG   ] spawn_process: at 2018-11-15 17:44:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 17:44:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 17:44:46 [DEBUG   ] spawn_process: at 2018-11-15 17:44:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 17:44:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 17:44:46 [DEBUG   ] spawn_process: at 2018-11-15 17:44:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 17:44:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 17:44:46 [DEBUG   ] spawn_process: at 2018-11-15 17:44:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 17:44:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 17:44:46 [DEBUG   ] spawn_process: at 2018-11-15 17:44:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 17:44:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 17:44:46 [DEBUG   ] spawn_process: at 2018-11-15 17:44:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 17:44:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 17:44:46 [DEBUG   ] spawn_process: at 2018-11-15 17:44:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 17:44:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 17:44:46 [DEBUG   ] spawn_process: at 2018-11-15 17:44:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 17:44:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 17:44:46 [DEBUG   ] spawn_process: at 2018-11-15 17:44:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 17:44:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 17:44:46 [DEBUG   ] spawn_process: at 2018-11-15 17:44:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 17:44:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 17:44:46 [DEBUG   ] spawn_process: at 2018-11-15 17:44:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 17:44:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 17:44:46 [DEBUG   ] spawn_process: at 2018-11-15 17:44:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 17:44:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 17:44:46 [DEBUG   ] spawn_process: at 2018-11-15 17:44:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 17:44:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 17:44:46 [DEBUG   ] spawn_process: at 2018-11-15 17:44:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 17:44:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 17:44:46 [DEBUG   ] spawn_process: at 2018-11-15 17:44:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 17:44:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 17:44:46 [DEBUG   ] spawn_process: at 2018-11-15 17:44:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 17:44:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 17:44:46 [DEBUG   ] spawn_process: at 2018-11-15 17:44:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 17:44:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 17:44:46 [DEBUG   ] spawn_process: at 2018-11-15 17:44:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 17:44:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 17:44:46 [DEBUG   ] spawn_process: at 2018-11-15 17:44:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 17:44:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 17:44:46 [DEBUG   ] spawn_process: at 2018-11-15 17:44:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 17:44:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 17:44:46 [DEBUG   ] spawn_process: at 2018-11-15 17:44:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 17:44:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 17:44:46 [DEBUG   ] spawn_process: at 2018-11-15 17:44:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 17:44:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 17:44:46 [DEBUG   ] spawn_process: at 2018-11-15 17:44:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 17:44:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 17:44:46 [DEBUG   ] spawn_process: at 2018-11-15 17:44:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 17:45:02 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 17:45:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-11-15 17:45:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 17:45:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:45:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-11-15 17:45:08 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 17:45:08 [WARNING ] (13, 1, 'bot')
2018-11-15 17:45:08 [WARNING ] (13, 1, 'bot')
2018-11-15 17:45:08 [WARNING ] (13, 1, 'bot')
2018-11-15 17:45:08 [WARNING ] (13, 1, 'bot')
2018-11-15 17:45:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:45:08 [DEBUG   ] Finished updating board flags in 1.214 seconds
2018-11-15 17:45:12 [DEBUG   ] Got command BAM from MCS: ref #517141
2018-11-15 17:45:12 [INFO    ] Finished processing BAM request
2018-11-15 17:45:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:45:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517141   8 58437 63912025 A  ERROR'
2018-11-15 17:45:12 [DEBUG   ] Got command BAM from MCS: ref #517140
2018-11-15 17:45:12 [INFO    ] Finished processing BAM request
2018-11-15 17:45:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:45:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517140   8 58437 63912029 A  ERROR'
2018-11-15 17:45:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 17:45:12 [DEBUG   ] spawn_process: at 2018-11-15 17:45:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 17:45:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 17:45:12 [DEBUG   ] spawn_process: at 2018-11-15 17:45:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 17:45:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 17:45:12 [DEBUG   ] spawn_process: at 2018-11-15 17:45:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 17:45:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 17:45:12 [DEBUG   ] spawn_process: at 2018-11-15 17:45:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 17:45:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 17:45:12 [DEBUG   ] spawn_process: at 2018-11-15 17:45:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 17:45:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 17:45:12 [DEBUG   ] spawn_process: at 2018-11-15 17:45:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 17:45:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 17:45:12 [DEBUG   ] spawn_process: at 2018-11-15 17:45:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 17:45:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 17:45:12 [DEBUG   ] spawn_process: at 2018-11-15 17:45:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 17:45:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 17:45:12 [DEBUG   ] spawn_process: at 2018-11-15 17:45:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 17:45:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 17:45:12 [DEBUG   ] spawn_process: at 2018-11-15 17:45:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 17:45:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 17:45:12 [DEBUG   ] spawn_process: at 2018-11-15 17:45:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 17:45:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 17:45:12 [DEBUG   ] spawn_process: at 2018-11-15 17:45:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 17:45:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 17:45:12 [DEBUG   ] spawn_process: at 2018-11-15 17:45:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 17:45:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 17:45:12 [DEBUG   ] spawn_process: at 2018-11-15 17:45:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 17:45:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 17:45:12 [DEBUG   ] spawn_process: at 2018-11-15 17:45:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 17:45:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 17:45:12 [DEBUG   ] spawn_process: at 2018-11-15 17:45:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 17:45:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 17:45:12 [DEBUG   ] spawn_process: at 2018-11-15 17:45:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 17:45:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 17:45:12 [DEBUG   ] spawn_process: at 2018-11-15 17:45:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 17:45:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 17:45:12 [DEBUG   ] spawn_process: at 2018-11-15 17:45:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 17:45:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 17:45:12 [DEBUG   ] spawn_process: at 2018-11-15 17:45:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 17:45:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 17:45:12 [DEBUG   ] spawn_process: at 2018-11-15 17:45:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 17:45:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 17:45:12 [DEBUG   ] spawn_process: at 2018-11-15 17:45:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 17:45:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 17:45:12 [DEBUG   ] spawn_process: at 2018-11-15 17:45:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 17:45:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 17:45:12 [DEBUG   ] spawn_process: at 2018-11-15 17:45:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 17:45:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 17:45:12 [DEBUG   ] spawn_process: at 2018-11-15 17:45:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 17:45:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 17:45:12 [DEBUG   ] spawn_process: at 2018-11-15 17:45:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 17:45:22 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 17:45:38 [DEBUG   ] Got command BAM from MCS: ref #517143
2018-11-15 17:45:38 [INFO    ] Finished processing BAM request
2018-11-15 17:45:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:45:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517143   8 58437 63938030 A  ERROR'
2018-11-15 17:45:38 [DEBUG   ] Got command BAM from MCS: ref #517142
2018-11-15 17:45:38 [INFO    ] Finished processing BAM request
2018-11-15 17:45:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 17:45:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517142   8 58437 63938034 A  ERROR'
2018-11-15 17:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 17:45:38 [DEBUG   ] spawn_process: at 2018-11-15 17:45:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 17:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 17:45:38 [DEBUG   ] spawn_process: at 2018-11-15 17:45:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 17:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 17:45:38 [DEBUG   ] spawn_process: at 2018-11-15 17:45:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 17:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 17:45:38 [DEBUG   ] spawn_process: at 2018-11-15 17:45:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 17:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 17:45:38 [DEBUG   ] spawn_process: at 2018-11-15 17:45:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 17:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 17:45:38 [DEBUG   ] spawn_process: at 2018-11-15 17:45:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 17:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 17:45:38 [DEBUG   ] spawn_process: at 2018-11-15 17:45:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 17:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 17:45:38 [DEBUG   ] spawn_process: at 2018-11-15 17:45:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 17:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 17:45:38 [DEBUG   ] spawn_process: at 2018-11-15 17:45:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 17:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 17:45:38 [DEBUG   ] spawn_process: at 2018-11-15 17:45:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 17:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 17:45:38 [DEBUG   ] spawn_process: at 2018-11-15 17:45:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 17:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 17:45:38 [DEBUG   ] spawn_process: at 2018-11-15 17:45:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 17:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 17:45:38 [DEBUG   ] spawn_process: at 2018-11-15 17:45:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 17:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 17:45:38 [DEBUG   ] spawn_process: at 2018-11-15 17:45:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 17:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 17:45:38 [DEBUG   ] spawn_process: at 2018-11-15 17:45:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 17:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 17:45:38 [DEBUG   ] spawn_process: at 2018-11-15 17:45:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 17:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 17:45:38 [DEBUG   ] spawn_process: at 2018-11-15 17:45:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 17:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 17:45:38 [DEBUG   ] spawn_process: at 2018-11-15 17:45:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 17:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 17:45:38 [DEBUG   ] spawn_process: at 2018-11-15 17:45:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 17:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 17:45:38 [DEBUG   ] spawn_process: at 2018-11-15 17:45:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 17:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 17:45:38 [DEBUG   ] spawn_process: at 2018-11-15 17:45:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 17:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 17:45:38 [DEBUG   ] spawn_process: at 2018-11-15 17:45:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 17:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 17:45:38 [DEBUG   ] spawn_process: at 2018-11-15 17:45:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 17:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 17:45:38 [DEBUG   ] spawn_process: at 2018-11-15 17:45:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 17:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 17:45:38 [DEBUG   ] spawn_process: at 2018-11-15 17:45:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 17:45:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 17:45:38 [DEBUG   ] spawn_process: at 2018-11-15 17:45:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 17:45:42 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 17:45:45 [DEBUG   ] Got command RPT from MCS: ref #517144
2018-11-15 17:45:45 [DEBUG   ] summary = ERROR
2018-11-15 17:45:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517144  13 58437 63945150 A  ERRORERROR'
2018-11-15 17:45:45 [DEBUG   ] Got command RPT from MCS: ref #517145
2018-11-15 17:45:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 17:45:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517145  77 58437 63945150 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 17:46:02 [DEBUG   ] Got command STP from MCS: ref #517161
2018-11-15 17:46:02 [INFO    ] Finished processing BAM request
2018-11-15 17:46:02 [INFO    ] Shutdown the adder chain on beam #4
2018-11-15 17:46:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP   517161   8 58437 63962025 A  ERROR'
2018-11-15 17:46:02 [DEBUG   ] Got command STP from MCS: ref #517162
2018-11-15 17:46:02 [INFO    ] Finished processing BAM request
2018-11-15 17:46:02 [INFO    ] Shutdown the adder chain on beam #2
2018-11-15 17:46:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP   517162   8 58437 63962029 A  ERROR'
2018-11-15 17:46:02 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 17:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 17:46:02 [DEBUG   ] spawn_process: at 2018-11-15 17:46:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 17:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 17:46:02 [DEBUG   ] spawn_process: at 2018-11-15 17:46:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 17:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 17:46:02 [DEBUG   ] spawn_process: at 2018-11-15 17:46:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 17:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 17:46:02 [DEBUG   ] spawn_process: at 2018-11-15 17:46:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 17:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 17:46:02 [DEBUG   ] spawn_process: at 2018-11-15 17:46:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 17:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 17:46:02 [DEBUG   ] spawn_process: at 2018-11-15 17:46:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 17:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 17:46:02 [DEBUG   ] spawn_process: at 2018-11-15 17:46:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 17:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 17:46:02 [DEBUG   ] spawn_process: at 2018-11-15 17:46:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 17:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 17:46:02 [DEBUG   ] spawn_process: at 2018-11-15 17:46:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 17:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 17:46:02 [DEBUG   ] spawn_process: at 2018-11-15 17:46:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 17:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 17:46:02 [DEBUG   ] spawn_process: at 2018-11-15 17:46:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 17:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 17:46:02 [DEBUG   ] spawn_process: at 2018-11-15 17:46:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 17:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 17:46:02 [DEBUG   ] spawn_process: at 2018-11-15 17:46:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 17:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 17:46:02 [DEBUG   ] spawn_process: at 2018-11-15 17:46:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 17:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 17:46:02 [DEBUG   ] spawn_process: at 2018-11-15 17:46:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 17:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 17:46:02 [DEBUG   ] spawn_process: at 2018-11-15 17:46:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 17:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 17:46:02 [DEBUG   ] spawn_process: at 2018-11-15 17:46:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 17:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 17:46:02 [DEBUG   ] spawn_process: at 2018-11-15 17:46:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 17:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 17:46:02 [DEBUG   ] spawn_process: at 2018-11-15 17:46:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 17:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 17:46:02 [DEBUG   ] spawn_process: at 2018-11-15 17:46:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 17:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 17:46:02 [DEBUG   ] spawn_process: at 2018-11-15 17:46:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 17:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 17:46:02 [DEBUG   ] spawn_process: at 2018-11-15 17:46:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 17:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 17:46:02 [DEBUG   ] spawn_process: at 2018-11-15 17:46:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 17:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 17:46:02 [DEBUG   ] spawn_process: at 2018-11-15 17:46:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 17:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 17:46:02 [DEBUG   ] spawn_process: at 2018-11-15 17:46:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 17:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 17:46:02 [DEBUG   ] spawn_process: at 2018-11-15 17:46:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 17:46:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:46:08 [WARNING ] (13, 1, 'bot')
2018-11-15 17:46:08 [WARNING ] (13, 1, 'bot')
2018-11-15 17:46:08 [WARNING ] (13, 1, 'bot')
2018-11-15 17:46:08 [WARNING ] (13, 1, 'bot')
2018-11-15 17:46:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:46:08 [DEBUG   ] Finished updating board flags in 1.192 seconds
2018-11-15 17:46:22 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 17:46:42 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 17:47:02 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 17:47:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:47:08 [WARNING ] (13, 1, 'bot')
2018-11-15 17:47:08 [WARNING ] (13, 1, 'bot')
2018-11-15 17:47:08 [WARNING ] (13, 1, 'bot')
2018-11-15 17:47:08 [WARNING ] (13, 1, 'bot')
2018-11-15 17:47:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:47:08 [DEBUG   ] Finished updating board flags in 1.077 seconds
2018-11-15 17:47:22 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 17:47:42 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 17:48:02 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 17:48:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:48:09 [WARNING ] (13, 1, 'bot')
2018-11-15 17:48:09 [WARNING ] (13, 1, 'bot')
2018-11-15 17:48:09 [WARNING ] (13, 1, 'bot')
2018-11-15 17:48:09 [WARNING ] (13, 1, 'bot')
2018-11-15 17:48:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:48:09 [DEBUG   ] Finished updating board flags in 2.004 seconds
2018-11-15 17:48:20 [DEBUG   ] Got command RPT from MCS: ref #517169
2018-11-15 17:48:20 [DEBUG   ] summary = ERROR
2018-11-15 17:48:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517169  13 58437 64100869 A  ERRORERROR'
2018-11-15 17:48:21 [DEBUG   ] Got command RPT from MCS: ref #517170
2018-11-15 17:48:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 17:48:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517170  77 58437 64101073 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 17:48:21 [DEBUG   ] Got command RPT from MCS: ref #517171
2018-11-15 17:48:21 [DEBUG   ] summary = ERROR
2018-11-15 17:48:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517171  13 58437 64101266 A  ERRORERROR'
2018-11-15 17:48:21 [DEBUG   ] Got command RPT from MCS: ref #517173
2018-11-15 17:48:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 17:48:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517173  77 58437 64101469 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 17:48:21 [DEBUG   ] Got command RPT from MCS: ref #517174
2018-11-15 17:48:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 17:48:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517174  12 58437 64101674 A  ERRORBœ™š'
2018-11-15 17:48:22 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 17:48:42 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 17:49:02 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 17:49:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 17:49:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:49:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-15 17:49:08 [WARNING ] (13, 1, 'bot')
2018-11-15 17:49:08 [WARNING ] (13, 1, 'bot')
2018-11-15 17:49:08 [WARNING ] (13, 1, 'bot')
2018-11-15 17:49:08 [WARNING ] (13, 1, 'bot')
2018-11-15 17:49:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:49:08 [DEBUG   ] Finished updating board flags in 1.369 seconds
2018-11-15 17:49:22 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 17:49:42 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 17:50:02 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 17:50:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:50:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-15 17:50:08 [WARNING ] (13, 1, 'bot')
2018-11-15 17:50:08 [WARNING ] (13, 1, 'bot')
2018-11-15 17:50:08 [WARNING ] (13, 1, 'bot')
2018-11-15 17:50:08 [WARNING ] (13, 1, 'bot')
2018-11-15 17:50:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:50:08 [DEBUG   ] Finished updating board flags in 1.247 seconds
2018-11-15 17:50:22 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 17:50:42 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 17:50:45 [DEBUG   ] Got command RPT from MCS: ref #517183
2018-11-15 17:50:45 [DEBUG   ] summary = ERROR
2018-11-15 17:50:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517183  13 58437 64245153 A  ERRORERROR'
2018-11-15 17:50:45 [DEBUG   ] Got command RPT from MCS: ref #517184
2018-11-15 17:50:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 17:50:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517184  77 58437 64245154 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 17:51:02 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 17:51:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:51:08 [WARNING ] (13, 1, 'bot')
2018-11-15 17:51:08 [WARNING ] (13, 1, 'bot')
2018-11-15 17:51:08 [WARNING ] (13, 1, 'bot')
2018-11-15 17:51:08 [WARNING ] (13, 1, 'bot')
2018-11-15 17:51:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:51:08 [DEBUG   ] Finished updating board flags in 1.169 seconds
2018-11-15 17:51:23 [DEBUG   ] Finished updating ant stats in 1.403 seconds
2018-11-15 17:51:42 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 17:52:02 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 17:52:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:52:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 17:52:08 [WARNING ] (13, 1, 'bot')
2018-11-15 17:52:08 [WARNING ] (13, 1, 'bot')
2018-11-15 17:52:08 [WARNING ] (13, 1, 'bot')
2018-11-15 17:52:08 [WARNING ] (13, 1, 'bot')
2018-11-15 17:52:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:52:08 [DEBUG   ] Finished updating board flags in 1.032 seconds
2018-11-15 17:52:22 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 17:52:42 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 17:53:02 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 17:53:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 17:53:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:53:09 [WARNING ] (13, 1, 'bot')
2018-11-15 17:53:09 [WARNING ] (13, 1, 'bot')
2018-11-15 17:53:09 [WARNING ] (13, 1, 'bot')
2018-11-15 17:53:09 [WARNING ] (13, 1, 'bot')
2018-11-15 17:53:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:53:09 [DEBUG   ] Finished updating board flags in 1.531 seconds
2018-11-15 17:53:20 [DEBUG   ] Got command RPT from MCS: ref #517200
2018-11-15 17:53:20 [DEBUG   ] summary = ERROR
2018-11-15 17:53:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517200  13 58437 64400949 A  ERRORERROR'
2018-11-15 17:53:21 [DEBUG   ] Got command RPT from MCS: ref #517201
2018-11-15 17:53:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 17:53:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517201  77 58437 64401153 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 17:53:21 [DEBUG   ] Got command RPT from MCS: ref #517202
2018-11-15 17:53:21 [DEBUG   ] summary = ERROR
2018-11-15 17:53:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517202  13 58437 64401357 A  ERRORERROR'
2018-11-15 17:53:21 [DEBUG   ] Got command RPT from MCS: ref #517203
2018-11-15 17:53:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 17:53:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517203  77 58437 64401561 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 17:53:21 [DEBUG   ] Got command RPT from MCS: ref #517204
2018-11-15 17:53:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 17:53:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517204  12 58437 64401753 A  ERRORB™™š'
2018-11-15 17:53:22 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 17:53:42 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 17:54:02 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 17:54:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:54:09 [WARNING ] (13, 1, 'bot')
2018-11-15 17:54:09 [WARNING ] (13, 1, 'bot')
2018-11-15 17:54:09 [WARNING ] (13, 1, 'bot')
2018-11-15 17:54:09 [WARNING ] (13, 1, 'bot')
2018-11-15 17:54:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:54:09 [DEBUG   ] Finished updating board flags in 1.437 seconds
2018-11-15 17:54:22 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 17:54:42 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 17:55:02 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 17:55:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:55:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 17:55:09 [WARNING ] (13, 1, 'bot')
2018-11-15 17:55:09 [WARNING ] (13, 1, 'bot')
2018-11-15 17:55:09 [WARNING ] (13, 1, 'bot')
2018-11-15 17:55:09 [WARNING ] (13, 1, 'bot')
2018-11-15 17:55:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:55:09 [DEBUG   ] Finished updating board flags in 1.426 seconds
2018-11-15 17:55:22 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-15 17:55:43 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 17:55:45 [DEBUG   ] Got command RPT from MCS: ref #517209
2018-11-15 17:55:45 [DEBUG   ] summary = ERROR
2018-11-15 17:55:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517209  13 58437 64545157 A  ERRORERROR'
2018-11-15 17:55:45 [DEBUG   ] Got command RPT from MCS: ref #517210
2018-11-15 17:55:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 17:55:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517210  77 58437 64545158 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 17:56:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 17:56:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:56:09 [WARNING ] (13, 1, 'bot')
2018-11-15 17:56:09 [WARNING ] (13, 1, 'bot')
2018-11-15 17:56:09 [WARNING ] (13, 1, 'bot')
2018-11-15 17:56:09 [WARNING ] (13, 1, 'bot')
2018-11-15 17:56:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:56:09 [DEBUG   ] Finished updating board flags in 1.343 seconds
2018-11-15 17:56:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 17:56:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 17:57:03 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-15 17:57:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:57:09 [WARNING ] (13, 1, 'bot')
2018-11-15 17:57:09 [WARNING ] (13, 1, 'bot')
2018-11-15 17:57:09 [WARNING ] (13, 1, 'bot')
2018-11-15 17:57:09 [WARNING ] (13, 1, 'bot')
2018-11-15 17:57:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:57:09 [DEBUG   ] Finished updating board flags in 1.195 seconds
2018-11-15 17:57:23 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 17:57:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 17:58:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 17:58:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:58:09 [WARNING ] (13, 1, 'bot')
2018-11-15 17:58:09 [WARNING ] (13, 1, 'bot')
2018-11-15 17:58:09 [WARNING ] (13, 1, 'bot')
2018-11-15 17:58:09 [WARNING ] (13, 1, 'bot')
2018-11-15 17:58:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:58:09 [DEBUG   ] Finished updating board flags in 0.998 seconds
2018-11-15 17:58:21 [DEBUG   ] Got command RPT from MCS: ref #517232
2018-11-15 17:58:21 [DEBUG   ] summary = ERROR
2018-11-15 17:58:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517232  13 58437 64701037 A  ERRORERROR'
2018-11-15 17:58:21 [DEBUG   ] Got command RPT from MCS: ref #517233
2018-11-15 17:58:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 17:58:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517233  77 58437 64701241 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 17:58:21 [DEBUG   ] Got command RPT from MCS: ref #517234
2018-11-15 17:58:21 [DEBUG   ] summary = ERROR
2018-11-15 17:58:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517234  13 58437 64701445 A  ERRORERROR'
2018-11-15 17:58:21 [DEBUG   ] Got command RPT from MCS: ref #517236
2018-11-15 17:58:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 17:58:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517236  77 58437 64701637 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 17:58:21 [DEBUG   ] Got command RPT from MCS: ref #517237
2018-11-15 17:58:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 17:58:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517237  12 58437 64701841 A  ERRORB˜™š'
2018-11-15 17:58:23 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 17:58:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 17:59:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 17:59:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 17:59:10 [WARNING ] (13, 1, 'bot')
2018-11-15 17:59:10 [WARNING ] (13, 1, 'bot')
2018-11-15 17:59:10 [WARNING ] (13, 1, 'bot')
2018-11-15 17:59:10 [WARNING ] (13, 1, 'bot')
2018-11-15 17:59:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 17:59:10 [DEBUG   ] Finished updating board flags in 1.815 seconds
2018-11-15 17:59:23 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 17:59:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 18:00:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 18:00:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 18:00:09 [WARNING ] (13, 1, 'bot')
2018-11-15 18:00:09 [WARNING ] (13, 1, 'bot')
2018-11-15 18:00:09 [WARNING ] (13, 1, 'bot')
2018-11-15 18:00:09 [WARNING ] (13, 1, 'bot')
2018-11-15 18:00:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 18:00:09 [DEBUG   ] Finished updating board flags in 1.234 seconds
2018-11-15 18:00:23 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 18:00:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 18:00:45 [DEBUG   ] Got command RPT from MCS: ref #517246
2018-11-15 18:00:45 [DEBUG   ] summary = ERROR
2018-11-15 18:00:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517246  13 58437 64845153 A  ERRORERROR'
2018-11-15 18:00:45 [DEBUG   ] Got command RPT from MCS: ref #517247
2018-11-15 18:00:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 18:00:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517247  77 58437 64845154 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 18:01:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 18:01:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 18:01:09 [WARNING ] (13, 1, 'bot')
2018-11-15 18:01:09 [WARNING ] (13, 1, 'bot')
2018-11-15 18:01:09 [WARNING ] (13, 1, 'bot')
2018-11-15 18:01:09 [WARNING ] (13, 1, 'bot')
2018-11-15 18:01:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 18:01:09 [DEBUG   ] Finished updating board flags in 1.221 seconds
2018-11-15 18:01:23 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 18:01:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 18:02:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 18:02:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 18:02:09 [WARNING ] (13, 1, 'bot')
2018-11-15 18:02:09 [WARNING ] (13, 1, 'bot')
2018-11-15 18:02:09 [WARNING ] (13, 1, 'bot')
2018-11-15 18:02:09 [WARNING ] (13, 1, 'bot')
2018-11-15 18:02:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 18:02:09 [DEBUG   ] Finished updating board flags in 1.265 seconds
2018-11-15 18:02:23 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-15 18:02:43 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 18:03:03 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 18:03:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 18:03:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 18:03:09 [WARNING ] (13, 1, 'bot')
2018-11-15 18:03:09 [WARNING ] (13, 1, 'bot')
2018-11-15 18:03:09 [WARNING ] (13, 1, 'bot')
2018-11-15 18:03:09 [WARNING ] (13, 1, 'bot')
2018-11-15 18:03:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 18:03:09 [DEBUG   ] Finished updating board flags in 1.106 seconds
2018-11-15 18:03:21 [DEBUG   ] Got command RPT from MCS: ref #517267
2018-11-15 18:03:21 [DEBUG   ] summary = ERROR
2018-11-15 18:03:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517267  13 58437 65001121 A  ERRORERROR'
2018-11-15 18:03:21 [DEBUG   ] Got command RPT from MCS: ref #517268
2018-11-15 18:03:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 18:03:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517268  77 58437 65001325 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 18:03:21 [DEBUG   ] Got command RPT from MCS: ref #517269
2018-11-15 18:03:21 [DEBUG   ] summary = ERROR
2018-11-15 18:03:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517269  13 58437 65001529 A  ERRORERROR'
2018-11-15 18:03:21 [DEBUG   ] Got command RPT from MCS: ref #517270
2018-11-15 18:03:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 18:03:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517270  77 58437 65001721 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 18:03:21 [DEBUG   ] Got command RPT from MCS: ref #517271
2018-11-15 18:03:21 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 18:03:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517271  12 58437 65001925 A  ERRORB—™š'
2018-11-15 18:03:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 18:03:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 18:04:03 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 18:04:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 18:04:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 18:04:09 [WARNING ] (13, 1, 'bot')
2018-11-15 18:04:09 [WARNING ] (13, 1, 'bot')
2018-11-15 18:04:09 [WARNING ] (13, 1, 'bot')
2018-11-15 18:04:09 [WARNING ] (13, 1, 'bot')
2018-11-15 18:04:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 18:04:09 [DEBUG   ] Finished updating board flags in 1.040 seconds
2018-11-15 18:04:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 18:04:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 18:05:03 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 18:05:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 18:05:10 [WARNING ] (13, 1, 'bot')
2018-11-15 18:05:10 [WARNING ] (13, 1, 'bot')
2018-11-15 18:05:10 [WARNING ] (13, 1, 'bot')
2018-11-15 18:05:10 [WARNING ] (13, 1, 'bot')
2018-11-15 18:05:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 18:05:10 [DEBUG   ] Finished updating board flags in 1.549 seconds
2018-11-15 18:05:23 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-15 18:05:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 18:05:45 [DEBUG   ] Got command RPT from MCS: ref #517276
2018-11-15 18:05:45 [DEBUG   ] summary = ERROR
2018-11-15 18:05:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517276  13 58437 65145157 A  ERRORERROR'
2018-11-15 18:05:45 [DEBUG   ] Got command RPT from MCS: ref #517277
2018-11-15 18:05:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 18:05:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517277  77 58437 65145158 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 18:06:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 18:06:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 18:06:10 [WARNING ] (13, 1, 'bot')
2018-11-15 18:06:10 [WARNING ] (13, 1, 'bot')
2018-11-15 18:06:10 [WARNING ] (13, 1, 'bot')
2018-11-15 18:06:10 [WARNING ] (13, 1, 'bot')
2018-11-15 18:06:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 18:06:10 [DEBUG   ] Finished updating board flags in 1.372 seconds
2018-11-15 18:06:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 18:06:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 18:07:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 18:07:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 18:07:10 [WARNING ] (13, 1, 'bot')
2018-11-15 18:07:10 [WARNING ] (13, 1, 'bot')
2018-11-15 18:07:10 [WARNING ] (13, 1, 'bot')
2018-11-15 18:07:10 [WARNING ] (13, 1, 'bot')
2018-11-15 18:07:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 18:07:10 [DEBUG   ] Finished updating board flags in 1.222 seconds
2018-11-15 18:07:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 18:07:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 18:08:03 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-15 18:08:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 18:08:10 [WARNING ] (13, 1, 'bot')
2018-11-15 18:08:10 [WARNING ] (13, 1, 'bot')
2018-11-15 18:08:10 [WARNING ] (13, 1, 'bot')
2018-11-15 18:08:10 [WARNING ] (13, 1, 'bot')
2018-11-15 18:08:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 18:08:10 [DEBUG   ] Finished updating board flags in 1.234 seconds
2018-11-15 18:08:21 [DEBUG   ] Got command RPT from MCS: ref #517295
2018-11-15 18:08:21 [DEBUG   ] summary = ERROR
2018-11-15 18:08:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517295  13 58437 65301209 A  ERRORERROR'
2018-11-15 18:08:21 [DEBUG   ] Got command RPT from MCS: ref #517296
2018-11-15 18:08:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 18:08:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517296  77 58437 65301413 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 18:08:21 [DEBUG   ] Got command RPT from MCS: ref #517297
2018-11-15 18:08:21 [DEBUG   ] summary = ERROR
2018-11-15 18:08:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517297  13 58437 65301617 A  ERRORERROR'
2018-11-15 18:08:21 [DEBUG   ] Got command RPT from MCS: ref #517299
2018-11-15 18:08:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 18:08:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517299  77 58437 65301809 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 18:08:22 [DEBUG   ] Got command RPT from MCS: ref #517300
2018-11-15 18:08:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 18:08:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517300  12 58437 65302013 A  ERRORB—™š'
2018-11-15 18:08:23 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 18:08:43 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 18:09:03 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 18:09:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 18:09:10 [WARNING ] (13, 1, 'bot')
2018-11-15 18:09:10 [WARNING ] (13, 1, 'bot')
2018-11-15 18:09:10 [WARNING ] (13, 1, 'bot')
2018-11-15 18:09:10 [WARNING ] (13, 1, 'bot')
2018-11-15 18:09:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 18:09:10 [DEBUG   ] Finished updating board flags in 1.214 seconds
2018-11-15 18:09:23 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 18:09:43 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 18:10:03 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 18:10:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 18:10:10 [WARNING ] (13, 1, 'bot')
2018-11-15 18:10:10 [WARNING ] (13, 1, 'bot')
2018-11-15 18:10:10 [WARNING ] (13, 1, 'bot')
2018-11-15 18:10:10 [WARNING ] (13, 1, 'bot')
2018-11-15 18:10:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 18:10:10 [DEBUG   ] Finished updating board flags in 1.175 seconds
2018-11-15 18:10:23 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 18:10:43 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 18:10:45 [DEBUG   ] Got command RPT from MCS: ref #517309
2018-11-15 18:10:45 [DEBUG   ] summary = ERROR
2018-11-15 18:10:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517309  13 58437 65445157 A  ERRORERROR'
2018-11-15 18:10:45 [DEBUG   ] Got command RPT from MCS: ref #517310
2018-11-15 18:10:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 18:10:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517310  77 58437 65445158 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 18:11:03 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 18:11:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 18:11:11 [WARNING ] (13, 1, 'bot')
2018-11-15 18:11:11 [WARNING ] (13, 1, 'bot')
2018-11-15 18:11:11 [WARNING ] (13, 1, 'bot')
2018-11-15 18:11:11 [WARNING ] (13, 1, 'bot')
2018-11-15 18:11:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 18:11:11 [DEBUG   ] Finished updating board flags in 2.013 seconds
2018-11-15 18:11:23 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 18:11:43 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 18:12:03 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 18:12:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 18:12:10 [WARNING ] (13, 1, 'bot')
2018-11-15 18:12:10 [WARNING ] (13, 1, 'bot')
2018-11-15 18:12:10 [WARNING ] (13, 1, 'bot')
2018-11-15 18:12:10 [WARNING ] (13, 1, 'bot')
2018-11-15 18:12:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 18:12:10 [DEBUG   ] Finished updating board flags in 1.419 seconds
2018-11-15 18:12:12 [DEBUG   ] Got command TBW from MCS: ref #517331
2018-11-15 18:12:12 [DEBUG   ] tbw = exited with status True, code 0x00
2018-11-15 18:12:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW   517331   8 58437 65532190 A  ERROR'
2018-11-15 18:12:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2018-11-15 18:12:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2018-11-15 18:12:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2018-11-15 18:12:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2018-11-15 18:12:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2018-11-15 18:12:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2018-11-15 18:12:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2018-11-15 18:12:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2018-11-15 18:12:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2018-11-15 18:12:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2018-11-15 18:12:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2018-11-15 18:12:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2018-11-15 18:12:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2018-11-15 18:12:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2018-11-15 18:12:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2018-11-15 18:12:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2018-11-15 18:12:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2018-11-15 18:12:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2018-11-15 18:12:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2018-11-15 18:12:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2018-11-15 18:12:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2018-11-15 18:12:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2018-11-15 18:12:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2018-11-15 18:12:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2018-11-15 18:12:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2018-11-15 18:12:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2018-11-15 18:12:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2018-11-15 18:12:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2018-11-15 18:12:14 [DEBUG   ] spawn_process: at 2018-11-15 18:12:14 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2018-11-15 18:12:14 [DEBUG   ] spawn_process: at 2018-11-15 18:12:14 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2018-11-15 18:12:14 [DEBUG   ] spawn_process: at 2018-11-15 18:12:14 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2018-11-15 18:12:14 [DEBUG   ] spawn_process: at 2018-11-15 18:12:14 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2018-11-15 18:12:14 [DEBUG   ] spawn_process: at 2018-11-15 18:12:14 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2018-11-15 18:12:14 [DEBUG   ] spawn_process: at 2018-11-15 18:12:14 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2018-11-15 18:12:14 [DEBUG   ] spawn_process: at 2018-11-15 18:12:14 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2018-11-15 18:12:14 [DEBUG   ] spawn_process: at 2018-11-15 18:12:14 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2018-11-15 18:12:14 [DEBUG   ] spawn_process: at 2018-11-15 18:12:14 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2018-11-15 18:12:14 [DEBUG   ] spawn_process: at 2018-11-15 18:12:14 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2018-11-15 18:12:14 [DEBUG   ] spawn_process: at 2018-11-15 18:12:14 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2018-11-15 18:12:14 [DEBUG   ] spawn_process: at 2018-11-15 18:12:14 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2018-11-15 18:12:14 [DEBUG   ] spawn_process: at 2018-11-15 18:12:14 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2018-11-15 18:12:14 [DEBUG   ] spawn_process: at 2018-11-15 18:12:14 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2018-11-15 18:12:14 [DEBUG   ] spawn_process: at 2018-11-15 18:12:14 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2018-11-15 18:12:14 [DEBUG   ] spawn_process: at 2018-11-15 18:12:14 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2018-11-15 18:12:14 [DEBUG   ] spawn_process: at 2018-11-15 18:12:14 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2018-11-15 18:12:14 [DEBUG   ] spawn_process: at 2018-11-15 18:12:14 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2018-11-15 18:12:14 [DEBUG   ] spawn_process: at 2018-11-15 18:12:14 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2018-11-15 18:12:14 [DEBUG   ] spawn_process: at 2018-11-15 18:12:14 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2018-11-15 18:12:14 [DEBUG   ] spawn_process: at 2018-11-15 18:12:14 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2018-11-15 18:12:14 [DEBUG   ] spawn_process: at 2018-11-15 18:12:14 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2018-11-15 18:12:14 [DEBUG   ] spawn_process: at 2018-11-15 18:12:14 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2018-11-15 18:12:14 [DEBUG   ] spawn_process: at 2018-11-15 18:12:14 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2018-11-15 18:12:14 [DEBUG   ] spawn_process: at 2018-11-15 18:12:14 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2018-11-15 18:12:14 [DEBUG   ] spawn_process: at 2018-11-15 18:12:14 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2018-11-15 18:12:14 [INFO    ] Finished spawning TBW
2018-11-15 18:13:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 18:13:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-15 18:13:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 18:13:11 [WARNING ] (13, 1, 'bot')
2018-11-15 18:13:11 [WARNING ] (13, 1, 'bot')
2018-11-15 18:13:11 [WARNING ] (13, 1, 'bot')
2018-11-15 18:13:11 [WARNING ] (13, 1, 'bot')
2018-11-15 18:13:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 18:13:11 [DEBUG   ] Finished updating board flags in 2.089 seconds
2018-11-15 18:13:21 [DEBUG   ] Got command RPT from MCS: ref #517335
2018-11-15 18:13:21 [DEBUG   ] summary = ERROR
2018-11-15 18:13:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517335  13 58437 65601301 A  ERRORERROR'
2018-11-15 18:13:21 [DEBUG   ] Got command RPT from MCS: ref #517336
2018-11-15 18:13:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 18:13:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517336  77 58437 65601494 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 18:13:21 [DEBUG   ] Got command RPT from MCS: ref #517337
2018-11-15 18:13:21 [DEBUG   ] summary = ERROR
2018-11-15 18:13:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517337  13 58437 65601697 A  ERRORERROR'
2018-11-15 18:13:21 [DEBUG   ] Got command RPT from MCS: ref #517338
2018-11-15 18:13:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 18:13:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517338  77 58437 65601902 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 18:13:22 [DEBUG   ] Got command RPT from MCS: ref #517339
2018-11-15 18:13:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 18:13:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517339  12 58437 65602105 A  ERRORB˜™š'
2018-11-15 18:14:02 [INFO    ] __waitForTBW - TBW finished in 108.048 s
2018-11-15 18:14:03 [DEBUG   ] Finished updating ant stats in 0.570 seconds
2018-11-15 18:14:03 [INFO    ] Started antennas statistics background thread
2018-11-15 18:14:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 18:14:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-15 18:14:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 18:14:10 [WARNING ] (13, 1, 'bot')
2018-11-15 18:14:10 [WARNING ] (13, 1, 'bot')
2018-11-15 18:14:10 [WARNING ] (13, 1, 'bot')
2018-11-15 18:14:10 [WARNING ] (13, 1, 'bot')
2018-11-15 18:14:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 18:14:10 [DEBUG   ] Finished updating board flags in 1.324 seconds
2018-11-15 18:14:23 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 18:14:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 18:15:03 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 18:15:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 18:15:10 [WARNING ] (13, 1, 'bot')
2018-11-15 18:15:10 [WARNING ] (13, 1, 'bot')
2018-11-15 18:15:10 [WARNING ] (13, 1, 'bot')
2018-11-15 18:15:10 [WARNING ] (13, 1, 'bot')
2018-11-15 18:15:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 18:15:10 [DEBUG   ] Finished updating board flags in 1.191 seconds
2018-11-15 18:15:23 [DEBUG   ] Finished updating ant stats in 0.394 seconds
2018-11-15 18:15:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 18:15:45 [DEBUG   ] Got command RPT from MCS: ref #517348
2018-11-15 18:15:45 [DEBUG   ] summary = ERROR
2018-11-15 18:15:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517348  13 58437 65745165 A  ERRORERROR'
2018-11-15 18:15:45 [DEBUG   ] Got command RPT from MCS: ref #517349
2018-11-15 18:15:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 18:15:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517349  77 58437 65745166 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 18:16:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 18:16:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 18:16:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 18:16:10 [WARNING ] (13, 1, 'bot')
2018-11-15 18:16:10 [WARNING ] (13, 1, 'bot')
2018-11-15 18:16:10 [WARNING ] (13, 1, 'bot')
2018-11-15 18:16:10 [WARNING ] (13, 1, 'bot')
2018-11-15 18:16:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 18:16:10 [DEBUG   ] Finished updating board flags in 1.012 seconds
2018-11-15 18:16:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 18:16:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 18:17:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 18:17:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 18:17:11 [WARNING ] (13, 1, 'bot')
2018-11-15 18:17:11 [WARNING ] (13, 1, 'bot')
2018-11-15 18:17:11 [WARNING ] (13, 1, 'bot')
2018-11-15 18:17:11 [WARNING ] (13, 1, 'bot')
2018-11-15 18:17:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 18:17:11 [DEBUG   ] Finished updating board flags in 1.572 seconds
2018-11-15 18:17:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 18:17:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 18:18:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 18:18:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 18:18:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 18:18:11 [WARNING ] (13, 1, 'bot')
2018-11-15 18:18:11 [WARNING ] (13, 1, 'bot')
2018-11-15 18:18:11 [WARNING ] (13, 1, 'bot')
2018-11-15 18:18:11 [WARNING ] (13, 1, 'bot')
2018-11-15 18:18:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 18:18:11 [DEBUG   ] Finished updating board flags in 1.366 seconds
2018-11-15 18:18:21 [DEBUG   ] Got command RPT from MCS: ref #517371
2018-11-15 18:18:21 [DEBUG   ] summary = ERROR
2018-11-15 18:18:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517371  13 58437 65901381 A  ERRORERROR'
2018-11-15 18:18:21 [DEBUG   ] Got command RPT from MCS: ref #517372
2018-11-15 18:18:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 18:18:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517372  77 58437 65901585 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 18:18:21 [DEBUG   ] Got command RPT from MCS: ref #517373
2018-11-15 18:18:21 [DEBUG   ] summary = ERROR
2018-11-15 18:18:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517373  13 58437 65901789 A  ERRORERROR'
2018-11-15 18:18:21 [DEBUG   ] Got command RPT from MCS: ref #517375
2018-11-15 18:18:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 18:18:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517375  77 58437 65901981 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 18:18:22 [DEBUG   ] Got command RPT from MCS: ref #517376
2018-11-15 18:18:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 18:18:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517376  12 58437 65902185 A  ERRORB˜™š'
2018-11-15 18:18:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 18:18:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 18:19:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 18:19:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 18:19:11 [WARNING ] (13, 1, 'bot')
2018-11-15 18:19:11 [WARNING ] (13, 1, 'bot')
2018-11-15 18:19:11 [WARNING ] (13, 1, 'bot')
2018-11-15 18:19:11 [WARNING ] (13, 1, 'bot')
2018-11-15 18:19:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 18:19:11 [DEBUG   ] Finished updating board flags in 1.211 seconds
2018-11-15 18:19:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 18:19:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 18:20:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 18:20:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 18:20:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 18:20:11 [WARNING ] (13, 1, 'bot')
2018-11-15 18:20:11 [WARNING ] (13, 1, 'bot')
2018-11-15 18:20:11 [WARNING ] (13, 1, 'bot')
2018-11-15 18:20:11 [WARNING ] (13, 1, 'bot')
2018-11-15 18:20:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 18:20:11 [DEBUG   ] Finished updating board flags in 1.234 seconds
2018-11-15 18:20:24 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-15 18:20:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 18:20:45 [DEBUG   ] Got command RPT from MCS: ref #517385
2018-11-15 18:20:45 [DEBUG   ] summary = ERROR
2018-11-15 18:20:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517385  13 58437 66045157 A  ERRORERROR'
2018-11-15 18:20:45 [DEBUG   ] Got command RPT from MCS: ref #517386
2018-11-15 18:20:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 18:20:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517386  77 58437 66045158 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 18:21:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 18:21:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 18:21:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-15 18:21:11 [WARNING ] (13, 1, 'bot')
2018-11-15 18:21:11 [WARNING ] (13, 1, 'bot')
2018-11-15 18:21:11 [WARNING ] (13, 1, 'bot')
2018-11-15 18:21:11 [WARNING ] (13, 1, 'bot')
2018-11-15 18:21:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 18:21:11 [DEBUG   ] Finished updating board flags in 1.214 seconds
2018-11-15 18:21:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 18:21:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 18:22:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 18:22:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 18:22:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 18:22:11 [WARNING ] (13, 1, 'bot')
2018-11-15 18:22:11 [WARNING ] (13, 1, 'bot')
2018-11-15 18:22:11 [WARNING ] (13, 1, 'bot')
2018-11-15 18:22:11 [WARNING ] (13, 1, 'bot')
2018-11-15 18:22:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 18:22:11 [DEBUG   ] Finished updating board flags in 1.155 seconds
2018-11-15 18:22:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 18:22:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 18:23:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 18:23:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 18:23:11 [WARNING ] (13, 1, 'bot')
2018-11-15 18:23:11 [WARNING ] (13, 1, 'bot')
2018-11-15 18:23:11 [WARNING ] (13, 1, 'bot')
2018-11-15 18:23:11 [WARNING ] (13, 1, 'bot')
2018-11-15 18:23:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 18:23:11 [DEBUG   ] Finished updating board flags in 1.033 seconds
2018-11-15 18:23:21 [DEBUG   ] Got command RPT from MCS: ref #517402
2018-11-15 18:23:21 [DEBUG   ] summary = ERROR
2018-11-15 18:23:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517402  13 58437 66201465 A  ERRORERROR'
2018-11-15 18:23:21 [DEBUG   ] Got command RPT from MCS: ref #517403
2018-11-15 18:23:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 18:23:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517403  77 58437 66201669 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 18:23:21 [DEBUG   ] Got command RPT from MCS: ref #517404
2018-11-15 18:23:21 [DEBUG   ] summary = ERROR
2018-11-15 18:23:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517404  13 58437 66201873 A  ERRORERROR'
2018-11-15 18:23:22 [DEBUG   ] Got command RPT from MCS: ref #517405
2018-11-15 18:23:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 18:23:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517405  77 58437 66202065 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 18:23:22 [DEBUG   ] Got command RPT from MCS: ref #517406
2018-11-15 18:23:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 18:23:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517406  12 58437 66202269 A  ERRORB˜™š'
2018-11-15 18:23:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 18:23:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 18:24:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 18:24:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 18:24:12 [WARNING ] (13, 1, 'bot')
2018-11-15 18:24:12 [WARNING ] (13, 1, 'bot')
2018-11-15 18:24:12 [WARNING ] (13, 1, 'bot')
2018-11-15 18:24:12 [WARNING ] (13, 1, 'bot')
2018-11-15 18:24:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 18:24:12 [DEBUG   ] Finished updating board flags in 2.005 seconds
2018-11-15 18:24:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 18:24:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 18:25:00 [DEBUG   ] Got command RPT from MCS: ref #517411
2018-11-15 18:25:00 [DEBUG   ] summary = ERROR
2018-11-15 18:25:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517411  13 58437 66300589 A  ERRORERROR'
2018-11-15 18:25:00 [DEBUG   ] Got command RPT from MCS: ref #517412
2018-11-15 18:25:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 18:25:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517412  77 58437 66300590 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 18:25:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 18:25:05 [DEBUG   ] Got command INI from MCS: ref #517413
2018-11-15 18:25:05 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-11-15 18:25:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI   517413   8 58437 66305602 ABOOTING'
2018-11-15 18:25:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 18:25:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-15 18:25:11 [WARNING ] (13, 1, 'bot')
2018-11-15 18:25:11 [WARNING ] (13, 1, 'bot')
2018-11-15 18:25:11 [WARNING ] (13, 1, 'bot')
2018-11-15 18:25:11 [WARNING ] (13, 1, 'bot')
2018-11-15 18:25:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 18:25:11 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-11-15 18:25:26 [INFO    ] -------------------
2018-11-15 18:25:26 [INFO    ]  LWA board status
2018-11-15 18:25:26 [INFO    ] -------------------
2018-11-15 18:25:26 [INFO    ] DP 1: 2 lwa27
2018-11-15 18:25:26 [INFO    ] DP 1: 3 lwa24
2018-11-15 18:25:26 [INFO    ] DP 1: 4 lwa23
2018-11-15 18:25:26 [INFO    ] DP 1: 5 lwa18
2018-11-15 18:25:26 [INFO    ] DP 1: 6 lwa10
2018-11-15 18:25:26 [INFO    ] DP 1: 7 lwa32
2018-11-15 18:25:26 [INFO    ] DP 1: 8 lwa11
2018-11-15 18:25:26 [INFO    ] DP 1: 9 lwa30
2018-11-15 18:25:26 [INFO    ] DP 1: 10 lwa12
2018-11-15 18:25:26 [INFO    ] DP 1: 11 lwa8
2018-11-15 18:25:26 [INFO    ] DP 1: 12 lwa13
2018-11-15 18:25:26 [INFO    ] DP 1: 13 lwa26
2018-11-15 18:25:26 [INFO    ] DP 1: 14 lwa14
2018-11-15 18:25:26 [INFO    ] DP 1: 16 lwa22
2018-11-15 18:25:26 [INFO    ] DP 1: 17 lwa20
2018-11-15 18:25:26 [INFO    ] DP 1: 18 lwa1
2018-11-15 18:25:26 [INFO    ] DP 1: 19 lwa5
2018-11-15 18:25:26 [INFO    ] DP 1: 20 lwa25
2018-11-15 18:25:26 [INFO    ] DP 1: 21 lwa35
2018-11-15 18:25:26 [INFO    ] DP 1: 22 lwa19
2018-11-15 18:25:26 [INFO    ] DP 1: 23 lwa21
2018-11-15 18:25:26 [INFO    ] DP 1: 24 lwa6
2018-11-15 18:25:26 [INFO    ] DP 1: 25 lwa7
2018-11-15 18:25:26 [INFO    ] DP 1: 26 lwa33
2018-11-15 18:25:26 [INFO    ] DP 1: 27 lwa15
2018-11-15 18:25:26 [INFO    ] DP 1: 28 lwa28
2018-11-15 18:25:26 [INFO    ] DP 2: 1 lwa16
2018-11-15 18:25:26 [INFO    ] DP 2: 15 lwa34
2018-11-15 18:25:26 [INFO    ] Total of 28 boards
2018-11-15 18:25:26 [INFO    ] Total of 260 stands
2018-11-15 18:25:26 [INFO    ] -------------------
2018-11-15 18:25:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-11-15 18:25:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-11-15 18:25:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-11-15 18:25:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-11-15 18:25:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-11-15 18:25:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-11-15 18:25:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-11-15 18:25:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-11-15 18:25:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-11-15 18:25:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-11-15 18:25:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-11-15 18:25:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-11-15 18:25:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-11-15 18:25:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-11-15 18:25:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-11-15 18:25:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-11-15 18:25:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-11-15 18:25:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-11-15 18:25:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-11-15 18:25:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-11-15 18:25:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-11-15 18:25:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-11-15 18:25:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-11-15 18:25:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-11-15 18:25:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-11-15 18:25:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-11-15 18:25:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-11-15 18:25:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-11-15 18:25:32 [DEBUG   ] 2018-11-15 18:25:32 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18987
2018-11-15 18:25:32 [DEBUG   ] 2018-11-15 18:25:32 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18988
2018-11-15 18:25:32 [DEBUG   ] 2018-11-15 18:25:32 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18989
2018-11-15 18:25:32 [DEBUG   ] 2018-11-15 18:25:32 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18990
2018-11-15 18:25:32 [DEBUG   ] 2018-11-15 18:25:32 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18991
2018-11-15 18:25:32 [DEBUG   ] 2018-11-15 18:25:32 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18992
2018-11-15 18:25:32 [DEBUG   ] 2018-11-15 18:25:32 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18993
2018-11-15 18:25:32 [DEBUG   ] 2018-11-15 18:25:32 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18994
2018-11-15 18:25:32 [DEBUG   ] 2018-11-15 18:25:32 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18995
2018-11-15 18:25:32 [DEBUG   ] 2018-11-15 18:25:32 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18996
2018-11-15 18:25:32 [DEBUG   ] 2018-11-15 18:25:32 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18997
2018-11-15 18:25:32 [DEBUG   ] 2018-11-15 18:25:32 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18998
2018-11-15 18:25:32 [DEBUG   ] 2018-11-15 18:25:32 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 18999
2018-11-15 18:25:32 [DEBUG   ] 2018-11-15 18:25:32 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19000
2018-11-15 18:25:32 [DEBUG   ] 2018-11-15 18:25:32 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19001
2018-11-15 18:25:32 [DEBUG   ] 2018-11-15 18:25:32 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19002
2018-11-15 18:25:32 [DEBUG   ] 2018-11-15 18:25:32 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19003
2018-11-15 18:25:32 [DEBUG   ] 2018-11-15 18:25:32 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19004
2018-11-15 18:25:32 [DEBUG   ] 2018-11-15 18:25:32 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19005
2018-11-15 18:25:32 [DEBUG   ] 2018-11-15 18:25:32 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19006
2018-11-15 18:25:32 [DEBUG   ] 2018-11-15 18:25:32 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19007
2018-11-15 18:25:32 [DEBUG   ] 2018-11-15 18:25:32 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19008
2018-11-15 18:25:32 [DEBUG   ] 2018-11-15 18:25:32 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19009
2018-11-15 18:25:32 [DEBUG   ] 2018-11-15 18:25:32 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19010
2018-11-15 18:25:33 [DEBUG   ] 2018-11-15 18:25:33 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19011
2018-11-15 18:25:33 [DEBUG   ] 2018-11-15 18:25:33 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 19012
2018-11-15 18:25:45 [DEBUG   ] Got command RPT from MCS: ref #517414
2018-11-15 18:25:45 [DEBUG   ] summary = ERROR
2018-11-15 18:25:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517414  13 58437 66345165 A  ERRORERROR'
2018-11-15 18:25:45 [DEBUG   ] Got command RPT from MCS: ref #517415
2018-11-15 18:25:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 18:25:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517415  77 58437 66345166 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 18:25:45 [DEBUG   ] 2018-11-15 18:25:45 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18987 exited with status 0
2018-11-15 18:25:45 [DEBUG   ] 2018-11-15 18:25:45 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18988 exited with status 0
2018-11-15 18:25:45 [DEBUG   ] 2018-11-15 18:25:45 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18989 exited with status 0
2018-11-15 18:25:45 [DEBUG   ] 2018-11-15 18:25:45 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18990 exited with status 0
2018-11-15 18:25:45 [DEBUG   ] 2018-11-15 18:25:45 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18991 exited with status 0
2018-11-15 18:25:45 [DEBUG   ] 2018-11-15 18:25:45 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18992 exited with status 0
2018-11-15 18:25:45 [DEBUG   ] 2018-11-15 18:25:45 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18993 exited with status 0
2018-11-15 18:25:45 [DEBUG   ] 2018-11-15 18:25:45 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18994 exited with status 0
2018-11-15 18:25:45 [DEBUG   ] 2018-11-15 18:25:45 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18995 exited with status 0
2018-11-15 18:25:45 [DEBUG   ] 2018-11-15 18:25:45 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18996 exited with status 0
2018-11-15 18:25:45 [DEBUG   ] 2018-11-15 18:25:45 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18997 exited with status 0
2018-11-15 18:25:45 [DEBUG   ] 2018-11-15 18:25:45 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18998 exited with status 0
2018-11-15 18:25:45 [DEBUG   ] 2018-11-15 18:25:45 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 18999 exited with status 0
2018-11-15 18:25:45 [DEBUG   ] 2018-11-15 18:25:45 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19000 exited with status 0
2018-11-15 18:25:45 [DEBUG   ] 2018-11-15 18:25:45 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19001 exited with status 0
2018-11-15 18:25:45 [DEBUG   ] 2018-11-15 18:25:45 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19002 exited with status 0
2018-11-15 18:25:45 [DEBUG   ] 2018-11-15 18:25:45 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19003 exited with status 0
2018-11-15 18:25:45 [DEBUG   ] 2018-11-15 18:25:45 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19004 exited with status 0
2018-11-15 18:25:45 [DEBUG   ] 2018-11-15 18:25:45 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19005 exited with status 0
2018-11-15 18:25:45 [DEBUG   ] 2018-11-15 18:25:45 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19006 exited with status 0
2018-11-15 18:25:45 [DEBUG   ] 2018-11-15 18:25:45 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19007 exited with status 0
2018-11-15 18:25:45 [DEBUG   ] 2018-11-15 18:25:45 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19008 exited with status 0
2018-11-15 18:25:45 [DEBUG   ] 2018-11-15 18:25:45 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19009 exited with status 0
2018-11-15 18:25:45 [DEBUG   ] 2018-11-15 18:25:45 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19010 exited with status 0
2018-11-15 18:25:45 [DEBUG   ] 2018-11-15 18:25:45 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19011 exited with status 0
2018-11-15 18:25:45 [DEBUG   ] 2018-11-15 18:25:45 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 19012 exited with status 0
2018-11-15 18:25:45 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-11-15 18:25:45 [DEBUG   ] spawn_process: at 2018-11-15 18:25:45 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-11-15 18:25:45 [DEBUG   ] spawn_process: at 2018-11-15 18:25:45 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-11-15 18:25:45 [DEBUG   ] spawn_process: at 2018-11-15 18:25:45 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-11-15 18:25:45 [DEBUG   ] spawn_process: at 2018-11-15 18:25:45 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-11-15 18:25:45 [DEBUG   ] spawn_process: at 2018-11-15 18:25:45 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-11-15 18:25:45 [DEBUG   ] spawn_process: at 2018-11-15 18:25:45 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-11-15 18:25:45 [DEBUG   ] spawn_process: at 2018-11-15 18:25:45 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-11-15 18:25:45 [DEBUG   ] spawn_process: at 2018-11-15 18:25:45 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-11-15 18:25:45 [DEBUG   ] spawn_process: at 2018-11-15 18:25:45 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-11-15 18:25:45 [DEBUG   ] spawn_process: at 2018-11-15 18:25:45 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-11-15 18:25:45 [DEBUG   ] spawn_process: at 2018-11-15 18:25:45 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-11-15 18:25:45 [DEBUG   ] spawn_process: at 2018-11-15 18:25:45 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-11-15 18:25:45 [DEBUG   ] spawn_process: at 2018-11-15 18:25:45 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-11-15 18:25:45 [DEBUG   ] spawn_process: at 2018-11-15 18:25:45 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-11-15 18:25:45 [DEBUG   ] spawn_process: at 2018-11-15 18:25:45 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-11-15 18:25:45 [DEBUG   ] spawn_process: at 2018-11-15 18:25:45 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-11-15 18:25:45 [DEBUG   ] spawn_process: at 2018-11-15 18:25:45 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-11-15 18:25:45 [DEBUG   ] spawn_process: at 2018-11-15 18:25:45 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-11-15 18:25:45 [DEBUG   ] spawn_process: at 2018-11-15 18:25:45 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-11-15 18:25:45 [DEBUG   ] spawn_process: at 2018-11-15 18:25:45 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-11-15 18:25:45 [DEBUG   ] spawn_process: at 2018-11-15 18:25:45 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-11-15 18:25:45 [DEBUG   ] spawn_process: at 2018-11-15 18:25:45 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-11-15 18:25:45 [DEBUG   ] spawn_process: at 2018-11-15 18:25:45 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-11-15 18:25:45 [DEBUG   ] spawn_process: at 2018-11-15 18:25:45 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-11-15 18:25:45 [DEBUG   ] spawn_process: at 2018-11-15 18:25:45 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-11-15 18:25:45 [DEBUG   ] spawn_process: at 2018-11-15 18:25:45 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-11-15 18:25:45 [DEBUG   ] 2018-11-15 18:25:45 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 19039
2018-11-15 18:25:45 [DEBUG   ] 2018-11-15 18:25:45 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 19040
2018-11-15 18:25:50 [DEBUG   ] 2018-11-15 18:25:50 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 19039 exited with status 0
2018-11-15 18:25:50 [DEBUG   ] 2018-11-15 18:25:50 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 19040 exited with status 0
2018-11-15 18:25:50 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-11-15 18:25:50 [DEBUG   ] spawn_process: at 2018-11-15 18:25:50 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-11-15 18:25:50 [DEBUG   ] spawn_process: at 2018-11-15 18:25:50 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-11-15 18:25:50 [INFO    ] Setting Beam 1 xbars
2018-11-15 18:25:50 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-11-15 18:25:50 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-11-15 18:25:51 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-11-15 18:25:51 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-11-15 18:25:51 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-11-15 18:25:51 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-11-15 18:25:51 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-11-15 18:25:51 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-11-15 18:25:51 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-11-15 18:25:51 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-11-15 18:25:51 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-11-15 18:25:52 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-11-15 18:25:52 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-11-15 18:25:52 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-11-15 18:25:52 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-11-15 18:25:52 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-11-15 18:25:52 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-11-15 18:25:52 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-11-15 18:25:52 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-11-15 18:25:52 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-11-15 18:25:53 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-11-15 18:25:53 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-11-15 18:25:53 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-11-15 18:25:53 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-11-15 18:25:53 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-11-15 18:25:53 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-11-15 18:25:53 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-11-15 18:25:53 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-11-15 18:25:53 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-11-15 18:25:54 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-11-15 18:25:54 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-11-15 18:25:54 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-11-15 18:25:54 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-11-15 18:25:54 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-11-15 18:25:54 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-11-15 18:25:54 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-11-15 18:25:54 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-11-15 18:25:54 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-11-15 18:25:54 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-11-15 18:25:55 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-11-15 18:25:55 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-11-15 18:25:55 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-11-15 18:25:55 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-11-15 18:25:55 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-11-15 18:25:55 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-11-15 18:25:55 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-11-15 18:25:55 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-11-15 18:25:55 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-11-15 18:25:56 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-11-15 18:25:56 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-11-15 18:25:56 [INFO    ] Setting Beam 2 xbars
2018-11-15 18:25:56 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-11-15 18:25:56 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-11-15 18:25:56 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-11-15 18:25:56 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-11-15 18:25:56 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-11-15 18:25:56 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-11-15 18:25:56 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-11-15 18:25:57 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-11-15 18:25:57 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-11-15 18:25:57 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-11-15 18:25:57 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-11-15 18:25:57 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-11-15 18:25:57 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-11-15 18:25:57 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-11-15 18:25:57 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-11-15 18:25:57 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-11-15 18:25:57 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-11-15 18:25:58 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-11-15 18:25:58 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-11-15 18:25:58 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-11-15 18:25:58 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-11-15 18:25:58 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-11-15 18:25:58 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-11-15 18:25:58 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-11-15 18:25:58 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-11-15 18:25:58 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-11-15 18:25:59 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-11-15 18:25:59 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-11-15 18:25:59 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-11-15 18:25:59 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-11-15 18:25:59 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-11-15 18:25:59 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-11-15 18:25:59 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-11-15 18:25:59 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-11-15 18:25:59 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-11-15 18:26:00 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-11-15 18:26:00 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-11-15 18:26:00 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-11-15 18:26:00 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-11-15 18:26:00 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-11-15 18:26:00 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-11-15 18:26:00 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-11-15 18:26:00 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-11-15 18:26:00 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-11-15 18:26:01 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-11-15 18:26:01 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-11-15 18:26:01 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-11-15 18:26:01 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-11-15 18:26:01 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-11-15 18:26:01 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-11-15 18:26:01 [INFO    ] Setting Beam 3 xbars
2018-11-15 18:26:01 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-11-15 18:26:01 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-11-15 18:26:01 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-11-15 18:26:01 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-11-15 18:26:02 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-11-15 18:26:02 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-11-15 18:26:02 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-11-15 18:26:02 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-11-15 18:26:02 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-11-15 18:26:02 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-11-15 18:26:02 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-11-15 18:26:02 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-11-15 18:26:02 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-11-15 18:26:03 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-11-15 18:26:03 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-11-15 18:26:03 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-11-15 18:26:03 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-11-15 18:26:03 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-11-15 18:26:03 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-11-15 18:26:03 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-11-15 18:26:03 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-11-15 18:26:03 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-11-15 18:26:04 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-11-15 18:26:04 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-11-15 18:26:04 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-11-15 18:26:04 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-11-15 18:26:04 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-11-15 18:26:04 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-11-15 18:26:04 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-11-15 18:26:04 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-11-15 18:26:04 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-11-15 18:26:05 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-11-15 18:26:05 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-11-15 18:26:05 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-11-15 18:26:05 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-11-15 18:26:05 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-11-15 18:26:05 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-11-15 18:26:05 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-11-15 18:26:05 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-11-15 18:26:05 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-11-15 18:26:05 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-11-15 18:26:06 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-11-15 18:26:06 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-11-15 18:26:06 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-11-15 18:26:06 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-11-15 18:26:06 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-11-15 18:26:06 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-11-15 18:26:06 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-11-15 18:26:06 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-11-15 18:26:06 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-11-15 18:26:07 [INFO    ] Setting Beam 4 xbars
2018-11-15 18:26:07 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-11-15 18:26:07 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-11-15 18:26:07 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-11-15 18:26:07 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-11-15 18:26:07 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-11-15 18:26:07 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-11-15 18:26:07 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-11-15 18:26:07 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-11-15 18:26:07 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-11-15 18:26:08 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-11-15 18:26:08 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-11-15 18:26:08 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-11-15 18:26:08 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-11-15 18:26:08 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-11-15 18:26:08 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-11-15 18:26:08 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-11-15 18:26:08 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-11-15 18:26:08 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-11-15 18:26:09 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-11-15 18:26:09 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-11-15 18:26:09 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-11-15 18:26:09 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-11-15 18:26:09 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-11-15 18:26:09 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-11-15 18:26:09 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-11-15 18:26:09 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-11-15 18:26:09 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-11-15 18:26:09 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-11-15 18:26:10 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-11-15 18:26:10 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-11-15 18:26:10 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-11-15 18:26:10 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-11-15 18:26:10 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-11-15 18:26:10 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-11-15 18:26:10 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-11-15 18:26:10 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-11-15 18:26:10 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-11-15 18:26:11 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-11-15 18:26:11 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-11-15 18:26:11 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-11-15 18:26:11 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-11-15 18:26:11 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-11-15 18:26:11 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-11-15 18:26:11 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-11-15 18:26:11 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-11-15 18:26:11 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-11-15 18:26:12 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-11-15 18:26:12 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-11-15 18:26:12 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-11-15 18:26:12 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-11-15 18:26:12 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-11-15 18:26:12 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-11-15 18:26:12 [INFO    ] All xbars set
2018-11-15 18:26:12 [INFO    ] Setting adder chain routing for all beams
2018-11-15 18:26:17 [INFO    ] Setting beam ids
2018-11-15 18:26:27 [INFO    ] Starting beam delay calibration
2018-11-15 18:26:39 [INFO    ] Beam 1 latency is 5718
2018-11-15 18:26:39 [INFO    ] Beam 2 latency is 5739
2018-11-15 18:26:39 [INFO    ] Beam 3 latency is 5727
2018-11-15 18:26:39 [INFO    ] Beam 4 latency is 5716
2018-11-15 18:26:39 [INFO    ] Stop calibration
2018-11-15 18:26:47 [INFO    ] Beam delay calibration successful
2018-11-15 18:26:47 [INFO    ] Calibration passed
2018-11-15 18:26:47 [DEBUG   ] spawn_process: at 2018-11-15 18:26:47 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-11-15 18:26:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-11-15 18:26:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-11-15 18:26:47 [DEBUG   ] spawn_process: at 2018-11-15 18:26:47 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-11-15 18:26:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-11-15 18:26:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-11-15 18:26:47 [DEBUG   ] spawn_process: at 2018-11-15 18:26:47 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-11-15 18:26:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-11-15 18:26:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-11-15 18:26:47 [DEBUG   ] spawn_process: at 2018-11-15 18:26:47 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-11-15 18:26:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-11-15 18:26:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-11-15 18:26:47 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2018-11-15 18:26:48 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 262 ms (1542306408.265 s) with PID 20611 and time 1542306409
2018-11-15 18:26:48 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-11-15 18:26:48 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 349 ms (1542306408.352 s) with PID 20614 and time 1542306409
2018-11-15 18:26:49 [DEBUG   ] Finished updating ant stats in 0.896 seconds
2018-11-15 18:26:49 [INFO    ] Started antennas statistics background thread
2018-11-15 18:26:49 [INFO    ] Started board flags background thread
2018-11-15 18:26:49 [INFO    ] Started BAM background thread
2018-11-15 18:26:49 [INFO    ] Finished the INI process (ref. #517413) in 103.872 s
2018-11-15 18:26:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 18:26:50 [WARNING ] (13, 1, 'bot')
2018-11-15 18:26:50 [WARNING ] (13, 1, 'bot')
2018-11-15 18:26:50 [WARNING ] (13, 1, 'bot')
2018-11-15 18:26:50 [WARNING ] (13, 1, 'bot')
2018-11-15 18:26:50 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-11-15 18:26:50 [DEBUG   ] Finished updating board flags in 1.086 seconds
2018-11-15 18:27:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 18:27:29 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 18:27:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 18:27:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 18:27:50 [WARNING ] (13, 1, 'bot')
2018-11-15 18:27:50 [WARNING ] (13, 1, 'bot')
2018-11-15 18:27:50 [WARNING ] (13, 1, 'bot')
2018-11-15 18:27:50 [WARNING ] (13, 1, 'bot')
2018-11-15 18:27:50 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-11-15 18:27:50 [DEBUG   ] Finished updating board flags in 0.987 seconds
2018-11-15 18:28:05 [DEBUG   ] Got command RPT from MCS: ref #517435
2018-11-15 18:28:05 [DEBUG   ] summary = ERROR
2018-11-15 18:28:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517435  13 58437 66485589 A  ERRORERROR'
2018-11-15 18:28:05 [DEBUG   ] Got command RPT from MCS: ref #517436
2018-11-15 18:28:05 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 18:28:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517436  98 58437 66485590 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 18:28:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 18:28:10 [DEBUG   ] Got command INI from MCS: ref #517437
2018-11-15 18:28:10 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-11-15 18:28:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI   517437   8 58437 66490610 ABOOTING'
2018-11-15 18:28:21 [DEBUG   ] Got command RPT from MCS: ref #517440
2018-11-15 18:28:21 [DEBUG   ] summary = BOOTING
2018-11-15 18:28:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517440  15 58437 66501549 ABOOTINGBOOTING'
2018-11-15 18:28:31 [INFO    ] -------------------
2018-11-15 18:28:31 [INFO    ]  LWA board status
2018-11-15 18:28:31 [INFO    ] -------------------
2018-11-15 18:28:31 [INFO    ] DP 1: 2 lwa27
2018-11-15 18:28:31 [INFO    ] DP 1: 3 lwa24
2018-11-15 18:28:31 [INFO    ] DP 1: 4 lwa23
2018-11-15 18:28:31 [INFO    ] DP 1: 5 lwa18
2018-11-15 18:28:31 [INFO    ] DP 1: 6 lwa10
2018-11-15 18:28:31 [INFO    ] DP 1: 7 lwa32
2018-11-15 18:28:31 [INFO    ] DP 1: 8 lwa11
2018-11-15 18:28:31 [INFO    ] DP 1: 9 lwa30
2018-11-15 18:28:31 [INFO    ] DP 1: 10 lwa12
2018-11-15 18:28:31 [INFO    ] DP 1: 11 lwa8
2018-11-15 18:28:31 [INFO    ] DP 1: 12 lwa13
2018-11-15 18:28:31 [INFO    ] DP 1: 13 lwa26
2018-11-15 18:28:31 [INFO    ] DP 1: 14 lwa14
2018-11-15 18:28:31 [INFO    ] DP 1: 16 lwa22
2018-11-15 18:28:31 [INFO    ] DP 1: 17 lwa20
2018-11-15 18:28:31 [INFO    ] DP 1: 18 lwa1
2018-11-15 18:28:31 [INFO    ] DP 1: 19 lwa5
2018-11-15 18:28:31 [INFO    ] DP 1: 20 lwa25
2018-11-15 18:28:31 [INFO    ] DP 1: 21 lwa35
2018-11-15 18:28:31 [INFO    ] DP 1: 22 lwa19
2018-11-15 18:28:31 [INFO    ] DP 1: 23 lwa21
2018-11-15 18:28:31 [INFO    ] DP 1: 24 lwa6
2018-11-15 18:28:31 [INFO    ] DP 1: 25 lwa7
2018-11-15 18:28:31 [INFO    ] DP 1: 26 lwa33
2018-11-15 18:28:31 [INFO    ] DP 1: 27 lwa15
2018-11-15 18:28:31 [INFO    ] DP 1: 28 lwa28
2018-11-15 18:28:31 [INFO    ] DP 2: 1 lwa16
2018-11-15 18:28:31 [INFO    ] DP 2: 15 lwa34
2018-11-15 18:28:31 [INFO    ] Total of 28 boards
2018-11-15 18:28:31 [INFO    ] Total of 260 stands
2018-11-15 18:28:31 [INFO    ] -------------------
2018-11-15 18:28:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-11-15 18:28:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-11-15 18:28:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-11-15 18:28:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-11-15 18:28:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-11-15 18:28:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-11-15 18:28:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-11-15 18:28:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-11-15 18:28:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-11-15 18:28:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-11-15 18:28:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-11-15 18:28:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-11-15 18:28:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-11-15 18:28:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-11-15 18:28:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-11-15 18:28:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-11-15 18:28:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-11-15 18:28:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-11-15 18:28:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-11-15 18:28:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-11-15 18:28:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-11-15 18:28:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-11-15 18:28:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-11-15 18:28:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-11-15 18:28:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-11-15 18:28:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-11-15 18:28:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-11-15 18:28:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-11-15 18:28:38 [DEBUG   ] 2018-11-15 18:28:38 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21165
2018-11-15 18:28:38 [DEBUG   ] 2018-11-15 18:28:38 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21166
2018-11-15 18:28:38 [DEBUG   ] 2018-11-15 18:28:38 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21167
2018-11-15 18:28:38 [DEBUG   ] 2018-11-15 18:28:38 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21168
2018-11-15 18:28:38 [DEBUG   ] 2018-11-15 18:28:38 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21169
2018-11-15 18:28:38 [DEBUG   ] 2018-11-15 18:28:38 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21170
2018-11-15 18:28:38 [DEBUG   ] 2018-11-15 18:28:38 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21171
2018-11-15 18:28:38 [DEBUG   ] 2018-11-15 18:28:38 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21172
2018-11-15 18:28:38 [DEBUG   ] 2018-11-15 18:28:38 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21173
2018-11-15 18:28:38 [DEBUG   ] 2018-11-15 18:28:38 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21174
2018-11-15 18:28:38 [DEBUG   ] 2018-11-15 18:28:38 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21175
2018-11-15 18:28:38 [DEBUG   ] 2018-11-15 18:28:38 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21176
2018-11-15 18:28:38 [DEBUG   ] 2018-11-15 18:28:38 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21177
2018-11-15 18:28:38 [DEBUG   ] 2018-11-15 18:28:38 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21178
2018-11-15 18:28:38 [DEBUG   ] 2018-11-15 18:28:38 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21179
2018-11-15 18:28:38 [DEBUG   ] 2018-11-15 18:28:38 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21180
2018-11-15 18:28:38 [DEBUG   ] 2018-11-15 18:28:38 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21181
2018-11-15 18:28:38 [DEBUG   ] 2018-11-15 18:28:38 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21182
2018-11-15 18:28:38 [DEBUG   ] 2018-11-15 18:28:38 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21183
2018-11-15 18:28:38 [DEBUG   ] 2018-11-15 18:28:38 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21184
2018-11-15 18:28:38 [DEBUG   ] 2018-11-15 18:28:38 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21185
2018-11-15 18:28:38 [DEBUG   ] 2018-11-15 18:28:38 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21186
2018-11-15 18:28:38 [DEBUG   ] 2018-11-15 18:28:38 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21187
2018-11-15 18:28:38 [DEBUG   ] 2018-11-15 18:28:38 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21188
2018-11-15 18:28:38 [DEBUG   ] 2018-11-15 18:28:38 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21189
2018-11-15 18:28:38 [DEBUG   ] 2018-11-15 18:28:38 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 21190
2018-11-15 18:28:50 [DEBUG   ] 2018-11-15 18:28:50 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21165 exited with status 0
2018-11-15 18:28:50 [DEBUG   ] 2018-11-15 18:28:50 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21166 exited with status 0
2018-11-15 18:28:50 [DEBUG   ] 2018-11-15 18:28:50 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21167 exited with status 0
2018-11-15 18:28:50 [DEBUG   ] 2018-11-15 18:28:50 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21168 exited with status 0
2018-11-15 18:28:50 [DEBUG   ] 2018-11-15 18:28:50 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21169 exited with status 0
2018-11-15 18:28:50 [DEBUG   ] 2018-11-15 18:28:50 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21170 exited with status 0
2018-11-15 18:28:50 [DEBUG   ] 2018-11-15 18:28:50 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21171 exited with status 0
2018-11-15 18:28:50 [DEBUG   ] 2018-11-15 18:28:50 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21172 exited with status 0
2018-11-15 18:28:50 [DEBUG   ] 2018-11-15 18:28:50 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21173 exited with status 0
2018-11-15 18:28:50 [DEBUG   ] 2018-11-15 18:28:50 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21174 exited with status 0
2018-11-15 18:28:50 [DEBUG   ] 2018-11-15 18:28:50 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21175 exited with status 0
2018-11-15 18:28:50 [DEBUG   ] 2018-11-15 18:28:50 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21176 exited with status 0
2018-11-15 18:28:50 [DEBUG   ] 2018-11-15 18:28:50 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21177 exited with status 0
2018-11-15 18:28:50 [DEBUG   ] 2018-11-15 18:28:50 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21178 exited with status 0
2018-11-15 18:28:50 [DEBUG   ] 2018-11-15 18:28:50 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21179 exited with status 0
2018-11-15 18:28:50 [DEBUG   ] 2018-11-15 18:28:50 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21180 exited with status 0
2018-11-15 18:28:50 [DEBUG   ] 2018-11-15 18:28:50 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21181 exited with status 0
2018-11-15 18:28:50 [DEBUG   ] 2018-11-15 18:28:50 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21182 exited with status 0
2018-11-15 18:28:50 [DEBUG   ] 2018-11-15 18:28:50 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21183 exited with status 0
2018-11-15 18:28:50 [DEBUG   ] 2018-11-15 18:28:50 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21184 exited with status 0
2018-11-15 18:28:50 [DEBUG   ] 2018-11-15 18:28:50 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21185 exited with status 0
2018-11-15 18:28:50 [DEBUG   ] 2018-11-15 18:28:50 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21186 exited with status 0
2018-11-15 18:28:50 [DEBUG   ] 2018-11-15 18:28:50 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21187 exited with status 0
2018-11-15 18:28:50 [DEBUG   ] 2018-11-15 18:28:50 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21188 exited with status 0
2018-11-15 18:28:50 [DEBUG   ] 2018-11-15 18:28:50 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21189 exited with status 0
2018-11-15 18:28:50 [DEBUG   ] 2018-11-15 18:28:50 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 21190 exited with status 0
2018-11-15 18:28:50 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-11-15 18:28:50 [DEBUG   ] spawn_process: at 2018-11-15 18:28:50 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-11-15 18:28:50 [DEBUG   ] spawn_process: at 2018-11-15 18:28:50 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-11-15 18:28:50 [DEBUG   ] spawn_process: at 2018-11-15 18:28:50 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-11-15 18:28:50 [DEBUG   ] spawn_process: at 2018-11-15 18:28:50 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-11-15 18:28:50 [DEBUG   ] spawn_process: at 2018-11-15 18:28:50 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-11-15 18:28:50 [DEBUG   ] spawn_process: at 2018-11-15 18:28:50 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-11-15 18:28:50 [DEBUG   ] spawn_process: at 2018-11-15 18:28:50 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-11-15 18:28:50 [DEBUG   ] spawn_process: at 2018-11-15 18:28:50 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-11-15 18:28:50 [DEBUG   ] spawn_process: at 2018-11-15 18:28:50 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-11-15 18:28:50 [DEBUG   ] spawn_process: at 2018-11-15 18:28:50 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-11-15 18:28:50 [DEBUG   ] spawn_process: at 2018-11-15 18:28:50 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-11-15 18:28:50 [DEBUG   ] spawn_process: at 2018-11-15 18:28:50 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-11-15 18:28:50 [DEBUG   ] spawn_process: at 2018-11-15 18:28:50 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-11-15 18:28:50 [DEBUG   ] spawn_process: at 2018-11-15 18:28:50 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-11-15 18:28:50 [DEBUG   ] spawn_process: at 2018-11-15 18:28:50 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-11-15 18:28:50 [DEBUG   ] spawn_process: at 2018-11-15 18:28:50 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-11-15 18:28:50 [DEBUG   ] spawn_process: at 2018-11-15 18:28:50 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-11-15 18:28:50 [DEBUG   ] spawn_process: at 2018-11-15 18:28:50 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-11-15 18:28:50 [DEBUG   ] spawn_process: at 2018-11-15 18:28:50 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-11-15 18:28:50 [DEBUG   ] spawn_process: at 2018-11-15 18:28:50 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-11-15 18:28:50 [DEBUG   ] spawn_process: at 2018-11-15 18:28:50 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-11-15 18:28:50 [DEBUG   ] spawn_process: at 2018-11-15 18:28:50 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-11-15 18:28:50 [DEBUG   ] spawn_process: at 2018-11-15 18:28:50 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-11-15 18:28:50 [DEBUG   ] spawn_process: at 2018-11-15 18:28:50 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-11-15 18:28:50 [DEBUG   ] spawn_process: at 2018-11-15 18:28:50 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-11-15 18:28:50 [DEBUG   ] spawn_process: at 2018-11-15 18:28:50 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-11-15 18:28:50 [DEBUG   ] 2018-11-15 18:28:50 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 21217
2018-11-15 18:28:50 [DEBUG   ] 2018-11-15 18:28:50 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 21218
2018-11-15 18:28:56 [DEBUG   ] 2018-11-15 18:28:56 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 21217 exited with status 0
2018-11-15 18:28:56 [DEBUG   ] 2018-11-15 18:28:56 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 21218 exited with status 0
2018-11-15 18:28:56 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-11-15 18:28:56 [DEBUG   ] spawn_process: at 2018-11-15 18:28:56 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-11-15 18:28:56 [DEBUG   ] spawn_process: at 2018-11-15 18:28:56 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-11-15 18:28:56 [INFO    ] Setting Beam 1 xbars
2018-11-15 18:28:56 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-11-15 18:28:56 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-11-15 18:28:56 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-11-15 18:28:56 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-11-15 18:28:56 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-11-15 18:28:56 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-11-15 18:28:56 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-11-15 18:28:56 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-11-15 18:28:57 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-11-15 18:28:57 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-11-15 18:28:57 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-11-15 18:28:57 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-11-15 18:28:57 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-11-15 18:28:57 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-11-15 18:28:57 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-11-15 18:28:57 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-11-15 18:28:57 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-11-15 18:28:58 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-11-15 18:28:58 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-11-15 18:28:58 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-11-15 18:28:58 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-11-15 18:28:58 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-11-15 18:28:58 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-11-15 18:28:58 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-11-15 18:28:58 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-11-15 18:28:58 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-11-15 18:28:58 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-11-15 18:28:59 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-11-15 18:28:59 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-11-15 18:28:59 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-11-15 18:28:59 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-11-15 18:28:59 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-11-15 18:28:59 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-11-15 18:28:59 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-11-15 18:28:59 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-11-15 18:28:59 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-11-15 18:29:00 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-11-15 18:29:00 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-11-15 18:29:00 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-11-15 18:29:00 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-11-15 18:29:00 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-11-15 18:29:00 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-11-15 18:29:00 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-11-15 18:29:00 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-11-15 18:29:00 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-11-15 18:29:01 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-11-15 18:29:01 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-11-15 18:29:01 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-11-15 18:29:01 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-11-15 18:29:01 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-11-15 18:29:01 [INFO    ] Setting Beam 2 xbars
2018-11-15 18:29:01 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-11-15 18:29:01 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-11-15 18:29:01 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-11-15 18:29:01 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-11-15 18:29:01 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-11-15 18:29:02 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-11-15 18:29:02 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-11-15 18:29:02 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-11-15 18:29:02 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-11-15 18:29:02 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-11-15 18:29:02 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-11-15 18:29:02 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-11-15 18:29:02 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-11-15 18:29:02 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-11-15 18:29:03 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-11-15 18:29:03 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-11-15 18:29:03 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-11-15 18:29:03 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-11-15 18:29:03 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-11-15 18:29:03 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-11-15 18:29:03 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-11-15 18:29:03 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-11-15 18:29:03 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-11-15 18:29:04 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-11-15 18:29:04 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-11-15 18:29:04 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-11-15 18:29:04 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-11-15 18:29:04 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-11-15 18:29:04 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-11-15 18:29:04 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-11-15 18:29:04 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-11-15 18:29:04 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-11-15 18:29:05 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-11-15 18:29:05 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-11-15 18:29:05 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-11-15 18:29:05 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-11-15 18:29:05 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-11-15 18:29:05 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-11-15 18:29:05 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-11-15 18:29:05 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-11-15 18:29:05 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-11-15 18:29:05 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-11-15 18:29:06 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-11-15 18:29:06 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-11-15 18:29:06 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-11-15 18:29:06 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-11-15 18:29:06 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-11-15 18:29:06 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-11-15 18:29:06 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-11-15 18:29:06 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-11-15 18:29:06 [INFO    ] Setting Beam 3 xbars
2018-11-15 18:29:06 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-11-15 18:29:07 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-11-15 18:29:07 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-11-15 18:29:07 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-11-15 18:29:07 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-11-15 18:29:07 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-11-15 18:29:07 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-11-15 18:29:07 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-11-15 18:29:07 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-11-15 18:29:07 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-11-15 18:29:08 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-11-15 18:29:08 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-11-15 18:29:08 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-11-15 18:29:08 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-11-15 18:29:08 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-11-15 18:29:08 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-11-15 18:29:08 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-11-15 18:29:08 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-11-15 18:29:08 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-11-15 18:29:08 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-11-15 18:29:09 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-11-15 18:29:09 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-11-15 18:29:09 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-11-15 18:29:09 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-11-15 18:29:09 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-11-15 18:29:09 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-11-15 18:29:09 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-11-15 18:29:09 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-11-15 18:29:09 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-11-15 18:29:10 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-11-15 18:29:10 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-11-15 18:29:10 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-11-15 18:29:10 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-11-15 18:29:10 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-11-15 18:29:10 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-11-15 18:29:10 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-11-15 18:29:10 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-11-15 18:29:10 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-11-15 18:29:11 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-11-15 18:29:11 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-11-15 18:29:11 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-11-15 18:29:11 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-11-15 18:29:11 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-11-15 18:29:11 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-11-15 18:29:11 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-11-15 18:29:11 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-11-15 18:29:11 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-11-15 18:29:12 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-11-15 18:29:12 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-11-15 18:29:12 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-11-15 18:29:12 [INFO    ] Setting Beam 4 xbars
2018-11-15 18:29:12 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-11-15 18:29:12 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-11-15 18:29:12 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-11-15 18:29:12 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-11-15 18:29:12 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-11-15 18:29:12 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-11-15 18:29:13 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-11-15 18:29:13 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-11-15 18:29:13 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-11-15 18:29:13 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-11-15 18:29:13 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-11-15 18:29:13 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-11-15 18:29:13 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-11-15 18:29:13 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-11-15 18:29:13 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-11-15 18:29:13 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-11-15 18:29:14 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-11-15 18:29:14 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-11-15 18:29:14 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-11-15 18:29:14 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-11-15 18:29:14 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-11-15 18:29:14 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-11-15 18:29:14 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-11-15 18:29:14 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-11-15 18:29:14 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-11-15 18:29:15 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-11-15 18:29:15 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-11-15 18:29:15 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-11-15 18:29:15 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-11-15 18:29:15 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-11-15 18:29:15 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-11-15 18:29:15 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-11-15 18:29:15 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-11-15 18:29:15 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-11-15 18:29:16 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-11-15 18:29:16 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-11-15 18:29:16 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-11-15 18:29:16 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-11-15 18:29:16 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-11-15 18:29:16 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-11-15 18:29:16 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-11-15 18:29:16 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-11-15 18:29:16 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-11-15 18:29:17 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-11-15 18:29:17 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-11-15 18:29:17 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-11-15 18:29:17 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-11-15 18:29:17 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-11-15 18:29:17 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-11-15 18:29:17 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-11-15 18:29:17 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-11-15 18:29:17 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-11-15 18:29:17 [INFO    ] All xbars set
2018-11-15 18:29:17 [INFO    ] Setting adder chain routing for all beams
2018-11-15 18:29:22 [INFO    ] Setting beam ids
2018-11-15 18:29:32 [INFO    ] Starting beam delay calibration
2018-11-15 18:29:44 [INFO    ] Beam 1 latency is 5736
2018-11-15 18:29:44 [INFO    ] Beam 2 latency is 6701
2018-11-15 18:29:44 [INFO    ] Beam 3 latency is 6697
2018-11-15 18:29:44 [INFO    ] Beam 4 latency is 5727
2018-11-15 18:29:44 [INFO    ] Stop calibration
2018-11-15 18:29:52 [ERROR   ] Beam delay calibration failed
2018-11-15 18:29:52 [CRITICAL] Calibration failed
2018-11-15 18:29:52 [DEBUG   ] spawn_process: at 2018-11-15 18:29:52 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-11-15 18:29:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-11-15 18:29:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-11-15 18:29:52 [DEBUG   ] spawn_process: at 2018-11-15 18:29:52 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-11-15 18:29:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-11-15 18:29:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-11-15 18:29:52 [DEBUG   ] spawn_process: at 2018-11-15 18:29:52 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-11-15 18:29:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-11-15 18:29:52 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-11-15 18:29:53 [DEBUG   ] spawn_process: at 2018-11-15 18:29:53 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-11-15 18:29:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-11-15 18:29:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-11-15 18:29:53 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2018-11-15 18:29:53 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 279 ms (1542306593.282 s) with PID 22781 and time 1542306594
2018-11-15 18:29:53 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2018-11-15 18:29:53 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 369 ms (1542306593.371 s) with PID 22784 and time 1542306594
2018-11-15 18:29:54 [DEBUG   ] Finished updating ant stats in 0.877 seconds
2018-11-15 18:29:54 [INFO    ] Started antennas statistics background thread
2018-11-15 18:29:54 [INFO    ] Started board flags background thread
2018-11-15 18:29:54 [INFO    ] Started BAM background thread
2018-11-15 18:29:54 [INFO    ] Finished the INI process (ref. #517437) in 103.885 s
2018-11-15 18:29:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 18:29:55 [WARNING ] (13, 1, 'bot')
2018-11-15 18:29:55 [WARNING ] (13, 1, 'bot')
2018-11-15 18:29:55 [WARNING ] (13, 1, 'bot')
2018-11-15 18:29:55 [WARNING ] (13, 1, 'bot')
2018-11-15 18:29:55 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-11-15 18:29:55 [DEBUG   ] Finished updating board flags in 1.062 seconds
2018-11-15 18:30:14 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-15 18:30:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 18:30:45 [DEBUG   ] Got command RPT from MCS: ref #517450
2018-11-15 18:30:45 [DEBUG   ] summary = ERROR
2018-11-15 18:30:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517450  13 58437 66645165 A  ERRORERROR'
2018-11-15 18:30:45 [DEBUG   ] Got command RPT from MCS: ref #517451
2018-11-15 18:30:45 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 18:30:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517451  98 58437 66645166 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 18:30:54 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 18:30:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 18:30:55 [WARNING ] (13, 1, 'bot')
2018-11-15 18:30:55 [WARNING ] (13, 1, 'bot')
2018-11-15 18:30:55 [WARNING ] (13, 1, 'bot')
2018-11-15 18:30:55 [WARNING ] (13, 1, 'bot')
2018-11-15 18:30:55 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-11-15 18:30:55 [DEBUG   ] Finished updating board flags in 1.010 seconds
2018-11-15 18:31:10 [DEBUG   ] Got command RPT from MCS: ref #517467
2018-11-15 18:31:10 [DEBUG   ] summary = ERROR
2018-11-15 18:31:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517467  13 58437 66670601 A  ERRORERROR'
2018-11-15 18:31:10 [DEBUG   ] Got command RPT from MCS: ref #517468
2018-11-15 18:31:10 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 18:31:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517468  98 58437 66670602 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 18:31:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 18:31:15 [DEBUG   ] Got command INI from MCS: ref #517469
2018-11-15 18:31:15 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-11-15 18:31:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI   517469   8 58437 66675614 ABOOTING'
2018-11-15 18:31:36 [INFO    ] -------------------
2018-11-15 18:31:36 [INFO    ]  LWA board status
2018-11-15 18:31:36 [INFO    ] -------------------
2018-11-15 18:31:36 [INFO    ] DP 1: 2 lwa27
2018-11-15 18:31:36 [INFO    ] DP 1: 3 lwa24
2018-11-15 18:31:36 [INFO    ] DP 1: 4 lwa23
2018-11-15 18:31:36 [INFO    ] DP 1: 5 lwa18
2018-11-15 18:31:36 [INFO    ] DP 1: 6 lwa10
2018-11-15 18:31:36 [INFO    ] DP 1: 7 lwa32
2018-11-15 18:31:36 [INFO    ] DP 1: 8 lwa11
2018-11-15 18:31:36 [INFO    ] DP 1: 9 lwa30
2018-11-15 18:31:36 [INFO    ] DP 1: 10 lwa12
2018-11-15 18:31:36 [INFO    ] DP 1: 11 lwa8
2018-11-15 18:31:36 [INFO    ] DP 1: 12 lwa13
2018-11-15 18:31:36 [INFO    ] DP 1: 13 lwa26
2018-11-15 18:31:36 [INFO    ] DP 1: 14 lwa14
2018-11-15 18:31:36 [INFO    ] DP 1: 16 lwa22
2018-11-15 18:31:36 [INFO    ] DP 1: 17 lwa20
2018-11-15 18:31:36 [INFO    ] DP 1: 18 lwa1
2018-11-15 18:31:36 [INFO    ] DP 1: 19 lwa5
2018-11-15 18:31:36 [INFO    ] DP 1: 20 lwa25
2018-11-15 18:31:36 [INFO    ] DP 1: 21 lwa35
2018-11-15 18:31:36 [INFO    ] DP 1: 22 lwa19
2018-11-15 18:31:36 [INFO    ] DP 1: 23 lwa21
2018-11-15 18:31:36 [INFO    ] DP 1: 24 lwa6
2018-11-15 18:31:36 [INFO    ] DP 1: 25 lwa7
2018-11-15 18:31:36 [INFO    ] DP 1: 26 lwa33
2018-11-15 18:31:36 [INFO    ] DP 1: 27 lwa15
2018-11-15 18:31:36 [INFO    ] DP 1: 28 lwa28
2018-11-15 18:31:36 [INFO    ] DP 2: 1 lwa16
2018-11-15 18:31:36 [INFO    ] DP 2: 15 lwa34
2018-11-15 18:31:36 [INFO    ] Total of 28 boards
2018-11-15 18:31:36 [INFO    ] Total of 260 stands
2018-11-15 18:31:36 [INFO    ] -------------------
2018-11-15 18:31:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-11-15 18:31:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-11-15 18:31:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-11-15 18:31:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-11-15 18:31:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-11-15 18:31:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-11-15 18:31:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-11-15 18:31:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-11-15 18:31:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-11-15 18:31:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-11-15 18:31:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-11-15 18:31:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-11-15 18:31:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-11-15 18:31:39 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-11-15 18:31:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-11-15 18:31:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-11-15 18:31:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-11-15 18:31:40 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-11-15 18:31:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-11-15 18:31:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-11-15 18:31:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-11-15 18:31:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-11-15 18:31:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-11-15 18:31:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-11-15 18:31:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-11-15 18:31:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-11-15 18:31:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-11-15 18:31:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-11-15 18:31:43 [DEBUG   ] 2018-11-15 18:31:43 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23353
2018-11-15 18:31:43 [DEBUG   ] 2018-11-15 18:31:43 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23354
2018-11-15 18:31:43 [DEBUG   ] 2018-11-15 18:31:43 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23355
2018-11-15 18:31:43 [DEBUG   ] 2018-11-15 18:31:43 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23356
2018-11-15 18:31:43 [DEBUG   ] 2018-11-15 18:31:43 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23357
2018-11-15 18:31:43 [DEBUG   ] 2018-11-15 18:31:43 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23358
2018-11-15 18:31:43 [DEBUG   ] 2018-11-15 18:31:43 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23359
2018-11-15 18:31:43 [DEBUG   ] 2018-11-15 18:31:43 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23360
2018-11-15 18:31:43 [DEBUG   ] 2018-11-15 18:31:43 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23361
2018-11-15 18:31:43 [DEBUG   ] 2018-11-15 18:31:43 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23362
2018-11-15 18:31:43 [DEBUG   ] 2018-11-15 18:31:43 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23363
2018-11-15 18:31:43 [DEBUG   ] 2018-11-15 18:31:43 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23364
2018-11-15 18:31:43 [DEBUG   ] 2018-11-15 18:31:43 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23365
2018-11-15 18:31:43 [DEBUG   ] 2018-11-15 18:31:43 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23366
2018-11-15 18:31:43 [DEBUG   ] 2018-11-15 18:31:43 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23367
2018-11-15 18:31:43 [DEBUG   ] 2018-11-15 18:31:43 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23368
2018-11-15 18:31:43 [DEBUG   ] 2018-11-15 18:31:43 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23369
2018-11-15 18:31:43 [DEBUG   ] 2018-11-15 18:31:43 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23370
2018-11-15 18:31:43 [DEBUG   ] 2018-11-15 18:31:43 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23371
2018-11-15 18:31:43 [DEBUG   ] 2018-11-15 18:31:43 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23372
2018-11-15 18:31:43 [DEBUG   ] 2018-11-15 18:31:43 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23373
2018-11-15 18:31:43 [DEBUG   ] 2018-11-15 18:31:43 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23374
2018-11-15 18:31:43 [DEBUG   ] 2018-11-15 18:31:43 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23375
2018-11-15 18:31:43 [DEBUG   ] 2018-11-15 18:31:43 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23376
2018-11-15 18:31:43 [DEBUG   ] 2018-11-15 18:31:43 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23377
2018-11-15 18:31:43 [DEBUG   ] 2018-11-15 18:31:43 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 23378
2018-11-15 18:31:55 [DEBUG   ] 2018-11-15 18:31:55 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23353 exited with status 0
2018-11-15 18:31:55 [DEBUG   ] 2018-11-15 18:31:55 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23354 exited with status 0
2018-11-15 18:31:55 [DEBUG   ] 2018-11-15 18:31:55 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23355 exited with status 0
2018-11-15 18:31:55 [DEBUG   ] 2018-11-15 18:31:55 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23356 exited with status 0
2018-11-15 18:31:55 [DEBUG   ] 2018-11-15 18:31:55 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23357 exited with status 0
2018-11-15 18:31:55 [DEBUG   ] 2018-11-15 18:31:55 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23358 exited with status 0
2018-11-15 18:31:55 [DEBUG   ] 2018-11-15 18:31:55 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23359 exited with status 0
2018-11-15 18:31:55 [DEBUG   ] 2018-11-15 18:31:55 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23360 exited with status 0
2018-11-15 18:31:55 [DEBUG   ] 2018-11-15 18:31:55 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23361 exited with status 0
2018-11-15 18:31:55 [DEBUG   ] 2018-11-15 18:31:55 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23362 exited with status 0
2018-11-15 18:31:55 [DEBUG   ] 2018-11-15 18:31:55 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23363 exited with status 0
2018-11-15 18:31:55 [DEBUG   ] 2018-11-15 18:31:55 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23364 exited with status 0
2018-11-15 18:31:55 [DEBUG   ] 2018-11-15 18:31:55 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23365 exited with status 0
2018-11-15 18:31:55 [DEBUG   ] 2018-11-15 18:31:55 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23366 exited with status 0
2018-11-15 18:31:55 [DEBUG   ] 2018-11-15 18:31:55 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23367 exited with status 0
2018-11-15 18:31:55 [DEBUG   ] 2018-11-15 18:31:55 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23368 exited with status 0
2018-11-15 18:31:55 [DEBUG   ] 2018-11-15 18:31:55 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23369 exited with status 0
2018-11-15 18:31:55 [DEBUG   ] 2018-11-15 18:31:55 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23370 exited with status 0
2018-11-15 18:31:55 [DEBUG   ] 2018-11-15 18:31:55 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23371 exited with status 0
2018-11-15 18:31:55 [DEBUG   ] 2018-11-15 18:31:55 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23372 exited with status 0
2018-11-15 18:31:55 [DEBUG   ] 2018-11-15 18:31:55 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23373 exited with status 0
2018-11-15 18:31:55 [DEBUG   ] 2018-11-15 18:31:55 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23374 exited with status 0
2018-11-15 18:31:55 [DEBUG   ] 2018-11-15 18:31:55 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23375 exited with status 0
2018-11-15 18:31:55 [DEBUG   ] 2018-11-15 18:31:55 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23376 exited with status 0
2018-11-15 18:31:55 [DEBUG   ] 2018-11-15 18:31:55 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23377 exited with status 0
2018-11-15 18:31:55 [DEBUG   ] 2018-11-15 18:31:55 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 23378 exited with status 0
2018-11-15 18:31:55 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-11-15 18:31:55 [DEBUG   ] spawn_process: at 2018-11-15 18:31:55 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-11-15 18:31:55 [DEBUG   ] spawn_process: at 2018-11-15 18:31:55 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-11-15 18:31:55 [DEBUG   ] spawn_process: at 2018-11-15 18:31:55 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-11-15 18:31:55 [DEBUG   ] spawn_process: at 2018-11-15 18:31:55 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-11-15 18:31:55 [DEBUG   ] spawn_process: at 2018-11-15 18:31:55 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-11-15 18:31:55 [DEBUG   ] spawn_process: at 2018-11-15 18:31:55 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-11-15 18:31:55 [DEBUG   ] spawn_process: at 2018-11-15 18:31:55 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-11-15 18:31:55 [DEBUG   ] spawn_process: at 2018-11-15 18:31:55 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-11-15 18:31:55 [DEBUG   ] spawn_process: at 2018-11-15 18:31:55 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-11-15 18:31:55 [DEBUG   ] spawn_process: at 2018-11-15 18:31:55 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-11-15 18:31:55 [DEBUG   ] spawn_process: at 2018-11-15 18:31:55 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-11-15 18:31:55 [DEBUG   ] spawn_process: at 2018-11-15 18:31:55 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-11-15 18:31:55 [DEBUG   ] spawn_process: at 2018-11-15 18:31:55 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-11-15 18:31:55 [DEBUG   ] spawn_process: at 2018-11-15 18:31:55 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-11-15 18:31:55 [DEBUG   ] spawn_process: at 2018-11-15 18:31:55 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-11-15 18:31:55 [DEBUG   ] spawn_process: at 2018-11-15 18:31:55 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-11-15 18:31:55 [DEBUG   ] spawn_process: at 2018-11-15 18:31:55 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-11-15 18:31:55 [DEBUG   ] spawn_process: at 2018-11-15 18:31:55 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-11-15 18:31:55 [DEBUG   ] spawn_process: at 2018-11-15 18:31:55 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-11-15 18:31:55 [DEBUG   ] spawn_process: at 2018-11-15 18:31:55 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-11-15 18:31:55 [DEBUG   ] spawn_process: at 2018-11-15 18:31:55 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-11-15 18:31:55 [DEBUG   ] spawn_process: at 2018-11-15 18:31:55 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-11-15 18:31:55 [DEBUG   ] spawn_process: at 2018-11-15 18:31:55 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-11-15 18:31:55 [DEBUG   ] spawn_process: at 2018-11-15 18:31:55 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-11-15 18:31:55 [DEBUG   ] spawn_process: at 2018-11-15 18:31:55 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-11-15 18:31:55 [DEBUG   ] spawn_process: at 2018-11-15 18:31:55 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-11-15 18:31:55 [DEBUG   ] 2018-11-15 18:31:55 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 23405
2018-11-15 18:31:55 [DEBUG   ] 2018-11-15 18:31:55 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 23406
2018-11-15 18:32:01 [DEBUG   ] 2018-11-15 18:32:01 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 23405 exited with status 0
2018-11-15 18:32:01 [DEBUG   ] 2018-11-15 18:32:01 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 23406 exited with status 0
2018-11-15 18:32:01 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-11-15 18:32:01 [DEBUG   ] spawn_process: at 2018-11-15 18:32:01 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-11-15 18:32:01 [DEBUG   ] spawn_process: at 2018-11-15 18:32:01 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-11-15 18:32:01 [INFO    ] Setting Beam 1 xbars
2018-11-15 18:32:01 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-11-15 18:32:01 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-11-15 18:32:01 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-11-15 18:32:01 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-11-15 18:32:01 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-11-15 18:32:02 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-11-15 18:32:02 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-11-15 18:32:02 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-11-15 18:32:02 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-11-15 18:32:02 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-11-15 18:32:02 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-11-15 18:32:02 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-11-15 18:32:02 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-11-15 18:32:02 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-11-15 18:32:03 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-11-15 18:32:03 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-11-15 18:32:03 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-11-15 18:32:03 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-11-15 18:32:03 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-11-15 18:32:03 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-11-15 18:32:03 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-11-15 18:32:03 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-11-15 18:32:03 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-11-15 18:32:04 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-11-15 18:32:04 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-11-15 18:32:04 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-11-15 18:32:04 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-11-15 18:32:04 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-11-15 18:32:04 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-11-15 18:32:04 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-11-15 18:32:04 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-11-15 18:32:04 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-11-15 18:32:04 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-11-15 18:32:05 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-11-15 18:32:05 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-11-15 18:32:05 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-11-15 18:32:05 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-11-15 18:32:05 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-11-15 18:32:05 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-11-15 18:32:05 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-11-15 18:32:05 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-11-15 18:32:05 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-11-15 18:32:06 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-11-15 18:32:06 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-11-15 18:32:06 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-11-15 18:32:06 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-11-15 18:32:06 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-11-15 18:32:06 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-11-15 18:32:06 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-11-15 18:32:06 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-11-15 18:32:06 [INFO    ] Setting Beam 2 xbars
2018-11-15 18:32:06 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-11-15 18:32:07 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-11-15 18:32:07 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-11-15 18:32:07 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-11-15 18:32:07 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-11-15 18:32:07 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-11-15 18:32:07 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-11-15 18:32:07 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-11-15 18:32:07 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-11-15 18:32:07 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-11-15 18:32:07 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-11-15 18:32:08 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-11-15 18:32:08 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-11-15 18:32:08 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-11-15 18:32:08 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-11-15 18:32:08 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-11-15 18:32:08 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-11-15 18:32:08 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-11-15 18:32:08 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-11-15 18:32:08 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-11-15 18:32:09 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-11-15 18:32:09 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-11-15 18:32:09 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-11-15 18:32:09 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-11-15 18:32:09 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-11-15 18:32:09 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-11-15 18:32:09 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-11-15 18:32:09 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-11-15 18:32:09 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-11-15 18:32:10 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-11-15 18:32:10 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-11-15 18:32:10 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-11-15 18:32:10 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-11-15 18:32:10 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-11-15 18:32:10 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-11-15 18:32:10 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-11-15 18:32:10 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-11-15 18:32:10 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-11-15 18:32:11 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-11-15 18:32:11 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-11-15 18:32:11 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-11-15 18:32:11 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-11-15 18:32:11 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-11-15 18:32:11 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-11-15 18:32:11 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-11-15 18:32:11 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-11-15 18:32:11 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-11-15 18:32:11 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-11-15 18:32:12 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-11-15 18:32:12 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-11-15 18:32:12 [INFO    ] Setting Beam 3 xbars
2018-11-15 18:32:12 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-11-15 18:32:12 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-11-15 18:32:12 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-11-15 18:32:12 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-11-15 18:32:12 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-11-15 18:32:12 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-11-15 18:32:12 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-11-15 18:32:13 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-11-15 18:32:13 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-11-15 18:32:13 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-11-15 18:32:13 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-11-15 18:32:13 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-11-15 18:32:13 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-11-15 18:32:13 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-11-15 18:32:13 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-11-15 18:32:13 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-11-15 18:32:14 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-11-15 18:32:14 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-11-15 18:32:14 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-11-15 18:32:14 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-11-15 18:32:14 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-11-15 18:32:14 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-11-15 18:32:14 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-11-15 18:32:14 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-11-15 18:32:14 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-11-15 18:32:15 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-11-15 18:32:15 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-11-15 18:32:15 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-11-15 18:32:15 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-11-15 18:32:15 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-11-15 18:32:15 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-11-15 18:32:15 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-11-15 18:32:15 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-11-15 18:32:15 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-11-15 18:32:15 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-11-15 18:32:16 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-11-15 18:32:16 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-11-15 18:32:16 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-11-15 18:32:16 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-11-15 18:32:16 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-11-15 18:32:16 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-11-15 18:32:16 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-11-15 18:32:16 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-11-15 18:32:16 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-11-15 18:32:17 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-11-15 18:32:17 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-11-15 18:32:17 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-11-15 18:32:17 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-11-15 18:32:17 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-11-15 18:32:17 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-11-15 18:32:17 [INFO    ] Setting Beam 4 xbars
2018-11-15 18:32:17 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-11-15 18:32:17 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-11-15 18:32:17 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-11-15 18:32:18 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-11-15 18:32:18 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-11-15 18:32:18 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-11-15 18:32:18 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-11-15 18:32:18 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-11-15 18:32:18 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-11-15 18:32:18 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-11-15 18:32:18 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-11-15 18:32:18 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-11-15 18:32:19 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-11-15 18:32:19 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-11-15 18:32:19 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-11-15 18:32:19 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-11-15 18:32:19 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-11-15 18:32:19 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-11-15 18:32:19 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-11-15 18:32:19 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-11-15 18:32:19 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-11-15 18:32:19 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-11-15 18:32:20 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-11-15 18:32:20 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-11-15 18:32:20 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-11-15 18:32:20 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-11-15 18:32:20 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-11-15 18:32:20 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-11-15 18:32:20 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-11-15 18:32:20 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-11-15 18:32:20 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-11-15 18:32:21 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-11-15 18:32:21 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-11-15 18:32:21 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-11-15 18:32:21 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-11-15 18:32:21 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-11-15 18:32:21 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-11-15 18:32:21 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-11-15 18:32:21 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-11-15 18:32:21 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-11-15 18:32:22 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-11-15 18:32:22 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-11-15 18:32:22 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-11-15 18:32:22 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-11-15 18:32:22 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-11-15 18:32:22 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-11-15 18:32:22 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-11-15 18:32:22 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-11-15 18:32:22 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-11-15 18:32:23 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-11-15 18:32:23 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-11-15 18:32:23 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-11-15 18:32:23 [INFO    ] All xbars set
2018-11-15 18:32:23 [INFO    ] Setting adder chain routing for all beams
2018-11-15 18:32:28 [INFO    ] Setting beam ids
2018-11-15 18:32:38 [INFO    ] Starting beam delay calibration
2018-11-15 18:32:50 [INFO    ] Beam 1 latency is 6711
2018-11-15 18:32:50 [INFO    ] Beam 2 latency is 5728
2018-11-15 18:32:50 [INFO    ] Beam 3 latency is 5715
2018-11-15 18:32:50 [INFO    ] Beam 4 latency is 6704
2018-11-15 18:32:50 [INFO    ] Stop calibration
2018-11-15 18:32:58 [ERROR   ] Beam delay calibration failed
2018-11-15 18:32:58 [CRITICAL] Calibration failed
2018-11-15 18:32:58 [DEBUG   ] spawn_process: at 2018-11-15 18:32:58 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-11-15 18:32:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-11-15 18:32:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-11-15 18:32:58 [DEBUG   ] spawn_process: at 2018-11-15 18:32:58 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-11-15 18:32:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-11-15 18:32:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-11-15 18:32:58 [DEBUG   ] spawn_process: at 2018-11-15 18:32:58 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-11-15 18:32:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-11-15 18:32:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-11-15 18:32:58 [DEBUG   ] spawn_process: at 2018-11-15 18:32:58 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-11-15 18:32:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-11-15 18:32:58 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-11-15 18:32:58 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-11-15 18:32:58 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 506 ms (1542306778.509 s) with PID 24966 and time 1542306779
2018-11-15 18:32:58 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2018-11-15 18:32:59 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 281 ms (1542306779.284 s) with PID 24988 and time 1542306780
2018-11-15 18:33:00 [DEBUG   ] Finished updating ant stats in 0.964 seconds
2018-11-15 18:33:00 [INFO    ] Started antennas statistics background thread
2018-11-15 18:33:00 [INFO    ] Started board flags background thread
2018-11-15 18:33:00 [INFO    ] Started BAM background thread
2018-11-15 18:33:00 [INFO    ] Finished the INI process (ref. #517469) in 104.792 s
2018-11-15 18:33:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 18:33:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-15 18:33:01 [WARNING ] (13, 1, 'bot')
2018-11-15 18:33:01 [WARNING ] (13, 1, 'bot')
2018-11-15 18:33:01 [WARNING ] (13, 1, 'bot')
2018-11-15 18:33:01 [WARNING ] (13, 1, 'bot')
2018-11-15 18:33:01 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-11-15 18:33:01 [DEBUG   ] Finished updating board flags in 1.147 seconds
2018-11-15 18:33:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 18:33:21 [DEBUG   ] Got command RPT from MCS: ref #517474
2018-11-15 18:33:21 [DEBUG   ] summary = ERROR
2018-11-15 18:33:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517474  13 58437 66801633 A  ERRORERROR'
2018-11-15 18:33:21 [DEBUG   ] Got command RPT from MCS: ref #517475
2018-11-15 18:33:21 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 18:33:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517475  98 58437 66801837 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 18:33:22 [DEBUG   ] Got command RPT from MCS: ref #517476
2018-11-15 18:33:22 [DEBUG   ] summary = ERROR
2018-11-15 18:33:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517476  13 58437 66802041 A  ERRORERROR'
2018-11-15 18:33:22 [DEBUG   ] Got command RPT from MCS: ref #517477
2018-11-15 18:33:22 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 18:33:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517477  98 58437 66802233 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 18:33:22 [DEBUG   ] Got command RPT from MCS: ref #517478
2018-11-15 18:33:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 18:33:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517478  12 58437 66802437 A  ERRORB—™š'
2018-11-15 18:33:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 18:34:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 18:34:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 18:34:01 [WARNING ] (13, 1, 'bot')
2018-11-15 18:34:01 [WARNING ] (13, 1, 'bot')
2018-11-15 18:34:01 [WARNING ] (13, 1, 'bot')
2018-11-15 18:34:01 [WARNING ] (13, 1, 'bot')
2018-11-15 18:34:01 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-11-15 18:34:01 [DEBUG   ] Finished updating board flags in 1.010 seconds
2018-11-15 18:34:15 [DEBUG   ] Got command RPT from MCS: ref #517479
2018-11-15 18:34:15 [DEBUG   ] summary = ERROR
2018-11-15 18:34:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517479  13 58437 66855605 A  ERRORERROR'
2018-11-15 18:34:15 [DEBUG   ] Got command RPT from MCS: ref #517480
2018-11-15 18:34:15 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 18:34:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517480  98 58437 66855606 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 18:34:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 18:34:20 [DEBUG   ] Got command INI from MCS: ref #517481
2018-11-15 18:34:20 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-11-15 18:34:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI   517481   8 58437 66860614 ABOOTING'
2018-11-15 18:34:41 [INFO    ] -------------------
2018-11-15 18:34:41 [INFO    ]  LWA board status
2018-11-15 18:34:41 [INFO    ] -------------------
2018-11-15 18:34:41 [INFO    ] DP 1: 2 lwa27
2018-11-15 18:34:41 [INFO    ] DP 1: 3 lwa24
2018-11-15 18:34:41 [INFO    ] DP 1: 4 lwa23
2018-11-15 18:34:41 [INFO    ] DP 1: 5 lwa18
2018-11-15 18:34:41 [INFO    ] DP 1: 6 lwa10
2018-11-15 18:34:41 [INFO    ] DP 1: 7 lwa32
2018-11-15 18:34:41 [INFO    ] DP 1: 8 lwa11
2018-11-15 18:34:41 [INFO    ] DP 1: 9 lwa30
2018-11-15 18:34:41 [INFO    ] DP 1: 10 lwa12
2018-11-15 18:34:41 [INFO    ] DP 1: 11 lwa8
2018-11-15 18:34:41 [INFO    ] DP 1: 12 lwa13
2018-11-15 18:34:41 [INFO    ] DP 1: 13 lwa26
2018-11-15 18:34:41 [INFO    ] DP 1: 14 lwa14
2018-11-15 18:34:41 [INFO    ] DP 1: 16 lwa22
2018-11-15 18:34:41 [INFO    ] DP 1: 17 lwa20
2018-11-15 18:34:41 [INFO    ] DP 1: 18 lwa1
2018-11-15 18:34:41 [INFO    ] DP 1: 19 lwa5
2018-11-15 18:34:41 [INFO    ] DP 1: 20 lwa25
2018-11-15 18:34:41 [INFO    ] DP 1: 21 lwa35
2018-11-15 18:34:41 [INFO    ] DP 1: 22 lwa19
2018-11-15 18:34:41 [INFO    ] DP 1: 23 lwa21
2018-11-15 18:34:41 [INFO    ] DP 1: 24 lwa6
2018-11-15 18:34:41 [INFO    ] DP 1: 25 lwa7
2018-11-15 18:34:41 [INFO    ] DP 1: 26 lwa33
2018-11-15 18:34:41 [INFO    ] DP 1: 27 lwa15
2018-11-15 18:34:41 [INFO    ] DP 1: 28 lwa28
2018-11-15 18:34:41 [INFO    ] DP 2: 1 lwa16
2018-11-15 18:34:41 [INFO    ] DP 2: 15 lwa34
2018-11-15 18:34:41 [INFO    ] Total of 28 boards
2018-11-15 18:34:41 [INFO    ] Total of 260 stands
2018-11-15 18:34:41 [INFO    ] -------------------
2018-11-15 18:34:41 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-11-15 18:34:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-11-15 18:34:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-11-15 18:34:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-11-15 18:34:42 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-11-15 18:34:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-11-15 18:34:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-11-15 18:34:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-11-15 18:34:43 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-11-15 18:34:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-11-15 18:34:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-11-15 18:34:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-11-15 18:34:44 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-11-15 18:34:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-11-15 18:34:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-11-15 18:34:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-11-15 18:34:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-11-15 18:34:45 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-11-15 18:34:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-11-15 18:34:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-11-15 18:34:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-11-15 18:34:46 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-11-15 18:34:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-11-15 18:34:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-11-15 18:34:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-11-15 18:34:47 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-11-15 18:34:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-11-15 18:34:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-11-15 18:34:48 [DEBUG   ] 2018-11-15 18:34:48 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25539
2018-11-15 18:34:48 [DEBUG   ] 2018-11-15 18:34:48 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25540
2018-11-15 18:34:48 [DEBUG   ] 2018-11-15 18:34:48 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25541
2018-11-15 18:34:48 [DEBUG   ] 2018-11-15 18:34:48 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25542
2018-11-15 18:34:48 [DEBUG   ] 2018-11-15 18:34:48 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25543
2018-11-15 18:34:48 [DEBUG   ] 2018-11-15 18:34:48 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25544
2018-11-15 18:34:48 [DEBUG   ] 2018-11-15 18:34:48 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25545
2018-11-15 18:34:48 [DEBUG   ] 2018-11-15 18:34:48 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25546
2018-11-15 18:34:48 [DEBUG   ] 2018-11-15 18:34:48 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25547
2018-11-15 18:34:48 [DEBUG   ] 2018-11-15 18:34:48 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25548
2018-11-15 18:34:48 [DEBUG   ] 2018-11-15 18:34:48 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25549
2018-11-15 18:34:48 [DEBUG   ] 2018-11-15 18:34:48 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25550
2018-11-15 18:34:48 [DEBUG   ] 2018-11-15 18:34:48 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25551
2018-11-15 18:34:48 [DEBUG   ] 2018-11-15 18:34:48 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25552
2018-11-15 18:34:48 [DEBUG   ] 2018-11-15 18:34:48 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25553
2018-11-15 18:34:48 [DEBUG   ] 2018-11-15 18:34:48 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25554
2018-11-15 18:34:48 [DEBUG   ] 2018-11-15 18:34:48 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25555
2018-11-15 18:34:48 [DEBUG   ] 2018-11-15 18:34:48 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25556
2018-11-15 18:34:48 [DEBUG   ] 2018-11-15 18:34:48 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25557
2018-11-15 18:34:48 [DEBUG   ] 2018-11-15 18:34:48 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25558
2018-11-15 18:34:48 [DEBUG   ] 2018-11-15 18:34:48 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25559
2018-11-15 18:34:48 [DEBUG   ] 2018-11-15 18:34:48 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25560
2018-11-15 18:34:48 [DEBUG   ] 2018-11-15 18:34:48 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25561
2018-11-15 18:34:48 [DEBUG   ] 2018-11-15 18:34:48 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25562
2018-11-15 18:34:48 [DEBUG   ] 2018-11-15 18:34:48 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25563
2018-11-15 18:34:48 [DEBUG   ] 2018-11-15 18:34:48 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 25564
2018-11-15 18:35:00 [DEBUG   ] 2018-11-15 18:35:00 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25539 exited with status 0
2018-11-15 18:35:00 [DEBUG   ] 2018-11-15 18:35:00 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25540 exited with status 0
2018-11-15 18:35:00 [DEBUG   ] 2018-11-15 18:35:00 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25541 exited with status 0
2018-11-15 18:35:00 [DEBUG   ] 2018-11-15 18:35:00 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25542 exited with status 0
2018-11-15 18:35:00 [DEBUG   ] 2018-11-15 18:35:00 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25543 exited with status 0
2018-11-15 18:35:00 [DEBUG   ] 2018-11-15 18:35:00 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25544 exited with status 0
2018-11-15 18:35:00 [DEBUG   ] 2018-11-15 18:35:00 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25545 exited with status 0
2018-11-15 18:35:00 [DEBUG   ] 2018-11-15 18:35:00 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25546 exited with status 0
2018-11-15 18:35:00 [DEBUG   ] 2018-11-15 18:35:00 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25547 exited with status 0
2018-11-15 18:35:00 [DEBUG   ] 2018-11-15 18:35:00 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25548 exited with status 0
2018-11-15 18:35:00 [DEBUG   ] 2018-11-15 18:35:00 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25549 exited with status 0
2018-11-15 18:35:00 [DEBUG   ] 2018-11-15 18:35:00 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25550 exited with status 0
2018-11-15 18:35:00 [DEBUG   ] 2018-11-15 18:35:00 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25551 exited with status 0
2018-11-15 18:35:00 [DEBUG   ] 2018-11-15 18:35:00 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25552 exited with status 0
2018-11-15 18:35:00 [DEBUG   ] 2018-11-15 18:35:00 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25553 exited with status 0
2018-11-15 18:35:00 [DEBUG   ] 2018-11-15 18:35:00 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25554 exited with status 0
2018-11-15 18:35:00 [DEBUG   ] 2018-11-15 18:35:00 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25555 exited with status 0
2018-11-15 18:35:00 [DEBUG   ] 2018-11-15 18:35:00 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25556 exited with status 0
2018-11-15 18:35:00 [DEBUG   ] 2018-11-15 18:35:00 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25557 exited with status 0
2018-11-15 18:35:00 [DEBUG   ] 2018-11-15 18:35:00 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25558 exited with status 0
2018-11-15 18:35:00 [DEBUG   ] 2018-11-15 18:35:00 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25559 exited with status 0
2018-11-15 18:35:00 [DEBUG   ] 2018-11-15 18:35:00 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25560 exited with status 0
2018-11-15 18:35:00 [DEBUG   ] 2018-11-15 18:35:00 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25561 exited with status 0
2018-11-15 18:35:00 [DEBUG   ] 2018-11-15 18:35:00 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25562 exited with status 0
2018-11-15 18:35:00 [DEBUG   ] 2018-11-15 18:35:00 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25563 exited with status 0
2018-11-15 18:35:00 [DEBUG   ] 2018-11-15 18:35:00 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 25564 exited with status 0
2018-11-15 18:35:00 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-11-15 18:35:00 [DEBUG   ] spawn_process: at 2018-11-15 18:35:00 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-11-15 18:35:00 [DEBUG   ] spawn_process: at 2018-11-15 18:35:00 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-11-15 18:35:00 [DEBUG   ] spawn_process: at 2018-11-15 18:35:00 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-11-15 18:35:00 [DEBUG   ] spawn_process: at 2018-11-15 18:35:00 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-11-15 18:35:00 [DEBUG   ] spawn_process: at 2018-11-15 18:35:00 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-11-15 18:35:00 [DEBUG   ] spawn_process: at 2018-11-15 18:35:00 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-11-15 18:35:00 [DEBUG   ] spawn_process: at 2018-11-15 18:35:00 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-11-15 18:35:00 [DEBUG   ] spawn_process: at 2018-11-15 18:35:00 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-11-15 18:35:00 [DEBUG   ] spawn_process: at 2018-11-15 18:35:00 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-11-15 18:35:00 [DEBUG   ] spawn_process: at 2018-11-15 18:35:00 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-11-15 18:35:00 [DEBUG   ] spawn_process: at 2018-11-15 18:35:00 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-11-15 18:35:00 [DEBUG   ] spawn_process: at 2018-11-15 18:35:00 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-11-15 18:35:00 [DEBUG   ] spawn_process: at 2018-11-15 18:35:00 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-11-15 18:35:00 [DEBUG   ] spawn_process: at 2018-11-15 18:35:00 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-11-15 18:35:00 [DEBUG   ] spawn_process: at 2018-11-15 18:35:00 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-11-15 18:35:00 [DEBUG   ] spawn_process: at 2018-11-15 18:35:00 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-11-15 18:35:00 [DEBUG   ] spawn_process: at 2018-11-15 18:35:00 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-11-15 18:35:00 [DEBUG   ] spawn_process: at 2018-11-15 18:35:00 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-11-15 18:35:00 [DEBUG   ] spawn_process: at 2018-11-15 18:35:00 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-11-15 18:35:00 [DEBUG   ] spawn_process: at 2018-11-15 18:35:00 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-11-15 18:35:00 [DEBUG   ] spawn_process: at 2018-11-15 18:35:00 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-11-15 18:35:00 [DEBUG   ] spawn_process: at 2018-11-15 18:35:00 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-11-15 18:35:00 [DEBUG   ] spawn_process: at 2018-11-15 18:35:00 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-11-15 18:35:00 [DEBUG   ] spawn_process: at 2018-11-15 18:35:00 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-11-15 18:35:00 [DEBUG   ] spawn_process: at 2018-11-15 18:35:00 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-11-15 18:35:00 [DEBUG   ] spawn_process: at 2018-11-15 18:35:00 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-11-15 18:35:00 [DEBUG   ] 2018-11-15 18:35:00 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 25591
2018-11-15 18:35:00 [DEBUG   ] 2018-11-15 18:35:00 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 25592
2018-11-15 18:35:06 [DEBUG   ] 2018-11-15 18:35:06 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 25591 exited with status 0
2018-11-15 18:35:06 [DEBUG   ] 2018-11-15 18:35:06 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 25592 exited with status 0
2018-11-15 18:35:06 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-11-15 18:35:06 [DEBUG   ] spawn_process: at 2018-11-15 18:35:06 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-11-15 18:35:06 [DEBUG   ] spawn_process: at 2018-11-15 18:35:06 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-11-15 18:35:06 [INFO    ] Setting Beam 1 xbars
2018-11-15 18:35:06 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-11-15 18:35:06 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-11-15 18:35:06 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-11-15 18:35:06 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-11-15 18:35:06 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-11-15 18:35:07 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-11-15 18:35:07 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-11-15 18:35:07 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-11-15 18:35:07 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-11-15 18:35:07 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-11-15 18:35:07 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-11-15 18:35:07 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-11-15 18:35:07 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-11-15 18:35:07 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-11-15 18:35:08 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-11-15 18:35:08 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-11-15 18:35:08 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-11-15 18:35:08 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-11-15 18:35:08 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-11-15 18:35:08 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-11-15 18:35:08 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-11-15 18:35:08 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-11-15 18:35:08 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-11-15 18:35:09 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-11-15 18:35:09 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-11-15 18:35:09 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-11-15 18:35:09 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-11-15 18:35:09 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-11-15 18:35:09 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-11-15 18:35:09 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-11-15 18:35:09 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-11-15 18:35:09 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-11-15 18:35:10 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-11-15 18:35:10 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-11-15 18:35:10 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-11-15 18:35:10 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-11-15 18:35:10 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-11-15 18:35:10 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-11-15 18:35:10 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-11-15 18:35:10 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-11-15 18:35:10 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-11-15 18:35:10 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-11-15 18:35:11 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-11-15 18:35:11 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-11-15 18:35:11 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-11-15 18:35:11 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-11-15 18:35:11 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-11-15 18:35:11 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-11-15 18:35:11 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-11-15 18:35:11 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-11-15 18:35:11 [INFO    ] Setting Beam 2 xbars
2018-11-15 18:35:11 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-11-15 18:35:12 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-11-15 18:35:12 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-11-15 18:35:12 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-11-15 18:35:12 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-11-15 18:35:12 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-11-15 18:35:12 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-11-15 18:35:12 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-11-15 18:35:12 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-11-15 18:35:12 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-11-15 18:35:13 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-11-15 18:35:13 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-11-15 18:35:13 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-11-15 18:35:13 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-11-15 18:35:13 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-11-15 18:35:13 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-11-15 18:35:13 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-11-15 18:35:13 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-11-15 18:35:13 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-11-15 18:35:14 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-11-15 18:35:14 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-11-15 18:35:14 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-11-15 18:35:14 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-11-15 18:35:14 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-11-15 18:35:14 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-11-15 18:35:14 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-11-15 18:35:14 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-11-15 18:35:14 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-11-15 18:35:15 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-11-15 18:35:15 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-11-15 18:35:15 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-11-15 18:35:15 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-11-15 18:35:15 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-11-15 18:35:15 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-11-15 18:35:15 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-11-15 18:35:15 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-11-15 18:35:15 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-11-15 18:35:16 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-11-15 18:35:16 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-11-15 18:35:16 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-11-15 18:35:16 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-11-15 18:35:16 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-11-15 18:35:16 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-11-15 18:35:16 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-11-15 18:35:16 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-11-15 18:35:16 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-11-15 18:35:16 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-11-15 18:35:17 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-11-15 18:35:17 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-11-15 18:35:17 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-11-15 18:35:17 [INFO    ] Setting Beam 3 xbars
2018-11-15 18:35:17 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-11-15 18:35:17 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-11-15 18:35:17 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-11-15 18:35:17 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-11-15 18:35:17 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-11-15 18:35:17 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-11-15 18:35:18 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-11-15 18:35:18 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-11-15 18:35:18 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-11-15 18:35:18 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-11-15 18:35:18 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-11-15 18:35:18 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-11-15 18:35:18 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-11-15 18:35:18 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-11-15 18:35:18 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-11-15 18:35:19 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-11-15 18:35:19 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-11-15 18:35:19 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-11-15 18:35:19 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-11-15 18:35:19 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-11-15 18:35:19 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-11-15 18:35:19 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-11-15 18:35:19 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-11-15 18:35:19 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-11-15 18:35:20 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-11-15 18:35:20 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-11-15 18:35:20 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-11-15 18:35:20 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-11-15 18:35:20 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-11-15 18:35:20 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-11-15 18:35:20 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-11-15 18:35:20 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-11-15 18:35:20 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-11-15 18:35:20 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-11-15 18:35:21 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-11-15 18:35:21 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-11-15 18:35:21 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-11-15 18:35:21 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-11-15 18:35:21 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-11-15 18:35:21 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-11-15 18:35:21 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-11-15 18:35:21 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-11-15 18:35:21 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-11-15 18:35:22 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-11-15 18:35:22 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-11-15 18:35:22 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-11-15 18:35:22 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-11-15 18:35:22 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-11-15 18:35:22 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-11-15 18:35:22 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-11-15 18:35:22 [INFO    ] Setting Beam 4 xbars
2018-11-15 18:35:22 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-11-15 18:35:22 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-11-15 18:35:23 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-11-15 18:35:23 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-11-15 18:35:23 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-11-15 18:35:23 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-11-15 18:35:23 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-11-15 18:35:23 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-11-15 18:35:23 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-11-15 18:35:23 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-11-15 18:35:23 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-11-15 18:35:24 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-11-15 18:35:24 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-11-15 18:35:24 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-11-15 18:35:24 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-11-15 18:35:24 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-11-15 18:35:24 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-11-15 18:35:24 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-11-15 18:35:24 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-11-15 18:35:24 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-11-15 18:35:24 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-11-15 18:35:25 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-11-15 18:35:25 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-11-15 18:35:25 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-11-15 18:35:25 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-11-15 18:35:25 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-11-15 18:35:25 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-11-15 18:35:25 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-11-15 18:35:25 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-11-15 18:35:25 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-11-15 18:35:26 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-11-15 18:35:26 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-11-15 18:35:26 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-11-15 18:35:26 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-11-15 18:35:26 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-11-15 18:35:26 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-11-15 18:35:26 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-11-15 18:35:26 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-11-15 18:35:26 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-11-15 18:35:27 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-11-15 18:35:27 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-11-15 18:35:27 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-11-15 18:35:27 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-11-15 18:35:27 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-11-15 18:35:27 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-11-15 18:35:27 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-11-15 18:35:27 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-11-15 18:35:27 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-11-15 18:35:28 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-11-15 18:35:28 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-11-15 18:35:28 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-11-15 18:35:28 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-11-15 18:35:28 [INFO    ] All xbars set
2018-11-15 18:35:28 [INFO    ] Setting adder chain routing for all beams
2018-11-15 18:35:33 [INFO    ] Setting beam ids
2018-11-15 18:35:43 [INFO    ] Starting beam delay calibration
2018-11-15 18:35:45 [DEBUG   ] Got command RPT from MCS: ref #517486
2018-11-15 18:35:45 [DEBUG   ] summary = BOOTING
2018-11-15 18:35:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517486  15 58437 66945162 ABOOTINGBOOTING'
2018-11-15 18:35:45 [DEBUG   ] Got command RPT from MCS: ref #517487
2018-11-15 18:35:45 [DEBUG   ] info = Starting calibration
2018-11-15 18:35:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517487  28 58437 66945162 ABOOTINGStarting calibration'
2018-11-15 18:35:55 [INFO    ] Beam 1 latency is 5728
2018-11-15 18:35:55 [INFO    ] Beam 2 latency is 5754
2018-11-15 18:35:55 [INFO    ] Beam 3 latency is 5750
2018-11-15 18:35:55 [INFO    ] Beam 4 latency is 5722
2018-11-15 18:35:55 [INFO    ] Stop calibration
2018-11-15 18:36:03 [INFO    ] Beam delay calibration successful
2018-11-15 18:36:03 [INFO    ] Calibration passed
2018-11-15 18:36:03 [DEBUG   ] spawn_process: at 2018-11-15 18:36:03 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-11-15 18:36:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-11-15 18:36:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-11-15 18:36:03 [DEBUG   ] spawn_process: at 2018-11-15 18:36:03 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-11-15 18:36:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-11-15 18:36:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-11-15 18:36:03 [DEBUG   ] spawn_process: at 2018-11-15 18:36:03 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-11-15 18:36:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-11-15 18:36:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-11-15 18:36:03 [DEBUG   ] spawn_process: at 2018-11-15 18:36:03 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-11-15 18:36:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-11-15 18:36:03 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-11-15 18:36:03 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2018-11-15 18:36:04 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 288 ms (1542306964.291 s) with PID 27180 and time 1542306965
2018-11-15 18:36:04 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -3 msec
2018-11-15 18:36:04 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 375 ms (1542306964.378 s) with PID 27183 and time 1542306965
2018-11-15 18:36:05 [DEBUG   ] Finished updating ant stats in 0.870 seconds
2018-11-15 18:36:05 [INFO    ] Started antennas statistics background thread
2018-11-15 18:36:05 [INFO    ] Started board flags background thread
2018-11-15 18:36:05 [INFO    ] Started BAM background thread
2018-11-15 18:36:05 [INFO    ] Finished the INI process (ref. #517481) in 104.889 s
2018-11-15 18:36:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 18:36:06 [WARNING ] (13, 1, 'bot')
2018-11-15 18:36:06 [WARNING ] (13, 1, 'bot')
2018-11-15 18:36:06 [WARNING ] (13, 1, 'bot')
2018-11-15 18:36:06 [WARNING ] (13, 1, 'bot')
2018-11-15 18:36:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 18:36:06 [DEBUG   ] Finished updating board flags in 1.052 seconds
2018-11-15 18:36:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 18:36:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 18:37:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 18:37:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 18:37:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 18:37:06 [WARNING ] (13, 1, 'bot')
2018-11-15 18:37:06 [WARNING ] (13, 1, 'bot')
2018-11-15 18:37:06 [WARNING ] (13, 1, 'bot')
2018-11-15 18:37:06 [WARNING ] (13, 1, 'bot')
2018-11-15 18:37:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 18:37:06 [DEBUG   ] Finished updating board flags in 1.011 seconds
2018-11-15 18:37:20 [DEBUG   ] Got command RPT from MCS: ref #517503
2018-11-15 18:37:20 [DEBUG   ] summary = ERROR
2018-11-15 18:37:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517503  13 58437 67040617 A  ERRORERROR'
2018-11-15 18:37:20 [DEBUG   ] Got command RPT from MCS: ref #517504
2018-11-15 18:37:20 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 18:37:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517504  77 58437 67040618 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 18:37:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 18:37:45 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-15 18:38:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 18:38:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 18:38:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 18:38:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-15 18:38:06 [WARNING ] (13, 1, 'bot')
2018-11-15 18:38:06 [WARNING ] (13, 1, 'bot')
2018-11-15 18:38:06 [WARNING ] (13, 1, 'bot')
2018-11-15 18:38:06 [WARNING ] (13, 1, 'bot')
2018-11-15 18:38:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 18:38:06 [DEBUG   ] Finished updating board flags in 0.984 seconds
2018-11-15 18:38:21 [DEBUG   ] Got command RPT from MCS: ref #517507
2018-11-15 18:38:21 [DEBUG   ] summary = ERROR
2018-11-15 18:38:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517507  13 58437 67101721 A  ERRORERROR'
2018-11-15 18:38:21 [DEBUG   ] Got command RPT from MCS: ref #517508
2018-11-15 18:38:21 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 18:38:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517508  77 58437 67101925 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 18:38:22 [DEBUG   ] Got command RPT from MCS: ref #517509
2018-11-15 18:38:22 [DEBUG   ] summary = ERROR
2018-11-15 18:38:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517509  13 58437 67102129 A  ERRORERROR'
2018-11-15 18:38:22 [DEBUG   ] Got command RPT from MCS: ref #517511
2018-11-15 18:38:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 18:38:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517511  77 58437 67102321 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 18:38:22 [DEBUG   ] Got command RPT from MCS: ref #517512
2018-11-15 18:38:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 18:38:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517512  12 58437 67102525 A  ERRORB˜™š'
2018-11-15 18:38:25 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-15 18:38:45 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 18:39:05 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 18:39:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 18:39:06 [WARNING ] (13, 1, 'bot')
2018-11-15 18:39:06 [WARNING ] (13, 1, 'bot')
2018-11-15 18:39:06 [WARNING ] (13, 1, 'bot')
2018-11-15 18:39:06 [WARNING ] (13, 1, 'bot')
2018-11-15 18:39:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 18:39:06 [DEBUG   ] Finished updating board flags in 1.272 seconds
2018-11-15 18:39:25 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 18:39:45 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 18:40:05 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 18:40:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 18:40:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 18:40:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-15 18:40:07 [WARNING ] (13, 1, 'bot')
2018-11-15 18:40:07 [WARNING ] (13, 1, 'bot')
2018-11-15 18:40:07 [WARNING ] (13, 1, 'bot')
2018-11-15 18:40:07 [WARNING ] (13, 1, 'bot')
2018-11-15 18:40:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 18:40:07 [DEBUG   ] Finished updating board flags in 1.816 seconds
2018-11-15 18:40:25 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 18:40:45 [DEBUG   ] Got command RPT from MCS: ref #517521
2018-11-15 18:40:45 [DEBUG   ] summary = ERROR
2018-11-15 18:40:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517521  13 58437 67245165 A  ERRORERROR'
2018-11-15 18:40:45 [DEBUG   ] Got command RPT from MCS: ref #517522
2018-11-15 18:40:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 18:40:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517522  77 58437 67245166 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 18:40:45 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 18:41:05 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 18:41:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 18:41:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 18:41:07 [WARNING ] (13, 1, 'bot')
2018-11-15 18:41:07 [WARNING ] (13, 1, 'bot')
2018-11-15 18:41:07 [WARNING ] (13, 1, 'bot')
2018-11-15 18:41:07 [WARNING ] (13, 1, 'bot')
2018-11-15 18:41:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 18:41:07 [DEBUG   ] Finished updating board flags in 1.805 seconds
2018-11-15 18:41:25 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 18:41:45 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 18:42:05 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 18:42:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 18:42:06 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 18:42:06 [WARNING ] (13, 1, 'bot')
2018-11-15 18:42:06 [WARNING ] (13, 1, 'bot')
2018-11-15 18:42:06 [WARNING ] (13, 1, 'bot')
2018-11-15 18:42:06 [WARNING ] (13, 1, 'bot')
2018-11-15 18:42:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 18:42:06 [DEBUG   ] Finished updating board flags in 1.187 seconds
2018-11-15 18:42:25 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 18:42:45 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 18:43:05 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 18:43:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 18:43:06 [WARNING ] (13, 1, 'bot')
2018-11-15 18:43:06 [WARNING ] (13, 1, 'bot')
2018-11-15 18:43:06 [WARNING ] (13, 1, 'bot')
2018-11-15 18:43:06 [WARNING ] (13, 1, 'bot')
2018-11-15 18:43:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 18:43:06 [DEBUG   ] Finished updating board flags in 1.015 seconds
2018-11-15 18:43:21 [DEBUG   ] Got command RPT from MCS: ref #517542
2018-11-15 18:43:21 [DEBUG   ] summary = ERROR
2018-11-15 18:43:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517542  13 58437 67401813 A  ERRORERROR'
2018-11-15 18:43:22 [DEBUG   ] Got command RPT from MCS: ref #517543
2018-11-15 18:43:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 18:43:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517543  77 58437 67402005 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 18:43:22 [DEBUG   ] Got command RPT from MCS: ref #517544
2018-11-15 18:43:22 [DEBUG   ] summary = ERROR
2018-11-15 18:43:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517544  13 58437 67402209 A  ERRORERROR'
2018-11-15 18:43:22 [DEBUG   ] Got command RPT from MCS: ref #517545
2018-11-15 18:43:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 18:43:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517545  77 58437 67402413 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 18:43:22 [DEBUG   ] Got command RPT from MCS: ref #517546
2018-11-15 18:43:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 18:43:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517546  12 58437 67402617 A  ERRORB˜™š'
2018-11-15 18:43:25 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 18:43:45 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 18:44:05 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 18:44:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 18:44:06 [WARNING ] (13, 1, 'bot')
2018-11-15 18:44:06 [WARNING ] (13, 1, 'bot')
2018-11-15 18:44:06 [WARNING ] (13, 1, 'bot')
2018-11-15 18:44:06 [WARNING ] (13, 1, 'bot')
2018-11-15 18:44:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 18:44:06 [DEBUG   ] Finished updating board flags in 0.973 seconds
2018-11-15 18:44:25 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 18:44:45 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 18:45:05 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 18:45:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 18:45:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-15 18:45:07 [WARNING ] (13, 1, 'bot')
2018-11-15 18:45:07 [WARNING ] (13, 1, 'bot')
2018-11-15 18:45:07 [WARNING ] (13, 1, 'bot')
2018-11-15 18:45:07 [WARNING ] (13, 1, 'bot')
2018-11-15 18:45:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 18:45:07 [DEBUG   ] Finished updating board flags in 1.367 seconds
2018-11-15 18:45:25 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-15 18:45:37 [DEBUG   ] Got command BAM from MCS: ref #517555
2018-11-15 18:45:37 [INFO    ] Finished processing BAM request
2018-11-15 18:45:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 18:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517555   8 58437 67537025 A  ERROR'
2018-11-15 18:45:37 [DEBUG   ] Got command BAM from MCS: ref #517556
2018-11-15 18:45:37 [INFO    ] Finished processing BAM request
2018-11-15 18:45:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 18:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517556   8 58437 67537029 A  ERROR'
2018-11-15 18:45:37 [DEBUG   ] Got command DRX from MCS: ref #517558
2018-11-15 18:45:37 [INFO    ] sending drx command to lwa34
2018-11-15 18:45:37 [DEBUG   ] run_process: at 2018-11-15 18:45:37 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 1 64500000.0 7 9 9']
2018-11-15 18:45:37 [DEBUG   ] drx = exited with status True, code 0x00
2018-11-15 18:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   517558   8 58437 67537105 A  ERROR'
2018-11-15 18:45:37 [DEBUG   ] Got command DRX from MCS: ref #517557
2018-11-15 18:45:37 [INFO    ] sending drx command to lwa16
2018-11-15 18:45:37 [DEBUG   ] run_process: at 2018-11-15 18:45:37 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 1 35100000.0 7 9 9']
2018-11-15 18:45:37 [DEBUG   ] drx = exited with status True, code 0x00
2018-11-15 18:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   517557   8 58437 67537109 A  ERROR'
2018-11-15 18:45:37 [DEBUG   ] Got command DRX from MCS: ref #517559
2018-11-15 18:45:37 [INFO    ] sending drx command to lwa16
2018-11-15 18:45:37 [DEBUG   ] run_process: at 2018-11-15 18:45:37 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 2 49800000.0 7 9 9']
2018-11-15 18:45:37 [DEBUG   ] drx = exited with status True, code 0x00
2018-11-15 18:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   517559   8 58437 67537113 A  ERROR'
2018-11-15 18:45:37 [DEBUG   ] Got command DRX from MCS: ref #517560
2018-11-15 18:45:37 [INFO    ] sending drx command to lwa34
2018-11-15 18:45:37 [DEBUG   ] run_process: at 2018-11-15 18:45:37 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 2 79200000.0 7 9 9']
2018-11-15 18:45:37 [DEBUG   ] drx = exited with status True, code 0x00
2018-11-15 18:45:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   517560   8 58437 67537117 A  ERROR'
2018-11-15 18:45:37 [INFO    ] Finished starting DRX
2018-11-15 18:45:37 [INFO    ] Finished starting DRX
2018-11-15 18:45:37 [INFO    ] Finished starting DRX
2018-11-15 18:45:37 [INFO    ] Finished starting DRX
2018-11-15 18:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 18:45:37 [DEBUG   ] spawn_process: at 2018-11-15 18:45:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 18:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 18:45:37 [DEBUG   ] spawn_process: at 2018-11-15 18:45:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 18:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 18:45:37 [DEBUG   ] spawn_process: at 2018-11-15 18:45:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 18:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 18:45:37 [DEBUG   ] spawn_process: at 2018-11-15 18:45:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 18:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 18:45:37 [DEBUG   ] spawn_process: at 2018-11-15 18:45:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 18:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 18:45:37 [DEBUG   ] spawn_process: at 2018-11-15 18:45:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 18:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 18:45:37 [DEBUG   ] spawn_process: at 2018-11-15 18:45:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 18:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 18:45:37 [DEBUG   ] spawn_process: at 2018-11-15 18:45:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 18:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 18:45:37 [DEBUG   ] spawn_process: at 2018-11-15 18:45:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 18:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 18:45:37 [DEBUG   ] spawn_process: at 2018-11-15 18:45:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 18:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 18:45:37 [DEBUG   ] spawn_process: at 2018-11-15 18:45:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 18:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 18:45:37 [DEBUG   ] spawn_process: at 2018-11-15 18:45:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 18:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 18:45:37 [DEBUG   ] spawn_process: at 2018-11-15 18:45:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 18:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 18:45:37 [DEBUG   ] spawn_process: at 2018-11-15 18:45:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 18:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 18:45:37 [DEBUG   ] spawn_process: at 2018-11-15 18:45:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 18:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 18:45:37 [DEBUG   ] spawn_process: at 2018-11-15 18:45:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 18:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 18:45:37 [DEBUG   ] spawn_process: at 2018-11-15 18:45:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 18:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 18:45:37 [DEBUG   ] spawn_process: at 2018-11-15 18:45:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 18:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 18:45:37 [DEBUG   ] spawn_process: at 2018-11-15 18:45:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 18:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 18:45:37 [DEBUG   ] spawn_process: at 2018-11-15 18:45:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 18:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 18:45:37 [DEBUG   ] spawn_process: at 2018-11-15 18:45:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 18:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 18:45:37 [DEBUG   ] spawn_process: at 2018-11-15 18:45:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 18:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 18:45:37 [DEBUG   ] spawn_process: at 2018-11-15 18:45:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 18:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 18:45:37 [DEBUG   ] spawn_process: at 2018-11-15 18:45:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 18:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 18:45:37 [DEBUG   ] spawn_process: at 2018-11-15 18:45:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 18:45:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 18:45:37 [DEBUG   ] spawn_process: at 2018-11-15 18:45:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 18:45:45 [DEBUG   ] Got command RPT from MCS: ref #517563
2018-11-15 18:45:45 [DEBUG   ] summary = ERROR
2018-11-15 18:45:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517563  13 58437 67545165 A  ERRORERROR'
2018-11-15 18:45:45 [DEBUG   ] Got command RPT from MCS: ref #517564
2018-11-15 18:45:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 18:45:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517564  77 58437 67545166 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 18:45:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 18:46:06 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-15 18:46:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 18:46:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 18:46:07 [WARNING ] (13, 1, 'bot')
2018-11-15 18:46:07 [WARNING ] (13, 1, 'bot')
2018-11-15 18:46:07 [WARNING ] (13, 1, 'bot')
2018-11-15 18:46:07 [WARNING ] (13, 1, 'bot')
2018-11-15 18:46:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 18:46:07 [DEBUG   ] Finished updating board flags in 1.185 seconds
2018-11-15 18:46:10 [DEBUG   ] Got command BAM from MCS: ref #517581
2018-11-15 18:46:10 [INFO    ] Finished processing BAM request
2018-11-15 18:46:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 18:46:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517581   8 58437 67570033 A  ERROR'
2018-11-15 18:46:10 [DEBUG   ] Got command BAM from MCS: ref #517580
2018-11-15 18:46:10 [INFO    ] Finished processing BAM request
2018-11-15 18:46:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 18:46:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517580   8 58437 67570037 A  ERROR'
2018-11-15 18:46:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 18:46:10 [DEBUG   ] spawn_process: at 2018-11-15 18:46:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 18:46:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 18:46:10 [DEBUG   ] spawn_process: at 2018-11-15 18:46:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 18:46:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 18:46:10 [DEBUG   ] spawn_process: at 2018-11-15 18:46:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 18:46:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 18:46:10 [DEBUG   ] spawn_process: at 2018-11-15 18:46:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 18:46:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 18:46:10 [DEBUG   ] spawn_process: at 2018-11-15 18:46:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 18:46:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 18:46:10 [DEBUG   ] spawn_process: at 2018-11-15 18:46:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 18:46:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 18:46:10 [DEBUG   ] spawn_process: at 2018-11-15 18:46:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 18:46:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 18:46:10 [DEBUG   ] spawn_process: at 2018-11-15 18:46:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 18:46:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 18:46:10 [DEBUG   ] spawn_process: at 2018-11-15 18:46:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 18:46:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 18:46:10 [DEBUG   ] spawn_process: at 2018-11-15 18:46:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 18:46:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 18:46:10 [DEBUG   ] spawn_process: at 2018-11-15 18:46:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 18:46:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 18:46:10 [DEBUG   ] spawn_process: at 2018-11-15 18:46:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 18:46:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 18:46:10 [DEBUG   ] spawn_process: at 2018-11-15 18:46:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 18:46:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 18:46:10 [DEBUG   ] spawn_process: at 2018-11-15 18:46:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 18:46:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 18:46:10 [DEBUG   ] spawn_process: at 2018-11-15 18:46:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 18:46:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 18:46:10 [DEBUG   ] spawn_process: at 2018-11-15 18:46:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 18:46:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 18:46:10 [DEBUG   ] spawn_process: at 2018-11-15 18:46:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 18:46:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 18:46:10 [DEBUG   ] spawn_process: at 2018-11-15 18:46:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 18:46:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 18:46:10 [DEBUG   ] spawn_process: at 2018-11-15 18:46:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 18:46:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 18:46:10 [DEBUG   ] spawn_process: at 2018-11-15 18:46:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 18:46:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 18:46:10 [DEBUG   ] spawn_process: at 2018-11-15 18:46:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 18:46:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 18:46:10 [DEBUG   ] spawn_process: at 2018-11-15 18:46:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 18:46:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 18:46:10 [DEBUG   ] spawn_process: at 2018-11-15 18:46:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 18:46:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 18:46:10 [DEBUG   ] spawn_process: at 2018-11-15 18:46:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 18:46:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 18:46:10 [DEBUG   ] spawn_process: at 2018-11-15 18:46:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 18:46:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 18:46:10 [DEBUG   ] spawn_process: at 2018-11-15 18:46:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 18:46:26 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-15 18:46:43 [DEBUG   ] Got command BAM from MCS: ref #517583
2018-11-15 18:46:43 [INFO    ] Finished processing BAM request
2018-11-15 18:46:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 18:46:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517583   8 58437 67603033 A  ERROR'
2018-11-15 18:46:43 [DEBUG   ] Got command BAM from MCS: ref #517582
2018-11-15 18:46:43 [INFO    ] Finished processing BAM request
2018-11-15 18:46:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 18:46:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517582   8 58437 67603037 A  ERROR'
2018-11-15 18:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 18:46:43 [DEBUG   ] spawn_process: at 2018-11-15 18:46:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 18:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 18:46:43 [DEBUG   ] spawn_process: at 2018-11-15 18:46:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 18:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 18:46:43 [DEBUG   ] spawn_process: at 2018-11-15 18:46:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 18:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 18:46:43 [DEBUG   ] spawn_process: at 2018-11-15 18:46:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 18:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 18:46:43 [DEBUG   ] spawn_process: at 2018-11-15 18:46:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 18:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 18:46:43 [DEBUG   ] spawn_process: at 2018-11-15 18:46:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 18:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 18:46:43 [DEBUG   ] spawn_process: at 2018-11-15 18:46:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 18:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 18:46:43 [DEBUG   ] spawn_process: at 2018-11-15 18:46:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 18:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 18:46:43 [DEBUG   ] spawn_process: at 2018-11-15 18:46:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 18:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 18:46:43 [DEBUG   ] spawn_process: at 2018-11-15 18:46:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 18:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 18:46:43 [DEBUG   ] spawn_process: at 2018-11-15 18:46:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 18:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 18:46:43 [DEBUG   ] spawn_process: at 2018-11-15 18:46:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 18:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 18:46:43 [DEBUG   ] spawn_process: at 2018-11-15 18:46:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 18:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 18:46:43 [DEBUG   ] spawn_process: at 2018-11-15 18:46:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 18:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 18:46:43 [DEBUG   ] spawn_process: at 2018-11-15 18:46:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 18:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 18:46:43 [DEBUG   ] spawn_process: at 2018-11-15 18:46:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 18:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 18:46:43 [DEBUG   ] spawn_process: at 2018-11-15 18:46:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 18:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 18:46:43 [DEBUG   ] spawn_process: at 2018-11-15 18:46:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 18:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 18:46:43 [DEBUG   ] spawn_process: at 2018-11-15 18:46:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 18:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 18:46:43 [DEBUG   ] spawn_process: at 2018-11-15 18:46:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 18:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 18:46:43 [DEBUG   ] spawn_process: at 2018-11-15 18:46:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 18:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 18:46:43 [DEBUG   ] spawn_process: at 2018-11-15 18:46:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 18:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 18:46:43 [DEBUG   ] spawn_process: at 2018-11-15 18:46:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 18:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 18:46:43 [DEBUG   ] spawn_process: at 2018-11-15 18:46:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 18:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 18:46:43 [DEBUG   ] spawn_process: at 2018-11-15 18:46:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 18:46:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 18:46:43 [DEBUG   ] spawn_process: at 2018-11-15 18:46:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 18:46:46 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-15 18:47:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 18:47:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 18:47:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 18:47:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-15 18:47:07 [WARNING ] (13, 1, 'bot')
2018-11-15 18:47:07 [WARNING ] (13, 1, 'bot')
2018-11-15 18:47:07 [WARNING ] (13, 1, 'bot')
2018-11-15 18:47:07 [WARNING ] (13, 1, 'bot')
2018-11-15 18:47:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 18:47:07 [DEBUG   ] Finished updating board flags in 1.006 seconds
2018-11-15 18:47:16 [DEBUG   ] Got command BAM from MCS: ref #517585
2018-11-15 18:47:16 [INFO    ] Finished processing BAM request
2018-11-15 18:47:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 18:47:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517585   8 58437 67636025 A  ERROR'
2018-11-15 18:47:16 [DEBUG   ] Got command BAM from MCS: ref #517584
2018-11-15 18:47:16 [INFO    ] Finished processing BAM request
2018-11-15 18:47:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 18:47:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517584   8 58437 67636029 A  ERROR'
2018-11-15 18:47:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 18:47:16 [DEBUG   ] spawn_process: at 2018-11-15 18:47:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 18:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 18:47:17 [DEBUG   ] spawn_process: at 2018-11-15 18:47:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 18:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 18:47:17 [DEBUG   ] spawn_process: at 2018-11-15 18:47:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 18:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 18:47:17 [DEBUG   ] spawn_process: at 2018-11-15 18:47:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 18:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 18:47:17 [DEBUG   ] spawn_process: at 2018-11-15 18:47:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 18:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 18:47:17 [DEBUG   ] spawn_process: at 2018-11-15 18:47:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 18:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 18:47:17 [DEBUG   ] spawn_process: at 2018-11-15 18:47:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 18:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 18:47:17 [DEBUG   ] spawn_process: at 2018-11-15 18:47:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 18:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 18:47:17 [DEBUG   ] spawn_process: at 2018-11-15 18:47:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 18:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 18:47:17 [DEBUG   ] spawn_process: at 2018-11-15 18:47:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 18:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 18:47:17 [DEBUG   ] spawn_process: at 2018-11-15 18:47:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 18:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 18:47:17 [DEBUG   ] spawn_process: at 2018-11-15 18:47:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 18:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 18:47:17 [DEBUG   ] spawn_process: at 2018-11-15 18:47:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 18:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 18:47:17 [DEBUG   ] spawn_process: at 2018-11-15 18:47:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 18:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 18:47:17 [DEBUG   ] spawn_process: at 2018-11-15 18:47:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 18:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 18:47:17 [DEBUG   ] spawn_process: at 2018-11-15 18:47:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 18:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 18:47:17 [DEBUG   ] spawn_process: at 2018-11-15 18:47:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 18:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 18:47:17 [DEBUG   ] spawn_process: at 2018-11-15 18:47:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 18:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 18:47:17 [DEBUG   ] spawn_process: at 2018-11-15 18:47:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 18:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 18:47:17 [DEBUG   ] spawn_process: at 2018-11-15 18:47:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 18:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 18:47:17 [DEBUG   ] spawn_process: at 2018-11-15 18:47:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 18:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 18:47:17 [DEBUG   ] spawn_process: at 2018-11-15 18:47:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 18:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 18:47:17 [DEBUG   ] spawn_process: at 2018-11-15 18:47:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 18:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 18:47:17 [DEBUG   ] spawn_process: at 2018-11-15 18:47:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 18:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 18:47:17 [DEBUG   ] spawn_process: at 2018-11-15 18:47:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 18:47:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 18:47:17 [DEBUG   ] spawn_process: at 2018-11-15 18:47:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 18:47:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 18:47:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 18:47:48 [DEBUG   ] Got command BAM from MCS: ref #517590
2018-11-15 18:47:48 [INFO    ] Finished processing BAM request
2018-11-15 18:47:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 18:47:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517590   8 58437 67668029 A  ERROR'
2018-11-15 18:47:48 [DEBUG   ] Got command BAM from MCS: ref #517591
2018-11-15 18:47:48 [INFO    ] Finished processing BAM request
2018-11-15 18:47:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 18:47:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517591   8 58437 67668033 A  ERROR'
2018-11-15 18:47:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 18:47:48 [DEBUG   ] spawn_process: at 2018-11-15 18:47:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 18:47:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 18:47:48 [DEBUG   ] spawn_process: at 2018-11-15 18:47:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 18:47:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 18:47:48 [DEBUG   ] spawn_process: at 2018-11-15 18:47:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 18:47:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 18:47:48 [DEBUG   ] spawn_process: at 2018-11-15 18:47:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 18:47:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 18:47:48 [DEBUG   ] spawn_process: at 2018-11-15 18:47:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 18:47:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 18:47:48 [DEBUG   ] spawn_process: at 2018-11-15 18:47:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 18:47:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 18:47:48 [DEBUG   ] spawn_process: at 2018-11-15 18:47:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 18:47:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 18:47:48 [DEBUG   ] spawn_process: at 2018-11-15 18:47:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 18:47:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 18:47:48 [DEBUG   ] spawn_process: at 2018-11-15 18:47:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 18:47:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 18:47:48 [DEBUG   ] spawn_process: at 2018-11-15 18:47:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 18:47:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 18:47:48 [DEBUG   ] spawn_process: at 2018-11-15 18:47:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 18:47:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 18:47:48 [DEBUG   ] spawn_process: at 2018-11-15 18:47:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 18:47:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 18:47:48 [DEBUG   ] spawn_process: at 2018-11-15 18:47:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 18:47:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 18:47:48 [DEBUG   ] spawn_process: at 2018-11-15 18:47:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 18:47:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 18:47:48 [DEBUG   ] spawn_process: at 2018-11-15 18:47:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 18:47:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 18:47:48 [DEBUG   ] spawn_process: at 2018-11-15 18:47:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 18:47:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 18:47:48 [DEBUG   ] spawn_process: at 2018-11-15 18:47:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 18:47:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 18:47:48 [DEBUG   ] spawn_process: at 2018-11-15 18:47:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 18:47:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 18:47:48 [DEBUG   ] spawn_process: at 2018-11-15 18:47:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 18:47:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 18:47:48 [DEBUG   ] spawn_process: at 2018-11-15 18:47:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 18:47:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 18:47:48 [DEBUG   ] spawn_process: at 2018-11-15 18:47:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 18:47:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 18:47:48 [DEBUG   ] spawn_process: at 2018-11-15 18:47:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 18:47:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 18:47:48 [DEBUG   ] spawn_process: at 2018-11-15 18:47:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 18:47:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 18:47:48 [DEBUG   ] spawn_process: at 2018-11-15 18:47:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 18:47:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 18:47:48 [DEBUG   ] spawn_process: at 2018-11-15 18:47:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 18:47:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 18:47:48 [DEBUG   ] spawn_process: at 2018-11-15 18:47:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 18:48:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 18:48:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 18:48:07 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-11-15 18:48:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-15 18:48:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2018-11-15 18:48:07 [WARNING ] (13, 1, 'bot')
2018-11-15 18:48:07 [WARNING ] (13, 1, 'bot')
2018-11-15 18:48:07 [WARNING ] (13, 1, 'bot')
2018-11-15 18:48:07 [WARNING ] (13, 1, 'bot')
2018-11-15 18:48:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 18:48:07 [DEBUG   ] Finished updating board flags in 1.071 seconds
2018-11-15 18:48:20 [DEBUG   ] Got command BAM from MCS: ref #517595
2018-11-15 18:48:20 [INFO    ] Finished processing BAM request
2018-11-15 18:48:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 18:48:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517595   8 58437 67700033 A  ERROR'
2018-11-15 18:48:20 [DEBUG   ] Got command BAM from MCS: ref #517594
2018-11-15 18:48:20 [INFO    ] Finished processing BAM request
2018-11-15 18:48:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 18:48:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517594   8 58437 67700037 A  ERROR'
2018-11-15 18:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 18:48:20 [DEBUG   ] spawn_process: at 2018-11-15 18:48:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 18:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 18:48:20 [DEBUG   ] spawn_process: at 2018-11-15 18:48:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 18:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 18:48:20 [DEBUG   ] spawn_process: at 2018-11-15 18:48:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 18:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 18:48:20 [DEBUG   ] spawn_process: at 2018-11-15 18:48:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 18:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 18:48:20 [DEBUG   ] spawn_process: at 2018-11-15 18:48:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 18:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 18:48:20 [DEBUG   ] spawn_process: at 2018-11-15 18:48:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 18:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 18:48:20 [DEBUG   ] spawn_process: at 2018-11-15 18:48:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 18:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 18:48:20 [DEBUG   ] spawn_process: at 2018-11-15 18:48:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 18:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 18:48:20 [DEBUG   ] spawn_process: at 2018-11-15 18:48:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 18:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 18:48:20 [DEBUG   ] spawn_process: at 2018-11-15 18:48:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 18:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 18:48:20 [DEBUG   ] spawn_process: at 2018-11-15 18:48:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 18:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 18:48:20 [DEBUG   ] spawn_process: at 2018-11-15 18:48:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 18:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 18:48:20 [DEBUG   ] spawn_process: at 2018-11-15 18:48:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 18:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 18:48:20 [DEBUG   ] spawn_process: at 2018-11-15 18:48:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 18:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 18:48:20 [DEBUG   ] spawn_process: at 2018-11-15 18:48:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 18:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 18:48:20 [DEBUG   ] spawn_process: at 2018-11-15 18:48:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 18:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 18:48:20 [DEBUG   ] spawn_process: at 2018-11-15 18:48:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 18:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 18:48:20 [DEBUG   ] spawn_process: at 2018-11-15 18:48:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 18:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 18:48:20 [DEBUG   ] spawn_process: at 2018-11-15 18:48:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 18:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 18:48:20 [DEBUG   ] spawn_process: at 2018-11-15 18:48:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 18:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 18:48:20 [DEBUG   ] spawn_process: at 2018-11-15 18:48:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 18:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 18:48:20 [DEBUG   ] spawn_process: at 2018-11-15 18:48:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 18:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 18:48:20 [DEBUG   ] spawn_process: at 2018-11-15 18:48:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 18:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 18:48:20 [DEBUG   ] spawn_process: at 2018-11-15 18:48:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 18:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 18:48:20 [DEBUG   ] spawn_process: at 2018-11-15 18:48:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 18:48:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 18:48:20 [DEBUG   ] spawn_process: at 2018-11-15 18:48:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 18:48:21 [DEBUG   ] Got command RPT from MCS: ref #517596
2018-11-15 18:48:21 [DEBUG   ] summary = ERROR
2018-11-15 18:48:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517596  13 58437 67701897 A  ERRORERROR'
2018-11-15 18:48:22 [DEBUG   ] Got command RPT from MCS: ref #517597
2018-11-15 18:48:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 18:48:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517597  77 58437 67702101 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 18:48:22 [DEBUG   ] Got command RPT from MCS: ref #517598
2018-11-15 18:48:22 [DEBUG   ] summary = ERROR
2018-11-15 18:48:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517598  13 58437 67702293 A  ERRORERROR'
2018-11-15 18:48:22 [DEBUG   ] Got command RPT from MCS: ref #517600
2018-11-15 18:48:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 18:48:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517600  77 58437 67702497 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 18:48:22 [DEBUG   ] Got command RPT from MCS: ref #517602
2018-11-15 18:48:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 18:48:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517602  12 58437 67702701 A  ERRORB ff'
2018-11-15 18:48:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 18:48:46 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 18:48:52 [DEBUG   ] Got command BAM from MCS: ref #517606
2018-11-15 18:48:52 [INFO    ] Finished processing BAM request
2018-11-15 18:48:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 18:48:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517606   8 58437 67732033 A  ERROR'
2018-11-15 18:48:52 [DEBUG   ] Got command BAM from MCS: ref #517607
2018-11-15 18:48:52 [INFO    ] Finished processing BAM request
2018-11-15 18:48:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 18:48:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517607   8 58437 67732037 A  ERROR'
2018-11-15 18:48:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 18:48:52 [DEBUG   ] spawn_process: at 2018-11-15 18:48:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 18:48:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 18:48:52 [DEBUG   ] spawn_process: at 2018-11-15 18:48:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 18:48:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 18:48:52 [DEBUG   ] spawn_process: at 2018-11-15 18:48:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 18:48:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 18:48:52 [DEBUG   ] spawn_process: at 2018-11-15 18:48:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 18:48:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 18:48:52 [DEBUG   ] spawn_process: at 2018-11-15 18:48:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 18:48:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 18:48:52 [DEBUG   ] spawn_process: at 2018-11-15 18:48:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 18:48:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 18:48:52 [DEBUG   ] spawn_process: at 2018-11-15 18:48:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 18:48:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 18:48:52 [DEBUG   ] spawn_process: at 2018-11-15 18:48:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 18:48:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 18:48:52 [DEBUG   ] spawn_process: at 2018-11-15 18:48:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 18:48:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 18:48:52 [DEBUG   ] spawn_process: at 2018-11-15 18:48:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 18:48:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 18:48:52 [DEBUG   ] spawn_process: at 2018-11-15 18:48:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 18:48:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 18:48:52 [DEBUG   ] spawn_process: at 2018-11-15 18:48:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 18:48:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 18:48:52 [DEBUG   ] spawn_process: at 2018-11-15 18:48:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 18:48:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 18:48:52 [DEBUG   ] spawn_process: at 2018-11-15 18:48:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 18:48:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 18:48:52 [DEBUG   ] spawn_process: at 2018-11-15 18:48:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 18:48:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 18:48:52 [DEBUG   ] spawn_process: at 2018-11-15 18:48:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 18:48:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 18:48:52 [DEBUG   ] spawn_process: at 2018-11-15 18:48:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 18:48:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 18:48:52 [DEBUG   ] spawn_process: at 2018-11-15 18:48:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 18:48:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 18:48:52 [DEBUG   ] spawn_process: at 2018-11-15 18:48:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 18:48:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 18:48:52 [DEBUG   ] spawn_process: at 2018-11-15 18:48:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 18:48:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 18:48:52 [DEBUG   ] spawn_process: at 2018-11-15 18:48:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 18:48:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 18:48:52 [DEBUG   ] spawn_process: at 2018-11-15 18:48:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 18:48:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 18:48:52 [DEBUG   ] spawn_process: at 2018-11-15 18:48:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 18:48:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 18:48:52 [DEBUG   ] spawn_process: at 2018-11-15 18:48:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 18:48:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 18:48:52 [DEBUG   ] spawn_process: at 2018-11-15 18:48:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 18:48:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 18:48:52 [DEBUG   ] spawn_process: at 2018-11-15 18:48:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 18:49:06 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-15 18:49:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 18:49:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 18:49:08 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-11-15 18:49:08 [WARNING ] (13, 1, 'bot')
2018-11-15 18:49:08 [WARNING ] (13, 1, 'bot')
2018-11-15 18:49:08 [WARNING ] (13, 1, 'bot')
2018-11-15 18:49:08 [WARNING ] (13, 1, 'bot')
2018-11-15 18:49:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 18:49:08 [DEBUG   ] Finished updating board flags in 2.003 seconds
2018-11-15 18:49:24 [DEBUG   ] Got command BAM from MCS: ref #517609
2018-11-15 18:49:24 [INFO    ] Finished processing BAM request
2018-11-15 18:49:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 18:49:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517609   8 58437 67764025 A  ERROR'
2018-11-15 18:49:24 [DEBUG   ] Got command BAM from MCS: ref #517608
2018-11-15 18:49:24 [INFO    ] Finished processing BAM request
2018-11-15 18:49:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 18:49:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517608   8 58437 67764029 A  ERROR'
2018-11-15 18:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 18:49:24 [DEBUG   ] spawn_process: at 2018-11-15 18:49:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 18:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 18:49:24 [DEBUG   ] spawn_process: at 2018-11-15 18:49:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 18:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 18:49:24 [DEBUG   ] spawn_process: at 2018-11-15 18:49:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 18:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 18:49:24 [DEBUG   ] spawn_process: at 2018-11-15 18:49:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 18:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 18:49:24 [DEBUG   ] spawn_process: at 2018-11-15 18:49:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 18:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 18:49:24 [DEBUG   ] spawn_process: at 2018-11-15 18:49:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 18:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 18:49:24 [DEBUG   ] spawn_process: at 2018-11-15 18:49:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 18:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 18:49:24 [DEBUG   ] spawn_process: at 2018-11-15 18:49:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 18:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 18:49:24 [DEBUG   ] spawn_process: at 2018-11-15 18:49:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 18:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 18:49:24 [DEBUG   ] spawn_process: at 2018-11-15 18:49:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 18:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 18:49:24 [DEBUG   ] spawn_process: at 2018-11-15 18:49:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 18:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 18:49:24 [DEBUG   ] spawn_process: at 2018-11-15 18:49:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 18:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 18:49:24 [DEBUG   ] spawn_process: at 2018-11-15 18:49:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 18:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 18:49:24 [DEBUG   ] spawn_process: at 2018-11-15 18:49:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 18:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 18:49:24 [DEBUG   ] spawn_process: at 2018-11-15 18:49:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 18:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 18:49:24 [DEBUG   ] spawn_process: at 2018-11-15 18:49:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 18:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 18:49:24 [DEBUG   ] spawn_process: at 2018-11-15 18:49:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 18:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 18:49:24 [DEBUG   ] spawn_process: at 2018-11-15 18:49:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 18:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 18:49:24 [DEBUG   ] spawn_process: at 2018-11-15 18:49:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 18:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 18:49:24 [DEBUG   ] spawn_process: at 2018-11-15 18:49:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 18:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 18:49:24 [DEBUG   ] spawn_process: at 2018-11-15 18:49:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 18:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 18:49:24 [DEBUG   ] spawn_process: at 2018-11-15 18:49:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 18:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 18:49:24 [DEBUG   ] spawn_process: at 2018-11-15 18:49:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 18:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 18:49:24 [DEBUG   ] spawn_process: at 2018-11-15 18:49:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 18:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 18:49:24 [DEBUG   ] spawn_process: at 2018-11-15 18:49:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 18:49:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 18:49:24 [DEBUG   ] spawn_process: at 2018-11-15 18:49:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 18:49:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 18:49:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 18:49:56 [DEBUG   ] Got command BAM from MCS: ref #517611
2018-11-15 18:49:56 [INFO    ] Finished processing BAM request
2018-11-15 18:49:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 18:49:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517611   8 58437 67796025 A  ERROR'
2018-11-15 18:49:56 [DEBUG   ] Got command BAM from MCS: ref #517610
2018-11-15 18:49:56 [INFO    ] Finished processing BAM request
2018-11-15 18:49:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 18:49:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517610   8 58437 67796029 A  ERROR'
2018-11-15 18:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 18:49:56 [DEBUG   ] spawn_process: at 2018-11-15 18:49:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 18:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 18:49:56 [DEBUG   ] spawn_process: at 2018-11-15 18:49:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 18:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 18:49:56 [DEBUG   ] spawn_process: at 2018-11-15 18:49:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 18:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 18:49:56 [DEBUG   ] spawn_process: at 2018-11-15 18:49:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 18:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 18:49:56 [DEBUG   ] spawn_process: at 2018-11-15 18:49:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 18:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 18:49:56 [DEBUG   ] spawn_process: at 2018-11-15 18:49:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 18:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 18:49:56 [DEBUG   ] spawn_process: at 2018-11-15 18:49:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 18:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 18:49:56 [DEBUG   ] spawn_process: at 2018-11-15 18:49:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 18:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 18:49:56 [DEBUG   ] spawn_process: at 2018-11-15 18:49:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 18:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 18:49:56 [DEBUG   ] spawn_process: at 2018-11-15 18:49:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 18:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 18:49:56 [DEBUG   ] spawn_process: at 2018-11-15 18:49:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 18:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 18:49:56 [DEBUG   ] spawn_process: at 2018-11-15 18:49:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 18:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 18:49:56 [DEBUG   ] spawn_process: at 2018-11-15 18:49:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 18:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 18:49:56 [DEBUG   ] spawn_process: at 2018-11-15 18:49:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 18:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 18:49:56 [DEBUG   ] spawn_process: at 2018-11-15 18:49:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 18:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 18:49:56 [DEBUG   ] spawn_process: at 2018-11-15 18:49:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 18:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 18:49:56 [DEBUG   ] spawn_process: at 2018-11-15 18:49:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 18:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 18:49:56 [DEBUG   ] spawn_process: at 2018-11-15 18:49:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 18:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 18:49:56 [DEBUG   ] spawn_process: at 2018-11-15 18:49:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 18:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 18:49:56 [DEBUG   ] spawn_process: at 2018-11-15 18:49:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 18:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 18:49:56 [DEBUG   ] spawn_process: at 2018-11-15 18:49:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 18:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 18:49:56 [DEBUG   ] spawn_process: at 2018-11-15 18:49:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 18:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 18:49:56 [DEBUG   ] spawn_process: at 2018-11-15 18:49:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 18:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 18:49:56 [DEBUG   ] spawn_process: at 2018-11-15 18:49:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 18:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 18:49:56 [DEBUG   ] spawn_process: at 2018-11-15 18:49:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 18:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 18:49:56 [DEBUG   ] spawn_process: at 2018-11-15 18:49:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 18:50:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 18:50:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-11-15 18:50:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 18:50:08 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-15 18:50:08 [WARNING ] (13, 1, 'bot')
2018-11-15 18:50:08 [WARNING ] (13, 1, 'bot')
2018-11-15 18:50:08 [WARNING ] (13, 1, 'bot')
2018-11-15 18:50:08 [WARNING ] (13, 1, 'bot')
2018-11-15 18:50:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 18:50:08 [DEBUG   ] Finished updating board flags in 1.932 seconds
2018-11-15 18:50:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 18:50:28 [DEBUG   ] Got command BAM from MCS: ref #517616
2018-11-15 18:50:28 [INFO    ] Finished processing BAM request
2018-11-15 18:50:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 18:50:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517616   8 58437 67828025 A  ERROR'
2018-11-15 18:50:28 [DEBUG   ] Got command BAM from MCS: ref #517617
2018-11-15 18:50:28 [INFO    ] Finished processing BAM request
2018-11-15 18:50:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 18:50:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517617   8 58437 67828029 A  ERROR'
2018-11-15 18:50:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 18:50:28 [DEBUG   ] spawn_process: at 2018-11-15 18:50:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 18:50:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 18:50:28 [DEBUG   ] spawn_process: at 2018-11-15 18:50:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 18:50:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 18:50:28 [DEBUG   ] spawn_process: at 2018-11-15 18:50:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 18:50:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 18:50:28 [DEBUG   ] spawn_process: at 2018-11-15 18:50:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 18:50:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 18:50:28 [DEBUG   ] spawn_process: at 2018-11-15 18:50:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 18:50:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 18:50:28 [DEBUG   ] spawn_process: at 2018-11-15 18:50:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 18:50:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 18:50:28 [DEBUG   ] spawn_process: at 2018-11-15 18:50:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 18:50:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 18:50:28 [DEBUG   ] spawn_process: at 2018-11-15 18:50:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 18:50:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 18:50:28 [DEBUG   ] spawn_process: at 2018-11-15 18:50:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 18:50:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 18:50:28 [DEBUG   ] spawn_process: at 2018-11-15 18:50:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 18:50:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 18:50:28 [DEBUG   ] spawn_process: at 2018-11-15 18:50:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 18:50:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 18:50:28 [DEBUG   ] spawn_process: at 2018-11-15 18:50:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 18:50:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 18:50:28 [DEBUG   ] spawn_process: at 2018-11-15 18:50:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 18:50:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 18:50:28 [DEBUG   ] spawn_process: at 2018-11-15 18:50:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 18:50:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 18:50:28 [DEBUG   ] spawn_process: at 2018-11-15 18:50:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 18:50:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 18:50:28 [DEBUG   ] spawn_process: at 2018-11-15 18:50:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 18:50:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 18:50:28 [DEBUG   ] spawn_process: at 2018-11-15 18:50:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 18:50:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 18:50:28 [DEBUG   ] spawn_process: at 2018-11-15 18:50:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 18:50:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 18:50:28 [DEBUG   ] spawn_process: at 2018-11-15 18:50:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 18:50:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 18:50:28 [DEBUG   ] spawn_process: at 2018-11-15 18:50:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 18:50:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 18:50:28 [DEBUG   ] spawn_process: at 2018-11-15 18:50:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 18:50:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 18:50:28 [DEBUG   ] spawn_process: at 2018-11-15 18:50:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 18:50:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 18:50:28 [DEBUG   ] spawn_process: at 2018-11-15 18:50:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 18:50:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 18:50:28 [DEBUG   ] spawn_process: at 2018-11-15 18:50:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 18:50:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 18:50:28 [DEBUG   ] spawn_process: at 2018-11-15 18:50:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 18:50:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 18:50:28 [DEBUG   ] spawn_process: at 2018-11-15 18:50:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 18:50:45 [DEBUG   ] Got command RPT from MCS: ref #517618
2018-11-15 18:50:45 [DEBUG   ] summary = ERROR
2018-11-15 18:50:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517618  13 58437 67845165 A  ERRORERROR'
2018-11-15 18:50:45 [DEBUG   ] Got command RPT from MCS: ref #517619
2018-11-15 18:50:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 18:50:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517619  77 58437 67845166 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 18:50:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 18:51:00 [DEBUG   ] Got command BAM from MCS: ref #517635
2018-11-15 18:51:00 [INFO    ] Finished processing BAM request
2018-11-15 18:51:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 18:51:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517635   8 58437 67860026 A  ERROR'
2018-11-15 18:51:00 [DEBUG   ] Got command BAM from MCS: ref #517636
2018-11-15 18:51:00 [INFO    ] Finished processing BAM request
2018-11-15 18:51:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 18:51:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517636   8 58437 67860030 A  ERROR'
2018-11-15 18:51:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 18:51:00 [DEBUG   ] spawn_process: at 2018-11-15 18:51:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 18:51:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 18:51:00 [DEBUG   ] spawn_process: at 2018-11-15 18:51:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 18:51:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 18:51:00 [DEBUG   ] spawn_process: at 2018-11-15 18:51:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 18:51:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 18:51:00 [DEBUG   ] spawn_process: at 2018-11-15 18:51:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 18:51:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 18:51:00 [DEBUG   ] spawn_process: at 2018-11-15 18:51:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 18:51:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 18:51:00 [DEBUG   ] spawn_process: at 2018-11-15 18:51:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 18:51:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 18:51:00 [DEBUG   ] spawn_process: at 2018-11-15 18:51:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 18:51:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 18:51:00 [DEBUG   ] spawn_process: at 2018-11-15 18:51:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 18:51:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 18:51:00 [DEBUG   ] spawn_process: at 2018-11-15 18:51:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 18:51:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 18:51:00 [DEBUG   ] spawn_process: at 2018-11-15 18:51:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 18:51:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 18:51:00 [DEBUG   ] spawn_process: at 2018-11-15 18:51:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 18:51:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 18:51:00 [DEBUG   ] spawn_process: at 2018-11-15 18:51:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 18:51:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 18:51:00 [DEBUG   ] spawn_process: at 2018-11-15 18:51:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 18:51:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 18:51:00 [DEBUG   ] spawn_process: at 2018-11-15 18:51:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 18:51:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 18:51:00 [DEBUG   ] spawn_process: at 2018-11-15 18:51:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 18:51:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 18:51:00 [DEBUG   ] spawn_process: at 2018-11-15 18:51:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 18:51:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 18:51:00 [DEBUG   ] spawn_process: at 2018-11-15 18:51:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 18:51:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 18:51:00 [DEBUG   ] spawn_process: at 2018-11-15 18:51:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 18:51:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 18:51:00 [DEBUG   ] spawn_process: at 2018-11-15 18:51:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 18:51:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 18:51:00 [DEBUG   ] spawn_process: at 2018-11-15 18:51:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 18:51:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 18:51:00 [DEBUG   ] spawn_process: at 2018-11-15 18:51:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 18:51:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 18:51:00 [DEBUG   ] spawn_process: at 2018-11-15 18:51:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 18:51:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 18:51:00 [DEBUG   ] spawn_process: at 2018-11-15 18:51:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 18:51:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 18:51:00 [DEBUG   ] spawn_process: at 2018-11-15 18:51:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 18:51:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 18:51:00 [DEBUG   ] spawn_process: at 2018-11-15 18:51:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 18:51:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 18:51:00 [DEBUG   ] spawn_process: at 2018-11-15 18:51:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 18:51:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 18:51:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 18:51:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 18:51:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-15 18:51:07 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-15 18:51:07 [WARNING ] (13, 1, 'bot')
2018-11-15 18:51:07 [WARNING ] (13, 1, 'bot')
2018-11-15 18:51:07 [WARNING ] (13, 1, 'bot')
2018-11-15 18:51:07 [WARNING ] (13, 1, 'bot')
2018-11-15 18:51:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 18:51:07 [DEBUG   ] Finished updating board flags in 1.241 seconds
2018-11-15 18:51:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 18:51:32 [DEBUG   ] Got command BAM from MCS: ref #517637
2018-11-15 18:51:32 [INFO    ] Finished processing BAM request
2018-11-15 18:51:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 18:51:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517637   8 58437 67892026 A  ERROR'
2018-11-15 18:51:32 [DEBUG   ] Got command BAM from MCS: ref #517638
2018-11-15 18:51:32 [INFO    ] Finished processing BAM request
2018-11-15 18:51:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 18:51:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517638   8 58437 67892030 A  ERROR'
2018-11-15 18:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 18:51:32 [DEBUG   ] spawn_process: at 2018-11-15 18:51:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 18:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 18:51:32 [DEBUG   ] spawn_process: at 2018-11-15 18:51:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 18:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 18:51:32 [DEBUG   ] spawn_process: at 2018-11-15 18:51:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 18:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 18:51:32 [DEBUG   ] spawn_process: at 2018-11-15 18:51:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 18:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 18:51:32 [DEBUG   ] spawn_process: at 2018-11-15 18:51:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 18:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 18:51:32 [DEBUG   ] spawn_process: at 2018-11-15 18:51:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 18:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 18:51:32 [DEBUG   ] spawn_process: at 2018-11-15 18:51:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 18:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 18:51:32 [DEBUG   ] spawn_process: at 2018-11-15 18:51:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 18:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 18:51:32 [DEBUG   ] spawn_process: at 2018-11-15 18:51:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 18:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 18:51:32 [DEBUG   ] spawn_process: at 2018-11-15 18:51:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 18:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 18:51:32 [DEBUG   ] spawn_process: at 2018-11-15 18:51:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 18:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 18:51:32 [DEBUG   ] spawn_process: at 2018-11-15 18:51:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 18:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 18:51:32 [DEBUG   ] spawn_process: at 2018-11-15 18:51:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 18:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 18:51:32 [DEBUG   ] spawn_process: at 2018-11-15 18:51:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 18:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 18:51:32 [DEBUG   ] spawn_process: at 2018-11-15 18:51:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 18:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 18:51:32 [DEBUG   ] spawn_process: at 2018-11-15 18:51:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 18:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 18:51:32 [DEBUG   ] spawn_process: at 2018-11-15 18:51:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 18:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 18:51:32 [DEBUG   ] spawn_process: at 2018-11-15 18:51:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 18:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 18:51:32 [DEBUG   ] spawn_process: at 2018-11-15 18:51:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 18:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 18:51:32 [DEBUG   ] spawn_process: at 2018-11-15 18:51:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 18:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 18:51:32 [DEBUG   ] spawn_process: at 2018-11-15 18:51:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 18:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 18:51:32 [DEBUG   ] spawn_process: at 2018-11-15 18:51:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 18:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 18:51:32 [DEBUG   ] spawn_process: at 2018-11-15 18:51:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 18:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 18:51:32 [DEBUG   ] spawn_process: at 2018-11-15 18:51:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 18:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 18:51:32 [DEBUG   ] spawn_process: at 2018-11-15 18:51:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 18:51:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 18:51:32 [DEBUG   ] spawn_process: at 2018-11-15 18:51:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 18:51:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 18:52:04 [DEBUG   ] Got command BAM from MCS: ref #517639
2018-11-15 18:52:04 [INFO    ] Finished processing BAM request
2018-11-15 18:52:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 18:52:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517639   8 58437 67924026 A  ERROR'
2018-11-15 18:52:04 [DEBUG   ] Got command BAM from MCS: ref #517640
2018-11-15 18:52:04 [INFO    ] Finished processing BAM request
2018-11-15 18:52:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 18:52:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517640   8 58437 67924030 A  ERROR'
2018-11-15 18:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 18:52:04 [DEBUG   ] spawn_process: at 2018-11-15 18:52:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 18:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 18:52:04 [DEBUG   ] spawn_process: at 2018-11-15 18:52:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 18:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 18:52:04 [DEBUG   ] spawn_process: at 2018-11-15 18:52:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 18:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 18:52:04 [DEBUG   ] spawn_process: at 2018-11-15 18:52:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 18:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 18:52:04 [DEBUG   ] spawn_process: at 2018-11-15 18:52:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 18:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 18:52:04 [DEBUG   ] spawn_process: at 2018-11-15 18:52:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 18:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 18:52:04 [DEBUG   ] spawn_process: at 2018-11-15 18:52:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 18:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 18:52:04 [DEBUG   ] spawn_process: at 2018-11-15 18:52:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 18:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 18:52:04 [DEBUG   ] spawn_process: at 2018-11-15 18:52:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 18:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 18:52:04 [DEBUG   ] spawn_process: at 2018-11-15 18:52:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 18:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 18:52:04 [DEBUG   ] spawn_process: at 2018-11-15 18:52:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 18:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 18:52:04 [DEBUG   ] spawn_process: at 2018-11-15 18:52:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 18:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 18:52:04 [DEBUG   ] spawn_process: at 2018-11-15 18:52:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 18:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 18:52:04 [DEBUG   ] spawn_process: at 2018-11-15 18:52:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 18:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 18:52:04 [DEBUG   ] spawn_process: at 2018-11-15 18:52:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 18:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 18:52:04 [DEBUG   ] spawn_process: at 2018-11-15 18:52:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 18:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 18:52:04 [DEBUG   ] spawn_process: at 2018-11-15 18:52:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 18:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 18:52:04 [DEBUG   ] spawn_process: at 2018-11-15 18:52:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 18:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 18:52:04 [DEBUG   ] spawn_process: at 2018-11-15 18:52:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 18:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 18:52:04 [DEBUG   ] spawn_process: at 2018-11-15 18:52:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 18:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 18:52:04 [DEBUG   ] spawn_process: at 2018-11-15 18:52:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 18:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 18:52:04 [DEBUG   ] spawn_process: at 2018-11-15 18:52:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 18:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 18:52:04 [DEBUG   ] spawn_process: at 2018-11-15 18:52:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 18:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 18:52:04 [DEBUG   ] spawn_process: at 2018-11-15 18:52:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 18:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 18:52:04 [DEBUG   ] spawn_process: at 2018-11-15 18:52:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 18:52:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 18:52:04 [DEBUG   ] spawn_process: at 2018-11-15 18:52:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 18:52:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 18:52:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 18:52:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 18:52:07 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-15 18:52:07 [WARNING ] (13, 1, 'bot')
2018-11-15 18:52:07 [WARNING ] (13, 1, 'bot')
2018-11-15 18:52:07 [WARNING ] (13, 1, 'bot')
2018-11-15 18:52:07 [WARNING ] (13, 1, 'bot')
2018-11-15 18:52:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 18:52:07 [DEBUG   ] Finished updating board flags in 1.220 seconds
2018-11-15 18:52:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 18:52:36 [DEBUG   ] Got command BAM from MCS: ref #517642
2018-11-15 18:52:36 [INFO    ] Finished processing BAM request
2018-11-15 18:52:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 18:52:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517642   8 58437 67956029 A  ERROR'
2018-11-15 18:52:36 [DEBUG   ] Got command BAM from MCS: ref #517641
2018-11-15 18:52:36 [INFO    ] Finished processing BAM request
2018-11-15 18:52:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 18:52:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517641   8 58437 67956033 A  ERROR'
2018-11-15 18:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 18:52:36 [DEBUG   ] spawn_process: at 2018-11-15 18:52:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 18:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 18:52:36 [DEBUG   ] spawn_process: at 2018-11-15 18:52:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 18:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 18:52:36 [DEBUG   ] spawn_process: at 2018-11-15 18:52:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 18:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 18:52:36 [DEBUG   ] spawn_process: at 2018-11-15 18:52:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 18:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 18:52:36 [DEBUG   ] spawn_process: at 2018-11-15 18:52:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 18:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 18:52:36 [DEBUG   ] spawn_process: at 2018-11-15 18:52:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 18:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 18:52:36 [DEBUG   ] spawn_process: at 2018-11-15 18:52:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 18:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 18:52:36 [DEBUG   ] spawn_process: at 2018-11-15 18:52:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 18:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 18:52:36 [DEBUG   ] spawn_process: at 2018-11-15 18:52:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 18:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 18:52:36 [DEBUG   ] spawn_process: at 2018-11-15 18:52:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 18:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 18:52:36 [DEBUG   ] spawn_process: at 2018-11-15 18:52:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 18:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 18:52:36 [DEBUG   ] spawn_process: at 2018-11-15 18:52:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 18:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 18:52:36 [DEBUG   ] spawn_process: at 2018-11-15 18:52:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 18:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 18:52:36 [DEBUG   ] spawn_process: at 2018-11-15 18:52:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 18:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 18:52:36 [DEBUG   ] spawn_process: at 2018-11-15 18:52:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 18:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 18:52:36 [DEBUG   ] spawn_process: at 2018-11-15 18:52:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 18:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 18:52:36 [DEBUG   ] spawn_process: at 2018-11-15 18:52:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 18:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 18:52:36 [DEBUG   ] spawn_process: at 2018-11-15 18:52:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 18:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 18:52:36 [DEBUG   ] spawn_process: at 2018-11-15 18:52:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 18:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 18:52:36 [DEBUG   ] spawn_process: at 2018-11-15 18:52:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 18:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 18:52:36 [DEBUG   ] spawn_process: at 2018-11-15 18:52:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 18:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 18:52:36 [DEBUG   ] spawn_process: at 2018-11-15 18:52:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 18:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 18:52:36 [DEBUG   ] spawn_process: at 2018-11-15 18:52:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 18:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 18:52:36 [DEBUG   ] spawn_process: at 2018-11-15 18:52:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 18:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 18:52:36 [DEBUG   ] spawn_process: at 2018-11-15 18:52:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 18:52:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 18:52:36 [DEBUG   ] spawn_process: at 2018-11-15 18:52:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 18:52:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 18:53:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 18:53:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 18:53:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-15 18:53:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 18:53:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 18:53:07 [WARNING ] (13, 1, 'bot')
2018-11-15 18:53:07 [WARNING ] (13, 1, 'bot')
2018-11-15 18:53:07 [WARNING ] (13, 1, 'bot')
2018-11-15 18:53:07 [WARNING ] (13, 1, 'bot')
2018-11-15 18:53:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 18:53:07 [DEBUG   ] Finished updating board flags in 1.211 seconds
2018-11-15 18:53:08 [DEBUG   ] Got command BAM from MCS: ref #517644
2018-11-15 18:53:08 [INFO    ] Finished processing BAM request
2018-11-15 18:53:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 18:53:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517644   8 58437 67988029 A  ERROR'
2018-11-15 18:53:08 [DEBUG   ] Got command BAM from MCS: ref #517643
2018-11-15 18:53:08 [INFO    ] Finished processing BAM request
2018-11-15 18:53:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 18:53:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517643   8 58437 67988033 A  ERROR'
2018-11-15 18:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 18:53:08 [DEBUG   ] spawn_process: at 2018-11-15 18:53:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 18:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 18:53:08 [DEBUG   ] spawn_process: at 2018-11-15 18:53:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 18:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 18:53:08 [DEBUG   ] spawn_process: at 2018-11-15 18:53:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 18:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 18:53:08 [DEBUG   ] spawn_process: at 2018-11-15 18:53:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 18:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 18:53:08 [DEBUG   ] spawn_process: at 2018-11-15 18:53:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 18:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 18:53:08 [DEBUG   ] spawn_process: at 2018-11-15 18:53:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 18:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 18:53:08 [DEBUG   ] spawn_process: at 2018-11-15 18:53:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 18:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 18:53:08 [DEBUG   ] spawn_process: at 2018-11-15 18:53:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 18:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 18:53:08 [DEBUG   ] spawn_process: at 2018-11-15 18:53:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 18:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 18:53:08 [DEBUG   ] spawn_process: at 2018-11-15 18:53:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 18:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 18:53:08 [DEBUG   ] spawn_process: at 2018-11-15 18:53:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 18:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 18:53:08 [DEBUG   ] spawn_process: at 2018-11-15 18:53:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 18:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 18:53:08 [DEBUG   ] spawn_process: at 2018-11-15 18:53:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 18:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 18:53:08 [DEBUG   ] spawn_process: at 2018-11-15 18:53:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 18:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 18:53:08 [DEBUG   ] spawn_process: at 2018-11-15 18:53:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 18:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 18:53:08 [DEBUG   ] spawn_process: at 2018-11-15 18:53:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 18:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 18:53:08 [DEBUG   ] spawn_process: at 2018-11-15 18:53:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 18:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 18:53:08 [DEBUG   ] spawn_process: at 2018-11-15 18:53:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 18:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 18:53:08 [DEBUG   ] spawn_process: at 2018-11-15 18:53:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 18:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 18:53:08 [DEBUG   ] spawn_process: at 2018-11-15 18:53:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 18:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 18:53:08 [DEBUG   ] spawn_process: at 2018-11-15 18:53:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 18:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 18:53:08 [DEBUG   ] spawn_process: at 2018-11-15 18:53:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 18:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 18:53:08 [DEBUG   ] spawn_process: at 2018-11-15 18:53:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 18:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 18:53:08 [DEBUG   ] spawn_process: at 2018-11-15 18:53:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 18:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 18:53:08 [DEBUG   ] spawn_process: at 2018-11-15 18:53:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 18:53:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 18:53:08 [DEBUG   ] spawn_process: at 2018-11-15 18:53:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 18:53:21 [DEBUG   ] Got command RPT from MCS: ref #517645
2018-11-15 18:53:21 [DEBUG   ] summary = ERROR
2018-11-15 18:53:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517645  13 58437 68001989 A  ERRORERROR'
2018-11-15 18:53:22 [DEBUG   ] Got command RPT from MCS: ref #517646
2018-11-15 18:53:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 18:53:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517646  77 58437 68002181 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 18:53:22 [DEBUG   ] Got command RPT from MCS: ref #517647
2018-11-15 18:53:22 [DEBUG   ] summary = ERROR
2018-11-15 18:53:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517647  13 58437 68002385 A  ERRORERROR'
2018-11-15 18:53:22 [DEBUG   ] Got command RPT from MCS: ref #517648
2018-11-15 18:53:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 18:53:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517648  77 58437 68002589 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 18:53:22 [DEBUG   ] Got command RPT from MCS: ref #517649
2018-11-15 18:53:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 18:53:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517649  12 58437 68002793 A  ERRORB¢ff'
2018-11-15 18:53:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 18:53:40 [DEBUG   ] Got command BAM from MCS: ref #517655
2018-11-15 18:53:40 [INFO    ] Finished processing BAM request
2018-11-15 18:53:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 18:53:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517655   8 58437 68020029 A  ERROR'
2018-11-15 18:53:40 [DEBUG   ] Got command BAM from MCS: ref #517654
2018-11-15 18:53:40 [INFO    ] Finished processing BAM request
2018-11-15 18:53:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 18:53:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517654   8 58437 68020033 A  ERROR'
2018-11-15 18:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 18:53:40 [DEBUG   ] spawn_process: at 2018-11-15 18:53:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 18:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 18:53:40 [DEBUG   ] spawn_process: at 2018-11-15 18:53:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 18:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 18:53:40 [DEBUG   ] spawn_process: at 2018-11-15 18:53:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 18:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 18:53:40 [DEBUG   ] spawn_process: at 2018-11-15 18:53:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 18:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 18:53:40 [DEBUG   ] spawn_process: at 2018-11-15 18:53:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 18:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 18:53:40 [DEBUG   ] spawn_process: at 2018-11-15 18:53:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 18:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 18:53:40 [DEBUG   ] spawn_process: at 2018-11-15 18:53:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 18:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 18:53:40 [DEBUG   ] spawn_process: at 2018-11-15 18:53:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 18:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 18:53:40 [DEBUG   ] spawn_process: at 2018-11-15 18:53:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 18:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 18:53:40 [DEBUG   ] spawn_process: at 2018-11-15 18:53:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 18:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 18:53:40 [DEBUG   ] spawn_process: at 2018-11-15 18:53:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 18:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 18:53:40 [DEBUG   ] spawn_process: at 2018-11-15 18:53:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 18:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 18:53:40 [DEBUG   ] spawn_process: at 2018-11-15 18:53:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 18:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 18:53:40 [DEBUG   ] spawn_process: at 2018-11-15 18:53:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 18:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 18:53:40 [DEBUG   ] spawn_process: at 2018-11-15 18:53:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 18:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 18:53:40 [DEBUG   ] spawn_process: at 2018-11-15 18:53:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 18:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 18:53:40 [DEBUG   ] spawn_process: at 2018-11-15 18:53:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 18:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 18:53:40 [DEBUG   ] spawn_process: at 2018-11-15 18:53:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 18:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 18:53:40 [DEBUG   ] spawn_process: at 2018-11-15 18:53:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 18:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 18:53:40 [DEBUG   ] spawn_process: at 2018-11-15 18:53:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 18:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 18:53:40 [DEBUG   ] spawn_process: at 2018-11-15 18:53:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 18:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 18:53:40 [DEBUG   ] spawn_process: at 2018-11-15 18:53:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 18:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 18:53:40 [DEBUG   ] spawn_process: at 2018-11-15 18:53:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 18:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 18:53:40 [DEBUG   ] spawn_process: at 2018-11-15 18:53:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 18:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 18:53:40 [DEBUG   ] spawn_process: at 2018-11-15 18:53:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 18:53:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 18:53:40 [DEBUG   ] spawn_process: at 2018-11-15 18:53:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 18:53:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 18:54:06 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 18:54:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 18:54:08 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 18:54:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 18:54:08 [WARNING ] (13, 1, 'bot')
2018-11-15 18:54:08 [WARNING ] (13, 1, 'bot')
2018-11-15 18:54:08 [WARNING ] (13, 1, 'bot')
2018-11-15 18:54:08 [WARNING ] (13, 1, 'bot')
2018-11-15 18:54:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 18:54:08 [DEBUG   ] Finished updating board flags in 1.751 seconds
2018-11-15 18:54:12 [DEBUG   ] Got command BAM from MCS: ref #517656
2018-11-15 18:54:12 [INFO    ] Finished processing BAM request
2018-11-15 18:54:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 18:54:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517656   8 58437 68052029 A  ERROR'
2018-11-15 18:54:12 [DEBUG   ] Got command BAM from MCS: ref #517657
2018-11-15 18:54:12 [INFO    ] Finished processing BAM request
2018-11-15 18:54:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 18:54:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517657   8 58437 68052033 A  ERROR'
2018-11-15 18:54:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 18:54:12 [DEBUG   ] spawn_process: at 2018-11-15 18:54:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 18:54:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 18:54:12 [DEBUG   ] spawn_process: at 2018-11-15 18:54:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 18:54:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 18:54:12 [DEBUG   ] spawn_process: at 2018-11-15 18:54:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 18:54:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 18:54:12 [DEBUG   ] spawn_process: at 2018-11-15 18:54:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 18:54:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 18:54:12 [DEBUG   ] spawn_process: at 2018-11-15 18:54:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 18:54:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 18:54:12 [DEBUG   ] spawn_process: at 2018-11-15 18:54:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 18:54:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 18:54:12 [DEBUG   ] spawn_process: at 2018-11-15 18:54:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 18:54:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 18:54:12 [DEBUG   ] spawn_process: at 2018-11-15 18:54:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 18:54:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 18:54:12 [DEBUG   ] spawn_process: at 2018-11-15 18:54:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 18:54:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 18:54:12 [DEBUG   ] spawn_process: at 2018-11-15 18:54:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 18:54:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 18:54:12 [DEBUG   ] spawn_process: at 2018-11-15 18:54:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 18:54:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 18:54:12 [DEBUG   ] spawn_process: at 2018-11-15 18:54:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 18:54:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 18:54:12 [DEBUG   ] spawn_process: at 2018-11-15 18:54:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 18:54:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 18:54:12 [DEBUG   ] spawn_process: at 2018-11-15 18:54:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 18:54:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 18:54:12 [DEBUG   ] spawn_process: at 2018-11-15 18:54:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 18:54:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 18:54:12 [DEBUG   ] spawn_process: at 2018-11-15 18:54:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 18:54:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 18:54:12 [DEBUG   ] spawn_process: at 2018-11-15 18:54:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 18:54:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 18:54:12 [DEBUG   ] spawn_process: at 2018-11-15 18:54:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 18:54:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 18:54:12 [DEBUG   ] spawn_process: at 2018-11-15 18:54:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 18:54:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 18:54:12 [DEBUG   ] spawn_process: at 2018-11-15 18:54:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 18:54:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 18:54:12 [DEBUG   ] spawn_process: at 2018-11-15 18:54:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 18:54:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 18:54:12 [DEBUG   ] spawn_process: at 2018-11-15 18:54:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 18:54:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 18:54:12 [DEBUG   ] spawn_process: at 2018-11-15 18:54:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 18:54:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 18:54:12 [DEBUG   ] spawn_process: at 2018-11-15 18:54:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 18:54:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 18:54:12 [DEBUG   ] spawn_process: at 2018-11-15 18:54:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 18:54:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 18:54:12 [DEBUG   ] spawn_process: at 2018-11-15 18:54:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 18:54:26 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-15 18:54:44 [DEBUG   ] Got command BAM from MCS: ref #517659
2018-11-15 18:54:44 [INFO    ] Finished processing BAM request
2018-11-15 18:54:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 18:54:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517659   8 58437 68084025 A  ERROR'
2018-11-15 18:54:44 [DEBUG   ] Got command BAM from MCS: ref #517658
2018-11-15 18:54:44 [INFO    ] Finished processing BAM request
2018-11-15 18:54:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 18:54:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517658   8 58437 68084029 A  ERROR'
2018-11-15 18:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 18:54:44 [DEBUG   ] spawn_process: at 2018-11-15 18:54:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 18:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 18:54:44 [DEBUG   ] spawn_process: at 2018-11-15 18:54:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 18:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 18:54:44 [DEBUG   ] spawn_process: at 2018-11-15 18:54:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 18:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 18:54:44 [DEBUG   ] spawn_process: at 2018-11-15 18:54:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 18:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 18:54:44 [DEBUG   ] spawn_process: at 2018-11-15 18:54:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 18:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 18:54:44 [DEBUG   ] spawn_process: at 2018-11-15 18:54:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 18:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 18:54:44 [DEBUG   ] spawn_process: at 2018-11-15 18:54:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 18:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 18:54:44 [DEBUG   ] spawn_process: at 2018-11-15 18:54:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 18:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 18:54:44 [DEBUG   ] spawn_process: at 2018-11-15 18:54:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 18:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 18:54:44 [DEBUG   ] spawn_process: at 2018-11-15 18:54:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 18:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 18:54:44 [DEBUG   ] spawn_process: at 2018-11-15 18:54:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 18:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 18:54:44 [DEBUG   ] spawn_process: at 2018-11-15 18:54:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 18:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 18:54:44 [DEBUG   ] spawn_process: at 2018-11-15 18:54:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 18:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 18:54:44 [DEBUG   ] spawn_process: at 2018-11-15 18:54:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 18:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 18:54:44 [DEBUG   ] spawn_process: at 2018-11-15 18:54:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 18:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 18:54:44 [DEBUG   ] spawn_process: at 2018-11-15 18:54:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 18:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 18:54:44 [DEBUG   ] spawn_process: at 2018-11-15 18:54:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 18:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 18:54:44 [DEBUG   ] spawn_process: at 2018-11-15 18:54:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 18:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 18:54:44 [DEBUG   ] spawn_process: at 2018-11-15 18:54:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 18:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 18:54:44 [DEBUG   ] spawn_process: at 2018-11-15 18:54:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 18:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 18:54:44 [DEBUG   ] spawn_process: at 2018-11-15 18:54:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 18:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 18:54:44 [DEBUG   ] spawn_process: at 2018-11-15 18:54:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 18:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 18:54:44 [DEBUG   ] spawn_process: at 2018-11-15 18:54:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 18:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 18:54:44 [DEBUG   ] spawn_process: at 2018-11-15 18:54:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 18:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 18:54:44 [DEBUG   ] spawn_process: at 2018-11-15 18:54:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 18:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 18:54:44 [DEBUG   ] spawn_process: at 2018-11-15 18:54:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 18:54:46 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 18:55:06 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 18:55:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 18:55:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 18:55:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 18:55:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 18:55:07 [WARNING ] (13, 1, 'bot')
2018-11-15 18:55:07 [WARNING ] (13, 1, 'bot')
2018-11-15 18:55:07 [WARNING ] (13, 1, 'bot')
2018-11-15 18:55:07 [WARNING ] (13, 1, 'bot')
2018-11-15 18:55:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 18:55:07 [DEBUG   ] Finished updating board flags in 1.024 seconds
2018-11-15 18:55:16 [DEBUG   ] Got command BAM from MCS: ref #517660
2018-11-15 18:55:16 [INFO    ] Finished processing BAM request
2018-11-15 18:55:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 18:55:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517660   8 58437 68116033 A  ERROR'
2018-11-15 18:55:16 [DEBUG   ] Got command BAM from MCS: ref #517661
2018-11-15 18:55:16 [INFO    ] Finished processing BAM request
2018-11-15 18:55:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 18:55:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517661   8 58437 68116037 A  ERROR'
2018-11-15 18:55:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 18:55:16 [DEBUG   ] spawn_process: at 2018-11-15 18:55:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 18:55:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 18:55:16 [DEBUG   ] spawn_process: at 2018-11-15 18:55:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 18:55:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 18:55:16 [DEBUG   ] spawn_process: at 2018-11-15 18:55:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 18:55:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 18:55:16 [DEBUG   ] spawn_process: at 2018-11-15 18:55:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 18:55:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 18:55:16 [DEBUG   ] spawn_process: at 2018-11-15 18:55:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 18:55:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 18:55:16 [DEBUG   ] spawn_process: at 2018-11-15 18:55:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 18:55:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 18:55:16 [DEBUG   ] spawn_process: at 2018-11-15 18:55:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 18:55:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 18:55:16 [DEBUG   ] spawn_process: at 2018-11-15 18:55:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 18:55:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 18:55:16 [DEBUG   ] spawn_process: at 2018-11-15 18:55:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 18:55:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 18:55:16 [DEBUG   ] spawn_process: at 2018-11-15 18:55:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 18:55:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 18:55:16 [DEBUG   ] spawn_process: at 2018-11-15 18:55:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 18:55:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 18:55:16 [DEBUG   ] spawn_process: at 2018-11-15 18:55:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 18:55:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 18:55:16 [DEBUG   ] spawn_process: at 2018-11-15 18:55:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 18:55:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 18:55:16 [DEBUG   ] spawn_process: at 2018-11-15 18:55:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 18:55:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 18:55:16 [DEBUG   ] spawn_process: at 2018-11-15 18:55:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 18:55:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 18:55:16 [DEBUG   ] spawn_process: at 2018-11-15 18:55:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 18:55:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 18:55:16 [DEBUG   ] spawn_process: at 2018-11-15 18:55:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 18:55:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 18:55:16 [DEBUG   ] spawn_process: at 2018-11-15 18:55:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 18:55:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 18:55:16 [DEBUG   ] spawn_process: at 2018-11-15 18:55:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 18:55:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 18:55:16 [DEBUG   ] spawn_process: at 2018-11-15 18:55:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 18:55:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 18:55:16 [DEBUG   ] spawn_process: at 2018-11-15 18:55:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 18:55:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 18:55:16 [DEBUG   ] spawn_process: at 2018-11-15 18:55:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 18:55:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 18:55:16 [DEBUG   ] spawn_process: at 2018-11-15 18:55:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 18:55:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 18:55:16 [DEBUG   ] spawn_process: at 2018-11-15 18:55:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 18:55:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 18:55:16 [DEBUG   ] spawn_process: at 2018-11-15 18:55:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 18:55:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 18:55:16 [DEBUG   ] spawn_process: at 2018-11-15 18:55:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 18:55:26 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-15 18:55:45 [DEBUG   ] Got command RPT from MCS: ref #517662
2018-11-15 18:55:45 [DEBUG   ] summary = ERROR
2018-11-15 18:55:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517662  13 58437 68145173 A  ERRORERROR'
2018-11-15 18:55:45 [DEBUG   ] Got command RPT from MCS: ref #517663
2018-11-15 18:55:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 18:55:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517663  77 58437 68145174 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 18:55:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 18:55:48 [DEBUG   ] Got command BAM from MCS: ref #517680
2018-11-15 18:55:48 [INFO    ] Finished processing BAM request
2018-11-15 18:55:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 18:55:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517680   8 58437 68148033 A  ERROR'
2018-11-15 18:55:48 [DEBUG   ] Got command BAM from MCS: ref #517679
2018-11-15 18:55:48 [INFO    ] Finished processing BAM request
2018-11-15 18:55:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 18:55:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517679   8 58437 68148037 A  ERROR'
2018-11-15 18:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 18:55:48 [DEBUG   ] spawn_process: at 2018-11-15 18:55:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 18:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 18:55:48 [DEBUG   ] spawn_process: at 2018-11-15 18:55:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 18:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 18:55:48 [DEBUG   ] spawn_process: at 2018-11-15 18:55:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 18:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 18:55:48 [DEBUG   ] spawn_process: at 2018-11-15 18:55:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 18:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 18:55:48 [DEBUG   ] spawn_process: at 2018-11-15 18:55:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 18:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 18:55:48 [DEBUG   ] spawn_process: at 2018-11-15 18:55:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 18:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 18:55:48 [DEBUG   ] spawn_process: at 2018-11-15 18:55:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 18:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 18:55:48 [DEBUG   ] spawn_process: at 2018-11-15 18:55:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 18:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 18:55:48 [DEBUG   ] spawn_process: at 2018-11-15 18:55:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 18:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 18:55:48 [DEBUG   ] spawn_process: at 2018-11-15 18:55:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 18:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 18:55:48 [DEBUG   ] spawn_process: at 2018-11-15 18:55:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 18:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 18:55:48 [DEBUG   ] spawn_process: at 2018-11-15 18:55:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 18:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 18:55:48 [DEBUG   ] spawn_process: at 2018-11-15 18:55:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 18:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 18:55:48 [DEBUG   ] spawn_process: at 2018-11-15 18:55:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 18:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 18:55:48 [DEBUG   ] spawn_process: at 2018-11-15 18:55:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 18:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 18:55:48 [DEBUG   ] spawn_process: at 2018-11-15 18:55:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 18:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 18:55:48 [DEBUG   ] spawn_process: at 2018-11-15 18:55:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 18:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 18:55:48 [DEBUG   ] spawn_process: at 2018-11-15 18:55:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 18:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 18:55:48 [DEBUG   ] spawn_process: at 2018-11-15 18:55:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 18:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 18:55:48 [DEBUG   ] spawn_process: at 2018-11-15 18:55:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 18:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 18:55:48 [DEBUG   ] spawn_process: at 2018-11-15 18:55:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 18:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 18:55:48 [DEBUG   ] spawn_process: at 2018-11-15 18:55:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 18:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 18:55:48 [DEBUG   ] spawn_process: at 2018-11-15 18:55:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 18:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 18:55:48 [DEBUG   ] spawn_process: at 2018-11-15 18:55:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 18:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 18:55:48 [DEBUG   ] spawn_process: at 2018-11-15 18:55:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 18:55:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 18:55:48 [DEBUG   ] spawn_process: at 2018-11-15 18:55:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 18:56:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 18:56:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 18:56:07 [DEBUG   ] Finished updating ant stats in 1.232 seconds
2018-11-15 18:56:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-11-15 18:56:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 18:56:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-11-15 18:56:08 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 18:56:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 18:56:08 [WARNING ] (13, 1, 'bot')
2018-11-15 18:56:08 [WARNING ] (13, 1, 'bot')
2018-11-15 18:56:08 [WARNING ] (13, 1, 'bot')
2018-11-15 18:56:08 [WARNING ] (13, 1, 'bot')
2018-11-15 18:56:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 18:56:08 [DEBUG   ] Finished updating board flags in 1.575 seconds
2018-11-15 18:56:20 [DEBUG   ] Got command BAM from MCS: ref #517681
2018-11-15 18:56:20 [INFO    ] Finished processing BAM request
2018-11-15 18:56:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 18:56:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517681   8 58437 68180025 A  ERROR'
2018-11-15 18:56:20 [DEBUG   ] Got command BAM from MCS: ref #517682
2018-11-15 18:56:20 [INFO    ] Finished processing BAM request
2018-11-15 18:56:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 18:56:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517682   8 58437 68180029 A  ERROR'
2018-11-15 18:56:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 18:56:20 [DEBUG   ] spawn_process: at 2018-11-15 18:56:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 18:56:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 18:56:20 [DEBUG   ] spawn_process: at 2018-11-15 18:56:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 18:56:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 18:56:20 [DEBUG   ] spawn_process: at 2018-11-15 18:56:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 18:56:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 18:56:20 [DEBUG   ] spawn_process: at 2018-11-15 18:56:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 18:56:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 18:56:20 [DEBUG   ] spawn_process: at 2018-11-15 18:56:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 18:56:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 18:56:20 [DEBUG   ] spawn_process: at 2018-11-15 18:56:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 18:56:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 18:56:20 [DEBUG   ] spawn_process: at 2018-11-15 18:56:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 18:56:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 18:56:20 [DEBUG   ] spawn_process: at 2018-11-15 18:56:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 18:56:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 18:56:20 [DEBUG   ] spawn_process: at 2018-11-15 18:56:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 18:56:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 18:56:20 [DEBUG   ] spawn_process: at 2018-11-15 18:56:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 18:56:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 18:56:20 [DEBUG   ] spawn_process: at 2018-11-15 18:56:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 18:56:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 18:56:20 [DEBUG   ] spawn_process: at 2018-11-15 18:56:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 18:56:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 18:56:20 [DEBUG   ] spawn_process: at 2018-11-15 18:56:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 18:56:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 18:56:20 [DEBUG   ] spawn_process: at 2018-11-15 18:56:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 18:56:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 18:56:20 [DEBUG   ] spawn_process: at 2018-11-15 18:56:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 18:56:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 18:56:20 [DEBUG   ] spawn_process: at 2018-11-15 18:56:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 18:56:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 18:56:20 [DEBUG   ] spawn_process: at 2018-11-15 18:56:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 18:56:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 18:56:20 [DEBUG   ] spawn_process: at 2018-11-15 18:56:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 18:56:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 18:56:20 [DEBUG   ] spawn_process: at 2018-11-15 18:56:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 18:56:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 18:56:20 [DEBUG   ] spawn_process: at 2018-11-15 18:56:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 18:56:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 18:56:20 [DEBUG   ] spawn_process: at 2018-11-15 18:56:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 18:56:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 18:56:20 [DEBUG   ] spawn_process: at 2018-11-15 18:56:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 18:56:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 18:56:20 [DEBUG   ] spawn_process: at 2018-11-15 18:56:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 18:56:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 18:56:20 [DEBUG   ] spawn_process: at 2018-11-15 18:56:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 18:56:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 18:56:20 [DEBUG   ] spawn_process: at 2018-11-15 18:56:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 18:56:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 18:56:20 [DEBUG   ] spawn_process: at 2018-11-15 18:56:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 18:56:27 [DEBUG   ] Finished updating ant stats in 1.171 seconds
2018-11-15 18:56:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 18:56:52 [DEBUG   ] Got command BAM from MCS: ref #517688
2018-11-15 18:56:52 [INFO    ] Finished processing BAM request
2018-11-15 18:56:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 18:56:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517688   8 58437 68212033 A  ERROR'
2018-11-15 18:56:52 [DEBUG   ] Got command BAM from MCS: ref #517687
2018-11-15 18:56:52 [INFO    ] Finished processing BAM request
2018-11-15 18:56:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 18:56:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517687   8 58437 68212041 A  ERROR'
2018-11-15 18:56:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 18:56:52 [DEBUG   ] spawn_process: at 2018-11-15 18:56:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 18:56:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 18:56:52 [DEBUG   ] spawn_process: at 2018-11-15 18:56:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 18:56:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 18:56:52 [DEBUG   ] spawn_process: at 2018-11-15 18:56:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 18:56:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 18:56:52 [DEBUG   ] spawn_process: at 2018-11-15 18:56:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 18:56:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 18:56:52 [DEBUG   ] spawn_process: at 2018-11-15 18:56:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 18:56:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 18:56:52 [DEBUG   ] spawn_process: at 2018-11-15 18:56:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 18:56:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 18:56:52 [DEBUG   ] spawn_process: at 2018-11-15 18:56:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 18:56:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 18:56:52 [DEBUG   ] spawn_process: at 2018-11-15 18:56:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 18:56:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 18:56:52 [DEBUG   ] spawn_process: at 2018-11-15 18:56:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 18:56:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 18:56:52 [DEBUG   ] spawn_process: at 2018-11-15 18:56:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 18:56:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 18:56:52 [DEBUG   ] spawn_process: at 2018-11-15 18:56:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 18:56:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 18:56:52 [DEBUG   ] spawn_process: at 2018-11-15 18:56:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 18:56:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 18:56:52 [DEBUG   ] spawn_process: at 2018-11-15 18:56:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 18:56:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 18:56:52 [DEBUG   ] spawn_process: at 2018-11-15 18:56:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 18:56:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 18:56:52 [DEBUG   ] spawn_process: at 2018-11-15 18:56:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 18:56:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 18:56:52 [DEBUG   ] spawn_process: at 2018-11-15 18:56:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 18:56:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 18:56:52 [DEBUG   ] spawn_process: at 2018-11-15 18:56:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 18:56:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 18:56:52 [DEBUG   ] spawn_process: at 2018-11-15 18:56:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 18:56:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 18:56:52 [DEBUG   ] spawn_process: at 2018-11-15 18:56:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 18:56:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 18:56:52 [DEBUG   ] spawn_process: at 2018-11-15 18:56:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 18:56:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 18:56:52 [DEBUG   ] spawn_process: at 2018-11-15 18:56:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 18:56:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 18:56:52 [DEBUG   ] spawn_process: at 2018-11-15 18:56:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 18:56:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 18:56:52 [DEBUG   ] spawn_process: at 2018-11-15 18:56:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 18:56:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 18:56:52 [DEBUG   ] spawn_process: at 2018-11-15 18:56:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 18:56:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 18:56:52 [DEBUG   ] spawn_process: at 2018-11-15 18:56:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 18:56:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 18:56:52 [DEBUG   ] spawn_process: at 2018-11-15 18:56:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 18:57:07 [DEBUG   ] Finished updating ant stats in 1.031 seconds
2018-11-15 18:57:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 18:57:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-15 18:57:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 18:57:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 18:57:08 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 18:57:08 [WARNING ] (13, 1, 'bot')
2018-11-15 18:57:08 [WARNING ] (13, 1, 'bot')
2018-11-15 18:57:08 [WARNING ] (13, 1, 'bot')
2018-11-15 18:57:08 [WARNING ] (13, 1, 'bot')
2018-11-15 18:57:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 18:57:08 [DEBUG   ] Finished updating board flags in 1.392 seconds
2018-11-15 18:57:24 [DEBUG   ] Got command BAM from MCS: ref #517690
2018-11-15 18:57:24 [INFO    ] Finished processing BAM request
2018-11-15 18:57:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 18:57:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517690   8 58437 68244025 A  ERROR'
2018-11-15 18:57:24 [DEBUG   ] Got command BAM from MCS: ref #517689
2018-11-15 18:57:24 [INFO    ] Finished processing BAM request
2018-11-15 18:57:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 18:57:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517689   8 58437 68244029 A  ERROR'
2018-11-15 18:57:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 18:57:24 [DEBUG   ] spawn_process: at 2018-11-15 18:57:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 18:57:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 18:57:24 [DEBUG   ] spawn_process: at 2018-11-15 18:57:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 18:57:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 18:57:24 [DEBUG   ] spawn_process: at 2018-11-15 18:57:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 18:57:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 18:57:24 [DEBUG   ] spawn_process: at 2018-11-15 18:57:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 18:57:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 18:57:24 [DEBUG   ] spawn_process: at 2018-11-15 18:57:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 18:57:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 18:57:24 [DEBUG   ] spawn_process: at 2018-11-15 18:57:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 18:57:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 18:57:24 [DEBUG   ] spawn_process: at 2018-11-15 18:57:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 18:57:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 18:57:24 [DEBUG   ] spawn_process: at 2018-11-15 18:57:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 18:57:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 18:57:24 [DEBUG   ] spawn_process: at 2018-11-15 18:57:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 18:57:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 18:57:24 [DEBUG   ] spawn_process: at 2018-11-15 18:57:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 18:57:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 18:57:24 [DEBUG   ] spawn_process: at 2018-11-15 18:57:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 18:57:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 18:57:24 [DEBUG   ] spawn_process: at 2018-11-15 18:57:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 18:57:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 18:57:24 [DEBUG   ] spawn_process: at 2018-11-15 18:57:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 18:57:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 18:57:24 [DEBUG   ] spawn_process: at 2018-11-15 18:57:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 18:57:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 18:57:24 [DEBUG   ] spawn_process: at 2018-11-15 18:57:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 18:57:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 18:57:24 [DEBUG   ] spawn_process: at 2018-11-15 18:57:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 18:57:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 18:57:24 [DEBUG   ] spawn_process: at 2018-11-15 18:57:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 18:57:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 18:57:24 [DEBUG   ] spawn_process: at 2018-11-15 18:57:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 18:57:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 18:57:24 [DEBUG   ] spawn_process: at 2018-11-15 18:57:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 18:57:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 18:57:24 [DEBUG   ] spawn_process: at 2018-11-15 18:57:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 18:57:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 18:57:24 [DEBUG   ] spawn_process: at 2018-11-15 18:57:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 18:57:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 18:57:24 [DEBUG   ] spawn_process: at 2018-11-15 18:57:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 18:57:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 18:57:24 [DEBUG   ] spawn_process: at 2018-11-15 18:57:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 18:57:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 18:57:24 [DEBUG   ] spawn_process: at 2018-11-15 18:57:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 18:57:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 18:57:24 [DEBUG   ] spawn_process: at 2018-11-15 18:57:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 18:57:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 18:57:24 [DEBUG   ] spawn_process: at 2018-11-15 18:57:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 18:57:27 [DEBUG   ] Finished updating ant stats in 0.975 seconds
2018-11-15 18:57:47 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 18:57:56 [DEBUG   ] Got command BAM from MCS: ref #517692
2018-11-15 18:57:56 [INFO    ] Finished processing BAM request
2018-11-15 18:57:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 18:57:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517692   8 58437 68276025 A  ERROR'
2018-11-15 18:57:56 [DEBUG   ] Got command BAM from MCS: ref #517691
2018-11-15 18:57:56 [INFO    ] Finished processing BAM request
2018-11-15 18:57:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 18:57:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517691   8 58437 68276033 A  ERROR'
2018-11-15 18:57:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 18:57:56 [DEBUG   ] spawn_process: at 2018-11-15 18:57:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 18:57:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 18:57:56 [DEBUG   ] spawn_process: at 2018-11-15 18:57:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 18:57:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 18:57:56 [DEBUG   ] spawn_process: at 2018-11-15 18:57:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 18:57:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 18:57:56 [DEBUG   ] spawn_process: at 2018-11-15 18:57:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 18:57:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 18:57:56 [DEBUG   ] spawn_process: at 2018-11-15 18:57:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 18:57:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 18:57:56 [DEBUG   ] spawn_process: at 2018-11-15 18:57:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 18:57:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 18:57:56 [DEBUG   ] spawn_process: at 2018-11-15 18:57:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 18:57:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 18:57:56 [DEBUG   ] spawn_process: at 2018-11-15 18:57:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 18:57:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 18:57:56 [DEBUG   ] spawn_process: at 2018-11-15 18:57:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 18:57:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 18:57:56 [DEBUG   ] spawn_process: at 2018-11-15 18:57:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 18:57:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 18:57:56 [DEBUG   ] spawn_process: at 2018-11-15 18:57:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 18:57:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 18:57:56 [DEBUG   ] spawn_process: at 2018-11-15 18:57:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 18:57:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 18:57:56 [DEBUG   ] spawn_process: at 2018-11-15 18:57:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 18:57:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 18:57:56 [DEBUG   ] spawn_process: at 2018-11-15 18:57:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 18:57:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 18:57:56 [DEBUG   ] spawn_process: at 2018-11-15 18:57:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 18:57:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 18:57:56 [DEBUG   ] spawn_process: at 2018-11-15 18:57:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 18:57:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 18:57:56 [DEBUG   ] spawn_process: at 2018-11-15 18:57:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 18:57:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 18:57:56 [DEBUG   ] spawn_process: at 2018-11-15 18:57:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 18:57:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 18:57:56 [DEBUG   ] spawn_process: at 2018-11-15 18:57:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 18:57:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 18:57:56 [DEBUG   ] spawn_process: at 2018-11-15 18:57:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 18:57:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 18:57:56 [DEBUG   ] spawn_process: at 2018-11-15 18:57:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 18:57:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 18:57:56 [DEBUG   ] spawn_process: at 2018-11-15 18:57:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 18:57:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 18:57:56 [DEBUG   ] spawn_process: at 2018-11-15 18:57:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 18:57:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 18:57:56 [DEBUG   ] spawn_process: at 2018-11-15 18:57:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 18:57:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 18:57:56 [DEBUG   ] spawn_process: at 2018-11-15 18:57:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 18:57:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 18:57:56 [DEBUG   ] spawn_process: at 2018-11-15 18:57:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 18:58:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 18:58:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 18:58:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 18:58:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 18:58:08 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-15 18:58:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 18:58:08 [WARNING ] (13, 1, 'bot')
2018-11-15 18:58:08 [WARNING ] (13, 1, 'bot')
2018-11-15 18:58:08 [WARNING ] (13, 1, 'bot')
2018-11-15 18:58:08 [WARNING ] (13, 1, 'bot')
2018-11-15 18:58:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 18:58:08 [DEBUG   ] Finished updating board flags in 1.226 seconds
2018-11-15 18:58:22 [DEBUG   ] Got command RPT from MCS: ref #517695
2018-11-15 18:58:22 [DEBUG   ] summary = ERROR
2018-11-15 18:58:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517695  13 58437 68302069 A  ERRORERROR'
2018-11-15 18:58:22 [DEBUG   ] Got command RPT from MCS: ref #517696
2018-11-15 18:58:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 18:58:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517696  77 58437 68302273 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 18:58:22 [DEBUG   ] Got command RPT from MCS: ref #517697
2018-11-15 18:58:22 [DEBUG   ] summary = ERROR
2018-11-15 18:58:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517697  13 58437 68302477 A  ERRORERROR'
2018-11-15 18:58:22 [DEBUG   ] Got command RPT from MCS: ref #517699
2018-11-15 18:58:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 18:58:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517699  77 58437 68302669 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 18:58:22 [DEBUG   ] Got command RPT from MCS: ref #517700
2018-11-15 18:58:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 18:58:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517700  12 58437 68302873 A  ERRORB¡ff'
2018-11-15 18:58:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 18:58:28 [DEBUG   ] Got command BAM from MCS: ref #517705
2018-11-15 18:58:28 [INFO    ] Finished processing BAM request
2018-11-15 18:58:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 18:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517705   8 58437 68308033 A  ERROR'
2018-11-15 18:58:28 [DEBUG   ] Got command BAM from MCS: ref #517706
2018-11-15 18:58:28 [INFO    ] Finished processing BAM request
2018-11-15 18:58:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 18:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517706   8 58437 68308037 A  ERROR'
2018-11-15 18:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 18:58:28 [DEBUG   ] spawn_process: at 2018-11-15 18:58:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 18:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 18:58:28 [DEBUG   ] spawn_process: at 2018-11-15 18:58:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 18:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 18:58:28 [DEBUG   ] spawn_process: at 2018-11-15 18:58:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 18:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 18:58:28 [DEBUG   ] spawn_process: at 2018-11-15 18:58:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 18:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 18:58:28 [DEBUG   ] spawn_process: at 2018-11-15 18:58:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 18:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 18:58:28 [DEBUG   ] spawn_process: at 2018-11-15 18:58:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 18:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 18:58:28 [DEBUG   ] spawn_process: at 2018-11-15 18:58:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 18:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 18:58:28 [DEBUG   ] spawn_process: at 2018-11-15 18:58:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 18:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 18:58:28 [DEBUG   ] spawn_process: at 2018-11-15 18:58:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 18:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 18:58:28 [DEBUG   ] spawn_process: at 2018-11-15 18:58:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 18:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 18:58:28 [DEBUG   ] spawn_process: at 2018-11-15 18:58:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 18:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 18:58:28 [DEBUG   ] spawn_process: at 2018-11-15 18:58:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 18:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 18:58:28 [DEBUG   ] spawn_process: at 2018-11-15 18:58:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 18:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 18:58:28 [DEBUG   ] spawn_process: at 2018-11-15 18:58:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 18:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 18:58:28 [DEBUG   ] spawn_process: at 2018-11-15 18:58:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 18:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 18:58:28 [DEBUG   ] spawn_process: at 2018-11-15 18:58:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 18:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 18:58:28 [DEBUG   ] spawn_process: at 2018-11-15 18:58:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 18:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 18:58:28 [DEBUG   ] spawn_process: at 2018-11-15 18:58:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 18:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 18:58:28 [DEBUG   ] spawn_process: at 2018-11-15 18:58:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 18:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 18:58:28 [DEBUG   ] spawn_process: at 2018-11-15 18:58:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 18:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 18:58:28 [DEBUG   ] spawn_process: at 2018-11-15 18:58:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 18:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 18:58:28 [DEBUG   ] spawn_process: at 2018-11-15 18:58:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 18:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 18:58:28 [DEBUG   ] spawn_process: at 2018-11-15 18:58:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 18:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 18:58:28 [DEBUG   ] spawn_process: at 2018-11-15 18:58:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 18:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 18:58:28 [DEBUG   ] spawn_process: at 2018-11-15 18:58:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 18:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 18:58:28 [DEBUG   ] spawn_process: at 2018-11-15 18:58:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 18:58:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 18:59:00 [DEBUG   ] Got command BAM from MCS: ref #517708
2018-11-15 18:59:00 [INFO    ] Finished processing BAM request
2018-11-15 18:59:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 18:59:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517708   8 58437 68340025 A  ERROR'
2018-11-15 18:59:00 [DEBUG   ] Got command BAM from MCS: ref #517707
2018-11-15 18:59:00 [INFO    ] Finished processing BAM request
2018-11-15 18:59:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 18:59:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517707   8 58437 68340029 A  ERROR'
2018-11-15 18:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 18:59:00 [DEBUG   ] spawn_process: at 2018-11-15 18:59:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 18:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 18:59:00 [DEBUG   ] spawn_process: at 2018-11-15 18:59:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 18:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 18:59:00 [DEBUG   ] spawn_process: at 2018-11-15 18:59:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 18:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 18:59:00 [DEBUG   ] spawn_process: at 2018-11-15 18:59:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 18:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 18:59:00 [DEBUG   ] spawn_process: at 2018-11-15 18:59:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 18:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 18:59:00 [DEBUG   ] spawn_process: at 2018-11-15 18:59:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 18:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 18:59:00 [DEBUG   ] spawn_process: at 2018-11-15 18:59:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 18:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 18:59:00 [DEBUG   ] spawn_process: at 2018-11-15 18:59:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 18:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 18:59:00 [DEBUG   ] spawn_process: at 2018-11-15 18:59:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 18:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 18:59:00 [DEBUG   ] spawn_process: at 2018-11-15 18:59:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 18:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 18:59:00 [DEBUG   ] spawn_process: at 2018-11-15 18:59:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 18:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 18:59:00 [DEBUG   ] spawn_process: at 2018-11-15 18:59:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 18:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 18:59:00 [DEBUG   ] spawn_process: at 2018-11-15 18:59:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 18:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 18:59:00 [DEBUG   ] spawn_process: at 2018-11-15 18:59:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 18:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 18:59:00 [DEBUG   ] spawn_process: at 2018-11-15 18:59:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 18:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 18:59:00 [DEBUG   ] spawn_process: at 2018-11-15 18:59:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 18:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 18:59:00 [DEBUG   ] spawn_process: at 2018-11-15 18:59:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 18:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 18:59:00 [DEBUG   ] spawn_process: at 2018-11-15 18:59:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 18:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 18:59:00 [DEBUG   ] spawn_process: at 2018-11-15 18:59:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 18:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 18:59:00 [DEBUG   ] spawn_process: at 2018-11-15 18:59:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 18:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 18:59:00 [DEBUG   ] spawn_process: at 2018-11-15 18:59:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 18:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 18:59:00 [DEBUG   ] spawn_process: at 2018-11-15 18:59:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 18:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 18:59:00 [DEBUG   ] spawn_process: at 2018-11-15 18:59:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 18:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 18:59:00 [DEBUG   ] spawn_process: at 2018-11-15 18:59:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 18:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 18:59:00 [DEBUG   ] spawn_process: at 2018-11-15 18:59:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 18:59:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 18:59:00 [DEBUG   ] spawn_process: at 2018-11-15 18:59:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 18:59:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 18:59:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 18:59:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-11-15 18:59:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 18:59:08 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 18:59:08 [WARNING ] (13, 1, 'bot')
2018-11-15 18:59:08 [WARNING ] (13, 1, 'bot')
2018-11-15 18:59:08 [WARNING ] (13, 1, 'bot')
2018-11-15 18:59:08 [WARNING ] (13, 1, 'bot')
2018-11-15 18:59:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 18:59:08 [DEBUG   ] Finished updating board flags in 1.176 seconds
2018-11-15 18:59:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 18:59:32 [DEBUG   ] Got command BAM from MCS: ref #517713
2018-11-15 18:59:32 [INFO    ] Finished processing BAM request
2018-11-15 18:59:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 18:59:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517713   8 58437 68372029 A  ERROR'
2018-11-15 18:59:32 [DEBUG   ] Got command BAM from MCS: ref #517714
2018-11-15 18:59:32 [INFO    ] Finished processing BAM request
2018-11-15 18:59:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 18:59:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517714   8 58437 68372033 A  ERROR'
2018-11-15 18:59:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 18:59:32 [DEBUG   ] spawn_process: at 2018-11-15 18:59:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 18:59:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 18:59:32 [DEBUG   ] spawn_process: at 2018-11-15 18:59:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 18:59:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 18:59:32 [DEBUG   ] spawn_process: at 2018-11-15 18:59:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 18:59:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 18:59:32 [DEBUG   ] spawn_process: at 2018-11-15 18:59:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 18:59:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 18:59:32 [DEBUG   ] spawn_process: at 2018-11-15 18:59:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 18:59:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 18:59:32 [DEBUG   ] spawn_process: at 2018-11-15 18:59:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 18:59:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 18:59:32 [DEBUG   ] spawn_process: at 2018-11-15 18:59:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 18:59:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 18:59:32 [DEBUG   ] spawn_process: at 2018-11-15 18:59:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 18:59:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 18:59:32 [DEBUG   ] spawn_process: at 2018-11-15 18:59:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 18:59:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 18:59:32 [DEBUG   ] spawn_process: at 2018-11-15 18:59:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 18:59:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 18:59:32 [DEBUG   ] spawn_process: at 2018-11-15 18:59:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 18:59:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 18:59:32 [DEBUG   ] spawn_process: at 2018-11-15 18:59:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 18:59:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 18:59:32 [DEBUG   ] spawn_process: at 2018-11-15 18:59:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 18:59:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 18:59:32 [DEBUG   ] spawn_process: at 2018-11-15 18:59:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 18:59:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 18:59:32 [DEBUG   ] spawn_process: at 2018-11-15 18:59:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 18:59:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 18:59:32 [DEBUG   ] spawn_process: at 2018-11-15 18:59:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 18:59:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 18:59:32 [DEBUG   ] spawn_process: at 2018-11-15 18:59:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 18:59:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 18:59:32 [DEBUG   ] spawn_process: at 2018-11-15 18:59:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 18:59:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 18:59:32 [DEBUG   ] spawn_process: at 2018-11-15 18:59:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 18:59:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 18:59:32 [DEBUG   ] spawn_process: at 2018-11-15 18:59:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 18:59:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 18:59:32 [DEBUG   ] spawn_process: at 2018-11-15 18:59:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 18:59:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 18:59:32 [DEBUG   ] spawn_process: at 2018-11-15 18:59:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 18:59:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 18:59:32 [DEBUG   ] spawn_process: at 2018-11-15 18:59:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 18:59:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 18:59:32 [DEBUG   ] spawn_process: at 2018-11-15 18:59:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 18:59:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 18:59:32 [DEBUG   ] spawn_process: at 2018-11-15 18:59:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 18:59:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 18:59:32 [DEBUG   ] spawn_process: at 2018-11-15 18:59:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 18:59:47 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 19:00:04 [DEBUG   ] Got command BAM from MCS: ref #517716
2018-11-15 19:00:04 [INFO    ] Finished processing BAM request
2018-11-15 19:00:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:00:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517716   8 58437 68404029 A  ERROR'
2018-11-15 19:00:04 [DEBUG   ] Got command BAM from MCS: ref #517715
2018-11-15 19:00:04 [INFO    ] Finished processing BAM request
2018-11-15 19:00:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:00:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517715   8 58437 68404033 A  ERROR'
2018-11-15 19:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 19:00:04 [DEBUG   ] spawn_process: at 2018-11-15 19:00:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 19:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 19:00:04 [DEBUG   ] spawn_process: at 2018-11-15 19:00:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 19:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 19:00:04 [DEBUG   ] spawn_process: at 2018-11-15 19:00:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 19:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 19:00:04 [DEBUG   ] spawn_process: at 2018-11-15 19:00:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 19:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 19:00:04 [DEBUG   ] spawn_process: at 2018-11-15 19:00:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 19:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 19:00:04 [DEBUG   ] spawn_process: at 2018-11-15 19:00:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 19:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 19:00:04 [DEBUG   ] spawn_process: at 2018-11-15 19:00:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 19:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 19:00:04 [DEBUG   ] spawn_process: at 2018-11-15 19:00:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 19:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 19:00:04 [DEBUG   ] spawn_process: at 2018-11-15 19:00:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 19:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 19:00:04 [DEBUG   ] spawn_process: at 2018-11-15 19:00:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 19:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 19:00:04 [DEBUG   ] spawn_process: at 2018-11-15 19:00:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 19:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 19:00:04 [DEBUG   ] spawn_process: at 2018-11-15 19:00:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 19:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 19:00:04 [DEBUG   ] spawn_process: at 2018-11-15 19:00:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 19:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 19:00:04 [DEBUG   ] spawn_process: at 2018-11-15 19:00:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 19:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 19:00:04 [DEBUG   ] spawn_process: at 2018-11-15 19:00:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 19:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 19:00:04 [DEBUG   ] spawn_process: at 2018-11-15 19:00:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 19:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 19:00:04 [DEBUG   ] spawn_process: at 2018-11-15 19:00:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 19:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 19:00:04 [DEBUG   ] spawn_process: at 2018-11-15 19:00:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 19:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 19:00:04 [DEBUG   ] spawn_process: at 2018-11-15 19:00:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 19:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 19:00:04 [DEBUG   ] spawn_process: at 2018-11-15 19:00:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 19:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 19:00:04 [DEBUG   ] spawn_process: at 2018-11-15 19:00:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 19:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 19:00:04 [DEBUG   ] spawn_process: at 2018-11-15 19:00:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 19:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 19:00:04 [DEBUG   ] spawn_process: at 2018-11-15 19:00:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 19:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 19:00:04 [DEBUG   ] spawn_process: at 2018-11-15 19:00:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 19:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 19:00:04 [DEBUG   ] spawn_process: at 2018-11-15 19:00:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 19:00:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 19:00:04 [DEBUG   ] spawn_process: at 2018-11-15 19:00:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 19:00:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 19:00:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 19:00:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:00:08 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-15 19:00:08 [WARNING ] (13, 1, 'bot')
2018-11-15 19:00:08 [WARNING ] (13, 1, 'bot')
2018-11-15 19:00:08 [WARNING ] (13, 1, 'bot')
2018-11-15 19:00:08 [WARNING ] (13, 1, 'bot')
2018-11-15 19:00:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:00:08 [DEBUG   ] Finished updating board flags in 1.010 seconds
2018-11-15 19:00:27 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-15 19:00:36 [DEBUG   ] Got command BAM from MCS: ref #517717
2018-11-15 19:00:36 [INFO    ] Finished processing BAM request
2018-11-15 19:00:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:00:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517717   8 58437 68436029 A  ERROR'
2018-11-15 19:00:36 [DEBUG   ] Got command BAM from MCS: ref #517718
2018-11-15 19:00:36 [INFO    ] Finished processing BAM request
2018-11-15 19:00:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:00:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517718   8 58437 68436033 A  ERROR'
2018-11-15 19:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 19:00:36 [DEBUG   ] spawn_process: at 2018-11-15 19:00:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 19:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 19:00:36 [DEBUG   ] spawn_process: at 2018-11-15 19:00:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 19:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 19:00:36 [DEBUG   ] spawn_process: at 2018-11-15 19:00:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 19:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 19:00:36 [DEBUG   ] spawn_process: at 2018-11-15 19:00:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 19:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 19:00:36 [DEBUG   ] spawn_process: at 2018-11-15 19:00:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 19:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 19:00:36 [DEBUG   ] spawn_process: at 2018-11-15 19:00:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 19:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 19:00:36 [DEBUG   ] spawn_process: at 2018-11-15 19:00:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 19:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 19:00:36 [DEBUG   ] spawn_process: at 2018-11-15 19:00:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 19:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 19:00:36 [DEBUG   ] spawn_process: at 2018-11-15 19:00:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 19:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 19:00:36 [DEBUG   ] spawn_process: at 2018-11-15 19:00:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 19:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 19:00:36 [DEBUG   ] spawn_process: at 2018-11-15 19:00:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 19:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 19:00:36 [DEBUG   ] spawn_process: at 2018-11-15 19:00:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 19:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 19:00:36 [DEBUG   ] spawn_process: at 2018-11-15 19:00:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 19:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 19:00:36 [DEBUG   ] spawn_process: at 2018-11-15 19:00:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 19:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 19:00:36 [DEBUG   ] spawn_process: at 2018-11-15 19:00:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 19:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 19:00:36 [DEBUG   ] spawn_process: at 2018-11-15 19:00:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 19:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 19:00:36 [DEBUG   ] spawn_process: at 2018-11-15 19:00:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 19:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 19:00:36 [DEBUG   ] spawn_process: at 2018-11-15 19:00:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 19:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 19:00:36 [DEBUG   ] spawn_process: at 2018-11-15 19:00:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 19:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 19:00:36 [DEBUG   ] spawn_process: at 2018-11-15 19:00:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 19:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 19:00:36 [DEBUG   ] spawn_process: at 2018-11-15 19:00:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 19:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 19:00:36 [DEBUG   ] spawn_process: at 2018-11-15 19:00:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 19:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 19:00:36 [DEBUG   ] spawn_process: at 2018-11-15 19:00:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 19:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 19:00:36 [DEBUG   ] spawn_process: at 2018-11-15 19:00:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 19:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 19:00:36 [DEBUG   ] spawn_process: at 2018-11-15 19:00:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 19:00:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 19:00:36 [DEBUG   ] spawn_process: at 2018-11-15 19:00:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 19:00:45 [DEBUG   ] Got command RPT from MCS: ref #517719
2018-11-15 19:00:45 [DEBUG   ] summary = ERROR
2018-11-15 19:00:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517719  13 58437 68445169 A  ERRORERROR'
2018-11-15 19:00:45 [DEBUG   ] Got command RPT from MCS: ref #517720
2018-11-15 19:00:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 19:00:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517720  77 58437 68445170 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 19:00:47 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 19:01:07 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 19:01:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 19:01:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-15 19:01:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:01:08 [DEBUG   ] Got command BAM from MCS: ref #517737
2018-11-15 19:01:08 [INFO    ] Finished processing BAM request
2018-11-15 19:01:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:01:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517737   8 58437 68468037 A  ERROR'
2018-11-15 19:01:08 [DEBUG   ] Got command BAM from MCS: ref #517736
2018-11-15 19:01:08 [INFO    ] Finished processing BAM request
2018-11-15 19:01:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:01:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517736   8 58437 68468045 A  ERROR'
2018-11-15 19:01:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 19:01:08 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-15 19:01:08 [WARNING ] (13, 1, 'bot')
2018-11-15 19:01:08 [WARNING ] (13, 1, 'bot')
2018-11-15 19:01:08 [WARNING ] (13, 1, 'bot')
2018-11-15 19:01:08 [WARNING ] (13, 1, 'bot')
2018-11-15 19:01:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:01:08 [DEBUG   ] Finished updating board flags in 1.008 seconds
2018-11-15 19:01:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 19:01:08 [DEBUG   ] spawn_process: at 2018-11-15 19:01:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 19:01:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 19:01:08 [DEBUG   ] spawn_process: at 2018-11-15 19:01:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 19:01:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 19:01:08 [DEBUG   ] spawn_process: at 2018-11-15 19:01:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 19:01:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 19:01:08 [DEBUG   ] spawn_process: at 2018-11-15 19:01:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 19:01:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 19:01:08 [DEBUG   ] spawn_process: at 2018-11-15 19:01:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 19:01:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 19:01:08 [DEBUG   ] spawn_process: at 2018-11-15 19:01:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 19:01:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 19:01:08 [DEBUG   ] spawn_process: at 2018-11-15 19:01:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 19:01:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 19:01:08 [DEBUG   ] spawn_process: at 2018-11-15 19:01:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 19:01:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 19:01:08 [DEBUG   ] spawn_process: at 2018-11-15 19:01:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 19:01:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 19:01:08 [DEBUG   ] spawn_process: at 2018-11-15 19:01:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 19:01:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 19:01:08 [DEBUG   ] spawn_process: at 2018-11-15 19:01:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 19:01:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 19:01:08 [DEBUG   ] spawn_process: at 2018-11-15 19:01:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 19:01:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 19:01:08 [DEBUG   ] spawn_process: at 2018-11-15 19:01:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 19:01:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 19:01:08 [DEBUG   ] spawn_process: at 2018-11-15 19:01:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 19:01:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 19:01:08 [DEBUG   ] spawn_process: at 2018-11-15 19:01:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 19:01:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 19:01:08 [DEBUG   ] spawn_process: at 2018-11-15 19:01:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 19:01:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 19:01:08 [DEBUG   ] spawn_process: at 2018-11-15 19:01:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 19:01:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 19:01:08 [DEBUG   ] spawn_process: at 2018-11-15 19:01:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 19:01:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 19:01:08 [DEBUG   ] spawn_process: at 2018-11-15 19:01:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 19:01:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 19:01:08 [DEBUG   ] spawn_process: at 2018-11-15 19:01:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 19:01:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 19:01:08 [DEBUG   ] spawn_process: at 2018-11-15 19:01:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 19:01:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 19:01:08 [DEBUG   ] spawn_process: at 2018-11-15 19:01:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 19:01:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 19:01:08 [DEBUG   ] spawn_process: at 2018-11-15 19:01:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 19:01:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 19:01:08 [DEBUG   ] spawn_process: at 2018-11-15 19:01:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 19:01:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 19:01:08 [DEBUG   ] spawn_process: at 2018-11-15 19:01:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 19:01:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 19:01:08 [DEBUG   ] spawn_process: at 2018-11-15 19:01:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 19:01:27 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-15 19:01:40 [DEBUG   ] Got command BAM from MCS: ref #517739
2018-11-15 19:01:40 [INFO    ] Finished processing BAM request
2018-11-15 19:01:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:01:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517739   8 58437 68500029 A  ERROR'
2018-11-15 19:01:40 [DEBUG   ] Got command BAM from MCS: ref #517738
2018-11-15 19:01:40 [INFO    ] Finished processing BAM request
2018-11-15 19:01:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:01:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517738   8 58437 68500033 A  ERROR'
2018-11-15 19:01:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 19:01:40 [DEBUG   ] spawn_process: at 2018-11-15 19:01:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 19:01:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 19:01:40 [DEBUG   ] spawn_process: at 2018-11-15 19:01:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 19:01:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 19:01:40 [DEBUG   ] spawn_process: at 2018-11-15 19:01:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 19:01:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 19:01:40 [DEBUG   ] spawn_process: at 2018-11-15 19:01:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 19:01:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 19:01:40 [DEBUG   ] spawn_process: at 2018-11-15 19:01:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 19:01:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 19:01:40 [DEBUG   ] spawn_process: at 2018-11-15 19:01:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 19:01:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 19:01:40 [DEBUG   ] spawn_process: at 2018-11-15 19:01:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 19:01:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 19:01:40 [DEBUG   ] spawn_process: at 2018-11-15 19:01:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 19:01:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 19:01:40 [DEBUG   ] spawn_process: at 2018-11-15 19:01:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 19:01:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 19:01:40 [DEBUG   ] spawn_process: at 2018-11-15 19:01:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 19:01:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 19:01:40 [DEBUG   ] spawn_process: at 2018-11-15 19:01:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 19:01:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 19:01:40 [DEBUG   ] spawn_process: at 2018-11-15 19:01:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 19:01:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 19:01:40 [DEBUG   ] spawn_process: at 2018-11-15 19:01:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 19:01:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 19:01:40 [DEBUG   ] spawn_process: at 2018-11-15 19:01:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 19:01:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 19:01:40 [DEBUG   ] spawn_process: at 2018-11-15 19:01:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 19:01:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 19:01:40 [DEBUG   ] spawn_process: at 2018-11-15 19:01:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 19:01:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 19:01:40 [DEBUG   ] spawn_process: at 2018-11-15 19:01:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 19:01:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 19:01:40 [DEBUG   ] spawn_process: at 2018-11-15 19:01:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 19:01:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 19:01:40 [DEBUG   ] spawn_process: at 2018-11-15 19:01:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 19:01:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 19:01:40 [DEBUG   ] spawn_process: at 2018-11-15 19:01:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 19:01:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 19:01:40 [DEBUG   ] spawn_process: at 2018-11-15 19:01:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 19:01:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 19:01:40 [DEBUG   ] spawn_process: at 2018-11-15 19:01:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 19:01:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 19:01:40 [DEBUG   ] spawn_process: at 2018-11-15 19:01:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 19:01:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 19:01:40 [DEBUG   ] spawn_process: at 2018-11-15 19:01:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 19:01:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 19:01:40 [DEBUG   ] spawn_process: at 2018-11-15 19:01:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 19:01:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 19:01:40 [DEBUG   ] spawn_process: at 2018-11-15 19:01:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 19:01:47 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 19:02:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 19:02:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:02:08 [DEBUG   ] Finished updating ant stats in 1.430 seconds
2018-11-15 19:02:08 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-11-15 19:02:08 [WARNING ] (13, 1, 'bot')
2018-11-15 19:02:08 [WARNING ] (13, 1, 'bot')
2018-11-15 19:02:08 [WARNING ] (13, 1, 'bot')
2018-11-15 19:02:08 [WARNING ] (13, 1, 'bot')
2018-11-15 19:02:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:02:08 [DEBUG   ] Finished updating board flags in 1.058 seconds
2018-11-15 19:02:12 [DEBUG   ] Got command BAM from MCS: ref #517741
2018-11-15 19:02:12 [INFO    ] Finished processing BAM request
2018-11-15 19:02:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:02:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517741   8 58437 68532025 A  ERROR'
2018-11-15 19:02:12 [DEBUG   ] Got command BAM from MCS: ref #517740
2018-11-15 19:02:12 [INFO    ] Finished processing BAM request
2018-11-15 19:02:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:02:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517740   8 58437 68532029 A  ERROR'
2018-11-15 19:02:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 19:02:12 [DEBUG   ] spawn_process: at 2018-11-15 19:02:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 19:02:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 19:02:12 [DEBUG   ] spawn_process: at 2018-11-15 19:02:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 19:02:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 19:02:12 [DEBUG   ] spawn_process: at 2018-11-15 19:02:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 19:02:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 19:02:12 [DEBUG   ] spawn_process: at 2018-11-15 19:02:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 19:02:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 19:02:12 [DEBUG   ] spawn_process: at 2018-11-15 19:02:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 19:02:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 19:02:12 [DEBUG   ] spawn_process: at 2018-11-15 19:02:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 19:02:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 19:02:12 [DEBUG   ] spawn_process: at 2018-11-15 19:02:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 19:02:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 19:02:12 [DEBUG   ] spawn_process: at 2018-11-15 19:02:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 19:02:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 19:02:12 [DEBUG   ] spawn_process: at 2018-11-15 19:02:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 19:02:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 19:02:12 [DEBUG   ] spawn_process: at 2018-11-15 19:02:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 19:02:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 19:02:12 [DEBUG   ] spawn_process: at 2018-11-15 19:02:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 19:02:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 19:02:12 [DEBUG   ] spawn_process: at 2018-11-15 19:02:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 19:02:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 19:02:12 [DEBUG   ] spawn_process: at 2018-11-15 19:02:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 19:02:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 19:02:12 [DEBUG   ] spawn_process: at 2018-11-15 19:02:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 19:02:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 19:02:12 [DEBUG   ] spawn_process: at 2018-11-15 19:02:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 19:02:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 19:02:12 [DEBUG   ] spawn_process: at 2018-11-15 19:02:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 19:02:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 19:02:12 [DEBUG   ] spawn_process: at 2018-11-15 19:02:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 19:02:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 19:02:12 [DEBUG   ] spawn_process: at 2018-11-15 19:02:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 19:02:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 19:02:12 [DEBUG   ] spawn_process: at 2018-11-15 19:02:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 19:02:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 19:02:12 [DEBUG   ] spawn_process: at 2018-11-15 19:02:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 19:02:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 19:02:12 [DEBUG   ] spawn_process: at 2018-11-15 19:02:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 19:02:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 19:02:12 [DEBUG   ] spawn_process: at 2018-11-15 19:02:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 19:02:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 19:02:12 [DEBUG   ] spawn_process: at 2018-11-15 19:02:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 19:02:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 19:02:12 [DEBUG   ] spawn_process: at 2018-11-15 19:02:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 19:02:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 19:02:12 [DEBUG   ] spawn_process: at 2018-11-15 19:02:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 19:02:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 19:02:12 [DEBUG   ] spawn_process: at 2018-11-15 19:02:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 19:02:27 [DEBUG   ] Finished updating ant stats in 0.374 seconds
2018-11-15 19:02:44 [DEBUG   ] Got command BAM from MCS: ref #517747
2018-11-15 19:02:44 [INFO    ] Finished processing BAM request
2018-11-15 19:02:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:02:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517747   8 58437 68564029 A  ERROR'
2018-11-15 19:02:44 [DEBUG   ] Got command BAM from MCS: ref #517746
2018-11-15 19:02:44 [INFO    ] Finished processing BAM request
2018-11-15 19:02:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:02:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517746   8 58437 68564033 A  ERROR'
2018-11-15 19:02:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 19:02:44 [DEBUG   ] spawn_process: at 2018-11-15 19:02:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 19:02:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 19:02:44 [DEBUG   ] spawn_process: at 2018-11-15 19:02:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 19:02:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 19:02:44 [DEBUG   ] spawn_process: at 2018-11-15 19:02:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 19:02:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 19:02:44 [DEBUG   ] spawn_process: at 2018-11-15 19:02:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 19:02:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 19:02:44 [DEBUG   ] spawn_process: at 2018-11-15 19:02:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 19:02:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 19:02:44 [DEBUG   ] spawn_process: at 2018-11-15 19:02:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 19:02:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 19:02:44 [DEBUG   ] spawn_process: at 2018-11-15 19:02:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 19:02:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 19:02:44 [DEBUG   ] spawn_process: at 2018-11-15 19:02:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 19:02:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 19:02:44 [DEBUG   ] spawn_process: at 2018-11-15 19:02:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 19:02:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 19:02:44 [DEBUG   ] spawn_process: at 2018-11-15 19:02:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 19:02:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 19:02:44 [DEBUG   ] spawn_process: at 2018-11-15 19:02:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 19:02:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 19:02:44 [DEBUG   ] spawn_process: at 2018-11-15 19:02:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 19:02:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 19:02:44 [DEBUG   ] spawn_process: at 2018-11-15 19:02:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 19:02:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 19:02:44 [DEBUG   ] spawn_process: at 2018-11-15 19:02:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 19:02:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 19:02:44 [DEBUG   ] spawn_process: at 2018-11-15 19:02:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 19:02:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 19:02:44 [DEBUG   ] spawn_process: at 2018-11-15 19:02:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 19:02:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 19:02:44 [DEBUG   ] spawn_process: at 2018-11-15 19:02:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 19:02:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 19:02:44 [DEBUG   ] spawn_process: at 2018-11-15 19:02:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 19:02:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 19:02:44 [DEBUG   ] spawn_process: at 2018-11-15 19:02:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 19:02:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 19:02:44 [DEBUG   ] spawn_process: at 2018-11-15 19:02:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 19:02:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 19:02:44 [DEBUG   ] spawn_process: at 2018-11-15 19:02:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 19:02:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 19:02:44 [DEBUG   ] spawn_process: at 2018-11-15 19:02:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 19:02:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 19:02:44 [DEBUG   ] spawn_process: at 2018-11-15 19:02:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 19:02:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 19:02:44 [DEBUG   ] spawn_process: at 2018-11-15 19:02:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 19:02:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 19:02:44 [DEBUG   ] spawn_process: at 2018-11-15 19:02:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 19:02:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 19:02:44 [DEBUG   ] spawn_process: at 2018-11-15 19:02:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 19:02:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 19:03:08 [DEBUG   ] Finished updating ant stats in 1.234 seconds
2018-11-15 19:03:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-15 19:03:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:03:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 19:03:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-15 19:03:09 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 19:03:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:03:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:03:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:03:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:03:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:03:09 [DEBUG   ] Finished updating board flags in 2.014 seconds
2018-11-15 19:03:16 [DEBUG   ] Got command BAM from MCS: ref #517749
2018-11-15 19:03:16 [INFO    ] Finished processing BAM request
2018-11-15 19:03:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:03:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517749   8 58437 68596033 A  ERROR'
2018-11-15 19:03:16 [DEBUG   ] Got command BAM from MCS: ref #517748
2018-11-15 19:03:16 [INFO    ] Finished processing BAM request
2018-11-15 19:03:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:03:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517748   8 58437 68596037 A  ERROR'
2018-11-15 19:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 19:03:16 [DEBUG   ] spawn_process: at 2018-11-15 19:03:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 19:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 19:03:16 [DEBUG   ] spawn_process: at 2018-11-15 19:03:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 19:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 19:03:16 [DEBUG   ] spawn_process: at 2018-11-15 19:03:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 19:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 19:03:16 [DEBUG   ] spawn_process: at 2018-11-15 19:03:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 19:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 19:03:16 [DEBUG   ] spawn_process: at 2018-11-15 19:03:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 19:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 19:03:16 [DEBUG   ] spawn_process: at 2018-11-15 19:03:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 19:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 19:03:16 [DEBUG   ] spawn_process: at 2018-11-15 19:03:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 19:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 19:03:16 [DEBUG   ] spawn_process: at 2018-11-15 19:03:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 19:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 19:03:16 [DEBUG   ] spawn_process: at 2018-11-15 19:03:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 19:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 19:03:16 [DEBUG   ] spawn_process: at 2018-11-15 19:03:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 19:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 19:03:16 [DEBUG   ] spawn_process: at 2018-11-15 19:03:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 19:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 19:03:16 [DEBUG   ] spawn_process: at 2018-11-15 19:03:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 19:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 19:03:16 [DEBUG   ] spawn_process: at 2018-11-15 19:03:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 19:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 19:03:16 [DEBUG   ] spawn_process: at 2018-11-15 19:03:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 19:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 19:03:16 [DEBUG   ] spawn_process: at 2018-11-15 19:03:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 19:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 19:03:16 [DEBUG   ] spawn_process: at 2018-11-15 19:03:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 19:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 19:03:16 [DEBUG   ] spawn_process: at 2018-11-15 19:03:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 19:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 19:03:16 [DEBUG   ] spawn_process: at 2018-11-15 19:03:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 19:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 19:03:16 [DEBUG   ] spawn_process: at 2018-11-15 19:03:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 19:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 19:03:16 [DEBUG   ] spawn_process: at 2018-11-15 19:03:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 19:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 19:03:16 [DEBUG   ] spawn_process: at 2018-11-15 19:03:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 19:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 19:03:16 [DEBUG   ] spawn_process: at 2018-11-15 19:03:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 19:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 19:03:16 [DEBUG   ] spawn_process: at 2018-11-15 19:03:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 19:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 19:03:16 [DEBUG   ] spawn_process: at 2018-11-15 19:03:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 19:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 19:03:16 [DEBUG   ] spawn_process: at 2018-11-15 19:03:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 19:03:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 19:03:16 [DEBUG   ] spawn_process: at 2018-11-15 19:03:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 19:03:22 [DEBUG   ] Got command RPT from MCS: ref #517750
2018-11-15 19:03:22 [DEBUG   ] summary = ERROR
2018-11-15 19:03:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517750  13 58437 68602157 A  ERRORERROR'
2018-11-15 19:03:22 [DEBUG   ] Got command RPT from MCS: ref #517751
2018-11-15 19:03:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 19:03:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517751  77 58437 68602361 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 19:03:22 [DEBUG   ] Got command RPT from MCS: ref #517752
2018-11-15 19:03:22 [DEBUG   ] summary = ERROR
2018-11-15 19:03:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517752  13 58437 68602565 A  ERRORERROR'
2018-11-15 19:03:22 [DEBUG   ] Got command RPT from MCS: ref #517753
2018-11-15 19:03:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 19:03:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517753  77 58437 68602757 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 19:03:22 [DEBUG   ] Got command RPT from MCS: ref #517754
2018-11-15 19:03:22 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 19:03:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517754  12 58437 68602961 A  ERRORB¢ff'
2018-11-15 19:03:28 [DEBUG   ] Finished updating ant stats in 1.171 seconds
2018-11-15 19:03:48 [DEBUG   ] Got command BAM from MCS: ref #517756
2018-11-15 19:03:48 [INFO    ] Finished processing BAM request
2018-11-15 19:03:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:03:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517756   8 58437 68628025 A  ERROR'
2018-11-15 19:03:48 [DEBUG   ] Got command BAM from MCS: ref #517755
2018-11-15 19:03:48 [INFO    ] Finished processing BAM request
2018-11-15 19:03:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:03:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517755   8 58437 68628029 A  ERROR'
2018-11-15 19:03:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 19:03:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 19:03:48 [DEBUG   ] spawn_process: at 2018-11-15 19:03:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 19:03:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 19:03:48 [DEBUG   ] spawn_process: at 2018-11-15 19:03:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 19:03:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 19:03:48 [DEBUG   ] spawn_process: at 2018-11-15 19:03:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 19:03:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 19:03:48 [DEBUG   ] spawn_process: at 2018-11-15 19:03:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 19:03:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 19:03:48 [DEBUG   ] spawn_process: at 2018-11-15 19:03:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 19:03:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 19:03:48 [DEBUG   ] spawn_process: at 2018-11-15 19:03:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 19:03:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 19:03:48 [DEBUG   ] spawn_process: at 2018-11-15 19:03:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 19:03:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 19:03:48 [DEBUG   ] spawn_process: at 2018-11-15 19:03:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 19:03:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 19:03:48 [DEBUG   ] spawn_process: at 2018-11-15 19:03:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 19:03:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 19:03:48 [DEBUG   ] spawn_process: at 2018-11-15 19:03:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 19:03:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 19:03:48 [DEBUG   ] spawn_process: at 2018-11-15 19:03:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 19:03:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 19:03:48 [DEBUG   ] spawn_process: at 2018-11-15 19:03:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 19:03:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 19:03:48 [DEBUG   ] spawn_process: at 2018-11-15 19:03:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 19:03:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 19:03:48 [DEBUG   ] spawn_process: at 2018-11-15 19:03:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 19:03:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 19:03:48 [DEBUG   ] spawn_process: at 2018-11-15 19:03:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 19:03:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 19:03:48 [DEBUG   ] spawn_process: at 2018-11-15 19:03:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 19:03:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 19:03:48 [DEBUG   ] spawn_process: at 2018-11-15 19:03:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 19:03:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 19:03:48 [DEBUG   ] spawn_process: at 2018-11-15 19:03:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 19:03:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 19:03:48 [DEBUG   ] spawn_process: at 2018-11-15 19:03:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 19:03:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 19:03:48 [DEBUG   ] spawn_process: at 2018-11-15 19:03:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 19:03:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 19:03:48 [DEBUG   ] spawn_process: at 2018-11-15 19:03:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 19:03:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 19:03:48 [DEBUG   ] spawn_process: at 2018-11-15 19:03:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 19:03:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 19:03:48 [DEBUG   ] spawn_process: at 2018-11-15 19:03:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 19:03:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 19:03:48 [DEBUG   ] spawn_process: at 2018-11-15 19:03:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 19:03:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 19:03:48 [DEBUG   ] spawn_process: at 2018-11-15 19:03:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 19:03:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 19:03:48 [DEBUG   ] spawn_process: at 2018-11-15 19:03:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 19:04:08 [DEBUG   ] Finished updating ant stats in 1.031 seconds
2018-11-15 19:04:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 19:04:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:04:09 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 19:04:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 19:04:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 19:04:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:04:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:04:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:04:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:04:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:04:09 [DEBUG   ] Finished updating board flags in 1.968 seconds
2018-11-15 19:04:20 [DEBUG   ] Got command BAM from MCS: ref #517758
2018-11-15 19:04:20 [INFO    ] Finished processing BAM request
2018-11-15 19:04:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517758   8 58437 68660025 A  ERROR'
2018-11-15 19:04:20 [DEBUG   ] Got command BAM from MCS: ref #517757
2018-11-15 19:04:20 [INFO    ] Finished processing BAM request
2018-11-15 19:04:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:04:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517757   8 58437 68660029 A  ERROR'
2018-11-15 19:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 19:04:20 [DEBUG   ] spawn_process: at 2018-11-15 19:04:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 19:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 19:04:20 [DEBUG   ] spawn_process: at 2018-11-15 19:04:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 19:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 19:04:20 [DEBUG   ] spawn_process: at 2018-11-15 19:04:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 19:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 19:04:20 [DEBUG   ] spawn_process: at 2018-11-15 19:04:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 19:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 19:04:20 [DEBUG   ] spawn_process: at 2018-11-15 19:04:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 19:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 19:04:20 [DEBUG   ] spawn_process: at 2018-11-15 19:04:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 19:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 19:04:20 [DEBUG   ] spawn_process: at 2018-11-15 19:04:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 19:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 19:04:20 [DEBUG   ] spawn_process: at 2018-11-15 19:04:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 19:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 19:04:20 [DEBUG   ] spawn_process: at 2018-11-15 19:04:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 19:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 19:04:20 [DEBUG   ] spawn_process: at 2018-11-15 19:04:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 19:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 19:04:20 [DEBUG   ] spawn_process: at 2018-11-15 19:04:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 19:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 19:04:20 [DEBUG   ] spawn_process: at 2018-11-15 19:04:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 19:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 19:04:20 [DEBUG   ] spawn_process: at 2018-11-15 19:04:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 19:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 19:04:20 [DEBUG   ] spawn_process: at 2018-11-15 19:04:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 19:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 19:04:20 [DEBUG   ] spawn_process: at 2018-11-15 19:04:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 19:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 19:04:20 [DEBUG   ] spawn_process: at 2018-11-15 19:04:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 19:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 19:04:20 [DEBUG   ] spawn_process: at 2018-11-15 19:04:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 19:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 19:04:20 [DEBUG   ] spawn_process: at 2018-11-15 19:04:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 19:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 19:04:20 [DEBUG   ] spawn_process: at 2018-11-15 19:04:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 19:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 19:04:20 [DEBUG   ] spawn_process: at 2018-11-15 19:04:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 19:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 19:04:20 [DEBUG   ] spawn_process: at 2018-11-15 19:04:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 19:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 19:04:20 [DEBUG   ] spawn_process: at 2018-11-15 19:04:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 19:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 19:04:20 [DEBUG   ] spawn_process: at 2018-11-15 19:04:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 19:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 19:04:20 [DEBUG   ] spawn_process: at 2018-11-15 19:04:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 19:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 19:04:20 [DEBUG   ] spawn_process: at 2018-11-15 19:04:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 19:04:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 19:04:20 [DEBUG   ] spawn_process: at 2018-11-15 19:04:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 19:04:28 [DEBUG   ] Finished updating ant stats in 0.975 seconds
2018-11-15 19:04:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 19:04:52 [DEBUG   ] Got command BAM from MCS: ref #517760
2018-11-15 19:04:52 [INFO    ] Finished processing BAM request
2018-11-15 19:04:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:04:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517760   8 58437 68692029 A  ERROR'
2018-11-15 19:04:52 [DEBUG   ] Got command BAM from MCS: ref #517759
2018-11-15 19:04:52 [INFO    ] Finished processing BAM request
2018-11-15 19:04:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:04:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517759   8 58437 68692033 A  ERROR'
2018-11-15 19:04:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 19:04:52 [DEBUG   ] spawn_process: at 2018-11-15 19:04:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 19:04:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 19:04:52 [DEBUG   ] spawn_process: at 2018-11-15 19:04:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 19:04:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 19:04:52 [DEBUG   ] spawn_process: at 2018-11-15 19:04:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 19:04:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 19:04:52 [DEBUG   ] spawn_process: at 2018-11-15 19:04:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 19:04:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 19:04:52 [DEBUG   ] spawn_process: at 2018-11-15 19:04:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 19:04:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 19:04:52 [DEBUG   ] spawn_process: at 2018-11-15 19:04:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 19:04:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 19:04:52 [DEBUG   ] spawn_process: at 2018-11-15 19:04:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 19:04:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 19:04:52 [DEBUG   ] spawn_process: at 2018-11-15 19:04:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 19:04:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 19:04:52 [DEBUG   ] spawn_process: at 2018-11-15 19:04:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 19:04:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 19:04:52 [DEBUG   ] spawn_process: at 2018-11-15 19:04:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 19:04:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 19:04:52 [DEBUG   ] spawn_process: at 2018-11-15 19:04:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 19:04:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 19:04:52 [DEBUG   ] spawn_process: at 2018-11-15 19:04:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 19:04:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 19:04:52 [DEBUG   ] spawn_process: at 2018-11-15 19:04:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 19:04:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 19:04:52 [DEBUG   ] spawn_process: at 2018-11-15 19:04:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 19:04:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 19:04:52 [DEBUG   ] spawn_process: at 2018-11-15 19:04:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 19:04:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 19:04:52 [DEBUG   ] spawn_process: at 2018-11-15 19:04:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 19:04:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 19:04:52 [DEBUG   ] spawn_process: at 2018-11-15 19:04:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 19:04:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 19:04:52 [DEBUG   ] spawn_process: at 2018-11-15 19:04:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 19:04:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 19:04:52 [DEBUG   ] spawn_process: at 2018-11-15 19:04:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 19:04:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 19:04:52 [DEBUG   ] spawn_process: at 2018-11-15 19:04:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 19:04:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 19:04:52 [DEBUG   ] spawn_process: at 2018-11-15 19:04:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 19:04:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 19:04:52 [DEBUG   ] spawn_process: at 2018-11-15 19:04:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 19:04:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 19:04:52 [DEBUG   ] spawn_process: at 2018-11-15 19:04:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 19:04:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 19:04:52 [DEBUG   ] spawn_process: at 2018-11-15 19:04:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 19:04:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 19:04:52 [DEBUG   ] spawn_process: at 2018-11-15 19:04:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 19:04:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 19:04:52 [DEBUG   ] spawn_process: at 2018-11-15 19:04:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 19:05:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 19:05:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-11-15 19:05:08 [DEBUG   ] Finished updating ant stats in 0.829 seconds
2018-11-15 19:05:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:05:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-15 19:05:09 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 19:05:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:05:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:05:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:05:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:05:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:05:09 [DEBUG   ] Finished updating board flags in 1.807 seconds
2018-11-15 19:05:24 [DEBUG   ] Got command BAM from MCS: ref #517762
2018-11-15 19:05:24 [INFO    ] Finished processing BAM request
2018-11-15 19:05:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:05:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517762   8 58437 68724033 A  ERROR'
2018-11-15 19:05:24 [DEBUG   ] Got command BAM from MCS: ref #517761
2018-11-15 19:05:24 [INFO    ] Finished processing BAM request
2018-11-15 19:05:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:05:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517761   8 58437 68724037 A  ERROR'
2018-11-15 19:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 19:05:24 [DEBUG   ] spawn_process: at 2018-11-15 19:05:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 19:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 19:05:24 [DEBUG   ] spawn_process: at 2018-11-15 19:05:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 19:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 19:05:24 [DEBUG   ] spawn_process: at 2018-11-15 19:05:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 19:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 19:05:24 [DEBUG   ] spawn_process: at 2018-11-15 19:05:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 19:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 19:05:24 [DEBUG   ] spawn_process: at 2018-11-15 19:05:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 19:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 19:05:24 [DEBUG   ] spawn_process: at 2018-11-15 19:05:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 19:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 19:05:24 [DEBUG   ] spawn_process: at 2018-11-15 19:05:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 19:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 19:05:24 [DEBUG   ] spawn_process: at 2018-11-15 19:05:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 19:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 19:05:24 [DEBUG   ] spawn_process: at 2018-11-15 19:05:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 19:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 19:05:24 [DEBUG   ] spawn_process: at 2018-11-15 19:05:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 19:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 19:05:24 [DEBUG   ] spawn_process: at 2018-11-15 19:05:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 19:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 19:05:24 [DEBUG   ] spawn_process: at 2018-11-15 19:05:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 19:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 19:05:24 [DEBUG   ] spawn_process: at 2018-11-15 19:05:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 19:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 19:05:24 [DEBUG   ] spawn_process: at 2018-11-15 19:05:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 19:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 19:05:24 [DEBUG   ] spawn_process: at 2018-11-15 19:05:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 19:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 19:05:24 [DEBUG   ] spawn_process: at 2018-11-15 19:05:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 19:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 19:05:24 [DEBUG   ] spawn_process: at 2018-11-15 19:05:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 19:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 19:05:24 [DEBUG   ] spawn_process: at 2018-11-15 19:05:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 19:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 19:05:24 [DEBUG   ] spawn_process: at 2018-11-15 19:05:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 19:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 19:05:24 [DEBUG   ] spawn_process: at 2018-11-15 19:05:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 19:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 19:05:24 [DEBUG   ] spawn_process: at 2018-11-15 19:05:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 19:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 19:05:24 [DEBUG   ] spawn_process: at 2018-11-15 19:05:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 19:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 19:05:24 [DEBUG   ] spawn_process: at 2018-11-15 19:05:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 19:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 19:05:24 [DEBUG   ] spawn_process: at 2018-11-15 19:05:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 19:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 19:05:24 [DEBUG   ] spawn_process: at 2018-11-15 19:05:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 19:05:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 19:05:24 [DEBUG   ] spawn_process: at 2018-11-15 19:05:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 19:05:28 [DEBUG   ] Finished updating ant stats in 0.770 seconds
2018-11-15 19:05:45 [DEBUG   ] Got command RPT from MCS: ref #517767
2018-11-15 19:05:45 [DEBUG   ] summary = ERROR
2018-11-15 19:05:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517767  13 58437 68745177 A  ERRORERROR'
2018-11-15 19:05:45 [DEBUG   ] Got command RPT from MCS: ref #517768
2018-11-15 19:05:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 19:05:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517768  77 58437 68745178 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 19:05:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 19:05:56 [DEBUG   ] Got command BAM from MCS: ref #517785
2018-11-15 19:05:56 [INFO    ] Finished processing BAM request
2018-11-15 19:05:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:05:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517785   8 58437 68756029 A  ERROR'
2018-11-15 19:05:56 [DEBUG   ] Got command BAM from MCS: ref #517784
2018-11-15 19:05:56 [INFO    ] Finished processing BAM request
2018-11-15 19:05:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:05:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517784   8 58437 68756033 A  ERROR'
2018-11-15 19:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 19:05:56 [DEBUG   ] spawn_process: at 2018-11-15 19:05:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 19:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 19:05:56 [DEBUG   ] spawn_process: at 2018-11-15 19:05:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 19:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 19:05:56 [DEBUG   ] spawn_process: at 2018-11-15 19:05:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 19:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 19:05:56 [DEBUG   ] spawn_process: at 2018-11-15 19:05:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 19:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 19:05:56 [DEBUG   ] spawn_process: at 2018-11-15 19:05:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 19:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 19:05:56 [DEBUG   ] spawn_process: at 2018-11-15 19:05:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 19:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 19:05:56 [DEBUG   ] spawn_process: at 2018-11-15 19:05:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 19:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 19:05:56 [DEBUG   ] spawn_process: at 2018-11-15 19:05:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 19:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 19:05:56 [DEBUG   ] spawn_process: at 2018-11-15 19:05:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 19:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 19:05:56 [DEBUG   ] spawn_process: at 2018-11-15 19:05:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 19:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 19:05:56 [DEBUG   ] spawn_process: at 2018-11-15 19:05:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 19:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 19:05:56 [DEBUG   ] spawn_process: at 2018-11-15 19:05:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 19:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 19:05:56 [DEBUG   ] spawn_process: at 2018-11-15 19:05:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 19:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 19:05:56 [DEBUG   ] spawn_process: at 2018-11-15 19:05:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 19:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 19:05:56 [DEBUG   ] spawn_process: at 2018-11-15 19:05:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 19:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 19:05:56 [DEBUG   ] spawn_process: at 2018-11-15 19:05:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 19:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 19:05:56 [DEBUG   ] spawn_process: at 2018-11-15 19:05:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 19:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 19:05:56 [DEBUG   ] spawn_process: at 2018-11-15 19:05:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 19:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 19:05:56 [DEBUG   ] spawn_process: at 2018-11-15 19:05:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 19:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 19:05:56 [DEBUG   ] spawn_process: at 2018-11-15 19:05:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 19:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 19:05:56 [DEBUG   ] spawn_process: at 2018-11-15 19:05:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 19:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 19:05:56 [DEBUG   ] spawn_process: at 2018-11-15 19:05:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 19:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 19:05:56 [DEBUG   ] spawn_process: at 2018-11-15 19:05:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 19:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 19:05:56 [DEBUG   ] spawn_process: at 2018-11-15 19:05:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 19:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 19:05:56 [DEBUG   ] spawn_process: at 2018-11-15 19:05:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 19:05:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 19:05:56 [DEBUG   ] spawn_process: at 2018-11-15 19:05:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 19:06:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 19:06:08 [DEBUG   ] Finished updating ant stats in 0.631 seconds
2018-11-15 19:06:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 19:06:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:06:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-11-15 19:06:09 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 19:06:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:06:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:06:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:06:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:06:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:06:09 [DEBUG   ] Finished updating board flags in 1.749 seconds
2018-11-15 19:06:28 [DEBUG   ] Got command BAM from MCS: ref #517787
2018-11-15 19:06:28 [INFO    ] Finished processing BAM request
2018-11-15 19:06:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:06:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517787   8 58437 68788033 A  ERROR'
2018-11-15 19:06:28 [DEBUG   ] Got command BAM from MCS: ref #517786
2018-11-15 19:06:28 [INFO    ] Finished processing BAM request
2018-11-15 19:06:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:06:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517786   8 58437 68788037 A  ERROR'
2018-11-15 19:06:28 [DEBUG   ] Finished updating ant stats in 0.575 seconds
2018-11-15 19:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 19:06:28 [DEBUG   ] spawn_process: at 2018-11-15 19:06:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 19:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 19:06:28 [DEBUG   ] spawn_process: at 2018-11-15 19:06:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 19:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 19:06:28 [DEBUG   ] spawn_process: at 2018-11-15 19:06:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 19:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 19:06:28 [DEBUG   ] spawn_process: at 2018-11-15 19:06:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 19:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 19:06:28 [DEBUG   ] spawn_process: at 2018-11-15 19:06:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 19:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 19:06:28 [DEBUG   ] spawn_process: at 2018-11-15 19:06:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 19:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 19:06:28 [DEBUG   ] spawn_process: at 2018-11-15 19:06:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 19:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 19:06:28 [DEBUG   ] spawn_process: at 2018-11-15 19:06:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 19:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 19:06:28 [DEBUG   ] spawn_process: at 2018-11-15 19:06:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 19:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 19:06:28 [DEBUG   ] spawn_process: at 2018-11-15 19:06:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 19:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 19:06:28 [DEBUG   ] spawn_process: at 2018-11-15 19:06:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 19:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 19:06:28 [DEBUG   ] spawn_process: at 2018-11-15 19:06:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 19:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 19:06:28 [DEBUG   ] spawn_process: at 2018-11-15 19:06:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 19:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 19:06:28 [DEBUG   ] spawn_process: at 2018-11-15 19:06:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 19:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 19:06:28 [DEBUG   ] spawn_process: at 2018-11-15 19:06:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 19:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 19:06:28 [DEBUG   ] spawn_process: at 2018-11-15 19:06:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 19:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 19:06:28 [DEBUG   ] spawn_process: at 2018-11-15 19:06:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 19:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 19:06:28 [DEBUG   ] spawn_process: at 2018-11-15 19:06:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 19:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 19:06:28 [DEBUG   ] spawn_process: at 2018-11-15 19:06:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 19:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 19:06:28 [DEBUG   ] spawn_process: at 2018-11-15 19:06:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 19:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 19:06:28 [DEBUG   ] spawn_process: at 2018-11-15 19:06:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 19:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 19:06:28 [DEBUG   ] spawn_process: at 2018-11-15 19:06:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 19:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 19:06:28 [DEBUG   ] spawn_process: at 2018-11-15 19:06:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 19:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 19:06:28 [DEBUG   ] spawn_process: at 2018-11-15 19:06:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 19:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 19:06:28 [DEBUG   ] spawn_process: at 2018-11-15 19:06:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 19:06:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 19:06:28 [DEBUG   ] spawn_process: at 2018-11-15 19:06:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 19:06:48 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 19:07:00 [DEBUG   ] Got command BAM from MCS: ref #517789
2018-11-15 19:07:00 [INFO    ] Finished processing BAM request
2018-11-15 19:07:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:07:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517789   8 58437 68820029 A  ERROR'
2018-11-15 19:07:00 [DEBUG   ] Got command BAM from MCS: ref #517788
2018-11-15 19:07:00 [INFO    ] Finished processing BAM request
2018-11-15 19:07:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:07:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517788   8 58437 68820033 A  ERROR'
2018-11-15 19:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 19:07:00 [DEBUG   ] spawn_process: at 2018-11-15 19:07:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 19:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 19:07:00 [DEBUG   ] spawn_process: at 2018-11-15 19:07:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 19:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 19:07:00 [DEBUG   ] spawn_process: at 2018-11-15 19:07:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 19:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 19:07:00 [DEBUG   ] spawn_process: at 2018-11-15 19:07:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 19:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 19:07:00 [DEBUG   ] spawn_process: at 2018-11-15 19:07:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 19:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 19:07:00 [DEBUG   ] spawn_process: at 2018-11-15 19:07:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 19:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 19:07:00 [DEBUG   ] spawn_process: at 2018-11-15 19:07:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 19:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 19:07:00 [DEBUG   ] spawn_process: at 2018-11-15 19:07:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 19:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 19:07:00 [DEBUG   ] spawn_process: at 2018-11-15 19:07:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 19:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 19:07:00 [DEBUG   ] spawn_process: at 2018-11-15 19:07:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 19:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 19:07:00 [DEBUG   ] spawn_process: at 2018-11-15 19:07:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 19:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 19:07:00 [DEBUG   ] spawn_process: at 2018-11-15 19:07:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 19:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 19:07:00 [DEBUG   ] spawn_process: at 2018-11-15 19:07:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 19:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 19:07:00 [DEBUG   ] spawn_process: at 2018-11-15 19:07:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 19:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 19:07:00 [DEBUG   ] spawn_process: at 2018-11-15 19:07:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 19:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 19:07:00 [DEBUG   ] spawn_process: at 2018-11-15 19:07:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 19:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 19:07:00 [DEBUG   ] spawn_process: at 2018-11-15 19:07:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 19:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 19:07:00 [DEBUG   ] spawn_process: at 2018-11-15 19:07:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 19:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 19:07:00 [DEBUG   ] spawn_process: at 2018-11-15 19:07:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 19:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 19:07:00 [DEBUG   ] spawn_process: at 2018-11-15 19:07:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 19:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 19:07:00 [DEBUG   ] spawn_process: at 2018-11-15 19:07:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 19:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 19:07:00 [DEBUG   ] spawn_process: at 2018-11-15 19:07:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 19:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 19:07:00 [DEBUG   ] spawn_process: at 2018-11-15 19:07:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 19:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 19:07:00 [DEBUG   ] spawn_process: at 2018-11-15 19:07:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 19:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 19:07:00 [DEBUG   ] spawn_process: at 2018-11-15 19:07:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 19:07:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 19:07:00 [DEBUG   ] spawn_process: at 2018-11-15 19:07:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 19:07:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 19:07:08 [DEBUG   ] Finished updating ant stats in 0.432 seconds
2018-11-15 19:07:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 19:07:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:07:09 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 19:07:09 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-15 19:07:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:07:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:07:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:07:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:07:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:07:09 [DEBUG   ] Finished updating board flags in 1.611 seconds
2018-11-15 19:07:28 [DEBUG   ] Finished updating ant stats in 0.370 seconds
2018-11-15 19:07:32 [DEBUG   ] Got command BAM from MCS: ref #517790
2018-11-15 19:07:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:07:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517790   8 58437 68852025 A  ERROR'
2018-11-15 19:07:32 [DEBUG   ] Got command BAM from MCS: ref #517791
2018-11-15 19:07:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:07:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517791   8 58437 68852029 A  ERROR'
2018-11-15 19:07:32 [INFO    ] Finished processing BAM request
2018-11-15 19:07:32 [INFO    ] Finished processing BAM request
2018-11-15 19:07:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 19:07:32 [DEBUG   ] spawn_process: at 2018-11-15 19:07:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 19:07:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 19:07:32 [DEBUG   ] spawn_process: at 2018-11-15 19:07:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 19:07:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 19:07:32 [DEBUG   ] spawn_process: at 2018-11-15 19:07:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 19:07:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 19:07:32 [DEBUG   ] spawn_process: at 2018-11-15 19:07:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 19:07:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 19:07:32 [DEBUG   ] spawn_process: at 2018-11-15 19:07:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 19:07:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 19:07:32 [DEBUG   ] spawn_process: at 2018-11-15 19:07:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 19:07:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 19:07:32 [DEBUG   ] spawn_process: at 2018-11-15 19:07:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 19:07:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 19:07:32 [DEBUG   ] spawn_process: at 2018-11-15 19:07:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 19:07:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 19:07:32 [DEBUG   ] spawn_process: at 2018-11-15 19:07:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 19:07:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 19:07:32 [DEBUG   ] spawn_process: at 2018-11-15 19:07:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 19:07:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 19:07:32 [DEBUG   ] spawn_process: at 2018-11-15 19:07:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 19:07:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 19:07:32 [DEBUG   ] spawn_process: at 2018-11-15 19:07:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 19:07:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 19:07:32 [DEBUG   ] spawn_process: at 2018-11-15 19:07:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 19:07:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 19:07:32 [DEBUG   ] spawn_process: at 2018-11-15 19:07:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 19:07:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 19:07:32 [DEBUG   ] spawn_process: at 2018-11-15 19:07:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 19:07:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 19:07:32 [DEBUG   ] spawn_process: at 2018-11-15 19:07:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 19:07:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 19:07:32 [DEBUG   ] spawn_process: at 2018-11-15 19:07:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 19:07:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 19:07:32 [DEBUG   ] spawn_process: at 2018-11-15 19:07:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 19:07:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 19:07:32 [DEBUG   ] spawn_process: at 2018-11-15 19:07:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 19:07:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 19:07:32 [DEBUG   ] spawn_process: at 2018-11-15 19:07:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 19:07:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 19:07:32 [DEBUG   ] spawn_process: at 2018-11-15 19:07:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 19:07:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 19:07:32 [DEBUG   ] spawn_process: at 2018-11-15 19:07:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 19:07:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 19:07:32 [DEBUG   ] spawn_process: at 2018-11-15 19:07:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 19:07:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 19:07:32 [DEBUG   ] spawn_process: at 2018-11-15 19:07:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 19:07:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 19:07:32 [DEBUG   ] spawn_process: at 2018-11-15 19:07:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 19:07:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 19:07:32 [DEBUG   ] spawn_process: at 2018-11-15 19:07:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 19:07:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 19:08:04 [DEBUG   ] Got command BAM from MCS: ref #517792
2018-11-15 19:08:04 [INFO    ] Finished processing BAM request
2018-11-15 19:08:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:08:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517792   8 58437 68884025 A  ERROR'
2018-11-15 19:08:04 [DEBUG   ] Got command BAM from MCS: ref #517793
2018-11-15 19:08:04 [INFO    ] Finished processing BAM request
2018-11-15 19:08:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:08:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517793   8 58437 68884029 A  ERROR'
2018-11-15 19:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 19:08:04 [DEBUG   ] spawn_process: at 2018-11-15 19:08:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 19:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 19:08:04 [DEBUG   ] spawn_process: at 2018-11-15 19:08:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 19:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 19:08:04 [DEBUG   ] spawn_process: at 2018-11-15 19:08:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 19:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 19:08:04 [DEBUG   ] spawn_process: at 2018-11-15 19:08:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 19:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 19:08:04 [DEBUG   ] spawn_process: at 2018-11-15 19:08:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 19:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 19:08:04 [DEBUG   ] spawn_process: at 2018-11-15 19:08:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 19:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 19:08:04 [DEBUG   ] spawn_process: at 2018-11-15 19:08:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 19:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 19:08:04 [DEBUG   ] spawn_process: at 2018-11-15 19:08:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 19:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 19:08:04 [DEBUG   ] spawn_process: at 2018-11-15 19:08:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 19:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 19:08:04 [DEBUG   ] spawn_process: at 2018-11-15 19:08:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 19:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 19:08:04 [DEBUG   ] spawn_process: at 2018-11-15 19:08:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 19:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 19:08:04 [DEBUG   ] spawn_process: at 2018-11-15 19:08:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 19:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 19:08:04 [DEBUG   ] spawn_process: at 2018-11-15 19:08:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 19:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 19:08:04 [DEBUG   ] spawn_process: at 2018-11-15 19:08:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 19:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 19:08:04 [DEBUG   ] spawn_process: at 2018-11-15 19:08:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 19:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 19:08:04 [DEBUG   ] spawn_process: at 2018-11-15 19:08:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 19:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 19:08:04 [DEBUG   ] spawn_process: at 2018-11-15 19:08:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 19:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 19:08:04 [DEBUG   ] spawn_process: at 2018-11-15 19:08:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 19:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 19:08:04 [DEBUG   ] spawn_process: at 2018-11-15 19:08:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 19:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 19:08:04 [DEBUG   ] spawn_process: at 2018-11-15 19:08:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 19:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 19:08:04 [DEBUG   ] spawn_process: at 2018-11-15 19:08:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 19:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 19:08:04 [DEBUG   ] spawn_process: at 2018-11-15 19:08:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 19:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 19:08:04 [DEBUG   ] spawn_process: at 2018-11-15 19:08:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 19:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 19:08:04 [DEBUG   ] spawn_process: at 2018-11-15 19:08:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 19:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 19:08:04 [DEBUG   ] spawn_process: at 2018-11-15 19:08:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 19:08:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 19:08:04 [DEBUG   ] spawn_process: at 2018-11-15 19:08:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 19:08:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:08:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-11-15 19:08:08 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-15 19:08:08 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-15 19:08:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 19:08:08 [WARNING ] (13, 1, 'bot')
2018-11-15 19:08:08 [WARNING ] (13, 1, 'bot')
2018-11-15 19:08:08 [WARNING ] (13, 1, 'bot')
2018-11-15 19:08:08 [WARNING ] (13, 1, 'bot')
2018-11-15 19:08:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:08:08 [DEBUG   ] Finished updating board flags in 1.076 seconds
2018-11-15 19:08:09 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-15 19:08:22 [DEBUG   ] Got command RPT from MCS: ref #517796
2018-11-15 19:08:22 [DEBUG   ] summary = ERROR
2018-11-15 19:08:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517796  13 58437 68902245 A  ERRORERROR'
2018-11-15 19:08:22 [DEBUG   ] Got command RPT from MCS: ref #517797
2018-11-15 19:08:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 19:08:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517797  77 58437 68902449 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 19:08:22 [DEBUG   ] Got command RPT from MCS: ref #517798
2018-11-15 19:08:22 [DEBUG   ] summary = ERROR
2018-11-15 19:08:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517798  13 58437 68902641 A  ERRORERROR'
2018-11-15 19:08:22 [DEBUG   ] Got command RPT from MCS: ref #517800
2018-11-15 19:08:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 19:08:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517800  77 58437 68902845 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 19:08:23 [DEBUG   ] Got command RPT from MCS: ref #517801
2018-11-15 19:08:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 19:08:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517801  12 58437 68903053 A  ERRORB¤ff'
2018-11-15 19:08:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 19:08:36 [DEBUG   ] Got command BAM from MCS: ref #517810
2018-11-15 19:08:36 [INFO    ] Finished processing BAM request
2018-11-15 19:08:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:08:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517810   8 58437 68916033 A  ERROR'
2018-11-15 19:08:36 [DEBUG   ] Got command BAM from MCS: ref #517811
2018-11-15 19:08:36 [INFO    ] Finished processing BAM request
2018-11-15 19:08:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:08:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517811   8 58437 68916037 A  ERROR'
2018-11-15 19:08:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 19:08:36 [DEBUG   ] spawn_process: at 2018-11-15 19:08:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 19:08:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 19:08:36 [DEBUG   ] spawn_process: at 2018-11-15 19:08:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 19:08:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 19:08:36 [DEBUG   ] spawn_process: at 2018-11-15 19:08:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 19:08:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 19:08:36 [DEBUG   ] spawn_process: at 2018-11-15 19:08:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 19:08:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 19:08:36 [DEBUG   ] spawn_process: at 2018-11-15 19:08:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 19:08:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 19:08:36 [DEBUG   ] spawn_process: at 2018-11-15 19:08:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 19:08:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 19:08:36 [DEBUG   ] spawn_process: at 2018-11-15 19:08:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 19:08:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 19:08:36 [DEBUG   ] spawn_process: at 2018-11-15 19:08:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 19:08:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 19:08:36 [DEBUG   ] spawn_process: at 2018-11-15 19:08:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 19:08:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 19:08:36 [DEBUG   ] spawn_process: at 2018-11-15 19:08:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 19:08:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 19:08:36 [DEBUG   ] spawn_process: at 2018-11-15 19:08:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 19:08:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 19:08:36 [DEBUG   ] spawn_process: at 2018-11-15 19:08:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 19:08:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 19:08:36 [DEBUG   ] spawn_process: at 2018-11-15 19:08:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 19:08:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 19:08:36 [DEBUG   ] spawn_process: at 2018-11-15 19:08:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 19:08:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 19:08:36 [DEBUG   ] spawn_process: at 2018-11-15 19:08:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 19:08:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 19:08:36 [DEBUG   ] spawn_process: at 2018-11-15 19:08:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 19:08:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 19:08:36 [DEBUG   ] spawn_process: at 2018-11-15 19:08:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 19:08:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 19:08:36 [DEBUG   ] spawn_process: at 2018-11-15 19:08:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 19:08:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 19:08:36 [DEBUG   ] spawn_process: at 2018-11-15 19:08:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 19:08:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 19:08:36 [DEBUG   ] spawn_process: at 2018-11-15 19:08:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 19:08:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 19:08:36 [DEBUG   ] spawn_process: at 2018-11-15 19:08:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 19:08:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 19:08:36 [DEBUG   ] spawn_process: at 2018-11-15 19:08:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 19:08:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 19:08:36 [DEBUG   ] spawn_process: at 2018-11-15 19:08:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 19:08:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 19:08:36 [DEBUG   ] spawn_process: at 2018-11-15 19:08:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 19:08:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 19:08:36 [DEBUG   ] spawn_process: at 2018-11-15 19:08:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 19:08:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 19:08:36 [DEBUG   ] spawn_process: at 2018-11-15 19:08:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 19:08:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 19:09:08 [DEBUG   ] Got command BAM from MCS: ref #517813
2018-11-15 19:09:08 [INFO    ] Finished processing BAM request
2018-11-15 19:09:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:09:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517813   8 58437 68948041 A  ERROR'
2018-11-15 19:09:08 [DEBUG   ] Got command BAM from MCS: ref #517812
2018-11-15 19:09:08 [INFO    ] Finished processing BAM request
2018-11-15 19:09:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:09:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517812   8 58437 68948045 A  ERROR'
2018-11-15 19:09:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 19:09:08 [DEBUG   ] spawn_process: at 2018-11-15 19:09:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 19:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 19:09:08 [DEBUG   ] spawn_process: at 2018-11-15 19:09:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 19:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 19:09:08 [DEBUG   ] spawn_process: at 2018-11-15 19:09:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 19:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 19:09:08 [DEBUG   ] spawn_process: at 2018-11-15 19:09:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 19:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 19:09:08 [DEBUG   ] spawn_process: at 2018-11-15 19:09:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 19:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 19:09:08 [DEBUG   ] spawn_process: at 2018-11-15 19:09:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 19:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 19:09:08 [DEBUG   ] spawn_process: at 2018-11-15 19:09:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 19:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 19:09:08 [DEBUG   ] spawn_process: at 2018-11-15 19:09:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 19:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 19:09:08 [DEBUG   ] spawn_process: at 2018-11-15 19:09:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 19:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 19:09:08 [DEBUG   ] spawn_process: at 2018-11-15 19:09:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 19:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 19:09:08 [DEBUG   ] spawn_process: at 2018-11-15 19:09:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 19:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 19:09:08 [DEBUG   ] spawn_process: at 2018-11-15 19:09:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 19:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 19:09:08 [DEBUG   ] spawn_process: at 2018-11-15 19:09:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 19:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 19:09:08 [DEBUG   ] spawn_process: at 2018-11-15 19:09:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 19:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 19:09:08 [DEBUG   ] spawn_process: at 2018-11-15 19:09:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 19:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 19:09:08 [DEBUG   ] spawn_process: at 2018-11-15 19:09:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 19:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 19:09:08 [DEBUG   ] spawn_process: at 2018-11-15 19:09:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 19:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 19:09:08 [DEBUG   ] spawn_process: at 2018-11-15 19:09:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 19:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 19:09:08 [DEBUG   ] spawn_process: at 2018-11-15 19:09:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 19:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 19:09:08 [DEBUG   ] spawn_process: at 2018-11-15 19:09:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 19:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 19:09:08 [DEBUG   ] spawn_process: at 2018-11-15 19:09:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 19:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 19:09:08 [DEBUG   ] spawn_process: at 2018-11-15 19:09:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 19:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 19:09:08 [DEBUG   ] spawn_process: at 2018-11-15 19:09:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 19:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 19:09:08 [DEBUG   ] spawn_process: at 2018-11-15 19:09:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 19:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 19:09:08 [DEBUG   ] spawn_process: at 2018-11-15 19:09:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 19:09:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 19:09:08 [DEBUG   ] spawn_process: at 2018-11-15 19:09:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 19:09:09 [DEBUG   ] Finished updating ant stats in 1.030 seconds
2018-11-15 19:09:09 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-15 19:09:09 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-15 19:09:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:09:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:09:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:09:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:09:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:09:09 [DEBUG   ] Finished updating board flags in 1.584 seconds
2018-11-15 19:09:29 [DEBUG   ] Finished updating ant stats in 0.974 seconds
2018-11-15 19:09:40 [DEBUG   ] Got command BAM from MCS: ref #517815
2018-11-15 19:09:40 [INFO    ] Finished processing BAM request
2018-11-15 19:09:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:09:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517815   8 58437 68980033 A  ERROR'
2018-11-15 19:09:40 [DEBUG   ] Got command BAM from MCS: ref #517814
2018-11-15 19:09:40 [INFO    ] Finished processing BAM request
2018-11-15 19:09:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:09:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517814   8 58437 68980037 A  ERROR'
2018-11-15 19:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 19:09:40 [DEBUG   ] spawn_process: at 2018-11-15 19:09:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 19:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 19:09:40 [DEBUG   ] spawn_process: at 2018-11-15 19:09:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 19:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 19:09:40 [DEBUG   ] spawn_process: at 2018-11-15 19:09:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 19:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 19:09:40 [DEBUG   ] spawn_process: at 2018-11-15 19:09:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 19:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 19:09:40 [DEBUG   ] spawn_process: at 2018-11-15 19:09:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 19:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 19:09:40 [DEBUG   ] spawn_process: at 2018-11-15 19:09:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 19:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 19:09:40 [DEBUG   ] spawn_process: at 2018-11-15 19:09:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 19:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 19:09:40 [DEBUG   ] spawn_process: at 2018-11-15 19:09:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 19:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 19:09:40 [DEBUG   ] spawn_process: at 2018-11-15 19:09:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 19:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 19:09:40 [DEBUG   ] spawn_process: at 2018-11-15 19:09:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 19:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 19:09:40 [DEBUG   ] spawn_process: at 2018-11-15 19:09:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 19:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 19:09:40 [DEBUG   ] spawn_process: at 2018-11-15 19:09:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 19:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 19:09:40 [DEBUG   ] spawn_process: at 2018-11-15 19:09:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 19:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 19:09:40 [DEBUG   ] spawn_process: at 2018-11-15 19:09:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 19:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 19:09:40 [DEBUG   ] spawn_process: at 2018-11-15 19:09:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 19:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 19:09:40 [DEBUG   ] spawn_process: at 2018-11-15 19:09:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 19:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 19:09:40 [DEBUG   ] spawn_process: at 2018-11-15 19:09:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 19:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 19:09:40 [DEBUG   ] spawn_process: at 2018-11-15 19:09:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 19:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 19:09:40 [DEBUG   ] spawn_process: at 2018-11-15 19:09:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 19:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 19:09:40 [DEBUG   ] spawn_process: at 2018-11-15 19:09:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 19:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 19:09:40 [DEBUG   ] spawn_process: at 2018-11-15 19:09:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 19:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 19:09:40 [DEBUG   ] spawn_process: at 2018-11-15 19:09:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 19:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 19:09:40 [DEBUG   ] spawn_process: at 2018-11-15 19:09:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 19:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 19:09:40 [DEBUG   ] spawn_process: at 2018-11-15 19:09:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 19:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 19:09:40 [DEBUG   ] spawn_process: at 2018-11-15 19:09:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 19:09:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 19:09:40 [DEBUG   ] spawn_process: at 2018-11-15 19:09:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 19:09:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 19:10:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:10:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-15 19:10:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-11-15 19:10:09 [DEBUG   ] Finished updating ant stats in 0.828 seconds
2018-11-15 19:10:09 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-15 19:10:09 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-15 19:10:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 19:10:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:10:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:10:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:10:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:10:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:10:09 [DEBUG   ] Finished updating board flags in 1.402 seconds
2018-11-15 19:10:12 [DEBUG   ] Got command BAM from MCS: ref #517817
2018-11-15 19:10:12 [INFO    ] Finished processing BAM request
2018-11-15 19:10:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:10:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517817   8 58437 69012025 A  ERROR'
2018-11-15 19:10:12 [DEBUG   ] Got command BAM from MCS: ref #517816
2018-11-15 19:10:12 [INFO    ] Finished processing BAM request
2018-11-15 19:10:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:10:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517816   8 58437 69012029 A  ERROR'
2018-11-15 19:10:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 19:10:12 [DEBUG   ] spawn_process: at 2018-11-15 19:10:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 19:10:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 19:10:12 [DEBUG   ] spawn_process: at 2018-11-15 19:10:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 19:10:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 19:10:12 [DEBUG   ] spawn_process: at 2018-11-15 19:10:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 19:10:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 19:10:12 [DEBUG   ] spawn_process: at 2018-11-15 19:10:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 19:10:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 19:10:12 [DEBUG   ] spawn_process: at 2018-11-15 19:10:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 19:10:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 19:10:12 [DEBUG   ] spawn_process: at 2018-11-15 19:10:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 19:10:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 19:10:12 [DEBUG   ] spawn_process: at 2018-11-15 19:10:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 19:10:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 19:10:12 [DEBUG   ] spawn_process: at 2018-11-15 19:10:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 19:10:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 19:10:12 [DEBUG   ] spawn_process: at 2018-11-15 19:10:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 19:10:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 19:10:12 [DEBUG   ] spawn_process: at 2018-11-15 19:10:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 19:10:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 19:10:12 [DEBUG   ] spawn_process: at 2018-11-15 19:10:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 19:10:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 19:10:12 [DEBUG   ] spawn_process: at 2018-11-15 19:10:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 19:10:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 19:10:12 [DEBUG   ] spawn_process: at 2018-11-15 19:10:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 19:10:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 19:10:12 [DEBUG   ] spawn_process: at 2018-11-15 19:10:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 19:10:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 19:10:12 [DEBUG   ] spawn_process: at 2018-11-15 19:10:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 19:10:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 19:10:12 [DEBUG   ] spawn_process: at 2018-11-15 19:10:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 19:10:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 19:10:12 [DEBUG   ] spawn_process: at 2018-11-15 19:10:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 19:10:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 19:10:12 [DEBUG   ] spawn_process: at 2018-11-15 19:10:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 19:10:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 19:10:12 [DEBUG   ] spawn_process: at 2018-11-15 19:10:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 19:10:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 19:10:12 [DEBUG   ] spawn_process: at 2018-11-15 19:10:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 19:10:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 19:10:12 [DEBUG   ] spawn_process: at 2018-11-15 19:10:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 19:10:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 19:10:12 [DEBUG   ] spawn_process: at 2018-11-15 19:10:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 19:10:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 19:10:12 [DEBUG   ] spawn_process: at 2018-11-15 19:10:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 19:10:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 19:10:12 [DEBUG   ] spawn_process: at 2018-11-15 19:10:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 19:10:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 19:10:12 [DEBUG   ] spawn_process: at 2018-11-15 19:10:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 19:10:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 19:10:12 [DEBUG   ] spawn_process: at 2018-11-15 19:10:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 19:10:29 [DEBUG   ] Finished updating ant stats in 0.775 seconds
2018-11-15 19:10:44 [DEBUG   ] Got command BAM from MCS: ref #517819
2018-11-15 19:10:44 [INFO    ] Finished processing BAM request
2018-11-15 19:10:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:10:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517819   8 58437 69044033 A  ERROR'
2018-11-15 19:10:44 [DEBUG   ] Got command BAM from MCS: ref #517818
2018-11-15 19:10:44 [INFO    ] Finished processing BAM request
2018-11-15 19:10:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:10:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517818   8 58437 69044037 A  ERROR'
2018-11-15 19:10:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 19:10:44 [DEBUG   ] spawn_process: at 2018-11-15 19:10:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 19:10:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 19:10:44 [DEBUG   ] spawn_process: at 2018-11-15 19:10:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 19:10:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 19:10:44 [DEBUG   ] spawn_process: at 2018-11-15 19:10:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 19:10:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 19:10:44 [DEBUG   ] spawn_process: at 2018-11-15 19:10:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 19:10:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 19:10:44 [DEBUG   ] spawn_process: at 2018-11-15 19:10:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 19:10:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 19:10:44 [DEBUG   ] spawn_process: at 2018-11-15 19:10:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 19:10:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 19:10:44 [DEBUG   ] spawn_process: at 2018-11-15 19:10:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 19:10:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 19:10:44 [DEBUG   ] spawn_process: at 2018-11-15 19:10:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 19:10:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 19:10:44 [DEBUG   ] spawn_process: at 2018-11-15 19:10:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 19:10:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 19:10:44 [DEBUG   ] spawn_process: at 2018-11-15 19:10:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 19:10:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 19:10:44 [DEBUG   ] spawn_process: at 2018-11-15 19:10:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 19:10:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 19:10:44 [DEBUG   ] spawn_process: at 2018-11-15 19:10:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 19:10:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 19:10:44 [DEBUG   ] spawn_process: at 2018-11-15 19:10:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 19:10:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 19:10:44 [DEBUG   ] spawn_process: at 2018-11-15 19:10:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 19:10:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 19:10:44 [DEBUG   ] spawn_process: at 2018-11-15 19:10:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 19:10:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 19:10:44 [DEBUG   ] spawn_process: at 2018-11-15 19:10:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 19:10:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 19:10:44 [DEBUG   ] spawn_process: at 2018-11-15 19:10:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 19:10:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 19:10:44 [DEBUG   ] spawn_process: at 2018-11-15 19:10:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 19:10:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 19:10:44 [DEBUG   ] spawn_process: at 2018-11-15 19:10:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 19:10:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 19:10:44 [DEBUG   ] spawn_process: at 2018-11-15 19:10:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 19:10:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 19:10:44 [DEBUG   ] spawn_process: at 2018-11-15 19:10:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 19:10:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 19:10:44 [DEBUG   ] spawn_process: at 2018-11-15 19:10:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 19:10:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 19:10:44 [DEBUG   ] spawn_process: at 2018-11-15 19:10:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 19:10:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 19:10:44 [DEBUG   ] spawn_process: at 2018-11-15 19:10:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 19:10:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 19:10:44 [DEBUG   ] spawn_process: at 2018-11-15 19:10:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 19:10:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 19:10:44 [DEBUG   ] spawn_process: at 2018-11-15 19:10:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 19:10:45 [DEBUG   ] Got command RPT from MCS: ref #517820
2018-11-15 19:10:45 [DEBUG   ] summary = ERROR
2018-11-15 19:10:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517820  13 58437 69045177 A  ERRORERROR'
2018-11-15 19:10:45 [DEBUG   ] Got command RPT from MCS: ref #517821
2018-11-15 19:10:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 19:10:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517821  77 58437 69045178 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 19:10:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 19:11:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:11:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-15 19:11:09 [DEBUG   ] Finished updating ant stats in 0.629 seconds
2018-11-15 19:11:09 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 19:11:09 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-15 19:11:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:11:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:11:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:11:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:11:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:11:09 [DEBUG   ] Finished updating board flags in 1.400 seconds
2018-11-15 19:11:16 [DEBUG   ] Got command BAM from MCS: ref #517837
2018-11-15 19:11:16 [INFO    ] Finished processing BAM request
2018-11-15 19:11:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:11:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517837   8 58437 69076029 A  ERROR'
2018-11-15 19:11:16 [DEBUG   ] Got command BAM from MCS: ref #517838
2018-11-15 19:11:16 [INFO    ] Finished processing BAM request
2018-11-15 19:11:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:11:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517838   8 58437 69076033 A  ERROR'
2018-11-15 19:11:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 19:11:16 [DEBUG   ] spawn_process: at 2018-11-15 19:11:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 19:11:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 19:11:16 [DEBUG   ] spawn_process: at 2018-11-15 19:11:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 19:11:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 19:11:16 [DEBUG   ] spawn_process: at 2018-11-15 19:11:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 19:11:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 19:11:16 [DEBUG   ] spawn_process: at 2018-11-15 19:11:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 19:11:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 19:11:16 [DEBUG   ] spawn_process: at 2018-11-15 19:11:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 19:11:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 19:11:16 [DEBUG   ] spawn_process: at 2018-11-15 19:11:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 19:11:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 19:11:16 [DEBUG   ] spawn_process: at 2018-11-15 19:11:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 19:11:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 19:11:16 [DEBUG   ] spawn_process: at 2018-11-15 19:11:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 19:11:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 19:11:16 [DEBUG   ] spawn_process: at 2018-11-15 19:11:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 19:11:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 19:11:16 [DEBUG   ] spawn_process: at 2018-11-15 19:11:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 19:11:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 19:11:16 [DEBUG   ] spawn_process: at 2018-11-15 19:11:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 19:11:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 19:11:16 [DEBUG   ] spawn_process: at 2018-11-15 19:11:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 19:11:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 19:11:16 [DEBUG   ] spawn_process: at 2018-11-15 19:11:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 19:11:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 19:11:16 [DEBUG   ] spawn_process: at 2018-11-15 19:11:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 19:11:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 19:11:16 [DEBUG   ] spawn_process: at 2018-11-15 19:11:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 19:11:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 19:11:16 [DEBUG   ] spawn_process: at 2018-11-15 19:11:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 19:11:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 19:11:16 [DEBUG   ] spawn_process: at 2018-11-15 19:11:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 19:11:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 19:11:16 [DEBUG   ] spawn_process: at 2018-11-15 19:11:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 19:11:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 19:11:16 [DEBUG   ] spawn_process: at 2018-11-15 19:11:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 19:11:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 19:11:16 [DEBUG   ] spawn_process: at 2018-11-15 19:11:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 19:11:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 19:11:16 [DEBUG   ] spawn_process: at 2018-11-15 19:11:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 19:11:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 19:11:16 [DEBUG   ] spawn_process: at 2018-11-15 19:11:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 19:11:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 19:11:16 [DEBUG   ] spawn_process: at 2018-11-15 19:11:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 19:11:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 19:11:16 [DEBUG   ] spawn_process: at 2018-11-15 19:11:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 19:11:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 19:11:16 [DEBUG   ] spawn_process: at 2018-11-15 19:11:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 19:11:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 19:11:16 [DEBUG   ] spawn_process: at 2018-11-15 19:11:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 19:11:29 [DEBUG   ] Finished updating ant stats in 0.574 seconds
2018-11-15 19:11:48 [DEBUG   ] Got command BAM from MCS: ref #517844
2018-11-15 19:11:48 [INFO    ] Finished processing BAM request
2018-11-15 19:11:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:11:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517844   8 58437 69108033 A  ERROR'
2018-11-15 19:11:48 [DEBUG   ] Got command BAM from MCS: ref #517843
2018-11-15 19:11:48 [INFO    ] Finished processing BAM request
2018-11-15 19:11:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:11:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517843   8 58437 69108037 A  ERROR'
2018-11-15 19:11:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 19:11:48 [DEBUG   ] spawn_process: at 2018-11-15 19:11:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 19:11:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 19:11:48 [DEBUG   ] spawn_process: at 2018-11-15 19:11:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 19:11:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 19:11:48 [DEBUG   ] spawn_process: at 2018-11-15 19:11:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 19:11:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 19:11:48 [DEBUG   ] spawn_process: at 2018-11-15 19:11:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 19:11:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 19:11:48 [DEBUG   ] spawn_process: at 2018-11-15 19:11:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 19:11:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 19:11:48 [DEBUG   ] spawn_process: at 2018-11-15 19:11:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 19:11:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 19:11:48 [DEBUG   ] spawn_process: at 2018-11-15 19:11:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 19:11:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 19:11:48 [DEBUG   ] spawn_process: at 2018-11-15 19:11:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 19:11:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 19:11:48 [DEBUG   ] spawn_process: at 2018-11-15 19:11:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 19:11:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 19:11:48 [DEBUG   ] spawn_process: at 2018-11-15 19:11:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 19:11:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 19:11:48 [DEBUG   ] spawn_process: at 2018-11-15 19:11:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 19:11:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 19:11:48 [DEBUG   ] spawn_process: at 2018-11-15 19:11:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 19:11:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 19:11:48 [DEBUG   ] spawn_process: at 2018-11-15 19:11:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 19:11:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 19:11:48 [DEBUG   ] spawn_process: at 2018-11-15 19:11:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 19:11:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 19:11:48 [DEBUG   ] spawn_process: at 2018-11-15 19:11:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 19:11:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 19:11:48 [DEBUG   ] spawn_process: at 2018-11-15 19:11:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 19:11:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 19:11:48 [DEBUG   ] spawn_process: at 2018-11-15 19:11:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 19:11:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 19:11:48 [DEBUG   ] spawn_process: at 2018-11-15 19:11:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 19:11:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 19:11:48 [DEBUG   ] spawn_process: at 2018-11-15 19:11:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 19:11:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 19:11:48 [DEBUG   ] spawn_process: at 2018-11-15 19:11:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 19:11:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 19:11:48 [DEBUG   ] spawn_process: at 2018-11-15 19:11:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 19:11:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 19:11:48 [DEBUG   ] spawn_process: at 2018-11-15 19:11:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 19:11:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 19:11:48 [DEBUG   ] spawn_process: at 2018-11-15 19:11:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 19:11:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 19:11:48 [DEBUG   ] spawn_process: at 2018-11-15 19:11:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 19:11:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 19:11:48 [DEBUG   ] spawn_process: at 2018-11-15 19:11:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 19:11:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 19:11:48 [DEBUG   ] spawn_process: at 2018-11-15 19:11:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 19:11:49 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-11-15 19:12:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-11-15 19:12:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:12:10 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-15 19:12:10 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 19:12:10 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-15 19:12:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 19:12:10 [WARNING ] (13, 1, 'bot')
2018-11-15 19:12:10 [WARNING ] (13, 1, 'bot')
2018-11-15 19:12:10 [WARNING ] (13, 1, 'bot')
2018-11-15 19:12:10 [WARNING ] (13, 1, 'bot')
2018-11-15 19:12:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:12:10 [DEBUG   ] Finished updating board flags in 2.467 seconds
2018-11-15 19:12:20 [DEBUG   ] Got command BAM from MCS: ref #517845
2018-11-15 19:12:20 [INFO    ] Finished processing BAM request
2018-11-15 19:12:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:12:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517845   8 58437 69140029 A  ERROR'
2018-11-15 19:12:20 [DEBUG   ] Got command BAM from MCS: ref #517846
2018-11-15 19:12:20 [INFO    ] Finished processing BAM request
2018-11-15 19:12:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:12:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517846   8 58437 69140033 A  ERROR'
2018-11-15 19:12:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 19:12:20 [DEBUG   ] spawn_process: at 2018-11-15 19:12:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 19:12:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 19:12:20 [DEBUG   ] spawn_process: at 2018-11-15 19:12:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 19:12:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 19:12:20 [DEBUG   ] spawn_process: at 2018-11-15 19:12:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 19:12:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 19:12:20 [DEBUG   ] spawn_process: at 2018-11-15 19:12:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 19:12:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 19:12:20 [DEBUG   ] spawn_process: at 2018-11-15 19:12:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 19:12:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 19:12:20 [DEBUG   ] spawn_process: at 2018-11-15 19:12:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 19:12:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 19:12:20 [DEBUG   ] spawn_process: at 2018-11-15 19:12:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 19:12:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 19:12:20 [DEBUG   ] spawn_process: at 2018-11-15 19:12:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 19:12:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 19:12:20 [DEBUG   ] spawn_process: at 2018-11-15 19:12:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 19:12:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 19:12:20 [DEBUG   ] spawn_process: at 2018-11-15 19:12:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 19:12:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 19:12:20 [DEBUG   ] spawn_process: at 2018-11-15 19:12:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 19:12:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 19:12:20 [DEBUG   ] spawn_process: at 2018-11-15 19:12:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 19:12:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 19:12:20 [DEBUG   ] spawn_process: at 2018-11-15 19:12:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 19:12:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 19:12:20 [DEBUG   ] spawn_process: at 2018-11-15 19:12:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 19:12:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 19:12:20 [DEBUG   ] spawn_process: at 2018-11-15 19:12:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 19:12:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 19:12:20 [DEBUG   ] spawn_process: at 2018-11-15 19:12:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 19:12:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 19:12:20 [DEBUG   ] spawn_process: at 2018-11-15 19:12:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 19:12:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 19:12:20 [DEBUG   ] spawn_process: at 2018-11-15 19:12:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 19:12:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 19:12:20 [DEBUG   ] spawn_process: at 2018-11-15 19:12:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 19:12:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 19:12:20 [DEBUG   ] spawn_process: at 2018-11-15 19:12:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 19:12:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 19:12:20 [DEBUG   ] spawn_process: at 2018-11-15 19:12:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 19:12:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 19:12:20 [DEBUG   ] spawn_process: at 2018-11-15 19:12:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 19:12:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 19:12:20 [DEBUG   ] spawn_process: at 2018-11-15 19:12:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 19:12:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 19:12:20 [DEBUG   ] spawn_process: at 2018-11-15 19:12:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 19:12:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 19:12:20 [DEBUG   ] spawn_process: at 2018-11-15 19:12:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 19:12:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 19:12:20 [DEBUG   ] spawn_process: at 2018-11-15 19:12:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 19:12:30 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-15 19:12:50 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 19:12:52 [DEBUG   ] Got command BAM from MCS: ref #517848
2018-11-15 19:12:52 [INFO    ] Finished processing BAM request
2018-11-15 19:12:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:12:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517848   8 58437 69172033 A  ERROR'
2018-11-15 19:12:52 [DEBUG   ] Got command BAM from MCS: ref #517847
2018-11-15 19:12:52 [INFO    ] Finished processing BAM request
2018-11-15 19:12:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:12:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517847   8 58437 69172037 A  ERROR'
2018-11-15 19:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 19:12:52 [DEBUG   ] spawn_process: at 2018-11-15 19:12:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 19:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 19:12:52 [DEBUG   ] spawn_process: at 2018-11-15 19:12:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 19:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 19:12:52 [DEBUG   ] spawn_process: at 2018-11-15 19:12:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 19:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 19:12:52 [DEBUG   ] spawn_process: at 2018-11-15 19:12:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 19:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 19:12:52 [DEBUG   ] spawn_process: at 2018-11-15 19:12:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 19:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 19:12:52 [DEBUG   ] spawn_process: at 2018-11-15 19:12:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 19:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 19:12:52 [DEBUG   ] spawn_process: at 2018-11-15 19:12:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 19:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 19:12:52 [DEBUG   ] spawn_process: at 2018-11-15 19:12:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 19:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 19:12:52 [DEBUG   ] spawn_process: at 2018-11-15 19:12:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 19:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 19:12:52 [DEBUG   ] spawn_process: at 2018-11-15 19:12:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 19:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 19:12:52 [DEBUG   ] spawn_process: at 2018-11-15 19:12:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 19:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 19:12:52 [DEBUG   ] spawn_process: at 2018-11-15 19:12:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 19:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 19:12:52 [DEBUG   ] spawn_process: at 2018-11-15 19:12:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 19:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 19:12:52 [DEBUG   ] spawn_process: at 2018-11-15 19:12:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 19:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 19:12:52 [DEBUG   ] spawn_process: at 2018-11-15 19:12:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 19:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 19:12:52 [DEBUG   ] spawn_process: at 2018-11-15 19:12:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 19:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 19:12:52 [DEBUG   ] spawn_process: at 2018-11-15 19:12:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 19:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 19:12:52 [DEBUG   ] spawn_process: at 2018-11-15 19:12:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 19:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 19:12:52 [DEBUG   ] spawn_process: at 2018-11-15 19:12:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 19:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 19:12:52 [DEBUG   ] spawn_process: at 2018-11-15 19:12:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 19:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 19:12:52 [DEBUG   ] spawn_process: at 2018-11-15 19:12:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 19:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 19:12:52 [DEBUG   ] spawn_process: at 2018-11-15 19:12:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 19:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 19:12:52 [DEBUG   ] spawn_process: at 2018-11-15 19:12:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 19:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 19:12:52 [DEBUG   ] spawn_process: at 2018-11-15 19:12:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 19:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 19:12:52 [DEBUG   ] spawn_process: at 2018-11-15 19:12:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 19:12:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 19:12:52 [DEBUG   ] spawn_process: at 2018-11-15 19:12:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 19:13:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:13:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-11-15 19:13:09 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-15 19:13:09 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-15 19:13:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 19:13:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:13:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:13:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:13:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:13:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:13:09 [DEBUG   ] Finished updating board flags in 1.292 seconds
2018-11-15 19:13:10 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2018-11-15 19:13:22 [DEBUG   ] Got command RPT from MCS: ref #517849
2018-11-15 19:13:22 [DEBUG   ] summary = ERROR
2018-11-15 19:13:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517849  13 58437 69202337 A  ERRORERROR'
2018-11-15 19:13:22 [DEBUG   ] Got command RPT from MCS: ref #517850
2018-11-15 19:13:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 19:13:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517850  77 58437 69202529 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 19:13:22 [DEBUG   ] Got command RPT from MCS: ref #517851
2018-11-15 19:13:22 [DEBUG   ] summary = ERROR
2018-11-15 19:13:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517851  13 58437 69202733 A  ERRORERROR'
2018-11-15 19:13:22 [DEBUG   ] Got command RPT from MCS: ref #517852
2018-11-15 19:13:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 19:13:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517852  77 58437 69202937 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 19:13:23 [DEBUG   ] Got command RPT from MCS: ref #517855
2018-11-15 19:13:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 19:13:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517855  12 58437 69203129 A  ERRORB¤ff'
2018-11-15 19:13:24 [DEBUG   ] Got command BAM from MCS: ref #517854
2018-11-15 19:13:24 [INFO    ] Finished processing BAM request
2018-11-15 19:13:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:13:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517854   8 58437 69204033 A  ERROR'
2018-11-15 19:13:24 [DEBUG   ] Got command BAM from MCS: ref #517853
2018-11-15 19:13:24 [INFO    ] Finished processing BAM request
2018-11-15 19:13:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:13:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517853   8 58437 69204037 A  ERROR'
2018-11-15 19:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 19:13:24 [DEBUG   ] spawn_process: at 2018-11-15 19:13:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 19:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 19:13:24 [DEBUG   ] spawn_process: at 2018-11-15 19:13:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 19:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 19:13:24 [DEBUG   ] spawn_process: at 2018-11-15 19:13:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 19:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 19:13:24 [DEBUG   ] spawn_process: at 2018-11-15 19:13:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 19:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 19:13:24 [DEBUG   ] spawn_process: at 2018-11-15 19:13:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 19:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 19:13:24 [DEBUG   ] spawn_process: at 2018-11-15 19:13:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 19:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 19:13:24 [DEBUG   ] spawn_process: at 2018-11-15 19:13:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 19:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 19:13:24 [DEBUG   ] spawn_process: at 2018-11-15 19:13:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 19:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 19:13:24 [DEBUG   ] spawn_process: at 2018-11-15 19:13:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 19:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 19:13:24 [DEBUG   ] spawn_process: at 2018-11-15 19:13:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 19:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 19:13:24 [DEBUG   ] spawn_process: at 2018-11-15 19:13:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 19:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 19:13:24 [DEBUG   ] spawn_process: at 2018-11-15 19:13:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 19:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 19:13:24 [DEBUG   ] spawn_process: at 2018-11-15 19:13:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 19:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 19:13:24 [DEBUG   ] spawn_process: at 2018-11-15 19:13:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 19:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 19:13:24 [DEBUG   ] spawn_process: at 2018-11-15 19:13:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 19:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 19:13:24 [DEBUG   ] spawn_process: at 2018-11-15 19:13:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 19:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 19:13:24 [DEBUG   ] spawn_process: at 2018-11-15 19:13:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 19:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 19:13:24 [DEBUG   ] spawn_process: at 2018-11-15 19:13:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 19:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 19:13:24 [DEBUG   ] spawn_process: at 2018-11-15 19:13:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 19:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 19:13:24 [DEBUG   ] spawn_process: at 2018-11-15 19:13:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 19:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 19:13:24 [DEBUG   ] spawn_process: at 2018-11-15 19:13:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 19:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 19:13:24 [DEBUG   ] spawn_process: at 2018-11-15 19:13:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 19:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 19:13:24 [DEBUG   ] spawn_process: at 2018-11-15 19:13:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 19:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 19:13:24 [DEBUG   ] spawn_process: at 2018-11-15 19:13:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 19:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 19:13:24 [DEBUG   ] spawn_process: at 2018-11-15 19:13:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 19:13:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 19:13:24 [DEBUG   ] spawn_process: at 2018-11-15 19:13:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 19:13:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 19:13:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 19:13:56 [DEBUG   ] Got command BAM from MCS: ref #517857
2018-11-15 19:13:56 [INFO    ] Finished processing BAM request
2018-11-15 19:13:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:13:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517857   8 58437 69236033 A  ERROR'
2018-11-15 19:13:56 [DEBUG   ] Got command BAM from MCS: ref #517856
2018-11-15 19:13:56 [INFO    ] Finished processing BAM request
2018-11-15 19:13:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:13:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517856   8 58437 69236037 A  ERROR'
2018-11-15 19:13:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 19:13:56 [DEBUG   ] spawn_process: at 2018-11-15 19:13:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 19:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 19:13:57 [DEBUG   ] spawn_process: at 2018-11-15 19:13:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 19:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 19:13:57 [DEBUG   ] spawn_process: at 2018-11-15 19:13:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 19:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 19:13:57 [DEBUG   ] spawn_process: at 2018-11-15 19:13:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 19:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 19:13:57 [DEBUG   ] spawn_process: at 2018-11-15 19:13:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 19:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 19:13:57 [DEBUG   ] spawn_process: at 2018-11-15 19:13:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 19:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 19:13:57 [DEBUG   ] spawn_process: at 2018-11-15 19:13:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 19:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 19:13:57 [DEBUG   ] spawn_process: at 2018-11-15 19:13:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 19:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 19:13:57 [DEBUG   ] spawn_process: at 2018-11-15 19:13:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 19:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 19:13:57 [DEBUG   ] spawn_process: at 2018-11-15 19:13:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 19:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 19:13:57 [DEBUG   ] spawn_process: at 2018-11-15 19:13:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 19:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 19:13:57 [DEBUG   ] spawn_process: at 2018-11-15 19:13:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 19:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 19:13:57 [DEBUG   ] spawn_process: at 2018-11-15 19:13:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 19:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 19:13:57 [DEBUG   ] spawn_process: at 2018-11-15 19:13:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 19:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 19:13:57 [DEBUG   ] spawn_process: at 2018-11-15 19:13:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 19:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 19:13:57 [DEBUG   ] spawn_process: at 2018-11-15 19:13:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 19:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 19:13:57 [DEBUG   ] spawn_process: at 2018-11-15 19:13:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 19:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 19:13:57 [DEBUG   ] spawn_process: at 2018-11-15 19:13:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 19:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 19:13:57 [DEBUG   ] spawn_process: at 2018-11-15 19:13:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 19:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 19:13:57 [DEBUG   ] spawn_process: at 2018-11-15 19:13:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 19:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 19:13:57 [DEBUG   ] spawn_process: at 2018-11-15 19:13:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 19:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 19:13:57 [DEBUG   ] spawn_process: at 2018-11-15 19:13:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 19:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 19:13:57 [DEBUG   ] spawn_process: at 2018-11-15 19:13:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 19:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 19:13:57 [DEBUG   ] spawn_process: at 2018-11-15 19:13:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 19:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 19:13:57 [DEBUG   ] spawn_process: at 2018-11-15 19:13:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 19:13:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 19:13:57 [DEBUG   ] spawn_process: at 2018-11-15 19:13:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 19:14:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa18, chip 5
2018-11-15 19:14:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:14:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-11-15 19:14:09 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-15 19:14:09 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-15 19:14:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 19:14:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:14:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:14:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:14:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:14:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:14:09 [DEBUG   ] Finished updating board flags in 1.194 seconds
2018-11-15 19:14:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 19:14:28 [DEBUG   ] Got command BAM from MCS: ref #517861
2018-11-15 19:14:28 [INFO    ] Finished processing BAM request
2018-11-15 19:14:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:14:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517861   8 58437 69268025 A  ERROR'
2018-11-15 19:14:28 [DEBUG   ] Got command BAM from MCS: ref #517862
2018-11-15 19:14:28 [INFO    ] Finished processing BAM request
2018-11-15 19:14:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:14:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517862   8 58437 69268029 A  ERROR'
2018-11-15 19:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 19:14:28 [DEBUG   ] spawn_process: at 2018-11-15 19:14:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 19:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 19:14:28 [DEBUG   ] spawn_process: at 2018-11-15 19:14:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 19:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 19:14:28 [DEBUG   ] spawn_process: at 2018-11-15 19:14:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 19:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 19:14:28 [DEBUG   ] spawn_process: at 2018-11-15 19:14:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 19:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 19:14:28 [DEBUG   ] spawn_process: at 2018-11-15 19:14:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 19:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 19:14:28 [DEBUG   ] spawn_process: at 2018-11-15 19:14:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 19:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 19:14:28 [DEBUG   ] spawn_process: at 2018-11-15 19:14:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 19:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 19:14:28 [DEBUG   ] spawn_process: at 2018-11-15 19:14:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 19:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 19:14:28 [DEBUG   ] spawn_process: at 2018-11-15 19:14:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 19:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 19:14:28 [DEBUG   ] spawn_process: at 2018-11-15 19:14:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 19:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 19:14:28 [DEBUG   ] spawn_process: at 2018-11-15 19:14:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 19:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 19:14:28 [DEBUG   ] spawn_process: at 2018-11-15 19:14:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 19:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 19:14:28 [DEBUG   ] spawn_process: at 2018-11-15 19:14:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 19:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 19:14:28 [DEBUG   ] spawn_process: at 2018-11-15 19:14:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 19:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 19:14:28 [DEBUG   ] spawn_process: at 2018-11-15 19:14:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 19:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 19:14:28 [DEBUG   ] spawn_process: at 2018-11-15 19:14:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 19:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 19:14:28 [DEBUG   ] spawn_process: at 2018-11-15 19:14:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 19:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 19:14:28 [DEBUG   ] spawn_process: at 2018-11-15 19:14:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 19:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 19:14:28 [DEBUG   ] spawn_process: at 2018-11-15 19:14:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 19:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 19:14:28 [DEBUG   ] spawn_process: at 2018-11-15 19:14:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 19:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 19:14:28 [DEBUG   ] spawn_process: at 2018-11-15 19:14:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 19:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 19:14:28 [DEBUG   ] spawn_process: at 2018-11-15 19:14:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 19:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 19:14:28 [DEBUG   ] spawn_process: at 2018-11-15 19:14:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 19:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 19:14:28 [DEBUG   ] spawn_process: at 2018-11-15 19:14:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 19:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 19:14:28 [DEBUG   ] spawn_process: at 2018-11-15 19:14:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 19:14:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 19:14:28 [DEBUG   ] spawn_process: at 2018-11-15 19:14:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 19:14:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 19:14:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 19:15:00 [DEBUG   ] Got command BAM from MCS: ref #517865
2018-11-15 19:15:00 [INFO    ] Finished processing BAM request
2018-11-15 19:15:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:15:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517865   8 58437 69300033 A  ERROR'
2018-11-15 19:15:00 [DEBUG   ] Got command BAM from MCS: ref #517864
2018-11-15 19:15:00 [INFO    ] Finished processing BAM request
2018-11-15 19:15:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:15:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517864   8 58437 69300037 A  ERROR'
2018-11-15 19:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 19:15:00 [DEBUG   ] spawn_process: at 2018-11-15 19:15:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 19:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 19:15:00 [DEBUG   ] spawn_process: at 2018-11-15 19:15:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 19:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 19:15:00 [DEBUG   ] spawn_process: at 2018-11-15 19:15:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 19:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 19:15:00 [DEBUG   ] spawn_process: at 2018-11-15 19:15:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 19:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 19:15:00 [DEBUG   ] spawn_process: at 2018-11-15 19:15:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 19:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 19:15:00 [DEBUG   ] spawn_process: at 2018-11-15 19:15:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 19:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 19:15:00 [DEBUG   ] spawn_process: at 2018-11-15 19:15:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 19:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 19:15:00 [DEBUG   ] spawn_process: at 2018-11-15 19:15:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 19:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 19:15:00 [DEBUG   ] spawn_process: at 2018-11-15 19:15:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 19:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 19:15:00 [DEBUG   ] spawn_process: at 2018-11-15 19:15:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 19:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 19:15:00 [DEBUG   ] spawn_process: at 2018-11-15 19:15:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 19:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 19:15:00 [DEBUG   ] spawn_process: at 2018-11-15 19:15:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 19:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 19:15:00 [DEBUG   ] spawn_process: at 2018-11-15 19:15:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 19:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 19:15:00 [DEBUG   ] spawn_process: at 2018-11-15 19:15:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 19:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 19:15:00 [DEBUG   ] spawn_process: at 2018-11-15 19:15:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 19:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 19:15:00 [DEBUG   ] spawn_process: at 2018-11-15 19:15:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 19:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 19:15:00 [DEBUG   ] spawn_process: at 2018-11-15 19:15:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 19:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 19:15:00 [DEBUG   ] spawn_process: at 2018-11-15 19:15:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 19:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 19:15:00 [DEBUG   ] spawn_process: at 2018-11-15 19:15:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 19:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 19:15:00 [DEBUG   ] spawn_process: at 2018-11-15 19:15:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 19:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 19:15:00 [DEBUG   ] spawn_process: at 2018-11-15 19:15:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 19:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 19:15:00 [DEBUG   ] spawn_process: at 2018-11-15 19:15:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 19:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 19:15:00 [DEBUG   ] spawn_process: at 2018-11-15 19:15:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 19:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 19:15:00 [DEBUG   ] spawn_process: at 2018-11-15 19:15:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 19:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 19:15:00 [DEBUG   ] spawn_process: at 2018-11-15 19:15:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 19:15:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 19:15:00 [DEBUG   ] spawn_process: at 2018-11-15 19:15:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 19:15:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 19:15:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:15:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-15 19:15:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-11-15 19:15:09 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-15 19:15:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:15:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:15:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:15:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:15:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:15:09 [DEBUG   ] Finished updating board flags in 0.998 seconds
2018-11-15 19:15:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 19:15:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 19:15:32 [DEBUG   ] Got command BAM from MCS: ref #517866
2018-11-15 19:15:32 [INFO    ] Finished processing BAM request
2018-11-15 19:15:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:15:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517866   8 58437 69332025 A  ERROR'
2018-11-15 19:15:32 [DEBUG   ] Got command BAM from MCS: ref #517867
2018-11-15 19:15:32 [INFO    ] Finished processing BAM request
2018-11-15 19:15:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:15:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517867   8 58437 69332029 A  ERROR'
2018-11-15 19:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 19:15:32 [DEBUG   ] spawn_process: at 2018-11-15 19:15:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 19:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 19:15:32 [DEBUG   ] spawn_process: at 2018-11-15 19:15:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 19:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 19:15:32 [DEBUG   ] spawn_process: at 2018-11-15 19:15:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 19:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 19:15:32 [DEBUG   ] spawn_process: at 2018-11-15 19:15:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 19:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 19:15:32 [DEBUG   ] spawn_process: at 2018-11-15 19:15:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 19:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 19:15:32 [DEBUG   ] spawn_process: at 2018-11-15 19:15:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 19:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 19:15:32 [DEBUG   ] spawn_process: at 2018-11-15 19:15:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 19:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 19:15:32 [DEBUG   ] spawn_process: at 2018-11-15 19:15:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 19:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 19:15:32 [DEBUG   ] spawn_process: at 2018-11-15 19:15:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 19:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 19:15:32 [DEBUG   ] spawn_process: at 2018-11-15 19:15:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 19:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 19:15:32 [DEBUG   ] spawn_process: at 2018-11-15 19:15:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 19:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 19:15:32 [DEBUG   ] spawn_process: at 2018-11-15 19:15:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 19:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 19:15:32 [DEBUG   ] spawn_process: at 2018-11-15 19:15:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 19:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 19:15:32 [DEBUG   ] spawn_process: at 2018-11-15 19:15:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 19:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 19:15:32 [DEBUG   ] spawn_process: at 2018-11-15 19:15:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 19:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 19:15:32 [DEBUG   ] spawn_process: at 2018-11-15 19:15:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 19:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 19:15:32 [DEBUG   ] spawn_process: at 2018-11-15 19:15:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 19:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 19:15:32 [DEBUG   ] spawn_process: at 2018-11-15 19:15:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 19:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 19:15:32 [DEBUG   ] spawn_process: at 2018-11-15 19:15:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 19:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 19:15:32 [DEBUG   ] spawn_process: at 2018-11-15 19:15:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 19:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 19:15:32 [DEBUG   ] spawn_process: at 2018-11-15 19:15:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 19:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 19:15:32 [DEBUG   ] spawn_process: at 2018-11-15 19:15:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 19:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 19:15:32 [DEBUG   ] spawn_process: at 2018-11-15 19:15:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 19:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 19:15:32 [DEBUG   ] spawn_process: at 2018-11-15 19:15:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 19:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 19:15:32 [DEBUG   ] spawn_process: at 2018-11-15 19:15:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 19:15:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 19:15:32 [DEBUG   ] spawn_process: at 2018-11-15 19:15:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 19:15:45 [DEBUG   ] Got command RPT from MCS: ref #517868
2018-11-15 19:15:45 [DEBUG   ] summary = ERROR
2018-11-15 19:15:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517868  13 58437 69345169 A  ERRORERROR'
2018-11-15 19:15:45 [DEBUG   ] Got command RPT from MCS: ref #517869
2018-11-15 19:15:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 19:15:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517869  77 58437 69345170 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 19:15:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 19:16:04 [DEBUG   ] Got command BAM from MCS: ref #517885
2018-11-15 19:16:04 [INFO    ] Finished processing BAM request
2018-11-15 19:16:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:16:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517885   8 58437 69364029 A  ERROR'
2018-11-15 19:16:04 [DEBUG   ] Got command BAM from MCS: ref #517886
2018-11-15 19:16:04 [INFO    ] Finished processing BAM request
2018-11-15 19:16:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:16:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517886   8 58437 69364033 A  ERROR'
2018-11-15 19:16:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 19:16:04 [DEBUG   ] spawn_process: at 2018-11-15 19:16:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 19:16:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 19:16:04 [DEBUG   ] spawn_process: at 2018-11-15 19:16:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 19:16:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 19:16:04 [DEBUG   ] spawn_process: at 2018-11-15 19:16:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 19:16:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 19:16:04 [DEBUG   ] spawn_process: at 2018-11-15 19:16:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 19:16:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 19:16:04 [DEBUG   ] spawn_process: at 2018-11-15 19:16:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 19:16:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 19:16:04 [DEBUG   ] spawn_process: at 2018-11-15 19:16:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 19:16:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 19:16:04 [DEBUG   ] spawn_process: at 2018-11-15 19:16:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 19:16:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 19:16:04 [DEBUG   ] spawn_process: at 2018-11-15 19:16:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 19:16:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 19:16:04 [DEBUG   ] spawn_process: at 2018-11-15 19:16:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 19:16:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 19:16:04 [DEBUG   ] spawn_process: at 2018-11-15 19:16:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 19:16:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 19:16:04 [DEBUG   ] spawn_process: at 2018-11-15 19:16:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 19:16:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 19:16:04 [DEBUG   ] spawn_process: at 2018-11-15 19:16:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 19:16:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 19:16:04 [DEBUG   ] spawn_process: at 2018-11-15 19:16:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 19:16:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 19:16:04 [DEBUG   ] spawn_process: at 2018-11-15 19:16:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 19:16:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 19:16:04 [DEBUG   ] spawn_process: at 2018-11-15 19:16:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 19:16:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 19:16:04 [DEBUG   ] spawn_process: at 2018-11-15 19:16:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 19:16:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 19:16:04 [DEBUG   ] spawn_process: at 2018-11-15 19:16:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 19:16:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 19:16:04 [DEBUG   ] spawn_process: at 2018-11-15 19:16:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 19:16:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 19:16:04 [DEBUG   ] spawn_process: at 2018-11-15 19:16:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 19:16:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 19:16:04 [DEBUG   ] spawn_process: at 2018-11-15 19:16:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 19:16:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 19:16:04 [DEBUG   ] spawn_process: at 2018-11-15 19:16:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 19:16:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 19:16:04 [DEBUG   ] spawn_process: at 2018-11-15 19:16:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 19:16:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 19:16:04 [DEBUG   ] spawn_process: at 2018-11-15 19:16:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 19:16:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 19:16:04 [DEBUG   ] spawn_process: at 2018-11-15 19:16:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 19:16:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 19:16:04 [DEBUG   ] spawn_process: at 2018-11-15 19:16:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 19:16:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 19:16:04 [DEBUG   ] spawn_process: at 2018-11-15 19:16:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 19:16:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:16:09 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-15 19:16:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 19:16:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:16:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:16:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:16:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:16:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:16:09 [DEBUG   ] Finished updating board flags in 1.290 seconds
2018-11-15 19:16:10 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-15 19:16:30 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 19:16:36 [DEBUG   ] Got command BAM from MCS: ref #517888
2018-11-15 19:16:36 [INFO    ] Finished processing BAM request
2018-11-15 19:16:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:16:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517888   8 58437 69396025 A  ERROR'
2018-11-15 19:16:36 [DEBUG   ] Got command BAM from MCS: ref #517887
2018-11-15 19:16:36 [INFO    ] Finished processing BAM request
2018-11-15 19:16:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:16:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517887   8 58437 69396029 A  ERROR'
2018-11-15 19:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 19:16:36 [DEBUG   ] spawn_process: at 2018-11-15 19:16:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 19:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 19:16:36 [DEBUG   ] spawn_process: at 2018-11-15 19:16:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 19:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 19:16:36 [DEBUG   ] spawn_process: at 2018-11-15 19:16:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 19:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 19:16:36 [DEBUG   ] spawn_process: at 2018-11-15 19:16:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 19:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 19:16:36 [DEBUG   ] spawn_process: at 2018-11-15 19:16:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 19:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 19:16:36 [DEBUG   ] spawn_process: at 2018-11-15 19:16:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 19:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 19:16:36 [DEBUG   ] spawn_process: at 2018-11-15 19:16:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 19:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 19:16:36 [DEBUG   ] spawn_process: at 2018-11-15 19:16:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 19:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 19:16:36 [DEBUG   ] spawn_process: at 2018-11-15 19:16:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 19:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 19:16:36 [DEBUG   ] spawn_process: at 2018-11-15 19:16:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 19:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 19:16:36 [DEBUG   ] spawn_process: at 2018-11-15 19:16:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 19:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 19:16:36 [DEBUG   ] spawn_process: at 2018-11-15 19:16:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 19:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 19:16:36 [DEBUG   ] spawn_process: at 2018-11-15 19:16:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 19:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 19:16:36 [DEBUG   ] spawn_process: at 2018-11-15 19:16:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 19:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 19:16:36 [DEBUG   ] spawn_process: at 2018-11-15 19:16:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 19:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 19:16:36 [DEBUG   ] spawn_process: at 2018-11-15 19:16:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 19:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 19:16:36 [DEBUG   ] spawn_process: at 2018-11-15 19:16:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 19:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 19:16:36 [DEBUG   ] spawn_process: at 2018-11-15 19:16:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 19:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 19:16:36 [DEBUG   ] spawn_process: at 2018-11-15 19:16:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 19:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 19:16:36 [DEBUG   ] spawn_process: at 2018-11-15 19:16:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 19:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 19:16:36 [DEBUG   ] spawn_process: at 2018-11-15 19:16:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 19:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 19:16:36 [DEBUG   ] spawn_process: at 2018-11-15 19:16:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 19:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 19:16:36 [DEBUG   ] spawn_process: at 2018-11-15 19:16:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 19:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 19:16:36 [DEBUG   ] spawn_process: at 2018-11-15 19:16:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 19:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 19:16:36 [DEBUG   ] spawn_process: at 2018-11-15 19:16:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 19:16:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 19:16:36 [DEBUG   ] spawn_process: at 2018-11-15 19:16:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 19:16:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 19:17:08 [DEBUG   ] Got command BAM from MCS: ref #517890
2018-11-15 19:17:08 [INFO    ] Finished processing BAM request
2018-11-15 19:17:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:17:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517890   8 58437 69428033 A  ERROR'
2018-11-15 19:17:08 [DEBUG   ] Got command BAM from MCS: ref #517889
2018-11-15 19:17:08 [INFO    ] Finished processing BAM request
2018-11-15 19:17:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:17:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517889   8 58437 69428037 A  ERROR'
2018-11-15 19:17:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 19:17:08 [DEBUG   ] spawn_process: at 2018-11-15 19:17:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 19:17:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 19:17:08 [DEBUG   ] spawn_process: at 2018-11-15 19:17:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 19:17:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 19:17:08 [DEBUG   ] spawn_process: at 2018-11-15 19:17:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 19:17:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 19:17:08 [DEBUG   ] spawn_process: at 2018-11-15 19:17:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 19:17:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 19:17:08 [DEBUG   ] spawn_process: at 2018-11-15 19:17:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 19:17:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 19:17:08 [DEBUG   ] spawn_process: at 2018-11-15 19:17:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 19:17:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 19:17:08 [DEBUG   ] spawn_process: at 2018-11-15 19:17:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 19:17:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 19:17:08 [DEBUG   ] spawn_process: at 2018-11-15 19:17:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 19:17:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 19:17:08 [DEBUG   ] spawn_process: at 2018-11-15 19:17:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 19:17:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 19:17:08 [DEBUG   ] spawn_process: at 2018-11-15 19:17:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 19:17:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 19:17:08 [DEBUG   ] spawn_process: at 2018-11-15 19:17:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 19:17:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 19:17:08 [DEBUG   ] spawn_process: at 2018-11-15 19:17:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 19:17:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 19:17:08 [DEBUG   ] spawn_process: at 2018-11-15 19:17:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 19:17:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 19:17:08 [DEBUG   ] spawn_process: at 2018-11-15 19:17:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 19:17:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 19:17:08 [DEBUG   ] spawn_process: at 2018-11-15 19:17:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 19:17:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 19:17:08 [DEBUG   ] spawn_process: at 2018-11-15 19:17:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 19:17:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 19:17:08 [DEBUG   ] spawn_process: at 2018-11-15 19:17:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 19:17:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 19:17:08 [DEBUG   ] spawn_process: at 2018-11-15 19:17:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 19:17:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 19:17:08 [DEBUG   ] spawn_process: at 2018-11-15 19:17:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 19:17:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 19:17:08 [DEBUG   ] spawn_process: at 2018-11-15 19:17:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 19:17:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 19:17:08 [DEBUG   ] spawn_process: at 2018-11-15 19:17:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 19:17:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 19:17:08 [DEBUG   ] spawn_process: at 2018-11-15 19:17:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 19:17:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 19:17:08 [DEBUG   ] spawn_process: at 2018-11-15 19:17:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 19:17:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 19:17:08 [DEBUG   ] spawn_process: at 2018-11-15 19:17:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 19:17:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 19:17:08 [DEBUG   ] spawn_process: at 2018-11-15 19:17:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 19:17:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 19:17:08 [DEBUG   ] spawn_process: at 2018-11-15 19:17:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 19:17:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 19:17:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 19:17:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:17:09 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 19:17:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 19:17:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:17:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:17:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:17:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:17:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:17:09 [DEBUG   ] Finished updating board flags in 1.168 seconds
2018-11-15 19:17:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 19:17:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 19:17:40 [DEBUG   ] Got command BAM from MCS: ref #517896
2018-11-15 19:17:40 [INFO    ] Finished processing BAM request
2018-11-15 19:17:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517896   8 58437 69460029 A  ERROR'
2018-11-15 19:17:40 [DEBUG   ] Got command BAM from MCS: ref #517895
2018-11-15 19:17:40 [INFO    ] Finished processing BAM request
2018-11-15 19:17:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:17:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517895   8 58437 69460033 A  ERROR'
2018-11-15 19:17:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 19:17:40 [DEBUG   ] spawn_process: at 2018-11-15 19:17:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 19:17:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 19:17:40 [DEBUG   ] spawn_process: at 2018-11-15 19:17:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 19:17:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 19:17:40 [DEBUG   ] spawn_process: at 2018-11-15 19:17:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 19:17:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 19:17:40 [DEBUG   ] spawn_process: at 2018-11-15 19:17:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 19:17:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 19:17:40 [DEBUG   ] spawn_process: at 2018-11-15 19:17:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 19:17:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 19:17:40 [DEBUG   ] spawn_process: at 2018-11-15 19:17:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 19:17:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 19:17:40 [DEBUG   ] spawn_process: at 2018-11-15 19:17:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 19:17:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 19:17:40 [DEBUG   ] spawn_process: at 2018-11-15 19:17:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 19:17:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 19:17:40 [DEBUG   ] spawn_process: at 2018-11-15 19:17:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 19:17:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 19:17:40 [DEBUG   ] spawn_process: at 2018-11-15 19:17:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 19:17:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 19:17:40 [DEBUG   ] spawn_process: at 2018-11-15 19:17:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 19:17:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 19:17:40 [DEBUG   ] spawn_process: at 2018-11-15 19:17:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 19:17:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 19:17:40 [DEBUG   ] spawn_process: at 2018-11-15 19:17:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 19:17:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 19:17:40 [DEBUG   ] spawn_process: at 2018-11-15 19:17:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 19:17:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 19:17:40 [DEBUG   ] spawn_process: at 2018-11-15 19:17:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 19:17:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 19:17:40 [DEBUG   ] spawn_process: at 2018-11-15 19:17:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 19:17:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 19:17:40 [DEBUG   ] spawn_process: at 2018-11-15 19:17:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 19:17:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 19:17:40 [DEBUG   ] spawn_process: at 2018-11-15 19:17:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 19:17:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 19:17:40 [DEBUG   ] spawn_process: at 2018-11-15 19:17:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 19:17:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 19:17:40 [DEBUG   ] spawn_process: at 2018-11-15 19:17:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 19:17:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 19:17:40 [DEBUG   ] spawn_process: at 2018-11-15 19:17:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 19:17:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 19:17:40 [DEBUG   ] spawn_process: at 2018-11-15 19:17:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 19:17:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 19:17:40 [DEBUG   ] spawn_process: at 2018-11-15 19:17:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 19:17:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 19:17:40 [DEBUG   ] spawn_process: at 2018-11-15 19:17:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 19:17:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 19:17:40 [DEBUG   ] spawn_process: at 2018-11-15 19:17:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 19:17:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 19:17:40 [DEBUG   ] spawn_process: at 2018-11-15 19:17:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 19:17:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 19:18:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 19:18:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:18:10 [DEBUG   ] Finished updating ant stats in 0.629 seconds
2018-11-15 19:18:10 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-15 19:18:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 19:18:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 19:18:10 [WARNING ] (13, 1, 'bot')
2018-11-15 19:18:10 [WARNING ] (13, 1, 'bot')
2018-11-15 19:18:10 [WARNING ] (13, 1, 'bot')
2018-11-15 19:18:10 [WARNING ] (13, 1, 'bot')
2018-11-15 19:18:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:18:10 [DEBUG   ] Finished updating board flags in 1.611 seconds
2018-11-15 19:18:12 [DEBUG   ] Got command BAM from MCS: ref #517897
2018-11-15 19:18:12 [INFO    ] Finished processing BAM request
2018-11-15 19:18:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:18:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517897   8 58437 69492025 A  ERROR'
2018-11-15 19:18:12 [DEBUG   ] Got command BAM from MCS: ref #517898
2018-11-15 19:18:12 [INFO    ] Finished processing BAM request
2018-11-15 19:18:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:18:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517898   8 58437 69492029 A  ERROR'
2018-11-15 19:18:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 19:18:12 [DEBUG   ] spawn_process: at 2018-11-15 19:18:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 19:18:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 19:18:12 [DEBUG   ] spawn_process: at 2018-11-15 19:18:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 19:18:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 19:18:12 [DEBUG   ] spawn_process: at 2018-11-15 19:18:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 19:18:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 19:18:12 [DEBUG   ] spawn_process: at 2018-11-15 19:18:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 19:18:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 19:18:12 [DEBUG   ] spawn_process: at 2018-11-15 19:18:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 19:18:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 19:18:12 [DEBUG   ] spawn_process: at 2018-11-15 19:18:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 19:18:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 19:18:12 [DEBUG   ] spawn_process: at 2018-11-15 19:18:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 19:18:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 19:18:12 [DEBUG   ] spawn_process: at 2018-11-15 19:18:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 19:18:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 19:18:12 [DEBUG   ] spawn_process: at 2018-11-15 19:18:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 19:18:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 19:18:12 [DEBUG   ] spawn_process: at 2018-11-15 19:18:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 19:18:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 19:18:12 [DEBUG   ] spawn_process: at 2018-11-15 19:18:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 19:18:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 19:18:12 [DEBUG   ] spawn_process: at 2018-11-15 19:18:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 19:18:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 19:18:12 [DEBUG   ] spawn_process: at 2018-11-15 19:18:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 19:18:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 19:18:12 [DEBUG   ] spawn_process: at 2018-11-15 19:18:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 19:18:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 19:18:12 [DEBUG   ] spawn_process: at 2018-11-15 19:18:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 19:18:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 19:18:12 [DEBUG   ] spawn_process: at 2018-11-15 19:18:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 19:18:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 19:18:12 [DEBUG   ] spawn_process: at 2018-11-15 19:18:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 19:18:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 19:18:12 [DEBUG   ] spawn_process: at 2018-11-15 19:18:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 19:18:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 19:18:12 [DEBUG   ] spawn_process: at 2018-11-15 19:18:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 19:18:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 19:18:12 [DEBUG   ] spawn_process: at 2018-11-15 19:18:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 19:18:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 19:18:12 [DEBUG   ] spawn_process: at 2018-11-15 19:18:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 19:18:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 19:18:12 [DEBUG   ] spawn_process: at 2018-11-15 19:18:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 19:18:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 19:18:12 [DEBUG   ] spawn_process: at 2018-11-15 19:18:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 19:18:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 19:18:12 [DEBUG   ] spawn_process: at 2018-11-15 19:18:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 19:18:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 19:18:12 [DEBUG   ] spawn_process: at 2018-11-15 19:18:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 19:18:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 19:18:12 [DEBUG   ] spawn_process: at 2018-11-15 19:18:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 19:18:22 [DEBUG   ] Got command RPT from MCS: ref #517901
2018-11-15 19:18:22 [DEBUG   ] summary = ERROR
2018-11-15 19:18:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517901  13 58437 69502421 A  ERRORERROR'
2018-11-15 19:18:22 [DEBUG   ] Got command RPT from MCS: ref #517902
2018-11-15 19:18:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 19:18:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517902  77 58437 69502613 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 19:18:22 [DEBUG   ] Got command RPT from MCS: ref #517903
2018-11-15 19:18:22 [DEBUG   ] summary = ERROR
2018-11-15 19:18:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517903  13 58437 69502821 A  ERRORERROR'
2018-11-15 19:18:23 [DEBUG   ] Got command RPT from MCS: ref #517905
2018-11-15 19:18:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 19:18:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517905  77 58437 69503025 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 19:18:23 [DEBUG   ] Got command RPT from MCS: ref #517907
2018-11-15 19:18:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 19:18:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517907  12 58437 69503217 A  ERRORB¤ff'
2018-11-15 19:18:30 [DEBUG   ] Finished updating ant stats in 0.574 seconds
2018-11-15 19:18:44 [DEBUG   ] Got command BAM from MCS: ref #517911
2018-11-15 19:18:44 [INFO    ] Finished processing BAM request
2018-11-15 19:18:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:18:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517911   8 58437 69524029 A  ERROR'
2018-11-15 19:18:44 [DEBUG   ] Got command BAM from MCS: ref #517912
2018-11-15 19:18:44 [INFO    ] Finished processing BAM request
2018-11-15 19:18:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:18:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517912   8 58437 69524033 A  ERROR'
2018-11-15 19:18:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 19:18:44 [DEBUG   ] spawn_process: at 2018-11-15 19:18:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 19:18:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 19:18:44 [DEBUG   ] spawn_process: at 2018-11-15 19:18:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 19:18:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 19:18:44 [DEBUG   ] spawn_process: at 2018-11-15 19:18:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 19:18:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 19:18:44 [DEBUG   ] spawn_process: at 2018-11-15 19:18:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 19:18:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 19:18:44 [DEBUG   ] spawn_process: at 2018-11-15 19:18:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 19:18:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 19:18:44 [DEBUG   ] spawn_process: at 2018-11-15 19:18:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 19:18:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 19:18:44 [DEBUG   ] spawn_process: at 2018-11-15 19:18:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 19:18:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 19:18:44 [DEBUG   ] spawn_process: at 2018-11-15 19:18:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 19:18:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 19:18:44 [DEBUG   ] spawn_process: at 2018-11-15 19:18:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 19:18:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 19:18:44 [DEBUG   ] spawn_process: at 2018-11-15 19:18:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 19:18:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 19:18:44 [DEBUG   ] spawn_process: at 2018-11-15 19:18:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 19:18:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 19:18:44 [DEBUG   ] spawn_process: at 2018-11-15 19:18:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 19:18:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 19:18:44 [DEBUG   ] spawn_process: at 2018-11-15 19:18:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 19:18:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 19:18:44 [DEBUG   ] spawn_process: at 2018-11-15 19:18:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 19:18:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 19:18:44 [DEBUG   ] spawn_process: at 2018-11-15 19:18:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 19:18:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 19:18:44 [DEBUG   ] spawn_process: at 2018-11-15 19:18:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 19:18:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 19:18:44 [DEBUG   ] spawn_process: at 2018-11-15 19:18:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 19:18:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 19:18:44 [DEBUG   ] spawn_process: at 2018-11-15 19:18:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 19:18:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 19:18:44 [DEBUG   ] spawn_process: at 2018-11-15 19:18:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 19:18:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 19:18:44 [DEBUG   ] spawn_process: at 2018-11-15 19:18:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 19:18:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 19:18:44 [DEBUG   ] spawn_process: at 2018-11-15 19:18:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 19:18:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 19:18:44 [DEBUG   ] spawn_process: at 2018-11-15 19:18:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 19:18:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 19:18:44 [DEBUG   ] spawn_process: at 2018-11-15 19:18:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 19:18:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 19:18:44 [DEBUG   ] spawn_process: at 2018-11-15 19:18:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 19:18:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 19:18:44 [DEBUG   ] spawn_process: at 2018-11-15 19:18:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 19:18:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 19:18:44 [DEBUG   ] spawn_process: at 2018-11-15 19:18:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 19:18:50 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 19:19:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:19:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-15 19:19:09 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 19:19:09 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-15 19:19:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 19:19:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:19:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:19:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:19:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:19:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:19:09 [DEBUG   ] Finished updating board flags in 1.023 seconds
2018-11-15 19:19:10 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 19:19:16 [DEBUG   ] Got command BAM from MCS: ref #517913
2018-11-15 19:19:16 [INFO    ] Finished processing BAM request
2018-11-15 19:19:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:19:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517913   8 58437 69556029 A  ERROR'
2018-11-15 19:19:16 [DEBUG   ] Got command BAM from MCS: ref #517914
2018-11-15 19:19:16 [INFO    ] Finished processing BAM request
2018-11-15 19:19:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:19:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517914   8 58437 69556033 A  ERROR'
2018-11-15 19:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 19:19:16 [DEBUG   ] spawn_process: at 2018-11-15 19:19:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 19:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 19:19:16 [DEBUG   ] spawn_process: at 2018-11-15 19:19:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 19:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 19:19:16 [DEBUG   ] spawn_process: at 2018-11-15 19:19:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 19:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 19:19:16 [DEBUG   ] spawn_process: at 2018-11-15 19:19:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 19:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 19:19:16 [DEBUG   ] spawn_process: at 2018-11-15 19:19:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 19:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 19:19:16 [DEBUG   ] spawn_process: at 2018-11-15 19:19:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 19:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 19:19:16 [DEBUG   ] spawn_process: at 2018-11-15 19:19:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 19:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 19:19:16 [DEBUG   ] spawn_process: at 2018-11-15 19:19:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 19:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 19:19:16 [DEBUG   ] spawn_process: at 2018-11-15 19:19:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 19:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 19:19:16 [DEBUG   ] spawn_process: at 2018-11-15 19:19:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 19:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 19:19:16 [DEBUG   ] spawn_process: at 2018-11-15 19:19:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 19:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 19:19:16 [DEBUG   ] spawn_process: at 2018-11-15 19:19:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 19:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 19:19:16 [DEBUG   ] spawn_process: at 2018-11-15 19:19:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 19:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 19:19:16 [DEBUG   ] spawn_process: at 2018-11-15 19:19:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 19:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 19:19:16 [DEBUG   ] spawn_process: at 2018-11-15 19:19:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 19:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 19:19:16 [DEBUG   ] spawn_process: at 2018-11-15 19:19:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 19:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 19:19:16 [DEBUG   ] spawn_process: at 2018-11-15 19:19:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 19:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 19:19:16 [DEBUG   ] spawn_process: at 2018-11-15 19:19:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 19:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 19:19:16 [DEBUG   ] spawn_process: at 2018-11-15 19:19:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 19:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 19:19:16 [DEBUG   ] spawn_process: at 2018-11-15 19:19:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 19:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 19:19:16 [DEBUG   ] spawn_process: at 2018-11-15 19:19:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 19:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 19:19:16 [DEBUG   ] spawn_process: at 2018-11-15 19:19:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 19:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 19:19:16 [DEBUG   ] spawn_process: at 2018-11-15 19:19:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 19:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 19:19:16 [DEBUG   ] spawn_process: at 2018-11-15 19:19:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 19:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 19:19:16 [DEBUG   ] spawn_process: at 2018-11-15 19:19:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 19:19:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 19:19:16 [DEBUG   ] spawn_process: at 2018-11-15 19:19:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 19:19:30 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 19:19:48 [DEBUG   ] Got command BAM from MCS: ref #517916
2018-11-15 19:19:48 [INFO    ] Finished processing BAM request
2018-11-15 19:19:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:19:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517916   8 58437 69588029 A  ERROR'
2018-11-15 19:19:48 [DEBUG   ] Got command BAM from MCS: ref #517915
2018-11-15 19:19:48 [INFO    ] Finished processing BAM request
2018-11-15 19:19:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:19:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517915   8 58437 69588033 A  ERROR'
2018-11-15 19:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 19:19:48 [DEBUG   ] spawn_process: at 2018-11-15 19:19:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 19:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 19:19:48 [DEBUG   ] spawn_process: at 2018-11-15 19:19:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 19:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 19:19:48 [DEBUG   ] spawn_process: at 2018-11-15 19:19:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 19:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 19:19:48 [DEBUG   ] spawn_process: at 2018-11-15 19:19:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 19:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 19:19:48 [DEBUG   ] spawn_process: at 2018-11-15 19:19:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 19:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 19:19:48 [DEBUG   ] spawn_process: at 2018-11-15 19:19:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 19:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 19:19:48 [DEBUG   ] spawn_process: at 2018-11-15 19:19:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 19:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 19:19:48 [DEBUG   ] spawn_process: at 2018-11-15 19:19:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 19:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 19:19:48 [DEBUG   ] spawn_process: at 2018-11-15 19:19:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 19:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 19:19:48 [DEBUG   ] spawn_process: at 2018-11-15 19:19:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 19:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 19:19:48 [DEBUG   ] spawn_process: at 2018-11-15 19:19:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 19:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 19:19:48 [DEBUG   ] spawn_process: at 2018-11-15 19:19:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 19:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 19:19:48 [DEBUG   ] spawn_process: at 2018-11-15 19:19:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 19:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 19:19:48 [DEBUG   ] spawn_process: at 2018-11-15 19:19:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 19:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 19:19:48 [DEBUG   ] spawn_process: at 2018-11-15 19:19:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 19:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 19:19:48 [DEBUG   ] spawn_process: at 2018-11-15 19:19:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 19:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 19:19:48 [DEBUG   ] spawn_process: at 2018-11-15 19:19:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 19:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 19:19:48 [DEBUG   ] spawn_process: at 2018-11-15 19:19:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 19:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 19:19:48 [DEBUG   ] spawn_process: at 2018-11-15 19:19:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 19:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 19:19:48 [DEBUG   ] spawn_process: at 2018-11-15 19:19:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 19:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 19:19:48 [DEBUG   ] spawn_process: at 2018-11-15 19:19:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 19:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 19:19:48 [DEBUG   ] spawn_process: at 2018-11-15 19:19:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 19:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 19:19:48 [DEBUG   ] spawn_process: at 2018-11-15 19:19:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 19:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 19:19:48 [DEBUG   ] spawn_process: at 2018-11-15 19:19:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 19:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 19:19:48 [DEBUG   ] spawn_process: at 2018-11-15 19:19:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 19:19:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 19:19:48 [DEBUG   ] spawn_process: at 2018-11-15 19:19:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 19:19:50 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 19:20:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 19:20:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:20:09 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 19:20:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 19:20:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:20:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:20:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:20:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:20:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:20:09 [DEBUG   ] Finished updating board flags in 1.032 seconds
2018-11-15 19:20:10 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 19:20:20 [DEBUG   ] Got command BAM from MCS: ref #517918
2018-11-15 19:20:20 [INFO    ] Finished processing BAM request
2018-11-15 19:20:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:20:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517918   8 58437 69620033 A  ERROR'
2018-11-15 19:20:20 [DEBUG   ] Got command BAM from MCS: ref #517917
2018-11-15 19:20:20 [INFO    ] Finished processing BAM request
2018-11-15 19:20:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:20:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517917   8 58437 69620037 A  ERROR'
2018-11-15 19:20:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 19:20:20 [DEBUG   ] spawn_process: at 2018-11-15 19:20:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 19:20:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 19:20:20 [DEBUG   ] spawn_process: at 2018-11-15 19:20:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 19:20:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 19:20:20 [DEBUG   ] spawn_process: at 2018-11-15 19:20:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 19:20:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 19:20:20 [DEBUG   ] spawn_process: at 2018-11-15 19:20:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 19:20:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 19:20:20 [DEBUG   ] spawn_process: at 2018-11-15 19:20:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 19:20:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 19:20:20 [DEBUG   ] spawn_process: at 2018-11-15 19:20:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 19:20:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 19:20:20 [DEBUG   ] spawn_process: at 2018-11-15 19:20:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 19:20:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 19:20:20 [DEBUG   ] spawn_process: at 2018-11-15 19:20:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 19:20:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 19:20:20 [DEBUG   ] spawn_process: at 2018-11-15 19:20:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 19:20:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 19:20:20 [DEBUG   ] spawn_process: at 2018-11-15 19:20:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 19:20:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 19:20:20 [DEBUG   ] spawn_process: at 2018-11-15 19:20:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 19:20:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 19:20:20 [DEBUG   ] spawn_process: at 2018-11-15 19:20:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 19:20:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 19:20:20 [DEBUG   ] spawn_process: at 2018-11-15 19:20:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 19:20:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 19:20:20 [DEBUG   ] spawn_process: at 2018-11-15 19:20:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 19:20:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 19:20:20 [DEBUG   ] spawn_process: at 2018-11-15 19:20:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 19:20:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 19:20:20 [DEBUG   ] spawn_process: at 2018-11-15 19:20:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 19:20:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 19:20:20 [DEBUG   ] spawn_process: at 2018-11-15 19:20:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 19:20:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 19:20:20 [DEBUG   ] spawn_process: at 2018-11-15 19:20:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 19:20:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 19:20:20 [DEBUG   ] spawn_process: at 2018-11-15 19:20:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 19:20:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 19:20:20 [DEBUG   ] spawn_process: at 2018-11-15 19:20:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 19:20:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 19:20:20 [DEBUG   ] spawn_process: at 2018-11-15 19:20:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 19:20:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 19:20:20 [DEBUG   ] spawn_process: at 2018-11-15 19:20:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 19:20:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 19:20:20 [DEBUG   ] spawn_process: at 2018-11-15 19:20:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 19:20:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 19:20:20 [DEBUG   ] spawn_process: at 2018-11-15 19:20:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 19:20:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 19:20:20 [DEBUG   ] spawn_process: at 2018-11-15 19:20:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 19:20:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 19:20:20 [DEBUG   ] spawn_process: at 2018-11-15 19:20:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 19:20:30 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 19:20:45 [DEBUG   ] Got command RPT from MCS: ref #517923
2018-11-15 19:20:45 [DEBUG   ] summary = ERROR
2018-11-15 19:20:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517923  13 58437 69645173 A  ERRORERROR'
2018-11-15 19:20:45 [DEBUG   ] Got command RPT from MCS: ref #517924
2018-11-15 19:20:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 19:20:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517924  77 58437 69645174 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 19:20:50 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 19:20:52 [DEBUG   ] Got command BAM from MCS: ref #517940
2018-11-15 19:20:52 [INFO    ] Finished processing BAM request
2018-11-15 19:20:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:20:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517940   8 58437 69652029 A  ERROR'
2018-11-15 19:20:52 [DEBUG   ] Got command BAM from MCS: ref #517941
2018-11-15 19:20:52 [INFO    ] Finished processing BAM request
2018-11-15 19:20:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:20:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517941   8 58437 69652033 A  ERROR'
2018-11-15 19:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 19:20:52 [DEBUG   ] spawn_process: at 2018-11-15 19:20:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 19:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 19:20:52 [DEBUG   ] spawn_process: at 2018-11-15 19:20:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 19:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 19:20:52 [DEBUG   ] spawn_process: at 2018-11-15 19:20:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 19:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 19:20:52 [DEBUG   ] spawn_process: at 2018-11-15 19:20:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 19:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 19:20:52 [DEBUG   ] spawn_process: at 2018-11-15 19:20:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 19:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 19:20:52 [DEBUG   ] spawn_process: at 2018-11-15 19:20:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 19:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 19:20:52 [DEBUG   ] spawn_process: at 2018-11-15 19:20:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 19:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 19:20:52 [DEBUG   ] spawn_process: at 2018-11-15 19:20:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 19:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 19:20:52 [DEBUG   ] spawn_process: at 2018-11-15 19:20:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 19:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 19:20:52 [DEBUG   ] spawn_process: at 2018-11-15 19:20:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 19:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 19:20:52 [DEBUG   ] spawn_process: at 2018-11-15 19:20:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 19:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 19:20:52 [DEBUG   ] spawn_process: at 2018-11-15 19:20:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 19:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 19:20:52 [DEBUG   ] spawn_process: at 2018-11-15 19:20:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 19:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 19:20:52 [DEBUG   ] spawn_process: at 2018-11-15 19:20:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 19:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 19:20:52 [DEBUG   ] spawn_process: at 2018-11-15 19:20:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 19:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 19:20:52 [DEBUG   ] spawn_process: at 2018-11-15 19:20:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 19:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 19:20:52 [DEBUG   ] spawn_process: at 2018-11-15 19:20:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 19:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 19:20:52 [DEBUG   ] spawn_process: at 2018-11-15 19:20:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 19:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 19:20:52 [DEBUG   ] spawn_process: at 2018-11-15 19:20:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 19:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 19:20:52 [DEBUG   ] spawn_process: at 2018-11-15 19:20:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 19:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 19:20:52 [DEBUG   ] spawn_process: at 2018-11-15 19:20:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 19:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 19:20:52 [DEBUG   ] spawn_process: at 2018-11-15 19:20:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 19:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 19:20:52 [DEBUG   ] spawn_process: at 2018-11-15 19:20:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 19:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 19:20:52 [DEBUG   ] spawn_process: at 2018-11-15 19:20:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 19:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 19:20:52 [DEBUG   ] spawn_process: at 2018-11-15 19:20:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 19:20:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 19:20:52 [DEBUG   ] spawn_process: at 2018-11-15 19:20:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 19:21:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 19:21:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:21:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-15 19:21:09 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 19:21:09 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-15 19:21:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 19:21:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 19:21:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:21:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:21:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:21:09 [WARNING ] (13, 1, 'bot')
2018-11-15 19:21:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:21:09 [DEBUG   ] Finished updating board flags in 0.934 seconds
2018-11-15 19:21:10 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 19:21:24 [DEBUG   ] Got command BAM from MCS: ref #517943
2018-11-15 19:21:24 [INFO    ] Finished processing BAM request
2018-11-15 19:21:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:21:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517943   8 58437 69684029 A  ERROR'
2018-11-15 19:21:24 [DEBUG   ] Got command BAM from MCS: ref #517942
2018-11-15 19:21:24 [INFO    ] Finished processing BAM request
2018-11-15 19:21:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:21:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517942   8 58437 69684033 A  ERROR'
2018-11-15 19:21:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 19:21:24 [DEBUG   ] spawn_process: at 2018-11-15 19:21:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 19:21:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 19:21:24 [DEBUG   ] spawn_process: at 2018-11-15 19:21:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 19:21:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 19:21:24 [DEBUG   ] spawn_process: at 2018-11-15 19:21:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 19:21:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 19:21:24 [DEBUG   ] spawn_process: at 2018-11-15 19:21:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 19:21:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 19:21:24 [DEBUG   ] spawn_process: at 2018-11-15 19:21:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 19:21:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 19:21:24 [DEBUG   ] spawn_process: at 2018-11-15 19:21:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 19:21:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 19:21:24 [DEBUG   ] spawn_process: at 2018-11-15 19:21:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 19:21:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 19:21:24 [DEBUG   ] spawn_process: at 2018-11-15 19:21:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 19:21:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 19:21:24 [DEBUG   ] spawn_process: at 2018-11-15 19:21:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 19:21:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 19:21:24 [DEBUG   ] spawn_process: at 2018-11-15 19:21:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 19:21:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 19:21:24 [DEBUG   ] spawn_process: at 2018-11-15 19:21:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 19:21:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 19:21:24 [DEBUG   ] spawn_process: at 2018-11-15 19:21:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 19:21:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 19:21:24 [DEBUG   ] spawn_process: at 2018-11-15 19:21:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 19:21:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 19:21:24 [DEBUG   ] spawn_process: at 2018-11-15 19:21:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 19:21:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 19:21:24 [DEBUG   ] spawn_process: at 2018-11-15 19:21:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 19:21:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 19:21:24 [DEBUG   ] spawn_process: at 2018-11-15 19:21:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 19:21:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 19:21:24 [DEBUG   ] spawn_process: at 2018-11-15 19:21:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 19:21:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 19:21:24 [DEBUG   ] spawn_process: at 2018-11-15 19:21:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 19:21:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 19:21:24 [DEBUG   ] spawn_process: at 2018-11-15 19:21:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 19:21:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 19:21:24 [DEBUG   ] spawn_process: at 2018-11-15 19:21:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 19:21:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 19:21:24 [DEBUG   ] spawn_process: at 2018-11-15 19:21:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 19:21:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 19:21:24 [DEBUG   ] spawn_process: at 2018-11-15 19:21:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 19:21:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 19:21:24 [DEBUG   ] spawn_process: at 2018-11-15 19:21:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 19:21:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 19:21:24 [DEBUG   ] spawn_process: at 2018-11-15 19:21:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 19:21:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 19:21:24 [DEBUG   ] spawn_process: at 2018-11-15 19:21:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 19:21:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 19:21:24 [DEBUG   ] spawn_process: at 2018-11-15 19:21:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 19:21:30 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 19:21:50 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-15 19:21:56 [DEBUG   ] Got command BAM from MCS: ref #517945
2018-11-15 19:21:56 [INFO    ] Finished processing BAM request
2018-11-15 19:21:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:21:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517945   8 58437 69716033 A  ERROR'
2018-11-15 19:21:56 [DEBUG   ] Got command BAM from MCS: ref #517944
2018-11-15 19:21:56 [INFO    ] Finished processing BAM request
2018-11-15 19:21:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:21:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517944   8 58437 69716037 A  ERROR'
2018-11-15 19:21:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 19:21:56 [DEBUG   ] spawn_process: at 2018-11-15 19:21:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 19:21:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 19:21:56 [DEBUG   ] spawn_process: at 2018-11-15 19:21:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 19:21:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 19:21:56 [DEBUG   ] spawn_process: at 2018-11-15 19:21:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 19:21:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 19:21:56 [DEBUG   ] spawn_process: at 2018-11-15 19:21:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 19:21:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 19:21:56 [DEBUG   ] spawn_process: at 2018-11-15 19:21:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 19:21:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 19:21:56 [DEBUG   ] spawn_process: at 2018-11-15 19:21:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 19:21:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 19:21:56 [DEBUG   ] spawn_process: at 2018-11-15 19:21:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 19:21:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 19:21:56 [DEBUG   ] spawn_process: at 2018-11-15 19:21:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 19:21:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 19:21:56 [DEBUG   ] spawn_process: at 2018-11-15 19:21:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 19:21:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 19:21:56 [DEBUG   ] spawn_process: at 2018-11-15 19:21:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 19:21:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 19:21:56 [DEBUG   ] spawn_process: at 2018-11-15 19:21:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 19:21:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 19:21:56 [DEBUG   ] spawn_process: at 2018-11-15 19:21:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 19:21:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 19:21:56 [DEBUG   ] spawn_process: at 2018-11-15 19:21:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 19:21:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 19:21:56 [DEBUG   ] spawn_process: at 2018-11-15 19:21:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 19:21:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 19:21:56 [DEBUG   ] spawn_process: at 2018-11-15 19:21:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 19:21:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 19:21:56 [DEBUG   ] spawn_process: at 2018-11-15 19:21:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 19:21:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 19:21:56 [DEBUG   ] spawn_process: at 2018-11-15 19:21:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 19:21:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 19:21:56 [DEBUG   ] spawn_process: at 2018-11-15 19:21:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 19:21:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 19:21:56 [DEBUG   ] spawn_process: at 2018-11-15 19:21:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 19:21:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 19:21:56 [DEBUG   ] spawn_process: at 2018-11-15 19:21:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 19:21:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 19:21:56 [DEBUG   ] spawn_process: at 2018-11-15 19:21:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 19:21:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 19:21:56 [DEBUG   ] spawn_process: at 2018-11-15 19:21:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 19:21:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 19:21:56 [DEBUG   ] spawn_process: at 2018-11-15 19:21:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 19:21:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 19:21:56 [DEBUG   ] spawn_process: at 2018-11-15 19:21:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 19:21:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 19:21:56 [DEBUG   ] spawn_process: at 2018-11-15 19:21:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 19:21:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 19:21:56 [DEBUG   ] spawn_process: at 2018-11-15 19:21:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 19:22:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 19:22:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:22:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-11-15 19:22:10 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 19:22:10 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-15 19:22:10 [WARNING ] (13, 1, 'bot')
2018-11-15 19:22:10 [WARNING ] (13, 1, 'bot')
2018-11-15 19:22:10 [WARNING ] (13, 1, 'bot')
2018-11-15 19:22:10 [WARNING ] (13, 1, 'bot')
2018-11-15 19:22:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:22:10 [DEBUG   ] Finished updating board flags in 1.376 seconds
2018-11-15 19:22:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 19:22:28 [DEBUG   ] Got command BAM from MCS: ref #517947
2018-11-15 19:22:28 [INFO    ] Finished processing BAM request
2018-11-15 19:22:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:22:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517947   8 58437 69748029 A  ERROR'
2018-11-15 19:22:28 [DEBUG   ] Got command BAM from MCS: ref #517946
2018-11-15 19:22:28 [INFO    ] Finished processing BAM request
2018-11-15 19:22:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:22:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517946   8 58437 69748033 A  ERROR'
2018-11-15 19:22:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 19:22:28 [DEBUG   ] spawn_process: at 2018-11-15 19:22:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 19:22:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 19:22:28 [DEBUG   ] spawn_process: at 2018-11-15 19:22:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 19:22:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 19:22:28 [DEBUG   ] spawn_process: at 2018-11-15 19:22:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 19:22:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 19:22:28 [DEBUG   ] spawn_process: at 2018-11-15 19:22:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 19:22:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 19:22:28 [DEBUG   ] spawn_process: at 2018-11-15 19:22:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 19:22:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 19:22:28 [DEBUG   ] spawn_process: at 2018-11-15 19:22:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 19:22:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 19:22:28 [DEBUG   ] spawn_process: at 2018-11-15 19:22:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 19:22:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 19:22:28 [DEBUG   ] spawn_process: at 2018-11-15 19:22:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 19:22:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 19:22:28 [DEBUG   ] spawn_process: at 2018-11-15 19:22:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 19:22:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 19:22:28 [DEBUG   ] spawn_process: at 2018-11-15 19:22:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 19:22:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 19:22:28 [DEBUG   ] spawn_process: at 2018-11-15 19:22:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 19:22:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 19:22:28 [DEBUG   ] spawn_process: at 2018-11-15 19:22:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 19:22:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 19:22:28 [DEBUG   ] spawn_process: at 2018-11-15 19:22:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 19:22:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 19:22:28 [DEBUG   ] spawn_process: at 2018-11-15 19:22:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 19:22:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 19:22:28 [DEBUG   ] spawn_process: at 2018-11-15 19:22:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 19:22:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 19:22:28 [DEBUG   ] spawn_process: at 2018-11-15 19:22:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 19:22:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 19:22:28 [DEBUG   ] spawn_process: at 2018-11-15 19:22:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 19:22:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 19:22:28 [DEBUG   ] spawn_process: at 2018-11-15 19:22:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 19:22:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 19:22:28 [DEBUG   ] spawn_process: at 2018-11-15 19:22:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 19:22:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 19:22:28 [DEBUG   ] spawn_process: at 2018-11-15 19:22:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 19:22:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 19:22:28 [DEBUG   ] spawn_process: at 2018-11-15 19:22:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 19:22:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 19:22:28 [DEBUG   ] spawn_process: at 2018-11-15 19:22:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 19:22:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 19:22:28 [DEBUG   ] spawn_process: at 2018-11-15 19:22:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 19:22:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 19:22:28 [DEBUG   ] spawn_process: at 2018-11-15 19:22:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 19:22:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 19:22:28 [DEBUG   ] spawn_process: at 2018-11-15 19:22:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 19:22:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 19:22:28 [DEBUG   ] spawn_process: at 2018-11-15 19:22:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 19:22:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 19:22:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 19:23:00 [DEBUG   ] Got command BAM from MCS: ref #517949
2018-11-15 19:23:00 [INFO    ] Finished processing BAM request
2018-11-15 19:23:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:23:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517949   8 58437 69780029 A  ERROR'
2018-11-15 19:23:00 [DEBUG   ] Got command BAM from MCS: ref #517948
2018-11-15 19:23:00 [INFO    ] Finished processing BAM request
2018-11-15 19:23:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:23:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517948   8 58437 69780033 A  ERROR'
2018-11-15 19:23:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 19:23:00 [DEBUG   ] spawn_process: at 2018-11-15 19:23:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 19:23:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 19:23:00 [DEBUG   ] spawn_process: at 2018-11-15 19:23:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 19:23:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 19:23:00 [DEBUG   ] spawn_process: at 2018-11-15 19:23:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 19:23:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 19:23:00 [DEBUG   ] spawn_process: at 2018-11-15 19:23:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 19:23:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 19:23:00 [DEBUG   ] spawn_process: at 2018-11-15 19:23:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 19:23:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 19:23:00 [DEBUG   ] spawn_process: at 2018-11-15 19:23:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 19:23:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 19:23:00 [DEBUG   ] spawn_process: at 2018-11-15 19:23:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 19:23:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 19:23:00 [DEBUG   ] spawn_process: at 2018-11-15 19:23:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 19:23:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 19:23:00 [DEBUG   ] spawn_process: at 2018-11-15 19:23:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 19:23:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 19:23:00 [DEBUG   ] spawn_process: at 2018-11-15 19:23:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 19:23:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 19:23:00 [DEBUG   ] spawn_process: at 2018-11-15 19:23:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 19:23:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 19:23:00 [DEBUG   ] spawn_process: at 2018-11-15 19:23:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 19:23:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 19:23:00 [DEBUG   ] spawn_process: at 2018-11-15 19:23:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 19:23:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 19:23:00 [DEBUG   ] spawn_process: at 2018-11-15 19:23:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 19:23:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 19:23:00 [DEBUG   ] spawn_process: at 2018-11-15 19:23:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 19:23:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 19:23:00 [DEBUG   ] spawn_process: at 2018-11-15 19:23:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 19:23:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 19:23:00 [DEBUG   ] spawn_process: at 2018-11-15 19:23:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 19:23:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 19:23:00 [DEBUG   ] spawn_process: at 2018-11-15 19:23:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 19:23:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 19:23:00 [DEBUG   ] spawn_process: at 2018-11-15 19:23:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 19:23:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 19:23:00 [DEBUG   ] spawn_process: at 2018-11-15 19:23:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 19:23:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 19:23:00 [DEBUG   ] spawn_process: at 2018-11-15 19:23:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 19:23:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 19:23:00 [DEBUG   ] spawn_process: at 2018-11-15 19:23:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 19:23:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 19:23:00 [DEBUG   ] spawn_process: at 2018-11-15 19:23:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 19:23:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 19:23:00 [DEBUG   ] spawn_process: at 2018-11-15 19:23:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 19:23:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 19:23:00 [DEBUG   ] spawn_process: at 2018-11-15 19:23:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 19:23:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 19:23:00 [DEBUG   ] spawn_process: at 2018-11-15 19:23:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 19:23:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 19:23:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:23:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-15 19:23:10 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 19:23:10 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-15 19:23:10 [WARNING ] (13, 1, 'bot')
2018-11-15 19:23:10 [WARNING ] (13, 1, 'bot')
2018-11-15 19:23:10 [WARNING ] (13, 1, 'bot')
2018-11-15 19:23:10 [WARNING ] (13, 1, 'bot')
2018-11-15 19:23:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:23:10 [DEBUG   ] Finished updating board flags in 1.234 seconds
2018-11-15 19:23:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 19:23:22 [DEBUG   ] Got command RPT from MCS: ref #517950
2018-11-15 19:23:22 [DEBUG   ] summary = ERROR
2018-11-15 19:23:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517950  13 58437 69802505 A  ERRORERROR'
2018-11-15 19:23:22 [DEBUG   ] Got command RPT from MCS: ref #517951
2018-11-15 19:23:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 19:23:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517951  77 58437 69802709 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 19:23:22 [DEBUG   ] Got command RPT from MCS: ref #517952
2018-11-15 19:23:22 [DEBUG   ] summary = ERROR
2018-11-15 19:23:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517952  13 58437 69802902 A  ERRORERROR'
2018-11-15 19:23:23 [DEBUG   ] Got command RPT from MCS: ref #517953
2018-11-15 19:23:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 19:23:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517953  77 58437 69803105 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 19:23:23 [DEBUG   ] Got command RPT from MCS: ref #517954
2018-11-15 19:23:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 19:23:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517954  12 58437 69803309 A  ERRORB£ff'
2018-11-15 19:23:31 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 19:23:32 [DEBUG   ] Got command BAM from MCS: ref #517960
2018-11-15 19:23:32 [INFO    ] Finished processing BAM request
2018-11-15 19:23:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:23:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517960   8 58437 69812029 A  ERROR'
2018-11-15 19:23:32 [DEBUG   ] Got command BAM from MCS: ref #517959
2018-11-15 19:23:32 [INFO    ] Finished processing BAM request
2018-11-15 19:23:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:23:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517959   8 58437 69812033 A  ERROR'
2018-11-15 19:23:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 19:23:32 [DEBUG   ] spawn_process: at 2018-11-15 19:23:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 19:23:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 19:23:32 [DEBUG   ] spawn_process: at 2018-11-15 19:23:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 19:23:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 19:23:32 [DEBUG   ] spawn_process: at 2018-11-15 19:23:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 19:23:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 19:23:32 [DEBUG   ] spawn_process: at 2018-11-15 19:23:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 19:23:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 19:23:32 [DEBUG   ] spawn_process: at 2018-11-15 19:23:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 19:23:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 19:23:32 [DEBUG   ] spawn_process: at 2018-11-15 19:23:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 19:23:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 19:23:32 [DEBUG   ] spawn_process: at 2018-11-15 19:23:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 19:23:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 19:23:32 [DEBUG   ] spawn_process: at 2018-11-15 19:23:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 19:23:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 19:23:32 [DEBUG   ] spawn_process: at 2018-11-15 19:23:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 19:23:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 19:23:32 [DEBUG   ] spawn_process: at 2018-11-15 19:23:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 19:23:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 19:23:32 [DEBUG   ] spawn_process: at 2018-11-15 19:23:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 19:23:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 19:23:32 [DEBUG   ] spawn_process: at 2018-11-15 19:23:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 19:23:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 19:23:32 [DEBUG   ] spawn_process: at 2018-11-15 19:23:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 19:23:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 19:23:32 [DEBUG   ] spawn_process: at 2018-11-15 19:23:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 19:23:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 19:23:32 [DEBUG   ] spawn_process: at 2018-11-15 19:23:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 19:23:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 19:23:32 [DEBUG   ] spawn_process: at 2018-11-15 19:23:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 19:23:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 19:23:32 [DEBUG   ] spawn_process: at 2018-11-15 19:23:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 19:23:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 19:23:32 [DEBUG   ] spawn_process: at 2018-11-15 19:23:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 19:23:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 19:23:32 [DEBUG   ] spawn_process: at 2018-11-15 19:23:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 19:23:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 19:23:32 [DEBUG   ] spawn_process: at 2018-11-15 19:23:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 19:23:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 19:23:32 [DEBUG   ] spawn_process: at 2018-11-15 19:23:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 19:23:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 19:23:32 [DEBUG   ] spawn_process: at 2018-11-15 19:23:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 19:23:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 19:23:32 [DEBUG   ] spawn_process: at 2018-11-15 19:23:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 19:23:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 19:23:32 [DEBUG   ] spawn_process: at 2018-11-15 19:23:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 19:23:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 19:23:32 [DEBUG   ] spawn_process: at 2018-11-15 19:23:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 19:23:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 19:23:32 [DEBUG   ] spawn_process: at 2018-11-15 19:23:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 19:23:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 19:24:04 [DEBUG   ] Got command BAM from MCS: ref #517962
2018-11-15 19:24:04 [INFO    ] Finished processing BAM request
2018-11-15 19:24:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:24:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517962   8 58437 69844025 A  ERROR'
2018-11-15 19:24:04 [DEBUG   ] Got command BAM from MCS: ref #517961
2018-11-15 19:24:04 [INFO    ] Finished processing BAM request
2018-11-15 19:24:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:24:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517961   8 58437 69844029 A  ERROR'
2018-11-15 19:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 19:24:04 [DEBUG   ] spawn_process: at 2018-11-15 19:24:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 19:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 19:24:04 [DEBUG   ] spawn_process: at 2018-11-15 19:24:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 19:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 19:24:04 [DEBUG   ] spawn_process: at 2018-11-15 19:24:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 19:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 19:24:04 [DEBUG   ] spawn_process: at 2018-11-15 19:24:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 19:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 19:24:04 [DEBUG   ] spawn_process: at 2018-11-15 19:24:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 19:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 19:24:04 [DEBUG   ] spawn_process: at 2018-11-15 19:24:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 19:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 19:24:04 [DEBUG   ] spawn_process: at 2018-11-15 19:24:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 19:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 19:24:04 [DEBUG   ] spawn_process: at 2018-11-15 19:24:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 19:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 19:24:04 [DEBUG   ] spawn_process: at 2018-11-15 19:24:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 19:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 19:24:04 [DEBUG   ] spawn_process: at 2018-11-15 19:24:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 19:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 19:24:04 [DEBUG   ] spawn_process: at 2018-11-15 19:24:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 19:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 19:24:04 [DEBUG   ] spawn_process: at 2018-11-15 19:24:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 19:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 19:24:04 [DEBUG   ] spawn_process: at 2018-11-15 19:24:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 19:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 19:24:04 [DEBUG   ] spawn_process: at 2018-11-15 19:24:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 19:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 19:24:04 [DEBUG   ] spawn_process: at 2018-11-15 19:24:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 19:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 19:24:04 [DEBUG   ] spawn_process: at 2018-11-15 19:24:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 19:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 19:24:04 [DEBUG   ] spawn_process: at 2018-11-15 19:24:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 19:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 19:24:04 [DEBUG   ] spawn_process: at 2018-11-15 19:24:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 19:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 19:24:04 [DEBUG   ] spawn_process: at 2018-11-15 19:24:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 19:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 19:24:04 [DEBUG   ] spawn_process: at 2018-11-15 19:24:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 19:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 19:24:04 [DEBUG   ] spawn_process: at 2018-11-15 19:24:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 19:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 19:24:04 [DEBUG   ] spawn_process: at 2018-11-15 19:24:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 19:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 19:24:04 [DEBUG   ] spawn_process: at 2018-11-15 19:24:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 19:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 19:24:04 [DEBUG   ] spawn_process: at 2018-11-15 19:24:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 19:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 19:24:04 [DEBUG   ] spawn_process: at 2018-11-15 19:24:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 19:24:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 19:24:04 [DEBUG   ] spawn_process: at 2018-11-15 19:24:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 19:24:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 19:24:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:24:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-15 19:24:10 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 19:24:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 19:24:10 [WARNING ] (13, 1, 'bot')
2018-11-15 19:24:10 [WARNING ] (13, 1, 'bot')
2018-11-15 19:24:10 [WARNING ] (13, 1, 'bot')
2018-11-15 19:24:10 [WARNING ] (13, 1, 'bot')
2018-11-15 19:24:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:24:10 [DEBUG   ] Finished updating board flags in 1.175 seconds
2018-11-15 19:24:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 19:24:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 19:24:36 [DEBUG   ] Got command BAM from MCS: ref #517964
2018-11-15 19:24:36 [INFO    ] Finished processing BAM request
2018-11-15 19:24:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:24:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517964   8 58437 69876025 A  ERROR'
2018-11-15 19:24:36 [DEBUG   ] Got command BAM from MCS: ref #517963
2018-11-15 19:24:36 [INFO    ] Finished processing BAM request
2018-11-15 19:24:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:24:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517963   8 58437 69876029 A  ERROR'
2018-11-15 19:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 19:24:36 [DEBUG   ] spawn_process: at 2018-11-15 19:24:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 19:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 19:24:36 [DEBUG   ] spawn_process: at 2018-11-15 19:24:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 19:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 19:24:36 [DEBUG   ] spawn_process: at 2018-11-15 19:24:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 19:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 19:24:36 [DEBUG   ] spawn_process: at 2018-11-15 19:24:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 19:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 19:24:36 [DEBUG   ] spawn_process: at 2018-11-15 19:24:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 19:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 19:24:36 [DEBUG   ] spawn_process: at 2018-11-15 19:24:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 19:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 19:24:36 [DEBUG   ] spawn_process: at 2018-11-15 19:24:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 19:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 19:24:36 [DEBUG   ] spawn_process: at 2018-11-15 19:24:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 19:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 19:24:36 [DEBUG   ] spawn_process: at 2018-11-15 19:24:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 19:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 19:24:36 [DEBUG   ] spawn_process: at 2018-11-15 19:24:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 19:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 19:24:36 [DEBUG   ] spawn_process: at 2018-11-15 19:24:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 19:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 19:24:36 [DEBUG   ] spawn_process: at 2018-11-15 19:24:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 19:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 19:24:36 [DEBUG   ] spawn_process: at 2018-11-15 19:24:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 19:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 19:24:36 [DEBUG   ] spawn_process: at 2018-11-15 19:24:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 19:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 19:24:36 [DEBUG   ] spawn_process: at 2018-11-15 19:24:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 19:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 19:24:36 [DEBUG   ] spawn_process: at 2018-11-15 19:24:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 19:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 19:24:36 [DEBUG   ] spawn_process: at 2018-11-15 19:24:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 19:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 19:24:36 [DEBUG   ] spawn_process: at 2018-11-15 19:24:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 19:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 19:24:36 [DEBUG   ] spawn_process: at 2018-11-15 19:24:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 19:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 19:24:36 [DEBUG   ] spawn_process: at 2018-11-15 19:24:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 19:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 19:24:36 [DEBUG   ] spawn_process: at 2018-11-15 19:24:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 19:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 19:24:36 [DEBUG   ] spawn_process: at 2018-11-15 19:24:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 19:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 19:24:36 [DEBUG   ] spawn_process: at 2018-11-15 19:24:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 19:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 19:24:36 [DEBUG   ] spawn_process: at 2018-11-15 19:24:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 19:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 19:24:36 [DEBUG   ] spawn_process: at 2018-11-15 19:24:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 19:24:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 19:24:36 [DEBUG   ] spawn_process: at 2018-11-15 19:24:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 19:24:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 19:25:08 [DEBUG   ] Got command BAM from MCS: ref #517966
2018-11-15 19:25:08 [INFO    ] Finished processing BAM request
2018-11-15 19:25:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:25:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517966   8 58437 69908033 A  ERROR'
2018-11-15 19:25:08 [DEBUG   ] Got command BAM from MCS: ref #517965
2018-11-15 19:25:08 [INFO    ] Finished processing BAM request
2018-11-15 19:25:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:25:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517965   8 58437 69908037 A  ERROR'
2018-11-15 19:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 19:25:08 [DEBUG   ] spawn_process: at 2018-11-15 19:25:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 19:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 19:25:08 [DEBUG   ] spawn_process: at 2018-11-15 19:25:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 19:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 19:25:08 [DEBUG   ] spawn_process: at 2018-11-15 19:25:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 19:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 19:25:08 [DEBUG   ] spawn_process: at 2018-11-15 19:25:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 19:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 19:25:08 [DEBUG   ] spawn_process: at 2018-11-15 19:25:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 19:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 19:25:08 [DEBUG   ] spawn_process: at 2018-11-15 19:25:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 19:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 19:25:08 [DEBUG   ] spawn_process: at 2018-11-15 19:25:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 19:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 19:25:08 [DEBUG   ] spawn_process: at 2018-11-15 19:25:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 19:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 19:25:08 [DEBUG   ] spawn_process: at 2018-11-15 19:25:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 19:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 19:25:08 [DEBUG   ] spawn_process: at 2018-11-15 19:25:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 19:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 19:25:08 [DEBUG   ] spawn_process: at 2018-11-15 19:25:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 19:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 19:25:08 [DEBUG   ] spawn_process: at 2018-11-15 19:25:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 19:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 19:25:08 [DEBUG   ] spawn_process: at 2018-11-15 19:25:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 19:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 19:25:08 [DEBUG   ] spawn_process: at 2018-11-15 19:25:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 19:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 19:25:08 [DEBUG   ] spawn_process: at 2018-11-15 19:25:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 19:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 19:25:08 [DEBUG   ] spawn_process: at 2018-11-15 19:25:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 19:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 19:25:08 [DEBUG   ] spawn_process: at 2018-11-15 19:25:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 19:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 19:25:08 [DEBUG   ] spawn_process: at 2018-11-15 19:25:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 19:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 19:25:08 [DEBUG   ] spawn_process: at 2018-11-15 19:25:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 19:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 19:25:08 [DEBUG   ] spawn_process: at 2018-11-15 19:25:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 19:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 19:25:08 [DEBUG   ] spawn_process: at 2018-11-15 19:25:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 19:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 19:25:08 [DEBUG   ] spawn_process: at 2018-11-15 19:25:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 19:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 19:25:08 [DEBUG   ] spawn_process: at 2018-11-15 19:25:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 19:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 19:25:08 [DEBUG   ] spawn_process: at 2018-11-15 19:25:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 19:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 19:25:08 [DEBUG   ] spawn_process: at 2018-11-15 19:25:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 19:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 19:25:08 [DEBUG   ] spawn_process: at 2018-11-15 19:25:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 19:25:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 19:25:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-15 19:25:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-15 19:25:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:25:11 [DEBUG   ] Finished updating ant stats in 1.229 seconds
2018-11-15 19:25:11 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 19:25:11 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-15 19:25:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 19:25:11 [WARNING ] (13, 1, 'bot')
2018-11-15 19:25:11 [WARNING ] (13, 1, 'bot')
2018-11-15 19:25:11 [WARNING ] (13, 1, 'bot')
2018-11-15 19:25:11 [WARNING ] (13, 1, 'bot')
2018-11-15 19:25:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:25:11 [DEBUG   ] Finished updating board flags in 2.036 seconds
2018-11-15 19:25:31 [DEBUG   ] Finished updating ant stats in 1.174 seconds
2018-11-15 19:25:40 [DEBUG   ] Got command BAM from MCS: ref #517968
2018-11-15 19:25:40 [INFO    ] Finished processing BAM request
2018-11-15 19:25:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:25:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517968   8 58437 69940029 A  ERROR'
2018-11-15 19:25:40 [DEBUG   ] Got command BAM from MCS: ref #517967
2018-11-15 19:25:40 [INFO    ] Finished processing BAM request
2018-11-15 19:25:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:25:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517967   8 58437 69940033 A  ERROR'
2018-11-15 19:25:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 19:25:40 [DEBUG   ] spawn_process: at 2018-11-15 19:25:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 19:25:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 19:25:40 [DEBUG   ] spawn_process: at 2018-11-15 19:25:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 19:25:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 19:25:40 [DEBUG   ] spawn_process: at 2018-11-15 19:25:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 19:25:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 19:25:40 [DEBUG   ] spawn_process: at 2018-11-15 19:25:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 19:25:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 19:25:40 [DEBUG   ] spawn_process: at 2018-11-15 19:25:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 19:25:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 19:25:40 [DEBUG   ] spawn_process: at 2018-11-15 19:25:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 19:25:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 19:25:40 [DEBUG   ] spawn_process: at 2018-11-15 19:25:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 19:25:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 19:25:40 [DEBUG   ] spawn_process: at 2018-11-15 19:25:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 19:25:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 19:25:40 [DEBUG   ] spawn_process: at 2018-11-15 19:25:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 19:25:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 19:25:40 [DEBUG   ] spawn_process: at 2018-11-15 19:25:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 19:25:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 19:25:40 [DEBUG   ] spawn_process: at 2018-11-15 19:25:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 19:25:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 19:25:40 [DEBUG   ] spawn_process: at 2018-11-15 19:25:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 19:25:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 19:25:40 [DEBUG   ] spawn_process: at 2018-11-15 19:25:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 19:25:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 19:25:40 [DEBUG   ] spawn_process: at 2018-11-15 19:25:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 19:25:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 19:25:40 [DEBUG   ] spawn_process: at 2018-11-15 19:25:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 19:25:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 19:25:40 [DEBUG   ] spawn_process: at 2018-11-15 19:25:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 19:25:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 19:25:40 [DEBUG   ] spawn_process: at 2018-11-15 19:25:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 19:25:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 19:25:40 [DEBUG   ] spawn_process: at 2018-11-15 19:25:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 19:25:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 19:25:40 [DEBUG   ] spawn_process: at 2018-11-15 19:25:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 19:25:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 19:25:40 [DEBUG   ] spawn_process: at 2018-11-15 19:25:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 19:25:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 19:25:40 [DEBUG   ] spawn_process: at 2018-11-15 19:25:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 19:25:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 19:25:40 [DEBUG   ] spawn_process: at 2018-11-15 19:25:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 19:25:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 19:25:40 [DEBUG   ] spawn_process: at 2018-11-15 19:25:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 19:25:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 19:25:40 [DEBUG   ] spawn_process: at 2018-11-15 19:25:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 19:25:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 19:25:40 [DEBUG   ] spawn_process: at 2018-11-15 19:25:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 19:25:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 19:25:40 [DEBUG   ] spawn_process: at 2018-11-15 19:25:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 19:25:45 [DEBUG   ] Got command RPT from MCS: ref #517969
2018-11-15 19:25:45 [DEBUG   ] summary = ERROR
2018-11-15 19:25:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517969  13 58437 69945181 A  ERRORERROR'
2018-11-15 19:25:45 [DEBUG   ] Got command RPT from MCS: ref #517970
2018-11-15 19:25:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 19:25:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   517970  77 58437 69945182 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 19:25:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 19:26:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 19:26:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-11-15 19:26:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 19:26:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:26:10 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-15 19:26:10 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-15 19:26:10 [WARNING ] (13, 1, 'bot')
2018-11-15 19:26:10 [WARNING ] (13, 1, 'bot')
2018-11-15 19:26:10 [WARNING ] (13, 1, 'bot')
2018-11-15 19:26:10 [WARNING ] (13, 1, 'bot')
2018-11-15 19:26:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:26:10 [DEBUG   ] Finished updating board flags in 1.417 seconds
2018-11-15 19:26:11 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-15 19:26:12 [DEBUG   ] Got command BAM from MCS: ref #517986
2018-11-15 19:26:12 [INFO    ] Finished processing BAM request
2018-11-15 19:26:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:26:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517986   8 58437 69972029 A  ERROR'
2018-11-15 19:26:12 [DEBUG   ] Got command BAM from MCS: ref #517987
2018-11-15 19:26:12 [INFO    ] Finished processing BAM request
2018-11-15 19:26:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:26:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517987   8 58437 69972033 A  ERROR'
2018-11-15 19:26:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 19:26:12 [DEBUG   ] spawn_process: at 2018-11-15 19:26:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 19:26:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 19:26:12 [DEBUG   ] spawn_process: at 2018-11-15 19:26:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 19:26:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 19:26:12 [DEBUG   ] spawn_process: at 2018-11-15 19:26:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 19:26:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 19:26:12 [DEBUG   ] spawn_process: at 2018-11-15 19:26:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 19:26:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 19:26:12 [DEBUG   ] spawn_process: at 2018-11-15 19:26:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 19:26:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 19:26:12 [DEBUG   ] spawn_process: at 2018-11-15 19:26:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 19:26:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 19:26:12 [DEBUG   ] spawn_process: at 2018-11-15 19:26:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 19:26:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 19:26:12 [DEBUG   ] spawn_process: at 2018-11-15 19:26:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 19:26:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 19:26:12 [DEBUG   ] spawn_process: at 2018-11-15 19:26:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 19:26:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 19:26:12 [DEBUG   ] spawn_process: at 2018-11-15 19:26:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 19:26:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 19:26:12 [DEBUG   ] spawn_process: at 2018-11-15 19:26:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 19:26:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 19:26:12 [DEBUG   ] spawn_process: at 2018-11-15 19:26:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 19:26:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 19:26:12 [DEBUG   ] spawn_process: at 2018-11-15 19:26:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 19:26:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 19:26:12 [DEBUG   ] spawn_process: at 2018-11-15 19:26:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 19:26:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 19:26:12 [DEBUG   ] spawn_process: at 2018-11-15 19:26:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 19:26:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 19:26:12 [DEBUG   ] spawn_process: at 2018-11-15 19:26:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 19:26:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 19:26:12 [DEBUG   ] spawn_process: at 2018-11-15 19:26:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 19:26:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 19:26:12 [DEBUG   ] spawn_process: at 2018-11-15 19:26:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 19:26:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 19:26:12 [DEBUG   ] spawn_process: at 2018-11-15 19:26:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 19:26:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 19:26:12 [DEBUG   ] spawn_process: at 2018-11-15 19:26:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 19:26:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 19:26:12 [DEBUG   ] spawn_process: at 2018-11-15 19:26:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 19:26:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 19:26:12 [DEBUG   ] spawn_process: at 2018-11-15 19:26:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 19:26:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 19:26:12 [DEBUG   ] spawn_process: at 2018-11-15 19:26:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 19:26:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 19:26:12 [DEBUG   ] spawn_process: at 2018-11-15 19:26:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 19:26:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 19:26:12 [DEBUG   ] spawn_process: at 2018-11-15 19:26:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 19:26:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 19:26:12 [DEBUG   ] spawn_process: at 2018-11-15 19:26:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 19:26:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 19:26:44 [DEBUG   ] Got command BAM from MCS: ref #517992
2018-11-15 19:26:44 [INFO    ] Finished processing BAM request
2018-11-15 19:26:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:26:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517992   8 58437 70004033 A  ERROR'
2018-11-15 19:26:44 [DEBUG   ] Got command BAM from MCS: ref #517993
2018-11-15 19:26:44 [INFO    ] Finished processing BAM request
2018-11-15 19:26:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:26:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517993   8 58437 70004037 A  ERROR'
2018-11-15 19:26:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 19:26:44 [DEBUG   ] spawn_process: at 2018-11-15 19:26:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 19:26:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 19:26:44 [DEBUG   ] spawn_process: at 2018-11-15 19:26:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 19:26:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 19:26:44 [DEBUG   ] spawn_process: at 2018-11-15 19:26:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 19:26:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 19:26:44 [DEBUG   ] spawn_process: at 2018-11-15 19:26:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 19:26:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 19:26:44 [DEBUG   ] spawn_process: at 2018-11-15 19:26:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 19:26:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 19:26:44 [DEBUG   ] spawn_process: at 2018-11-15 19:26:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 19:26:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 19:26:44 [DEBUG   ] spawn_process: at 2018-11-15 19:26:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 19:26:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 19:26:44 [DEBUG   ] spawn_process: at 2018-11-15 19:26:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 19:26:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 19:26:44 [DEBUG   ] spawn_process: at 2018-11-15 19:26:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 19:26:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 19:26:44 [DEBUG   ] spawn_process: at 2018-11-15 19:26:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 19:26:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 19:26:44 [DEBUG   ] spawn_process: at 2018-11-15 19:26:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 19:26:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 19:26:44 [DEBUG   ] spawn_process: at 2018-11-15 19:26:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 19:26:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 19:26:44 [DEBUG   ] spawn_process: at 2018-11-15 19:26:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 19:26:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 19:26:44 [DEBUG   ] spawn_process: at 2018-11-15 19:26:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 19:26:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 19:26:44 [DEBUG   ] spawn_process: at 2018-11-15 19:26:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 19:26:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 19:26:44 [DEBUG   ] spawn_process: at 2018-11-15 19:26:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 19:26:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 19:26:44 [DEBUG   ] spawn_process: at 2018-11-15 19:26:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 19:26:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 19:26:44 [DEBUG   ] spawn_process: at 2018-11-15 19:26:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 19:26:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 19:26:44 [DEBUG   ] spawn_process: at 2018-11-15 19:26:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 19:26:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 19:26:44 [DEBUG   ] spawn_process: at 2018-11-15 19:26:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 19:26:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 19:26:44 [DEBUG   ] spawn_process: at 2018-11-15 19:26:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 19:26:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 19:26:44 [DEBUG   ] spawn_process: at 2018-11-15 19:26:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 19:26:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 19:26:44 [DEBUG   ] spawn_process: at 2018-11-15 19:26:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 19:26:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 19:26:44 [DEBUG   ] spawn_process: at 2018-11-15 19:26:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 19:26:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 19:26:44 [DEBUG   ] spawn_process: at 2018-11-15 19:26:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 19:26:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 19:26:44 [DEBUG   ] spawn_process: at 2018-11-15 19:26:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 19:26:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 19:27:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:27:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-15 19:27:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-11-15 19:27:10 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 19:27:10 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-15 19:27:10 [WARNING ] (13, 1, 'bot')
2018-11-15 19:27:10 [WARNING ] (13, 1, 'bot')
2018-11-15 19:27:10 [WARNING ] (13, 1, 'bot')
2018-11-15 19:27:10 [WARNING ] (13, 1, 'bot')
2018-11-15 19:27:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:27:10 [DEBUG   ] Finished updating board flags in 1.420 seconds
2018-11-15 19:27:11 [DEBUG   ] Finished updating ant stats in 0.790 seconds
2018-11-15 19:27:16 [DEBUG   ] Got command BAM from MCS: ref #517995
2018-11-15 19:27:16 [INFO    ] Finished processing BAM request
2018-11-15 19:27:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:27:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517995   8 58437 70036033 A  ERROR'
2018-11-15 19:27:16 [DEBUG   ] Got command BAM from MCS: ref #517994
2018-11-15 19:27:16 [INFO    ] Finished processing BAM request
2018-11-15 19:27:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:27:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517994   8 58437 70036037 A  ERROR'
2018-11-15 19:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 19:27:16 [DEBUG   ] spawn_process: at 2018-11-15 19:27:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 19:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 19:27:16 [DEBUG   ] spawn_process: at 2018-11-15 19:27:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 19:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 19:27:16 [DEBUG   ] spawn_process: at 2018-11-15 19:27:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 19:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 19:27:16 [DEBUG   ] spawn_process: at 2018-11-15 19:27:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 19:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 19:27:16 [DEBUG   ] spawn_process: at 2018-11-15 19:27:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 19:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 19:27:16 [DEBUG   ] spawn_process: at 2018-11-15 19:27:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 19:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 19:27:16 [DEBUG   ] spawn_process: at 2018-11-15 19:27:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 19:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 19:27:16 [DEBUG   ] spawn_process: at 2018-11-15 19:27:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 19:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 19:27:16 [DEBUG   ] spawn_process: at 2018-11-15 19:27:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 19:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 19:27:16 [DEBUG   ] spawn_process: at 2018-11-15 19:27:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 19:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 19:27:16 [DEBUG   ] spawn_process: at 2018-11-15 19:27:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 19:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 19:27:16 [DEBUG   ] spawn_process: at 2018-11-15 19:27:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 19:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 19:27:16 [DEBUG   ] spawn_process: at 2018-11-15 19:27:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 19:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 19:27:16 [DEBUG   ] spawn_process: at 2018-11-15 19:27:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 19:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 19:27:16 [DEBUG   ] spawn_process: at 2018-11-15 19:27:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 19:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 19:27:16 [DEBUG   ] spawn_process: at 2018-11-15 19:27:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 19:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 19:27:16 [DEBUG   ] spawn_process: at 2018-11-15 19:27:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 19:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 19:27:16 [DEBUG   ] spawn_process: at 2018-11-15 19:27:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 19:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 19:27:16 [DEBUG   ] spawn_process: at 2018-11-15 19:27:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 19:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 19:27:16 [DEBUG   ] spawn_process: at 2018-11-15 19:27:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 19:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 19:27:16 [DEBUG   ] spawn_process: at 2018-11-15 19:27:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 19:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 19:27:16 [DEBUG   ] spawn_process: at 2018-11-15 19:27:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 19:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 19:27:16 [DEBUG   ] spawn_process: at 2018-11-15 19:27:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 19:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 19:27:16 [DEBUG   ] spawn_process: at 2018-11-15 19:27:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 19:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 19:27:16 [DEBUG   ] spawn_process: at 2018-11-15 19:27:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 19:27:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 19:27:16 [DEBUG   ] spawn_process: at 2018-11-15 19:27:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 19:27:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 19:27:48 [DEBUG   ] Got command BAM from MCS: ref #517997
2018-11-15 19:27:48 [INFO    ] Finished processing BAM request
2018-11-15 19:27:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:27:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517997   8 58437 70068033 A  ERROR'
2018-11-15 19:27:48 [DEBUG   ] Got command BAM from MCS: ref #517996
2018-11-15 19:27:48 [INFO    ] Finished processing BAM request
2018-11-15 19:27:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:27:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   517996   8 58437 70068037 A  ERROR'
2018-11-15 19:27:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 19:27:48 [DEBUG   ] spawn_process: at 2018-11-15 19:27:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 19:27:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 19:27:48 [DEBUG   ] spawn_process: at 2018-11-15 19:27:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 19:27:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 19:27:48 [DEBUG   ] spawn_process: at 2018-11-15 19:27:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 19:27:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 19:27:48 [DEBUG   ] spawn_process: at 2018-11-15 19:27:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 19:27:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 19:27:48 [DEBUG   ] spawn_process: at 2018-11-15 19:27:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 19:27:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 19:27:48 [DEBUG   ] spawn_process: at 2018-11-15 19:27:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 19:27:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 19:27:48 [DEBUG   ] spawn_process: at 2018-11-15 19:27:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 19:27:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 19:27:48 [DEBUG   ] spawn_process: at 2018-11-15 19:27:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 19:27:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 19:27:48 [DEBUG   ] spawn_process: at 2018-11-15 19:27:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 19:27:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 19:27:48 [DEBUG   ] spawn_process: at 2018-11-15 19:27:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 19:27:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 19:27:48 [DEBUG   ] spawn_process: at 2018-11-15 19:27:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 19:27:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 19:27:48 [DEBUG   ] spawn_process: at 2018-11-15 19:27:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 19:27:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 19:27:48 [DEBUG   ] spawn_process: at 2018-11-15 19:27:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 19:27:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 19:27:48 [DEBUG   ] spawn_process: at 2018-11-15 19:27:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 19:27:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 19:27:48 [DEBUG   ] spawn_process: at 2018-11-15 19:27:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 19:27:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 19:27:48 [DEBUG   ] spawn_process: at 2018-11-15 19:27:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 19:27:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 19:27:48 [DEBUG   ] spawn_process: at 2018-11-15 19:27:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 19:27:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 19:27:48 [DEBUG   ] spawn_process: at 2018-11-15 19:27:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 19:27:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 19:27:48 [DEBUG   ] spawn_process: at 2018-11-15 19:27:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 19:27:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 19:27:48 [DEBUG   ] spawn_process: at 2018-11-15 19:27:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 19:27:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 19:27:48 [DEBUG   ] spawn_process: at 2018-11-15 19:27:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 19:27:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 19:27:48 [DEBUG   ] spawn_process: at 2018-11-15 19:27:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 19:27:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 19:27:48 [DEBUG   ] spawn_process: at 2018-11-15 19:27:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 19:27:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 19:27:48 [DEBUG   ] spawn_process: at 2018-11-15 19:27:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 19:27:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 19:27:48 [DEBUG   ] spawn_process: at 2018-11-15 19:27:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 19:27:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 19:27:48 [DEBUG   ] spawn_process: at 2018-11-15 19:27:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 19:27:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 19:28:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 19:28:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:28:10 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 19:28:10 [WARNING ] (13, 1, 'bot')
2018-11-15 19:28:10 [WARNING ] (13, 1, 'bot')
2018-11-15 19:28:10 [WARNING ] (13, 1, 'bot')
2018-11-15 19:28:10 [WARNING ] (13, 1, 'bot')
2018-11-15 19:28:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:28:10 [DEBUG   ] Finished updating board flags in 1.403 seconds
2018-11-15 19:28:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 19:28:20 [DEBUG   ] Got command BAM from MCS: ref #518000
2018-11-15 19:28:20 [INFO    ] Finished processing BAM request
2018-11-15 19:28:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:28:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518000   8 58437 70100025 A  ERROR'
2018-11-15 19:28:20 [DEBUG   ] Got command BAM from MCS: ref #518001
2018-11-15 19:28:20 [INFO    ] Finished processing BAM request
2018-11-15 19:28:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:28:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518001   8 58437 70100029 A  ERROR'
2018-11-15 19:28:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 19:28:20 [DEBUG   ] spawn_process: at 2018-11-15 19:28:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 19:28:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 19:28:20 [DEBUG   ] spawn_process: at 2018-11-15 19:28:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 19:28:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 19:28:20 [DEBUG   ] spawn_process: at 2018-11-15 19:28:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 19:28:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 19:28:20 [DEBUG   ] spawn_process: at 2018-11-15 19:28:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 19:28:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 19:28:20 [DEBUG   ] spawn_process: at 2018-11-15 19:28:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 19:28:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 19:28:20 [DEBUG   ] spawn_process: at 2018-11-15 19:28:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 19:28:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 19:28:20 [DEBUG   ] spawn_process: at 2018-11-15 19:28:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 19:28:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 19:28:20 [DEBUG   ] spawn_process: at 2018-11-15 19:28:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 19:28:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 19:28:20 [DEBUG   ] spawn_process: at 2018-11-15 19:28:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 19:28:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 19:28:20 [DEBUG   ] spawn_process: at 2018-11-15 19:28:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 19:28:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 19:28:20 [DEBUG   ] spawn_process: at 2018-11-15 19:28:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 19:28:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 19:28:20 [DEBUG   ] spawn_process: at 2018-11-15 19:28:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 19:28:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 19:28:20 [DEBUG   ] spawn_process: at 2018-11-15 19:28:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 19:28:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 19:28:20 [DEBUG   ] spawn_process: at 2018-11-15 19:28:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 19:28:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 19:28:20 [DEBUG   ] spawn_process: at 2018-11-15 19:28:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 19:28:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 19:28:20 [DEBUG   ] spawn_process: at 2018-11-15 19:28:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 19:28:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 19:28:20 [DEBUG   ] spawn_process: at 2018-11-15 19:28:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 19:28:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 19:28:20 [DEBUG   ] spawn_process: at 2018-11-15 19:28:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 19:28:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 19:28:20 [DEBUG   ] spawn_process: at 2018-11-15 19:28:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 19:28:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 19:28:20 [DEBUG   ] spawn_process: at 2018-11-15 19:28:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 19:28:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 19:28:20 [DEBUG   ] spawn_process: at 2018-11-15 19:28:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 19:28:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 19:28:20 [DEBUG   ] spawn_process: at 2018-11-15 19:28:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 19:28:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 19:28:20 [DEBUG   ] spawn_process: at 2018-11-15 19:28:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 19:28:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 19:28:20 [DEBUG   ] spawn_process: at 2018-11-15 19:28:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 19:28:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 19:28:20 [DEBUG   ] spawn_process: at 2018-11-15 19:28:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 19:28:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 19:28:20 [DEBUG   ] spawn_process: at 2018-11-15 19:28:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 19:28:22 [DEBUG   ] Got command RPT from MCS: ref #518002
2018-11-15 19:28:22 [DEBUG   ] summary = ERROR
2018-11-15 19:28:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518002  13 58437 70102585 A  ERRORERROR'
2018-11-15 19:28:22 [DEBUG   ] Got command RPT from MCS: ref #518003
2018-11-15 19:28:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 19:28:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518003  77 58437 70102789 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 19:28:22 [DEBUG   ] Got command RPT from MCS: ref #518004
2018-11-15 19:28:22 [DEBUG   ] summary = ERROR
2018-11-15 19:28:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518004  13 58437 70102998 A  ERRORERROR'
2018-11-15 19:28:23 [DEBUG   ] Got command RPT from MCS: ref #518006
2018-11-15 19:28:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 19:28:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518006  77 58437 70103189 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 19:28:23 [DEBUG   ] Got command RPT from MCS: ref #518007
2018-11-15 19:28:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 19:28:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518007  12 58437 70103393 A  ERRORB¢ff'
2018-11-15 19:28:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 19:28:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 19:28:52 [DEBUG   ] Got command BAM from MCS: ref #518012
2018-11-15 19:28:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:28:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518012   8 58437 70132029 A  ERROR'
2018-11-15 19:28:52 [DEBUG   ] Got command BAM from MCS: ref #518013
2018-11-15 19:28:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:28:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518013   8 58437 70132033 A  ERROR'
2018-11-15 19:28:52 [INFO    ] Finished processing BAM request
2018-11-15 19:28:52 [INFO    ] Finished processing BAM request
2018-11-15 19:28:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 19:28:52 [DEBUG   ] spawn_process: at 2018-11-15 19:28:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 19:28:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 19:28:52 [DEBUG   ] spawn_process: at 2018-11-15 19:28:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 19:28:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 19:28:52 [DEBUG   ] spawn_process: at 2018-11-15 19:28:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 19:28:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 19:28:52 [DEBUG   ] spawn_process: at 2018-11-15 19:28:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 19:28:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 19:28:52 [DEBUG   ] spawn_process: at 2018-11-15 19:28:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 19:28:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 19:28:52 [DEBUG   ] spawn_process: at 2018-11-15 19:28:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 19:28:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 19:28:52 [DEBUG   ] spawn_process: at 2018-11-15 19:28:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 19:28:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 19:28:52 [DEBUG   ] spawn_process: at 2018-11-15 19:28:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 19:28:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 19:28:52 [DEBUG   ] spawn_process: at 2018-11-15 19:28:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 19:28:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 19:28:52 [DEBUG   ] spawn_process: at 2018-11-15 19:28:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 19:28:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 19:28:52 [DEBUG   ] spawn_process: at 2018-11-15 19:28:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 19:28:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 19:28:52 [DEBUG   ] spawn_process: at 2018-11-15 19:28:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 19:28:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 19:28:52 [DEBUG   ] spawn_process: at 2018-11-15 19:28:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 19:28:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 19:28:52 [DEBUG   ] spawn_process: at 2018-11-15 19:28:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 19:28:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 19:28:52 [DEBUG   ] spawn_process: at 2018-11-15 19:28:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 19:28:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 19:28:52 [DEBUG   ] spawn_process: at 2018-11-15 19:28:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 19:28:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 19:28:52 [DEBUG   ] spawn_process: at 2018-11-15 19:28:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 19:28:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 19:28:52 [DEBUG   ] spawn_process: at 2018-11-15 19:28:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 19:28:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 19:28:52 [DEBUG   ] spawn_process: at 2018-11-15 19:28:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 19:28:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 19:28:52 [DEBUG   ] spawn_process: at 2018-11-15 19:28:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 19:28:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 19:28:52 [DEBUG   ] spawn_process: at 2018-11-15 19:28:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 19:28:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 19:28:52 [DEBUG   ] spawn_process: at 2018-11-15 19:28:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 19:28:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 19:28:52 [DEBUG   ] spawn_process: at 2018-11-15 19:28:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 19:28:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 19:28:52 [DEBUG   ] spawn_process: at 2018-11-15 19:28:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 19:28:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 19:28:52 [DEBUG   ] spawn_process: at 2018-11-15 19:28:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 19:28:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 19:28:52 [DEBUG   ] spawn_process: at 2018-11-15 19:28:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 19:29:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 19:29:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:29:10 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 19:29:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 19:29:10 [WARNING ] (13, 1, 'bot')
2018-11-15 19:29:10 [WARNING ] (13, 1, 'bot')
2018-11-15 19:29:10 [WARNING ] (13, 1, 'bot')
2018-11-15 19:29:10 [WARNING ] (13, 1, 'bot')
2018-11-15 19:29:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:29:10 [DEBUG   ] Finished updating board flags in 1.387 seconds
2018-11-15 19:29:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 19:29:24 [DEBUG   ] Got command BAM from MCS: ref #518014
2018-11-15 19:29:24 [INFO    ] Finished processing BAM request
2018-11-15 19:29:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:29:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518014   8 58437 70164025 A  ERROR'
2018-11-15 19:29:24 [DEBUG   ] Got command BAM from MCS: ref #518015
2018-11-15 19:29:24 [INFO    ] Finished processing BAM request
2018-11-15 19:29:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:29:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518015   8 58437 70164029 A  ERROR'
2018-11-15 19:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 19:29:24 [DEBUG   ] spawn_process: at 2018-11-15 19:29:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 19:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 19:29:24 [DEBUG   ] spawn_process: at 2018-11-15 19:29:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 19:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 19:29:24 [DEBUG   ] spawn_process: at 2018-11-15 19:29:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 19:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 19:29:24 [DEBUG   ] spawn_process: at 2018-11-15 19:29:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 19:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 19:29:24 [DEBUG   ] spawn_process: at 2018-11-15 19:29:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 19:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 19:29:24 [DEBUG   ] spawn_process: at 2018-11-15 19:29:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 19:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 19:29:24 [DEBUG   ] spawn_process: at 2018-11-15 19:29:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 19:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 19:29:24 [DEBUG   ] spawn_process: at 2018-11-15 19:29:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 19:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 19:29:24 [DEBUG   ] spawn_process: at 2018-11-15 19:29:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 19:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 19:29:24 [DEBUG   ] spawn_process: at 2018-11-15 19:29:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 19:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 19:29:24 [DEBUG   ] spawn_process: at 2018-11-15 19:29:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 19:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 19:29:24 [DEBUG   ] spawn_process: at 2018-11-15 19:29:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 19:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 19:29:24 [DEBUG   ] spawn_process: at 2018-11-15 19:29:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 19:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 19:29:24 [DEBUG   ] spawn_process: at 2018-11-15 19:29:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 19:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 19:29:24 [DEBUG   ] spawn_process: at 2018-11-15 19:29:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 19:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 19:29:24 [DEBUG   ] spawn_process: at 2018-11-15 19:29:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 19:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 19:29:24 [DEBUG   ] spawn_process: at 2018-11-15 19:29:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 19:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 19:29:24 [DEBUG   ] spawn_process: at 2018-11-15 19:29:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 19:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 19:29:24 [DEBUG   ] spawn_process: at 2018-11-15 19:29:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 19:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 19:29:24 [DEBUG   ] spawn_process: at 2018-11-15 19:29:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 19:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 19:29:24 [DEBUG   ] spawn_process: at 2018-11-15 19:29:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 19:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 19:29:24 [DEBUG   ] spawn_process: at 2018-11-15 19:29:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 19:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 19:29:24 [DEBUG   ] spawn_process: at 2018-11-15 19:29:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 19:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 19:29:24 [DEBUG   ] spawn_process: at 2018-11-15 19:29:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 19:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 19:29:24 [DEBUG   ] spawn_process: at 2018-11-15 19:29:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 19:29:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 19:29:24 [DEBUG   ] spawn_process: at 2018-11-15 19:29:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 19:29:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 19:29:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 19:29:56 [DEBUG   ] Got command BAM from MCS: ref #518020
2018-11-15 19:29:56 [INFO    ] Finished processing BAM request
2018-11-15 19:29:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:29:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518020   8 58437 70196025 A  ERROR'
2018-11-15 19:29:56 [DEBUG   ] Got command BAM from MCS: ref #518021
2018-11-15 19:29:56 [INFO    ] Finished processing BAM request
2018-11-15 19:29:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:29:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518021   8 58437 70196029 A  ERROR'
2018-11-15 19:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 19:29:56 [DEBUG   ] spawn_process: at 2018-11-15 19:29:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 19:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 19:29:56 [DEBUG   ] spawn_process: at 2018-11-15 19:29:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 19:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 19:29:56 [DEBUG   ] spawn_process: at 2018-11-15 19:29:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 19:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 19:29:56 [DEBUG   ] spawn_process: at 2018-11-15 19:29:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 19:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 19:29:56 [DEBUG   ] spawn_process: at 2018-11-15 19:29:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 19:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 19:29:56 [DEBUG   ] spawn_process: at 2018-11-15 19:29:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 19:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 19:29:56 [DEBUG   ] spawn_process: at 2018-11-15 19:29:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 19:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 19:29:56 [DEBUG   ] spawn_process: at 2018-11-15 19:29:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 19:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 19:29:56 [DEBUG   ] spawn_process: at 2018-11-15 19:29:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 19:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 19:29:56 [DEBUG   ] spawn_process: at 2018-11-15 19:29:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 19:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 19:29:56 [DEBUG   ] spawn_process: at 2018-11-15 19:29:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 19:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 19:29:56 [DEBUG   ] spawn_process: at 2018-11-15 19:29:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 19:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 19:29:56 [DEBUG   ] spawn_process: at 2018-11-15 19:29:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 19:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 19:29:56 [DEBUG   ] spawn_process: at 2018-11-15 19:29:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 19:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 19:29:56 [DEBUG   ] spawn_process: at 2018-11-15 19:29:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 19:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 19:29:56 [DEBUG   ] spawn_process: at 2018-11-15 19:29:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 19:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 19:29:56 [DEBUG   ] spawn_process: at 2018-11-15 19:29:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 19:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 19:29:56 [DEBUG   ] spawn_process: at 2018-11-15 19:29:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 19:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 19:29:56 [DEBUG   ] spawn_process: at 2018-11-15 19:29:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 19:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 19:29:56 [DEBUG   ] spawn_process: at 2018-11-15 19:29:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 19:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 19:29:56 [DEBUG   ] spawn_process: at 2018-11-15 19:29:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 19:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 19:29:56 [DEBUG   ] spawn_process: at 2018-11-15 19:29:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 19:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 19:29:56 [DEBUG   ] spawn_process: at 2018-11-15 19:29:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 19:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 19:29:56 [DEBUG   ] spawn_process: at 2018-11-15 19:29:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 19:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 19:29:56 [DEBUG   ] spawn_process: at 2018-11-15 19:29:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 19:29:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 19:29:56 [DEBUG   ] spawn_process: at 2018-11-15 19:29:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 19:30:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 19:30:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:30:10 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 19:30:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2018-11-15 19:30:10 [WARNING ] (13, 1, 'bot')
2018-11-15 19:30:10 [WARNING ] (13, 1, 'bot')
2018-11-15 19:30:10 [WARNING ] (13, 1, 'bot')
2018-11-15 19:30:10 [WARNING ] (13, 1, 'bot')
2018-11-15 19:30:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:30:10 [DEBUG   ] Finished updating board flags in 1.191 seconds
2018-11-15 19:30:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 19:30:28 [DEBUG   ] Got command BAM from MCS: ref #518023
2018-11-15 19:30:28 [INFO    ] Finished processing BAM request
2018-11-15 19:30:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:30:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518023   8 58437 70228033 A  ERROR'
2018-11-15 19:30:28 [DEBUG   ] Got command BAM from MCS: ref #518022
2018-11-15 19:30:28 [INFO    ] Finished processing BAM request
2018-11-15 19:30:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:30:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518022   8 58437 70228037 A  ERROR'
2018-11-15 19:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 19:30:28 [DEBUG   ] spawn_process: at 2018-11-15 19:30:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 19:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 19:30:28 [DEBUG   ] spawn_process: at 2018-11-15 19:30:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 19:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 19:30:28 [DEBUG   ] spawn_process: at 2018-11-15 19:30:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 19:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 19:30:28 [DEBUG   ] spawn_process: at 2018-11-15 19:30:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 19:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 19:30:28 [DEBUG   ] spawn_process: at 2018-11-15 19:30:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 19:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 19:30:28 [DEBUG   ] spawn_process: at 2018-11-15 19:30:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 19:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 19:30:28 [DEBUG   ] spawn_process: at 2018-11-15 19:30:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 19:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 19:30:28 [DEBUG   ] spawn_process: at 2018-11-15 19:30:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 19:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 19:30:28 [DEBUG   ] spawn_process: at 2018-11-15 19:30:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 19:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 19:30:28 [DEBUG   ] spawn_process: at 2018-11-15 19:30:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 19:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 19:30:28 [DEBUG   ] spawn_process: at 2018-11-15 19:30:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 19:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 19:30:28 [DEBUG   ] spawn_process: at 2018-11-15 19:30:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 19:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 19:30:28 [DEBUG   ] spawn_process: at 2018-11-15 19:30:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 19:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 19:30:28 [DEBUG   ] spawn_process: at 2018-11-15 19:30:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 19:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 19:30:28 [DEBUG   ] spawn_process: at 2018-11-15 19:30:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 19:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 19:30:28 [DEBUG   ] spawn_process: at 2018-11-15 19:30:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 19:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 19:30:28 [DEBUG   ] spawn_process: at 2018-11-15 19:30:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 19:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 19:30:28 [DEBUG   ] spawn_process: at 2018-11-15 19:30:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 19:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 19:30:28 [DEBUG   ] spawn_process: at 2018-11-15 19:30:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 19:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 19:30:28 [DEBUG   ] spawn_process: at 2018-11-15 19:30:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 19:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 19:30:28 [DEBUG   ] spawn_process: at 2018-11-15 19:30:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 19:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 19:30:28 [DEBUG   ] spawn_process: at 2018-11-15 19:30:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 19:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 19:30:28 [DEBUG   ] spawn_process: at 2018-11-15 19:30:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 19:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 19:30:28 [DEBUG   ] spawn_process: at 2018-11-15 19:30:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 19:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 19:30:28 [DEBUG   ] spawn_process: at 2018-11-15 19:30:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 19:30:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 19:30:28 [DEBUG   ] spawn_process: at 2018-11-15 19:30:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 19:30:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 19:30:45 [DEBUG   ] Got command RPT from MCS: ref #518024
2018-11-15 19:30:45 [DEBUG   ] summary = ERROR
2018-11-15 19:30:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518024  13 58437 70245173 A  ERRORERROR'
2018-11-15 19:30:45 [DEBUG   ] Got command RPT from MCS: ref #518025
2018-11-15 19:30:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 19:30:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518025  77 58437 70245174 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 19:30:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 19:31:00 [DEBUG   ] Got command BAM from MCS: ref #518042
2018-11-15 19:31:00 [INFO    ] Finished processing BAM request
2018-11-15 19:31:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:31:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518042   8 58437 70260033 A  ERROR'
2018-11-15 19:31:00 [DEBUG   ] Got command BAM from MCS: ref #518041
2018-11-15 19:31:00 [INFO    ] Finished processing BAM request
2018-11-15 19:31:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:31:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518041   8 58437 70260037 A  ERROR'
2018-11-15 19:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 19:31:00 [DEBUG   ] spawn_process: at 2018-11-15 19:31:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 19:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 19:31:00 [DEBUG   ] spawn_process: at 2018-11-15 19:31:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 19:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 19:31:00 [DEBUG   ] spawn_process: at 2018-11-15 19:31:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 19:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 19:31:00 [DEBUG   ] spawn_process: at 2018-11-15 19:31:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 19:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 19:31:00 [DEBUG   ] spawn_process: at 2018-11-15 19:31:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 19:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 19:31:00 [DEBUG   ] spawn_process: at 2018-11-15 19:31:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 19:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 19:31:00 [DEBUG   ] spawn_process: at 2018-11-15 19:31:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 19:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 19:31:00 [DEBUG   ] spawn_process: at 2018-11-15 19:31:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 19:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 19:31:00 [DEBUG   ] spawn_process: at 2018-11-15 19:31:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 19:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 19:31:00 [DEBUG   ] spawn_process: at 2018-11-15 19:31:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 19:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 19:31:00 [DEBUG   ] spawn_process: at 2018-11-15 19:31:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 19:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 19:31:00 [DEBUG   ] spawn_process: at 2018-11-15 19:31:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 19:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 19:31:00 [DEBUG   ] spawn_process: at 2018-11-15 19:31:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 19:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 19:31:00 [DEBUG   ] spawn_process: at 2018-11-15 19:31:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 19:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 19:31:00 [DEBUG   ] spawn_process: at 2018-11-15 19:31:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 19:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 19:31:00 [DEBUG   ] spawn_process: at 2018-11-15 19:31:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 19:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 19:31:00 [DEBUG   ] spawn_process: at 2018-11-15 19:31:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 19:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 19:31:00 [DEBUG   ] spawn_process: at 2018-11-15 19:31:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 19:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 19:31:00 [DEBUG   ] spawn_process: at 2018-11-15 19:31:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 19:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 19:31:00 [DEBUG   ] spawn_process: at 2018-11-15 19:31:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 19:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 19:31:00 [DEBUG   ] spawn_process: at 2018-11-15 19:31:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 19:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 19:31:00 [DEBUG   ] spawn_process: at 2018-11-15 19:31:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 19:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 19:31:00 [DEBUG   ] spawn_process: at 2018-11-15 19:31:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 19:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 19:31:00 [DEBUG   ] spawn_process: at 2018-11-15 19:31:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 19:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 19:31:00 [DEBUG   ] spawn_process: at 2018-11-15 19:31:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 19:31:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 19:31:00 [DEBUG   ] spawn_process: at 2018-11-15 19:31:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 19:31:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-15 19:31:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 19:31:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:31:10 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 19:31:10 [WARNING ] (13, 1, 'bot')
2018-11-15 19:31:10 [WARNING ] (13, 1, 'bot')
2018-11-15 19:31:10 [WARNING ] (13, 1, 'bot')
2018-11-15 19:31:10 [WARNING ] (13, 1, 'bot')
2018-11-15 19:31:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:31:10 [DEBUG   ] Finished updating board flags in 1.011 seconds
2018-11-15 19:31:11 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-15 19:31:31 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 19:31:32 [DEBUG   ] Got command BAM from MCS: ref #518044
2018-11-15 19:31:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:31:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518044   8 58437 70292096 A  ERROR'
2018-11-15 19:31:32 [DEBUG   ] Got command BAM from MCS: ref #518043
2018-11-15 19:31:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:31:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518043   8 58437 70292097 A  ERROR'
2018-11-15 19:31:32 [INFO    ] Finished processing BAM request
2018-11-15 19:31:32 [INFO    ] Finished processing BAM request
2018-11-15 19:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 19:31:32 [DEBUG   ] spawn_process: at 2018-11-15 19:31:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 19:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 19:31:32 [DEBUG   ] spawn_process: at 2018-11-15 19:31:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 19:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 19:31:32 [DEBUG   ] spawn_process: at 2018-11-15 19:31:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 19:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 19:31:32 [DEBUG   ] spawn_process: at 2018-11-15 19:31:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 19:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 19:31:32 [DEBUG   ] spawn_process: at 2018-11-15 19:31:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 19:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 19:31:32 [DEBUG   ] spawn_process: at 2018-11-15 19:31:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 19:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 19:31:32 [DEBUG   ] spawn_process: at 2018-11-15 19:31:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 19:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 19:31:32 [DEBUG   ] spawn_process: at 2018-11-15 19:31:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 19:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 19:31:32 [DEBUG   ] spawn_process: at 2018-11-15 19:31:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 19:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 19:31:32 [DEBUG   ] spawn_process: at 2018-11-15 19:31:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 19:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 19:31:32 [DEBUG   ] spawn_process: at 2018-11-15 19:31:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 19:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 19:31:32 [DEBUG   ] spawn_process: at 2018-11-15 19:31:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 19:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 19:31:32 [DEBUG   ] spawn_process: at 2018-11-15 19:31:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 19:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 19:31:32 [DEBUG   ] spawn_process: at 2018-11-15 19:31:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 19:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 19:31:32 [DEBUG   ] spawn_process: at 2018-11-15 19:31:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 19:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 19:31:32 [DEBUG   ] spawn_process: at 2018-11-15 19:31:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 19:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 19:31:32 [DEBUG   ] spawn_process: at 2018-11-15 19:31:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 19:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 19:31:32 [DEBUG   ] spawn_process: at 2018-11-15 19:31:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 19:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 19:31:32 [DEBUG   ] spawn_process: at 2018-11-15 19:31:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 19:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 19:31:32 [DEBUG   ] spawn_process: at 2018-11-15 19:31:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 19:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 19:31:32 [DEBUG   ] spawn_process: at 2018-11-15 19:31:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 19:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 19:31:32 [DEBUG   ] spawn_process: at 2018-11-15 19:31:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 19:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 19:31:32 [DEBUG   ] spawn_process: at 2018-11-15 19:31:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 19:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 19:31:32 [DEBUG   ] spawn_process: at 2018-11-15 19:31:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 19:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 19:31:32 [DEBUG   ] spawn_process: at 2018-11-15 19:31:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 19:31:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 19:31:32 [DEBUG   ] spawn_process: at 2018-11-15 19:31:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 19:31:51 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 19:32:04 [DEBUG   ] Got command BAM from MCS: ref #518046
2018-11-15 19:32:04 [INFO    ] Finished processing BAM request
2018-11-15 19:32:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:32:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518046   8 58437 70324033 A  ERROR'
2018-11-15 19:32:04 [DEBUG   ] Got command BAM from MCS: ref #518045
2018-11-15 19:32:04 [INFO    ] Finished processing BAM request
2018-11-15 19:32:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:32:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518045   8 58437 70324037 A  ERROR'
2018-11-15 19:32:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 19:32:04 [DEBUG   ] spawn_process: at 2018-11-15 19:32:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 19:32:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 19:32:04 [DEBUG   ] spawn_process: at 2018-11-15 19:32:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 19:32:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 19:32:04 [DEBUG   ] spawn_process: at 2018-11-15 19:32:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 19:32:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 19:32:04 [DEBUG   ] spawn_process: at 2018-11-15 19:32:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 19:32:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 19:32:04 [DEBUG   ] spawn_process: at 2018-11-15 19:32:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 19:32:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 19:32:04 [DEBUG   ] spawn_process: at 2018-11-15 19:32:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 19:32:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 19:32:04 [DEBUG   ] spawn_process: at 2018-11-15 19:32:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 19:32:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 19:32:04 [DEBUG   ] spawn_process: at 2018-11-15 19:32:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 19:32:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 19:32:04 [DEBUG   ] spawn_process: at 2018-11-15 19:32:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 19:32:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 19:32:04 [DEBUG   ] spawn_process: at 2018-11-15 19:32:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 19:32:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 19:32:04 [DEBUG   ] spawn_process: at 2018-11-15 19:32:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 19:32:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 19:32:04 [DEBUG   ] spawn_process: at 2018-11-15 19:32:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 19:32:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 19:32:04 [DEBUG   ] spawn_process: at 2018-11-15 19:32:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 19:32:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 19:32:04 [DEBUG   ] spawn_process: at 2018-11-15 19:32:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 19:32:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 19:32:04 [DEBUG   ] spawn_process: at 2018-11-15 19:32:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 19:32:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 19:32:04 [DEBUG   ] spawn_process: at 2018-11-15 19:32:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 19:32:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 19:32:04 [DEBUG   ] spawn_process: at 2018-11-15 19:32:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 19:32:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 19:32:04 [DEBUG   ] spawn_process: at 2018-11-15 19:32:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 19:32:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 19:32:04 [DEBUG   ] spawn_process: at 2018-11-15 19:32:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 19:32:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 19:32:04 [DEBUG   ] spawn_process: at 2018-11-15 19:32:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 19:32:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 19:32:04 [DEBUG   ] spawn_process: at 2018-11-15 19:32:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 19:32:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 19:32:04 [DEBUG   ] spawn_process: at 2018-11-15 19:32:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 19:32:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 19:32:04 [DEBUG   ] spawn_process: at 2018-11-15 19:32:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 19:32:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 19:32:04 [DEBUG   ] spawn_process: at 2018-11-15 19:32:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 19:32:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 19:32:04 [DEBUG   ] spawn_process: at 2018-11-15 19:32:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 19:32:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 19:32:04 [DEBUG   ] spawn_process: at 2018-11-15 19:32:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 19:32:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 19:32:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 19:32:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:32:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-15 19:32:10 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 19:32:10 [WARNING ] (13, 1, 'bot')
2018-11-15 19:32:10 [WARNING ] (13, 1, 'bot')
2018-11-15 19:32:10 [WARNING ] (13, 1, 'bot')
2018-11-15 19:32:10 [WARNING ] (13, 1, 'bot')
2018-11-15 19:32:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:32:10 [DEBUG   ] Finished updating board flags in 0.965 seconds
2018-11-15 19:32:11 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 19:32:31 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 19:32:36 [DEBUG   ] Got command BAM from MCS: ref #518052
2018-11-15 19:32:36 [INFO    ] Finished processing BAM request
2018-11-15 19:32:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:32:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518052   8 58437 70356029 A  ERROR'
2018-11-15 19:32:36 [DEBUG   ] Got command BAM from MCS: ref #518051
2018-11-15 19:32:36 [INFO    ] Finished processing BAM request
2018-11-15 19:32:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:32:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518051   8 58437 70356033 A  ERROR'
2018-11-15 19:32:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 19:32:36 [DEBUG   ] spawn_process: at 2018-11-15 19:32:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 19:32:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 19:32:36 [DEBUG   ] spawn_process: at 2018-11-15 19:32:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 19:32:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 19:32:36 [DEBUG   ] spawn_process: at 2018-11-15 19:32:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 19:32:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 19:32:36 [DEBUG   ] spawn_process: at 2018-11-15 19:32:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 19:32:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 19:32:36 [DEBUG   ] spawn_process: at 2018-11-15 19:32:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 19:32:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 19:32:36 [DEBUG   ] spawn_process: at 2018-11-15 19:32:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 19:32:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 19:32:36 [DEBUG   ] spawn_process: at 2018-11-15 19:32:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 19:32:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 19:32:36 [DEBUG   ] spawn_process: at 2018-11-15 19:32:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 19:32:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 19:32:36 [DEBUG   ] spawn_process: at 2018-11-15 19:32:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 19:32:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 19:32:36 [DEBUG   ] spawn_process: at 2018-11-15 19:32:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 19:32:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 19:32:36 [DEBUG   ] spawn_process: at 2018-11-15 19:32:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 19:32:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 19:32:36 [DEBUG   ] spawn_process: at 2018-11-15 19:32:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 19:32:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 19:32:36 [DEBUG   ] spawn_process: at 2018-11-15 19:32:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 19:32:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 19:32:36 [DEBUG   ] spawn_process: at 2018-11-15 19:32:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 19:32:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 19:32:36 [DEBUG   ] spawn_process: at 2018-11-15 19:32:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 19:32:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 19:32:36 [DEBUG   ] spawn_process: at 2018-11-15 19:32:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 19:32:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 19:32:36 [DEBUG   ] spawn_process: at 2018-11-15 19:32:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 19:32:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 19:32:36 [DEBUG   ] spawn_process: at 2018-11-15 19:32:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 19:32:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 19:32:36 [DEBUG   ] spawn_process: at 2018-11-15 19:32:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 19:32:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 19:32:36 [DEBUG   ] spawn_process: at 2018-11-15 19:32:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 19:32:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 19:32:36 [DEBUG   ] spawn_process: at 2018-11-15 19:32:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 19:32:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 19:32:36 [DEBUG   ] spawn_process: at 2018-11-15 19:32:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 19:32:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 19:32:36 [DEBUG   ] spawn_process: at 2018-11-15 19:32:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 19:32:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 19:32:36 [DEBUG   ] spawn_process: at 2018-11-15 19:32:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 19:32:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 19:32:36 [DEBUG   ] spawn_process: at 2018-11-15 19:32:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 19:32:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 19:32:36 [DEBUG   ] spawn_process: at 2018-11-15 19:32:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 19:32:51 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 19:33:08 [DEBUG   ] Got command BAM from MCS: ref #518053
2018-11-15 19:33:08 [INFO    ] Finished processing BAM request
2018-11-15 19:33:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:33:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518053   8 58437 70388029 A  ERROR'
2018-11-15 19:33:08 [DEBUG   ] Got command BAM from MCS: ref #518054
2018-11-15 19:33:08 [INFO    ] Finished processing BAM request
2018-11-15 19:33:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:33:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518054   8 58437 70388033 A  ERROR'
2018-11-15 19:33:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 19:33:08 [DEBUG   ] spawn_process: at 2018-11-15 19:33:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 19:33:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 19:33:08 [DEBUG   ] spawn_process: at 2018-11-15 19:33:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 19:33:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 19:33:08 [DEBUG   ] spawn_process: at 2018-11-15 19:33:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 19:33:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 19:33:08 [DEBUG   ] spawn_process: at 2018-11-15 19:33:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 19:33:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 19:33:08 [DEBUG   ] spawn_process: at 2018-11-15 19:33:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 19:33:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 19:33:08 [DEBUG   ] spawn_process: at 2018-11-15 19:33:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 19:33:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 19:33:08 [DEBUG   ] spawn_process: at 2018-11-15 19:33:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 19:33:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 19:33:08 [DEBUG   ] spawn_process: at 2018-11-15 19:33:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 19:33:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 19:33:08 [DEBUG   ] spawn_process: at 2018-11-15 19:33:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 19:33:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 19:33:08 [DEBUG   ] spawn_process: at 2018-11-15 19:33:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 19:33:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 19:33:08 [DEBUG   ] spawn_process: at 2018-11-15 19:33:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 19:33:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 19:33:08 [DEBUG   ] spawn_process: at 2018-11-15 19:33:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 19:33:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 19:33:08 [DEBUG   ] spawn_process: at 2018-11-15 19:33:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 19:33:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 19:33:08 [DEBUG   ] spawn_process: at 2018-11-15 19:33:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 19:33:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 19:33:08 [DEBUG   ] spawn_process: at 2018-11-15 19:33:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 19:33:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 19:33:08 [DEBUG   ] spawn_process: at 2018-11-15 19:33:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 19:33:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 19:33:08 [DEBUG   ] spawn_process: at 2018-11-15 19:33:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 19:33:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 19:33:08 [DEBUG   ] spawn_process: at 2018-11-15 19:33:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 19:33:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 19:33:08 [DEBUG   ] spawn_process: at 2018-11-15 19:33:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 19:33:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 19:33:08 [DEBUG   ] spawn_process: at 2018-11-15 19:33:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 19:33:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 19:33:08 [DEBUG   ] spawn_process: at 2018-11-15 19:33:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 19:33:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 19:33:08 [DEBUG   ] spawn_process: at 2018-11-15 19:33:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 19:33:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 19:33:08 [DEBUG   ] spawn_process: at 2018-11-15 19:33:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 19:33:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 19:33:08 [DEBUG   ] spawn_process: at 2018-11-15 19:33:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 19:33:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 19:33:08 [DEBUG   ] spawn_process: at 2018-11-15 19:33:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 19:33:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 19:33:08 [DEBUG   ] spawn_process: at 2018-11-15 19:33:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 19:33:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 19:33:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 19:33:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:33:11 [DEBUG   ] Finished updating ant stats in 0.428 seconds
2018-11-15 19:33:11 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 19:33:11 [WARNING ] (13, 1, 'bot')
2018-11-15 19:33:11 [WARNING ] (13, 1, 'bot')
2018-11-15 19:33:11 [WARNING ] (13, 1, 'bot')
2018-11-15 19:33:11 [WARNING ] (13, 1, 'bot')
2018-11-15 19:33:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:33:11 [DEBUG   ] Finished updating board flags in 1.412 seconds
2018-11-15 19:33:22 [DEBUG   ] Got command RPT from MCS: ref #518055
2018-11-15 19:33:22 [DEBUG   ] summary = ERROR
2018-11-15 19:33:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518055  13 58437 70402681 A  ERRORERROR'
2018-11-15 19:33:22 [DEBUG   ] Got command RPT from MCS: ref #518056
2018-11-15 19:33:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 19:33:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518056  77 58437 70402873 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 19:33:23 [DEBUG   ] Got command RPT from MCS: ref #518057
2018-11-15 19:33:23 [DEBUG   ] summary = ERROR
2018-11-15 19:33:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518057  13 58437 70403077 A  ERRORERROR'
2018-11-15 19:33:23 [DEBUG   ] Got command RPT from MCS: ref #518058
2018-11-15 19:33:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 19:33:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518058  77 58437 70403281 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 19:33:23 [DEBUG   ] Got command RPT from MCS: ref #518059
2018-11-15 19:33:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 19:33:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518059  12 58437 70403473 A  ERRORB£ff'
2018-11-15 19:33:31 [DEBUG   ] Finished updating ant stats in 0.374 seconds
2018-11-15 19:33:40 [DEBUG   ] Got command BAM from MCS: ref #518061
2018-11-15 19:33:40 [INFO    ] Finished processing BAM request
2018-11-15 19:33:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:33:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518061   8 58437 70420025 A  ERROR'
2018-11-15 19:33:40 [DEBUG   ] Got command BAM from MCS: ref #518060
2018-11-15 19:33:40 [INFO    ] Finished processing BAM request
2018-11-15 19:33:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:33:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518060   8 58437 70420029 A  ERROR'
2018-11-15 19:33:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 19:33:40 [DEBUG   ] spawn_process: at 2018-11-15 19:33:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 19:33:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 19:33:40 [DEBUG   ] spawn_process: at 2018-11-15 19:33:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 19:33:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 19:33:40 [DEBUG   ] spawn_process: at 2018-11-15 19:33:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 19:33:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 19:33:40 [DEBUG   ] spawn_process: at 2018-11-15 19:33:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 19:33:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 19:33:40 [DEBUG   ] spawn_process: at 2018-11-15 19:33:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 19:33:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 19:33:40 [DEBUG   ] spawn_process: at 2018-11-15 19:33:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 19:33:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 19:33:40 [DEBUG   ] spawn_process: at 2018-11-15 19:33:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 19:33:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 19:33:40 [DEBUG   ] spawn_process: at 2018-11-15 19:33:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 19:33:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 19:33:40 [DEBUG   ] spawn_process: at 2018-11-15 19:33:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 19:33:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 19:33:40 [DEBUG   ] spawn_process: at 2018-11-15 19:33:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 19:33:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 19:33:40 [DEBUG   ] spawn_process: at 2018-11-15 19:33:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 19:33:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 19:33:40 [DEBUG   ] spawn_process: at 2018-11-15 19:33:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 19:33:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 19:33:40 [DEBUG   ] spawn_process: at 2018-11-15 19:33:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 19:33:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 19:33:40 [DEBUG   ] spawn_process: at 2018-11-15 19:33:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 19:33:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 19:33:40 [DEBUG   ] spawn_process: at 2018-11-15 19:33:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 19:33:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 19:33:40 [DEBUG   ] spawn_process: at 2018-11-15 19:33:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 19:33:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 19:33:40 [DEBUG   ] spawn_process: at 2018-11-15 19:33:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 19:33:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 19:33:40 [DEBUG   ] spawn_process: at 2018-11-15 19:33:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 19:33:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 19:33:40 [DEBUG   ] spawn_process: at 2018-11-15 19:33:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 19:33:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 19:33:40 [DEBUG   ] spawn_process: at 2018-11-15 19:33:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 19:33:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 19:33:40 [DEBUG   ] spawn_process: at 2018-11-15 19:33:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 19:33:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 19:33:40 [DEBUG   ] spawn_process: at 2018-11-15 19:33:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 19:33:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 19:33:40 [DEBUG   ] spawn_process: at 2018-11-15 19:33:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 19:33:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 19:33:40 [DEBUG   ] spawn_process: at 2018-11-15 19:33:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 19:33:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 19:33:40 [DEBUG   ] spawn_process: at 2018-11-15 19:33:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 19:33:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 19:33:40 [DEBUG   ] spawn_process: at 2018-11-15 19:33:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 19:33:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 19:34:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 19:34:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 19:34:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:34:11 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 19:34:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 19:34:11 [WARNING ] (13, 1, 'bot')
2018-11-15 19:34:11 [WARNING ] (13, 1, 'bot')
2018-11-15 19:34:11 [WARNING ] (13, 1, 'bot')
2018-11-15 19:34:11 [WARNING ] (13, 1, 'bot')
2018-11-15 19:34:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:34:11 [DEBUG   ] Finished updating board flags in 1.410 seconds
2018-11-15 19:34:12 [DEBUG   ] Got command BAM from MCS: ref #518062
2018-11-15 19:34:12 [INFO    ] Finished processing BAM request
2018-11-15 19:34:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:34:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518062   8 58437 70452030 A  ERROR'
2018-11-15 19:34:12 [DEBUG   ] Got command BAM from MCS: ref #518063
2018-11-15 19:34:12 [INFO    ] Finished processing BAM request
2018-11-15 19:34:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:34:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518063   8 58437 70452034 A  ERROR'
2018-11-15 19:34:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 19:34:12 [DEBUG   ] spawn_process: at 2018-11-15 19:34:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 19:34:12 [DEBUG   ] spawn_process: at 2018-11-15 19:34:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 19:34:12 [DEBUG   ] spawn_process: at 2018-11-15 19:34:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 19:34:12 [DEBUG   ] spawn_process: at 2018-11-15 19:34:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 19:34:12 [DEBUG   ] spawn_process: at 2018-11-15 19:34:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 19:34:12 [DEBUG   ] spawn_process: at 2018-11-15 19:34:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 19:34:12 [DEBUG   ] spawn_process: at 2018-11-15 19:34:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 19:34:12 [DEBUG   ] spawn_process: at 2018-11-15 19:34:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 19:34:12 [DEBUG   ] spawn_process: at 2018-11-15 19:34:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 19:34:12 [DEBUG   ] spawn_process: at 2018-11-15 19:34:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 19:34:12 [DEBUG   ] spawn_process: at 2018-11-15 19:34:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 19:34:12 [DEBUG   ] spawn_process: at 2018-11-15 19:34:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 19:34:12 [DEBUG   ] spawn_process: at 2018-11-15 19:34:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 19:34:12 [DEBUG   ] spawn_process: at 2018-11-15 19:34:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 19:34:12 [DEBUG   ] spawn_process: at 2018-11-15 19:34:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 19:34:12 [DEBUG   ] spawn_process: at 2018-11-15 19:34:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 19:34:12 [DEBUG   ] spawn_process: at 2018-11-15 19:34:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 19:34:12 [DEBUG   ] spawn_process: at 2018-11-15 19:34:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 19:34:12 [DEBUG   ] spawn_process: at 2018-11-15 19:34:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 19:34:12 [DEBUG   ] spawn_process: at 2018-11-15 19:34:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 19:34:12 [DEBUG   ] spawn_process: at 2018-11-15 19:34:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 19:34:12 [DEBUG   ] spawn_process: at 2018-11-15 19:34:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 19:34:12 [DEBUG   ] spawn_process: at 2018-11-15 19:34:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 19:34:12 [DEBUG   ] spawn_process: at 2018-11-15 19:34:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 19:34:12 [DEBUG   ] spawn_process: at 2018-11-15 19:34:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 19:34:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 19:34:12 [DEBUG   ] spawn_process: at 2018-11-15 19:34:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 19:34:32 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 19:34:44 [DEBUG   ] Got command BAM from MCS: ref #518064
2018-11-15 19:34:44 [INFO    ] Finished processing BAM request
2018-11-15 19:34:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:34:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518064   8 58437 70484030 A  ERROR'
2018-11-15 19:34:44 [DEBUG   ] Got command BAM from MCS: ref #518065
2018-11-15 19:34:44 [INFO    ] Finished processing BAM request
2018-11-15 19:34:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:34:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518065   8 58437 70484034 A  ERROR'
2018-11-15 19:34:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 19:34:44 [DEBUG   ] spawn_process: at 2018-11-15 19:34:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 19:34:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 19:34:44 [DEBUG   ] spawn_process: at 2018-11-15 19:34:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 19:34:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 19:34:44 [DEBUG   ] spawn_process: at 2018-11-15 19:34:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 19:34:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 19:34:44 [DEBUG   ] spawn_process: at 2018-11-15 19:34:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 19:34:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 19:34:44 [DEBUG   ] spawn_process: at 2018-11-15 19:34:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 19:34:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 19:34:44 [DEBUG   ] spawn_process: at 2018-11-15 19:34:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 19:34:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 19:34:44 [DEBUG   ] spawn_process: at 2018-11-15 19:34:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 19:34:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 19:34:44 [DEBUG   ] spawn_process: at 2018-11-15 19:34:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 19:34:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 19:34:44 [DEBUG   ] spawn_process: at 2018-11-15 19:34:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 19:34:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 19:34:44 [DEBUG   ] spawn_process: at 2018-11-15 19:34:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 19:34:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 19:34:44 [DEBUG   ] spawn_process: at 2018-11-15 19:34:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 19:34:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 19:34:44 [DEBUG   ] spawn_process: at 2018-11-15 19:34:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 19:34:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 19:34:44 [DEBUG   ] spawn_process: at 2018-11-15 19:34:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 19:34:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 19:34:44 [DEBUG   ] spawn_process: at 2018-11-15 19:34:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 19:34:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 19:34:44 [DEBUG   ] spawn_process: at 2018-11-15 19:34:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 19:34:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 19:34:44 [DEBUG   ] spawn_process: at 2018-11-15 19:34:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 19:34:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 19:34:44 [DEBUG   ] spawn_process: at 2018-11-15 19:34:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 19:34:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 19:34:44 [DEBUG   ] spawn_process: at 2018-11-15 19:34:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 19:34:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 19:34:44 [DEBUG   ] spawn_process: at 2018-11-15 19:34:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 19:34:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 19:34:44 [DEBUG   ] spawn_process: at 2018-11-15 19:34:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 19:34:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 19:34:44 [DEBUG   ] spawn_process: at 2018-11-15 19:34:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 19:34:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 19:34:44 [DEBUG   ] spawn_process: at 2018-11-15 19:34:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 19:34:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 19:34:44 [DEBUG   ] spawn_process: at 2018-11-15 19:34:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 19:34:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 19:34:44 [DEBUG   ] spawn_process: at 2018-11-15 19:34:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 19:34:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 19:34:44 [DEBUG   ] spawn_process: at 2018-11-15 19:34:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 19:34:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 19:34:44 [DEBUG   ] spawn_process: at 2018-11-15 19:34:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 19:34:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 19:35:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:35:12 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-15 19:35:12 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 19:35:12 [WARNING ] (13, 1, 'bot')
2018-11-15 19:35:12 [WARNING ] (13, 1, 'bot')
2018-11-15 19:35:12 [WARNING ] (13, 1, 'bot')
2018-11-15 19:35:12 [WARNING ] (13, 1, 'bot')
2018-11-15 19:35:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:35:12 [DEBUG   ] Finished updating board flags in 2.574 seconds
2018-11-15 19:35:16 [DEBUG   ] Got command BAM from MCS: ref #518066
2018-11-15 19:35:16 [INFO    ] Finished processing BAM request
2018-11-15 19:35:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:35:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518066   8 58437 70516030 A  ERROR'
2018-11-15 19:35:16 [DEBUG   ] Got command BAM from MCS: ref #518067
2018-11-15 19:35:16 [INFO    ] Finished processing BAM request
2018-11-15 19:35:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:35:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518067   8 58437 70516034 A  ERROR'
2018-11-15 19:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 19:35:16 [DEBUG   ] spawn_process: at 2018-11-15 19:35:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 19:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 19:35:16 [DEBUG   ] spawn_process: at 2018-11-15 19:35:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 19:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 19:35:16 [DEBUG   ] spawn_process: at 2018-11-15 19:35:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 19:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 19:35:16 [DEBUG   ] spawn_process: at 2018-11-15 19:35:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 19:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 19:35:16 [DEBUG   ] spawn_process: at 2018-11-15 19:35:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 19:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 19:35:16 [DEBUG   ] spawn_process: at 2018-11-15 19:35:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 19:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 19:35:16 [DEBUG   ] spawn_process: at 2018-11-15 19:35:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 19:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 19:35:16 [DEBUG   ] spawn_process: at 2018-11-15 19:35:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 19:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 19:35:16 [DEBUG   ] spawn_process: at 2018-11-15 19:35:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 19:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 19:35:16 [DEBUG   ] spawn_process: at 2018-11-15 19:35:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 19:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 19:35:16 [DEBUG   ] spawn_process: at 2018-11-15 19:35:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 19:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 19:35:16 [DEBUG   ] spawn_process: at 2018-11-15 19:35:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 19:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 19:35:16 [DEBUG   ] spawn_process: at 2018-11-15 19:35:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 19:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 19:35:16 [DEBUG   ] spawn_process: at 2018-11-15 19:35:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 19:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 19:35:16 [DEBUG   ] spawn_process: at 2018-11-15 19:35:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 19:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 19:35:16 [DEBUG   ] spawn_process: at 2018-11-15 19:35:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 19:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 19:35:16 [DEBUG   ] spawn_process: at 2018-11-15 19:35:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 19:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 19:35:16 [DEBUG   ] spawn_process: at 2018-11-15 19:35:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 19:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 19:35:16 [DEBUG   ] spawn_process: at 2018-11-15 19:35:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 19:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 19:35:16 [DEBUG   ] spawn_process: at 2018-11-15 19:35:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 19:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 19:35:16 [DEBUG   ] spawn_process: at 2018-11-15 19:35:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 19:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 19:35:16 [DEBUG   ] spawn_process: at 2018-11-15 19:35:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 19:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 19:35:16 [DEBUG   ] spawn_process: at 2018-11-15 19:35:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 19:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 19:35:16 [DEBUG   ] spawn_process: at 2018-11-15 19:35:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 19:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 19:35:16 [DEBUG   ] spawn_process: at 2018-11-15 19:35:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 19:35:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 19:35:16 [DEBUG   ] spawn_process: at 2018-11-15 19:35:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 19:35:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 19:35:45 [DEBUG   ] Got command RPT from MCS: ref #518072
2018-11-15 19:35:45 [DEBUG   ] summary = ERROR
2018-11-15 19:35:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518072  13 58437 70545181 A  ERRORERROR'
2018-11-15 19:35:45 [DEBUG   ] Got command RPT from MCS: ref #518073
2018-11-15 19:35:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 19:35:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518073  77 58437 70545182 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 19:35:48 [DEBUG   ] Got command BAM from MCS: ref #518089
2018-11-15 19:35:48 [INFO    ] Finished processing BAM request
2018-11-15 19:35:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:35:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518089   8 58437 70548030 A  ERROR'
2018-11-15 19:35:48 [DEBUG   ] Got command BAM from MCS: ref #518090
2018-11-15 19:35:48 [INFO    ] Finished processing BAM request
2018-11-15 19:35:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:35:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518090   8 58437 70548034 A  ERROR'
2018-11-15 19:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 19:35:48 [DEBUG   ] spawn_process: at 2018-11-15 19:35:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 19:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 19:35:48 [DEBUG   ] spawn_process: at 2018-11-15 19:35:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 19:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 19:35:48 [DEBUG   ] spawn_process: at 2018-11-15 19:35:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 19:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 19:35:48 [DEBUG   ] spawn_process: at 2018-11-15 19:35:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 19:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 19:35:48 [DEBUG   ] spawn_process: at 2018-11-15 19:35:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 19:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 19:35:48 [DEBUG   ] spawn_process: at 2018-11-15 19:35:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 19:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 19:35:48 [DEBUG   ] spawn_process: at 2018-11-15 19:35:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 19:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 19:35:48 [DEBUG   ] spawn_process: at 2018-11-15 19:35:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 19:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 19:35:48 [DEBUG   ] spawn_process: at 2018-11-15 19:35:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 19:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 19:35:48 [DEBUG   ] spawn_process: at 2018-11-15 19:35:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 19:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 19:35:48 [DEBUG   ] spawn_process: at 2018-11-15 19:35:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 19:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 19:35:48 [DEBUG   ] spawn_process: at 2018-11-15 19:35:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 19:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 19:35:48 [DEBUG   ] spawn_process: at 2018-11-15 19:35:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 19:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 19:35:48 [DEBUG   ] spawn_process: at 2018-11-15 19:35:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 19:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 19:35:48 [DEBUG   ] spawn_process: at 2018-11-15 19:35:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 19:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 19:35:48 [DEBUG   ] spawn_process: at 2018-11-15 19:35:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 19:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 19:35:48 [DEBUG   ] spawn_process: at 2018-11-15 19:35:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 19:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 19:35:48 [DEBUG   ] spawn_process: at 2018-11-15 19:35:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 19:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 19:35:48 [DEBUG   ] spawn_process: at 2018-11-15 19:35:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 19:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 19:35:48 [DEBUG   ] spawn_process: at 2018-11-15 19:35:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 19:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 19:35:48 [DEBUG   ] spawn_process: at 2018-11-15 19:35:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 19:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 19:35:48 [DEBUG   ] spawn_process: at 2018-11-15 19:35:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 19:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 19:35:48 [DEBUG   ] spawn_process: at 2018-11-15 19:35:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 19:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 19:35:48 [DEBUG   ] spawn_process: at 2018-11-15 19:35:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 19:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 19:35:48 [DEBUG   ] spawn_process: at 2018-11-15 19:35:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 19:35:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 19:35:48 [DEBUG   ] spawn_process: at 2018-11-15 19:35:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 19:35:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 19:36:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:36:11 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 19:36:11 [WARNING ] (13, 1, 'bot')
2018-11-15 19:36:11 [WARNING ] (13, 1, 'bot')
2018-11-15 19:36:11 [WARNING ] (13, 1, 'bot')
2018-11-15 19:36:11 [WARNING ] (13, 1, 'bot')
2018-11-15 19:36:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:36:11 [DEBUG   ] Finished updating board flags in 1.193 seconds
2018-11-15 19:36:12 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-15 19:36:20 [DEBUG   ] Got command BAM from MCS: ref #518092
2018-11-15 19:36:20 [INFO    ] Finished processing BAM request
2018-11-15 19:36:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:36:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518092   8 58437 70580030 A  ERROR'
2018-11-15 19:36:20 [DEBUG   ] Got command BAM from MCS: ref #518091
2018-11-15 19:36:20 [INFO    ] Finished processing BAM request
2018-11-15 19:36:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:36:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518091   8 58437 70580034 A  ERROR'
2018-11-15 19:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 19:36:20 [DEBUG   ] spawn_process: at 2018-11-15 19:36:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 19:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 19:36:20 [DEBUG   ] spawn_process: at 2018-11-15 19:36:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 19:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 19:36:20 [DEBUG   ] spawn_process: at 2018-11-15 19:36:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 19:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 19:36:20 [DEBUG   ] spawn_process: at 2018-11-15 19:36:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 19:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 19:36:20 [DEBUG   ] spawn_process: at 2018-11-15 19:36:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 19:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 19:36:20 [DEBUG   ] spawn_process: at 2018-11-15 19:36:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 19:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 19:36:20 [DEBUG   ] spawn_process: at 2018-11-15 19:36:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 19:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 19:36:20 [DEBUG   ] spawn_process: at 2018-11-15 19:36:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 19:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 19:36:20 [DEBUG   ] spawn_process: at 2018-11-15 19:36:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 19:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 19:36:20 [DEBUG   ] spawn_process: at 2018-11-15 19:36:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 19:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 19:36:20 [DEBUG   ] spawn_process: at 2018-11-15 19:36:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 19:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 19:36:20 [DEBUG   ] spawn_process: at 2018-11-15 19:36:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 19:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 19:36:20 [DEBUG   ] spawn_process: at 2018-11-15 19:36:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 19:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 19:36:20 [DEBUG   ] spawn_process: at 2018-11-15 19:36:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 19:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 19:36:20 [DEBUG   ] spawn_process: at 2018-11-15 19:36:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 19:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 19:36:20 [DEBUG   ] spawn_process: at 2018-11-15 19:36:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 19:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 19:36:20 [DEBUG   ] spawn_process: at 2018-11-15 19:36:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 19:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 19:36:20 [DEBUG   ] spawn_process: at 2018-11-15 19:36:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 19:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 19:36:20 [DEBUG   ] spawn_process: at 2018-11-15 19:36:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 19:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 19:36:20 [DEBUG   ] spawn_process: at 2018-11-15 19:36:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 19:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 19:36:20 [DEBUG   ] spawn_process: at 2018-11-15 19:36:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 19:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 19:36:20 [DEBUG   ] spawn_process: at 2018-11-15 19:36:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 19:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 19:36:20 [DEBUG   ] spawn_process: at 2018-11-15 19:36:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 19:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 19:36:20 [DEBUG   ] spawn_process: at 2018-11-15 19:36:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 19:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 19:36:20 [DEBUG   ] spawn_process: at 2018-11-15 19:36:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 19:36:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 19:36:20 [DEBUG   ] spawn_process: at 2018-11-15 19:36:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 19:36:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 19:36:52 [DEBUG   ] Got command BAM from MCS: ref #518094
2018-11-15 19:36:52 [INFO    ] Finished processing BAM request
2018-11-15 19:36:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:36:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518094   8 58437 70612030 A  ERROR'
2018-11-15 19:36:52 [DEBUG   ] Got command BAM from MCS: ref #518093
2018-11-15 19:36:52 [INFO    ] Finished processing BAM request
2018-11-15 19:36:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:36:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518093   8 58437 70612034 A  ERROR'
2018-11-15 19:36:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 19:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 19:36:52 [DEBUG   ] spawn_process: at 2018-11-15 19:36:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 19:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 19:36:52 [DEBUG   ] spawn_process: at 2018-11-15 19:36:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 19:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 19:36:52 [DEBUG   ] spawn_process: at 2018-11-15 19:36:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 19:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 19:36:52 [DEBUG   ] spawn_process: at 2018-11-15 19:36:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 19:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 19:36:52 [DEBUG   ] spawn_process: at 2018-11-15 19:36:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 19:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 19:36:52 [DEBUG   ] spawn_process: at 2018-11-15 19:36:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 19:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 19:36:52 [DEBUG   ] spawn_process: at 2018-11-15 19:36:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 19:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 19:36:52 [DEBUG   ] spawn_process: at 2018-11-15 19:36:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 19:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 19:36:52 [DEBUG   ] spawn_process: at 2018-11-15 19:36:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 19:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 19:36:52 [DEBUG   ] spawn_process: at 2018-11-15 19:36:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 19:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 19:36:52 [DEBUG   ] spawn_process: at 2018-11-15 19:36:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 19:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 19:36:52 [DEBUG   ] spawn_process: at 2018-11-15 19:36:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 19:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 19:36:52 [DEBUG   ] spawn_process: at 2018-11-15 19:36:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 19:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 19:36:52 [DEBUG   ] spawn_process: at 2018-11-15 19:36:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 19:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 19:36:52 [DEBUG   ] spawn_process: at 2018-11-15 19:36:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 19:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 19:36:52 [DEBUG   ] spawn_process: at 2018-11-15 19:36:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 19:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 19:36:52 [DEBUG   ] spawn_process: at 2018-11-15 19:36:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 19:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 19:36:52 [DEBUG   ] spawn_process: at 2018-11-15 19:36:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 19:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 19:36:52 [DEBUG   ] spawn_process: at 2018-11-15 19:36:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 19:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 19:36:52 [DEBUG   ] spawn_process: at 2018-11-15 19:36:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 19:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 19:36:52 [DEBUG   ] spawn_process: at 2018-11-15 19:36:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 19:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 19:36:52 [DEBUG   ] spawn_process: at 2018-11-15 19:36:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 19:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 19:36:52 [DEBUG   ] spawn_process: at 2018-11-15 19:36:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 19:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 19:36:52 [DEBUG   ] spawn_process: at 2018-11-15 19:36:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 19:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 19:36:52 [DEBUG   ] spawn_process: at 2018-11-15 19:36:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 19:36:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 19:36:52 [DEBUG   ] spawn_process: at 2018-11-15 19:36:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 19:37:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 19:37:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:37:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-15 19:37:12 [DEBUG   ] Finished updating ant stats in 1.028 seconds
2018-11-15 19:37:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-11-15 19:37:12 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 19:37:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 19:37:12 [WARNING ] (13, 1, 'bot')
2018-11-15 19:37:12 [WARNING ] (13, 1, 'bot')
2018-11-15 19:37:12 [WARNING ] (13, 1, 'bot')
2018-11-15 19:37:12 [WARNING ] (13, 1, 'bot')
2018-11-15 19:37:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:37:12 [DEBUG   ] Finished updating board flags in 2.041 seconds
2018-11-15 19:37:24 [DEBUG   ] Got command BAM from MCS: ref #518096
2018-11-15 19:37:24 [INFO    ] Finished processing BAM request
2018-11-15 19:37:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:37:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518096   8 58437 70644030 A  ERROR'
2018-11-15 19:37:24 [DEBUG   ] Got command BAM from MCS: ref #518095
2018-11-15 19:37:24 [INFO    ] Finished processing BAM request
2018-11-15 19:37:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:37:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518095   8 58437 70644034 A  ERROR'
2018-11-15 19:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 19:37:24 [DEBUG   ] spawn_process: at 2018-11-15 19:37:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 19:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 19:37:24 [DEBUG   ] spawn_process: at 2018-11-15 19:37:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 19:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 19:37:24 [DEBUG   ] spawn_process: at 2018-11-15 19:37:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 19:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 19:37:24 [DEBUG   ] spawn_process: at 2018-11-15 19:37:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 19:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 19:37:24 [DEBUG   ] spawn_process: at 2018-11-15 19:37:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 19:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 19:37:24 [DEBUG   ] spawn_process: at 2018-11-15 19:37:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 19:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 19:37:24 [DEBUG   ] spawn_process: at 2018-11-15 19:37:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 19:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 19:37:24 [DEBUG   ] spawn_process: at 2018-11-15 19:37:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 19:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 19:37:24 [DEBUG   ] spawn_process: at 2018-11-15 19:37:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 19:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 19:37:24 [DEBUG   ] spawn_process: at 2018-11-15 19:37:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 19:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 19:37:24 [DEBUG   ] spawn_process: at 2018-11-15 19:37:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 19:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 19:37:24 [DEBUG   ] spawn_process: at 2018-11-15 19:37:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 19:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 19:37:24 [DEBUG   ] spawn_process: at 2018-11-15 19:37:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 19:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 19:37:24 [DEBUG   ] spawn_process: at 2018-11-15 19:37:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 19:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 19:37:24 [DEBUG   ] spawn_process: at 2018-11-15 19:37:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 19:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 19:37:24 [DEBUG   ] spawn_process: at 2018-11-15 19:37:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 19:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 19:37:24 [DEBUG   ] spawn_process: at 2018-11-15 19:37:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 19:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 19:37:24 [DEBUG   ] spawn_process: at 2018-11-15 19:37:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 19:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 19:37:24 [DEBUG   ] spawn_process: at 2018-11-15 19:37:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 19:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 19:37:24 [DEBUG   ] spawn_process: at 2018-11-15 19:37:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 19:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 19:37:24 [DEBUG   ] spawn_process: at 2018-11-15 19:37:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 19:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 19:37:24 [DEBUG   ] spawn_process: at 2018-11-15 19:37:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 19:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 19:37:24 [DEBUG   ] spawn_process: at 2018-11-15 19:37:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 19:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 19:37:24 [DEBUG   ] spawn_process: at 2018-11-15 19:37:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 19:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 19:37:24 [DEBUG   ] spawn_process: at 2018-11-15 19:37:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 19:37:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 19:37:24 [DEBUG   ] spawn_process: at 2018-11-15 19:37:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 19:37:32 [DEBUG   ] Finished updating ant stats in 0.974 seconds
2018-11-15 19:37:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 19:37:56 [DEBUG   ] Got command BAM from MCS: ref #518097
2018-11-15 19:37:56 [INFO    ] Finished processing BAM request
2018-11-15 19:37:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:37:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518097   8 58437 70676029 A  ERROR'
2018-11-15 19:37:56 [DEBUG   ] Got command BAM from MCS: ref #518098
2018-11-15 19:37:56 [INFO    ] Finished processing BAM request
2018-11-15 19:37:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:37:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518098   8 58437 70676033 A  ERROR'
2018-11-15 19:37:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 19:37:56 [DEBUG   ] spawn_process: at 2018-11-15 19:37:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 19:37:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 19:37:56 [DEBUG   ] spawn_process: at 2018-11-15 19:37:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 19:37:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 19:37:56 [DEBUG   ] spawn_process: at 2018-11-15 19:37:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 19:37:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 19:37:56 [DEBUG   ] spawn_process: at 2018-11-15 19:37:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 19:37:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 19:37:56 [DEBUG   ] spawn_process: at 2018-11-15 19:37:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 19:37:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 19:37:56 [DEBUG   ] spawn_process: at 2018-11-15 19:37:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 19:37:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 19:37:56 [DEBUG   ] spawn_process: at 2018-11-15 19:37:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 19:37:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 19:37:56 [DEBUG   ] spawn_process: at 2018-11-15 19:37:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 19:37:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 19:37:56 [DEBUG   ] spawn_process: at 2018-11-15 19:37:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 19:37:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 19:37:56 [DEBUG   ] spawn_process: at 2018-11-15 19:37:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 19:37:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 19:37:56 [DEBUG   ] spawn_process: at 2018-11-15 19:37:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 19:37:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 19:37:56 [DEBUG   ] spawn_process: at 2018-11-15 19:37:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 19:37:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 19:37:56 [DEBUG   ] spawn_process: at 2018-11-15 19:37:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 19:37:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 19:37:56 [DEBUG   ] spawn_process: at 2018-11-15 19:37:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 19:37:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 19:37:56 [DEBUG   ] spawn_process: at 2018-11-15 19:37:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 19:37:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 19:37:56 [DEBUG   ] spawn_process: at 2018-11-15 19:37:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 19:37:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 19:37:56 [DEBUG   ] spawn_process: at 2018-11-15 19:37:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 19:37:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 19:37:56 [DEBUG   ] spawn_process: at 2018-11-15 19:37:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 19:37:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 19:37:56 [DEBUG   ] spawn_process: at 2018-11-15 19:37:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 19:37:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 19:37:56 [DEBUG   ] spawn_process: at 2018-11-15 19:37:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 19:37:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 19:37:56 [DEBUG   ] spawn_process: at 2018-11-15 19:37:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 19:37:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 19:37:56 [DEBUG   ] spawn_process: at 2018-11-15 19:37:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 19:37:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 19:37:56 [DEBUG   ] spawn_process: at 2018-11-15 19:37:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 19:37:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 19:37:56 [DEBUG   ] spawn_process: at 2018-11-15 19:37:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 19:37:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 19:37:56 [DEBUG   ] spawn_process: at 2018-11-15 19:37:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 19:37:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 19:37:56 [DEBUG   ] spawn_process: at 2018-11-15 19:37:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 19:38:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:38:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-15 19:38:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 19:38:12 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-11-15 19:38:12 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 19:38:12 [WARNING ] (13, 1, 'bot')
2018-11-15 19:38:12 [WARNING ] (13, 1, 'bot')
2018-11-15 19:38:12 [WARNING ] (13, 1, 'bot')
2018-11-15 19:38:12 [WARNING ] (13, 1, 'bot')
2018-11-15 19:38:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:38:12 [DEBUG   ] Finished updating board flags in 2.133 seconds
2018-11-15 19:38:22 [DEBUG   ] Got command RPT from MCS: ref #518101
2018-11-15 19:38:22 [DEBUG   ] summary = ERROR
2018-11-15 19:38:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518101  13 58437 70702757 A  ERRORERROR'
2018-11-15 19:38:22 [DEBUG   ] Got command RPT from MCS: ref #518102
2018-11-15 19:38:22 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 19:38:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518102  77 58437 70702961 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 19:38:23 [DEBUG   ] Got command RPT from MCS: ref #518103
2018-11-15 19:38:23 [DEBUG   ] summary = ERROR
2018-11-15 19:38:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518103  13 58437 70703165 A  ERRORERROR'
2018-11-15 19:38:23 [DEBUG   ] Got command RPT from MCS: ref #518105
2018-11-15 19:38:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 19:38:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518105  77 58437 70703369 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 19:38:23 [DEBUG   ] Got command RPT from MCS: ref #518107
2018-11-15 19:38:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 19:38:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518107  12 58437 70703561 A  ERRORB£ff'
2018-11-15 19:38:28 [DEBUG   ] Got command BAM from MCS: ref #518113
2018-11-15 19:38:28 [INFO    ] Finished processing BAM request
2018-11-15 19:38:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518113   8 58437 70708033 A  ERROR'
2018-11-15 19:38:28 [DEBUG   ] Got command BAM from MCS: ref #518112
2018-11-15 19:38:28 [INFO    ] Finished processing BAM request
2018-11-15 19:38:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518112   8 58437 70708037 A  ERROR'
2018-11-15 19:38:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 19:38:28 [DEBUG   ] spawn_process: at 2018-11-15 19:38:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 19:38:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 19:38:28 [DEBUG   ] spawn_process: at 2018-11-15 19:38:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 19:38:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 19:38:28 [DEBUG   ] spawn_process: at 2018-11-15 19:38:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 19:38:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 19:38:28 [DEBUG   ] spawn_process: at 2018-11-15 19:38:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 19:38:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 19:38:28 [DEBUG   ] spawn_process: at 2018-11-15 19:38:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 19:38:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 19:38:28 [DEBUG   ] spawn_process: at 2018-11-15 19:38:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 19:38:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 19:38:28 [DEBUG   ] spawn_process: at 2018-11-15 19:38:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 19:38:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 19:38:28 [DEBUG   ] spawn_process: at 2018-11-15 19:38:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 19:38:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 19:38:28 [DEBUG   ] spawn_process: at 2018-11-15 19:38:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 19:38:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 19:38:28 [DEBUG   ] spawn_process: at 2018-11-15 19:38:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 19:38:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 19:38:28 [DEBUG   ] spawn_process: at 2018-11-15 19:38:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 19:38:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 19:38:28 [DEBUG   ] spawn_process: at 2018-11-15 19:38:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 19:38:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 19:38:28 [DEBUG   ] spawn_process: at 2018-11-15 19:38:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 19:38:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 19:38:28 [DEBUG   ] spawn_process: at 2018-11-15 19:38:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 19:38:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 19:38:28 [DEBUG   ] spawn_process: at 2018-11-15 19:38:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 19:38:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 19:38:28 [DEBUG   ] spawn_process: at 2018-11-15 19:38:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 19:38:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 19:38:28 [DEBUG   ] spawn_process: at 2018-11-15 19:38:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 19:38:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 19:38:28 [DEBUG   ] spawn_process: at 2018-11-15 19:38:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 19:38:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 19:38:28 [DEBUG   ] spawn_process: at 2018-11-15 19:38:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 19:38:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 19:38:28 [DEBUG   ] spawn_process: at 2018-11-15 19:38:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 19:38:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 19:38:28 [DEBUG   ] spawn_process: at 2018-11-15 19:38:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 19:38:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 19:38:28 [DEBUG   ] spawn_process: at 2018-11-15 19:38:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 19:38:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 19:38:28 [DEBUG   ] spawn_process: at 2018-11-15 19:38:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 19:38:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 19:38:28 [DEBUG   ] spawn_process: at 2018-11-15 19:38:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 19:38:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 19:38:28 [DEBUG   ] spawn_process: at 2018-11-15 19:38:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 19:38:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 19:38:28 [DEBUG   ] spawn_process: at 2018-11-15 19:38:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 19:38:32 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-15 19:38:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 19:39:00 [DEBUG   ] Got command BAM from MCS: ref #518118
2018-11-15 19:39:00 [INFO    ] Finished processing BAM request
2018-11-15 19:39:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:39:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518118   8 58437 70740033 A  ERROR'
2018-11-15 19:39:00 [DEBUG   ] Got command BAM from MCS: ref #518117
2018-11-15 19:39:00 [INFO    ] Finished processing BAM request
2018-11-15 19:39:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:39:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518117   8 58437 70740037 A  ERROR'
2018-11-15 19:39:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 19:39:00 [DEBUG   ] spawn_process: at 2018-11-15 19:39:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 19:39:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 19:39:00 [DEBUG   ] spawn_process: at 2018-11-15 19:39:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 19:39:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 19:39:00 [DEBUG   ] spawn_process: at 2018-11-15 19:39:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 19:39:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 19:39:00 [DEBUG   ] spawn_process: at 2018-11-15 19:39:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 19:39:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 19:39:00 [DEBUG   ] spawn_process: at 2018-11-15 19:39:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 19:39:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 19:39:00 [DEBUG   ] spawn_process: at 2018-11-15 19:39:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 19:39:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 19:39:00 [DEBUG   ] spawn_process: at 2018-11-15 19:39:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 19:39:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 19:39:00 [DEBUG   ] spawn_process: at 2018-11-15 19:39:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 19:39:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 19:39:00 [DEBUG   ] spawn_process: at 2018-11-15 19:39:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 19:39:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 19:39:00 [DEBUG   ] spawn_process: at 2018-11-15 19:39:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 19:39:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 19:39:00 [DEBUG   ] spawn_process: at 2018-11-15 19:39:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 19:39:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 19:39:00 [DEBUG   ] spawn_process: at 2018-11-15 19:39:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 19:39:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 19:39:00 [DEBUG   ] spawn_process: at 2018-11-15 19:39:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 19:39:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 19:39:00 [DEBUG   ] spawn_process: at 2018-11-15 19:39:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 19:39:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 19:39:00 [DEBUG   ] spawn_process: at 2018-11-15 19:39:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 19:39:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 19:39:00 [DEBUG   ] spawn_process: at 2018-11-15 19:39:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 19:39:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 19:39:00 [DEBUG   ] spawn_process: at 2018-11-15 19:39:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 19:39:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 19:39:00 [DEBUG   ] spawn_process: at 2018-11-15 19:39:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 19:39:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 19:39:00 [DEBUG   ] spawn_process: at 2018-11-15 19:39:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 19:39:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 19:39:00 [DEBUG   ] spawn_process: at 2018-11-15 19:39:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 19:39:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 19:39:00 [DEBUG   ] spawn_process: at 2018-11-15 19:39:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 19:39:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 19:39:00 [DEBUG   ] spawn_process: at 2018-11-15 19:39:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 19:39:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 19:39:00 [DEBUG   ] spawn_process: at 2018-11-15 19:39:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 19:39:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 19:39:00 [DEBUG   ] spawn_process: at 2018-11-15 19:39:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 19:39:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 19:39:00 [DEBUG   ] spawn_process: at 2018-11-15 19:39:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 19:39:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 19:39:00 [DEBUG   ] spawn_process: at 2018-11-15 19:39:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 19:39:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 19:39:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 19:39:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 19:39:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:39:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 19:39:12 [DEBUG   ] Finished updating ant stats in 0.628 seconds
2018-11-15 19:39:12 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 19:39:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 19:39:12 [WARNING ] (13, 1, 'bot')
2018-11-15 19:39:12 [WARNING ] (13, 1, 'bot')
2018-11-15 19:39:12 [WARNING ] (13, 1, 'bot')
2018-11-15 19:39:12 [WARNING ] (13, 1, 'bot')
2018-11-15 19:39:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:39:12 [DEBUG   ] Finished updating board flags in 1.853 seconds
2018-11-15 19:39:32 [DEBUG   ] Got command BAM from MCS: ref #518120
2018-11-15 19:39:32 [INFO    ] Finished processing BAM request
2018-11-15 19:39:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:39:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518120   8 58437 70772025 A  ERROR'
2018-11-15 19:39:32 [DEBUG   ] Got command BAM from MCS: ref #518119
2018-11-15 19:39:32 [INFO    ] Finished processing BAM request
2018-11-15 19:39:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:39:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518119   8 58437 70772029 A  ERROR'
2018-11-15 19:39:32 [DEBUG   ] Finished updating ant stats in 0.574 seconds
2018-11-15 19:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 19:39:32 [DEBUG   ] spawn_process: at 2018-11-15 19:39:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 19:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 19:39:32 [DEBUG   ] spawn_process: at 2018-11-15 19:39:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 19:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 19:39:32 [DEBUG   ] spawn_process: at 2018-11-15 19:39:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 19:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 19:39:32 [DEBUG   ] spawn_process: at 2018-11-15 19:39:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 19:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 19:39:32 [DEBUG   ] spawn_process: at 2018-11-15 19:39:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 19:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 19:39:32 [DEBUG   ] spawn_process: at 2018-11-15 19:39:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 19:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 19:39:32 [DEBUG   ] spawn_process: at 2018-11-15 19:39:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 19:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 19:39:32 [DEBUG   ] spawn_process: at 2018-11-15 19:39:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 19:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 19:39:32 [DEBUG   ] spawn_process: at 2018-11-15 19:39:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 19:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 19:39:32 [DEBUG   ] spawn_process: at 2018-11-15 19:39:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 19:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 19:39:32 [DEBUG   ] spawn_process: at 2018-11-15 19:39:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 19:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 19:39:32 [DEBUG   ] spawn_process: at 2018-11-15 19:39:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 19:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 19:39:32 [DEBUG   ] spawn_process: at 2018-11-15 19:39:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 19:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 19:39:32 [DEBUG   ] spawn_process: at 2018-11-15 19:39:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 19:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 19:39:32 [DEBUG   ] spawn_process: at 2018-11-15 19:39:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 19:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 19:39:32 [DEBUG   ] spawn_process: at 2018-11-15 19:39:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 19:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 19:39:32 [DEBUG   ] spawn_process: at 2018-11-15 19:39:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 19:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 19:39:32 [DEBUG   ] spawn_process: at 2018-11-15 19:39:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 19:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 19:39:32 [DEBUG   ] spawn_process: at 2018-11-15 19:39:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 19:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 19:39:32 [DEBUG   ] spawn_process: at 2018-11-15 19:39:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 19:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 19:39:32 [DEBUG   ] spawn_process: at 2018-11-15 19:39:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 19:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 19:39:32 [DEBUG   ] spawn_process: at 2018-11-15 19:39:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 19:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 19:39:32 [DEBUG   ] spawn_process: at 2018-11-15 19:39:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 19:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 19:39:32 [DEBUG   ] spawn_process: at 2018-11-15 19:39:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 19:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 19:39:32 [DEBUG   ] spawn_process: at 2018-11-15 19:39:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 19:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 19:39:32 [DEBUG   ] spawn_process: at 2018-11-15 19:39:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 19:39:52 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 19:40:04 [DEBUG   ] Got command BAM from MCS: ref #518122
2018-11-15 19:40:04 [INFO    ] Finished processing BAM request
2018-11-15 19:40:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:40:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518122   8 58437 70804033 A  ERROR'
2018-11-15 19:40:04 [DEBUG   ] Got command BAM from MCS: ref #518121
2018-11-15 19:40:04 [INFO    ] Finished processing BAM request
2018-11-15 19:40:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:40:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518121   8 58437 70804037 A  ERROR'
2018-11-15 19:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 19:40:04 [DEBUG   ] spawn_process: at 2018-11-15 19:40:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 19:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 19:40:04 [DEBUG   ] spawn_process: at 2018-11-15 19:40:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 19:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 19:40:04 [DEBUG   ] spawn_process: at 2018-11-15 19:40:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 19:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 19:40:04 [DEBUG   ] spawn_process: at 2018-11-15 19:40:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 19:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 19:40:04 [DEBUG   ] spawn_process: at 2018-11-15 19:40:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 19:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 19:40:04 [DEBUG   ] spawn_process: at 2018-11-15 19:40:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 19:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 19:40:04 [DEBUG   ] spawn_process: at 2018-11-15 19:40:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 19:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 19:40:04 [DEBUG   ] spawn_process: at 2018-11-15 19:40:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 19:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 19:40:04 [DEBUG   ] spawn_process: at 2018-11-15 19:40:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 19:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 19:40:04 [DEBUG   ] spawn_process: at 2018-11-15 19:40:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 19:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 19:40:04 [DEBUG   ] spawn_process: at 2018-11-15 19:40:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 19:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 19:40:04 [DEBUG   ] spawn_process: at 2018-11-15 19:40:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 19:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 19:40:04 [DEBUG   ] spawn_process: at 2018-11-15 19:40:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 19:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 19:40:04 [DEBUG   ] spawn_process: at 2018-11-15 19:40:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 19:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 19:40:04 [DEBUG   ] spawn_process: at 2018-11-15 19:40:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 19:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 19:40:04 [DEBUG   ] spawn_process: at 2018-11-15 19:40:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 19:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 19:40:04 [DEBUG   ] spawn_process: at 2018-11-15 19:40:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 19:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 19:40:04 [DEBUG   ] spawn_process: at 2018-11-15 19:40:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 19:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 19:40:04 [DEBUG   ] spawn_process: at 2018-11-15 19:40:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 19:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 19:40:04 [DEBUG   ] spawn_process: at 2018-11-15 19:40:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 19:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 19:40:04 [DEBUG   ] spawn_process: at 2018-11-15 19:40:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 19:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 19:40:04 [DEBUG   ] spawn_process: at 2018-11-15 19:40:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 19:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 19:40:04 [DEBUG   ] spawn_process: at 2018-11-15 19:40:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 19:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 19:40:04 [DEBUG   ] spawn_process: at 2018-11-15 19:40:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 19:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 19:40:04 [DEBUG   ] spawn_process: at 2018-11-15 19:40:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 19:40:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 19:40:04 [DEBUG   ] spawn_process: at 2018-11-15 19:40:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 19:40:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:40:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-15 19:40:11 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 19:40:11 [WARNING ] (13, 1, 'bot')
2018-11-15 19:40:11 [WARNING ] (13, 1, 'bot')
2018-11-15 19:40:11 [WARNING ] (13, 1, 'bot')
2018-11-15 19:40:11 [WARNING ] (13, 1, 'bot')
2018-11-15 19:40:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:40:11 [DEBUG   ] Finished updating board flags in 1.193 seconds
2018-11-15 19:40:12 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 19:40:32 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 19:40:36 [DEBUG   ] Got command BAM from MCS: ref #518124
2018-11-15 19:40:36 [INFO    ] Finished processing BAM request
2018-11-15 19:40:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:40:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518124   8 58437 70836029 A  ERROR'
2018-11-15 19:40:36 [DEBUG   ] Got command BAM from MCS: ref #518123
2018-11-15 19:40:36 [INFO    ] Finished processing BAM request
2018-11-15 19:40:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:40:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518123   8 58437 70836033 A  ERROR'
2018-11-15 19:40:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 19:40:36 [DEBUG   ] spawn_process: at 2018-11-15 19:40:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 19:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 19:40:37 [DEBUG   ] spawn_process: at 2018-11-15 19:40:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 19:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 19:40:37 [DEBUG   ] spawn_process: at 2018-11-15 19:40:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 19:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 19:40:37 [DEBUG   ] spawn_process: at 2018-11-15 19:40:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 19:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 19:40:37 [DEBUG   ] spawn_process: at 2018-11-15 19:40:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 19:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 19:40:37 [DEBUG   ] spawn_process: at 2018-11-15 19:40:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 19:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 19:40:37 [DEBUG   ] spawn_process: at 2018-11-15 19:40:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 19:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 19:40:37 [DEBUG   ] spawn_process: at 2018-11-15 19:40:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 19:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 19:40:37 [DEBUG   ] spawn_process: at 2018-11-15 19:40:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 19:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 19:40:37 [DEBUG   ] spawn_process: at 2018-11-15 19:40:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 19:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 19:40:37 [DEBUG   ] spawn_process: at 2018-11-15 19:40:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 19:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 19:40:37 [DEBUG   ] spawn_process: at 2018-11-15 19:40:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 19:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 19:40:37 [DEBUG   ] spawn_process: at 2018-11-15 19:40:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 19:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 19:40:37 [DEBUG   ] spawn_process: at 2018-11-15 19:40:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 19:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 19:40:37 [DEBUG   ] spawn_process: at 2018-11-15 19:40:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 19:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 19:40:37 [DEBUG   ] spawn_process: at 2018-11-15 19:40:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 19:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 19:40:37 [DEBUG   ] spawn_process: at 2018-11-15 19:40:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 19:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 19:40:37 [DEBUG   ] spawn_process: at 2018-11-15 19:40:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 19:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 19:40:37 [DEBUG   ] spawn_process: at 2018-11-15 19:40:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 19:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 19:40:37 [DEBUG   ] spawn_process: at 2018-11-15 19:40:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 19:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 19:40:37 [DEBUG   ] spawn_process: at 2018-11-15 19:40:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 19:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 19:40:37 [DEBUG   ] spawn_process: at 2018-11-15 19:40:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 19:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 19:40:37 [DEBUG   ] spawn_process: at 2018-11-15 19:40:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 19:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 19:40:37 [DEBUG   ] spawn_process: at 2018-11-15 19:40:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 19:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 19:40:37 [DEBUG   ] spawn_process: at 2018-11-15 19:40:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 19:40:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 19:40:37 [DEBUG   ] spawn_process: at 2018-11-15 19:40:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 19:40:45 [DEBUG   ] Got command RPT from MCS: ref #518125
2018-11-15 19:40:45 [DEBUG   ] summary = ERROR
2018-11-15 19:40:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518125  13 58437 70845185 A  ERRORERROR'
2018-11-15 19:40:45 [DEBUG   ] Got command RPT from MCS: ref #518126
2018-11-15 19:40:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 19:40:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518126  77 58437 70845186 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 19:40:52 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 19:41:08 [DEBUG   ] Got command BAM from MCS: ref #518142
2018-11-15 19:41:08 [INFO    ] Finished processing BAM request
2018-11-15 19:41:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:41:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518142   8 58437 70868033 A  ERROR'
2018-11-15 19:41:08 [DEBUG   ] Got command BAM from MCS: ref #518143
2018-11-15 19:41:08 [INFO    ] Finished processing BAM request
2018-11-15 19:41:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:41:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518143   8 58437 70868037 A  ERROR'
2018-11-15 19:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 19:41:08 [DEBUG   ] spawn_process: at 2018-11-15 19:41:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 19:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 19:41:08 [DEBUG   ] spawn_process: at 2018-11-15 19:41:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 19:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 19:41:08 [DEBUG   ] spawn_process: at 2018-11-15 19:41:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 19:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 19:41:08 [DEBUG   ] spawn_process: at 2018-11-15 19:41:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 19:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 19:41:08 [DEBUG   ] spawn_process: at 2018-11-15 19:41:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 19:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 19:41:08 [DEBUG   ] spawn_process: at 2018-11-15 19:41:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 19:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 19:41:08 [DEBUG   ] spawn_process: at 2018-11-15 19:41:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 19:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 19:41:08 [DEBUG   ] spawn_process: at 2018-11-15 19:41:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 19:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 19:41:08 [DEBUG   ] spawn_process: at 2018-11-15 19:41:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 19:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 19:41:08 [DEBUG   ] spawn_process: at 2018-11-15 19:41:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 19:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 19:41:08 [DEBUG   ] spawn_process: at 2018-11-15 19:41:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 19:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 19:41:08 [DEBUG   ] spawn_process: at 2018-11-15 19:41:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 19:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 19:41:08 [DEBUG   ] spawn_process: at 2018-11-15 19:41:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 19:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 19:41:08 [DEBUG   ] spawn_process: at 2018-11-15 19:41:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 19:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 19:41:08 [DEBUG   ] spawn_process: at 2018-11-15 19:41:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 19:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 19:41:08 [DEBUG   ] spawn_process: at 2018-11-15 19:41:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 19:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 19:41:08 [DEBUG   ] spawn_process: at 2018-11-15 19:41:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 19:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 19:41:08 [DEBUG   ] spawn_process: at 2018-11-15 19:41:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 19:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 19:41:08 [DEBUG   ] spawn_process: at 2018-11-15 19:41:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 19:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 19:41:08 [DEBUG   ] spawn_process: at 2018-11-15 19:41:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 19:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 19:41:08 [DEBUG   ] spawn_process: at 2018-11-15 19:41:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 19:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 19:41:08 [DEBUG   ] spawn_process: at 2018-11-15 19:41:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 19:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 19:41:08 [DEBUG   ] spawn_process: at 2018-11-15 19:41:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 19:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 19:41:08 [DEBUG   ] spawn_process: at 2018-11-15 19:41:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 19:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 19:41:08 [DEBUG   ] spawn_process: at 2018-11-15 19:41:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 19:41:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 19:41:08 [DEBUG   ] spawn_process: at 2018-11-15 19:41:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 19:41:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 19:41:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:41:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-15 19:41:11 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 19:41:11 [WARNING ] (13, 1, 'bot')
2018-11-15 19:41:11 [WARNING ] (13, 1, 'bot')
2018-11-15 19:41:11 [WARNING ] (13, 1, 'bot')
2018-11-15 19:41:11 [WARNING ] (13, 1, 'bot')
2018-11-15 19:41:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:41:11 [DEBUG   ] Finished updating board flags in 1.011 seconds
2018-11-15 19:41:12 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 19:41:32 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 19:41:40 [DEBUG   ] Got command BAM from MCS: ref #518148
2018-11-15 19:41:40 [INFO    ] Finished processing BAM request
2018-11-15 19:41:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:41:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518148   8 58437 70900029 A  ERROR'
2018-11-15 19:41:40 [DEBUG   ] Got command BAM from MCS: ref #518149
2018-11-15 19:41:40 [INFO    ] Finished processing BAM request
2018-11-15 19:41:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:41:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518149   8 58437 70900033 A  ERROR'
2018-11-15 19:41:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 19:41:40 [DEBUG   ] spawn_process: at 2018-11-15 19:41:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 19:41:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 19:41:40 [DEBUG   ] spawn_process: at 2018-11-15 19:41:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 19:41:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 19:41:40 [DEBUG   ] spawn_process: at 2018-11-15 19:41:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 19:41:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 19:41:40 [DEBUG   ] spawn_process: at 2018-11-15 19:41:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 19:41:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 19:41:40 [DEBUG   ] spawn_process: at 2018-11-15 19:41:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 19:41:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 19:41:40 [DEBUG   ] spawn_process: at 2018-11-15 19:41:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 19:41:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 19:41:40 [DEBUG   ] spawn_process: at 2018-11-15 19:41:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 19:41:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 19:41:40 [DEBUG   ] spawn_process: at 2018-11-15 19:41:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 19:41:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 19:41:40 [DEBUG   ] spawn_process: at 2018-11-15 19:41:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 19:41:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 19:41:40 [DEBUG   ] spawn_process: at 2018-11-15 19:41:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 19:41:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 19:41:40 [DEBUG   ] spawn_process: at 2018-11-15 19:41:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 19:41:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 19:41:40 [DEBUG   ] spawn_process: at 2018-11-15 19:41:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 19:41:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 19:41:40 [DEBUG   ] spawn_process: at 2018-11-15 19:41:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 19:41:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 19:41:40 [DEBUG   ] spawn_process: at 2018-11-15 19:41:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 19:41:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 19:41:40 [DEBUG   ] spawn_process: at 2018-11-15 19:41:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 19:41:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 19:41:40 [DEBUG   ] spawn_process: at 2018-11-15 19:41:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 19:41:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 19:41:40 [DEBUG   ] spawn_process: at 2018-11-15 19:41:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 19:41:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 19:41:40 [DEBUG   ] spawn_process: at 2018-11-15 19:41:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 19:41:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 19:41:40 [DEBUG   ] spawn_process: at 2018-11-15 19:41:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 19:41:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 19:41:40 [DEBUG   ] spawn_process: at 2018-11-15 19:41:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 19:41:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 19:41:40 [DEBUG   ] spawn_process: at 2018-11-15 19:41:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 19:41:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 19:41:40 [DEBUG   ] spawn_process: at 2018-11-15 19:41:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 19:41:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 19:41:40 [DEBUG   ] spawn_process: at 2018-11-15 19:41:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 19:41:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 19:41:40 [DEBUG   ] spawn_process: at 2018-11-15 19:41:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 19:41:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 19:41:40 [DEBUG   ] spawn_process: at 2018-11-15 19:41:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 19:41:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 19:41:40 [DEBUG   ] spawn_process: at 2018-11-15 19:41:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 19:41:52 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 19:42:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 19:42:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:42:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 19:42:11 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 19:42:11 [WARNING ] (13, 1, 'bot')
2018-11-15 19:42:11 [WARNING ] (13, 1, 'bot')
2018-11-15 19:42:11 [WARNING ] (13, 1, 'bot')
2018-11-15 19:42:11 [WARNING ] (13, 1, 'bot')
2018-11-15 19:42:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:42:11 [DEBUG   ] Finished updating board flags in 1.037 seconds
2018-11-15 19:42:12 [DEBUG   ] Got command BAM from MCS: ref #518151
2018-11-15 19:42:12 [INFO    ] Finished processing BAM request
2018-11-15 19:42:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:42:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518151   8 58437 70932029 A  ERROR'
2018-11-15 19:42:12 [DEBUG   ] Got command BAM from MCS: ref #518150
2018-11-15 19:42:12 [INFO    ] Finished processing BAM request
2018-11-15 19:42:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:42:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518150   8 58437 70932033 A  ERROR'
2018-11-15 19:42:12 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 19:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 19:42:12 [DEBUG   ] spawn_process: at 2018-11-15 19:42:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 19:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 19:42:12 [DEBUG   ] spawn_process: at 2018-11-15 19:42:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 19:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 19:42:12 [DEBUG   ] spawn_process: at 2018-11-15 19:42:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 19:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 19:42:12 [DEBUG   ] spawn_process: at 2018-11-15 19:42:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 19:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 19:42:12 [DEBUG   ] spawn_process: at 2018-11-15 19:42:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 19:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 19:42:12 [DEBUG   ] spawn_process: at 2018-11-15 19:42:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 19:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 19:42:12 [DEBUG   ] spawn_process: at 2018-11-15 19:42:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 19:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 19:42:12 [DEBUG   ] spawn_process: at 2018-11-15 19:42:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 19:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 19:42:12 [DEBUG   ] spawn_process: at 2018-11-15 19:42:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 19:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 19:42:12 [DEBUG   ] spawn_process: at 2018-11-15 19:42:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 19:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 19:42:12 [DEBUG   ] spawn_process: at 2018-11-15 19:42:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 19:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 19:42:12 [DEBUG   ] spawn_process: at 2018-11-15 19:42:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 19:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 19:42:12 [DEBUG   ] spawn_process: at 2018-11-15 19:42:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 19:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 19:42:12 [DEBUG   ] spawn_process: at 2018-11-15 19:42:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 19:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 19:42:12 [DEBUG   ] spawn_process: at 2018-11-15 19:42:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 19:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 19:42:12 [DEBUG   ] spawn_process: at 2018-11-15 19:42:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 19:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 19:42:12 [DEBUG   ] spawn_process: at 2018-11-15 19:42:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 19:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 19:42:12 [DEBUG   ] spawn_process: at 2018-11-15 19:42:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 19:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 19:42:12 [DEBUG   ] spawn_process: at 2018-11-15 19:42:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 19:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 19:42:12 [DEBUG   ] spawn_process: at 2018-11-15 19:42:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 19:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 19:42:12 [DEBUG   ] spawn_process: at 2018-11-15 19:42:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 19:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 19:42:12 [DEBUG   ] spawn_process: at 2018-11-15 19:42:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 19:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 19:42:12 [DEBUG   ] spawn_process: at 2018-11-15 19:42:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 19:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 19:42:12 [DEBUG   ] spawn_process: at 2018-11-15 19:42:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 19:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 19:42:12 [DEBUG   ] spawn_process: at 2018-11-15 19:42:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 19:42:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 19:42:12 [DEBUG   ] spawn_process: at 2018-11-15 19:42:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 19:42:32 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 19:42:44 [DEBUG   ] Got command BAM from MCS: ref #518152
2018-11-15 19:42:44 [INFO    ] Finished processing BAM request
2018-11-15 19:42:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:42:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518152   8 58437 70964029 A  ERROR'
2018-11-15 19:42:44 [DEBUG   ] Got command BAM from MCS: ref #518153
2018-11-15 19:42:44 [INFO    ] Finished processing BAM request
2018-11-15 19:42:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:42:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518153   8 58437 70964033 A  ERROR'
2018-11-15 19:42:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 19:42:44 [DEBUG   ] spawn_process: at 2018-11-15 19:42:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 19:42:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 19:42:44 [DEBUG   ] spawn_process: at 2018-11-15 19:42:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 19:42:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 19:42:44 [DEBUG   ] spawn_process: at 2018-11-15 19:42:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 19:42:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 19:42:44 [DEBUG   ] spawn_process: at 2018-11-15 19:42:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 19:42:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 19:42:44 [DEBUG   ] spawn_process: at 2018-11-15 19:42:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 19:42:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 19:42:44 [DEBUG   ] spawn_process: at 2018-11-15 19:42:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 19:42:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 19:42:44 [DEBUG   ] spawn_process: at 2018-11-15 19:42:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 19:42:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 19:42:44 [DEBUG   ] spawn_process: at 2018-11-15 19:42:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 19:42:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 19:42:44 [DEBUG   ] spawn_process: at 2018-11-15 19:42:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 19:42:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 19:42:44 [DEBUG   ] spawn_process: at 2018-11-15 19:42:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 19:42:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 19:42:44 [DEBUG   ] spawn_process: at 2018-11-15 19:42:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 19:42:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 19:42:44 [DEBUG   ] spawn_process: at 2018-11-15 19:42:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 19:42:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 19:42:44 [DEBUG   ] spawn_process: at 2018-11-15 19:42:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 19:42:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 19:42:44 [DEBUG   ] spawn_process: at 2018-11-15 19:42:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 19:42:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 19:42:44 [DEBUG   ] spawn_process: at 2018-11-15 19:42:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 19:42:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 19:42:44 [DEBUG   ] spawn_process: at 2018-11-15 19:42:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 19:42:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 19:42:44 [DEBUG   ] spawn_process: at 2018-11-15 19:42:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 19:42:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 19:42:44 [DEBUG   ] spawn_process: at 2018-11-15 19:42:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 19:42:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 19:42:44 [DEBUG   ] spawn_process: at 2018-11-15 19:42:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 19:42:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 19:42:44 [DEBUG   ] spawn_process: at 2018-11-15 19:42:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 19:42:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 19:42:44 [DEBUG   ] spawn_process: at 2018-11-15 19:42:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 19:42:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 19:42:44 [DEBUG   ] spawn_process: at 2018-11-15 19:42:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 19:42:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 19:42:44 [DEBUG   ] spawn_process: at 2018-11-15 19:42:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 19:42:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 19:42:44 [DEBUG   ] spawn_process: at 2018-11-15 19:42:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 19:42:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 19:42:44 [DEBUG   ] spawn_process: at 2018-11-15 19:42:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 19:42:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 19:42:44 [DEBUG   ] spawn_process: at 2018-11-15 19:42:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 19:42:52 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 19:43:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 19:43:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-11-15 19:43:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:43:11 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 19:43:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 19:43:12 [WARNING ] (13, 1, 'bot')
2018-11-15 19:43:12 [WARNING ] (13, 1, 'bot')
2018-11-15 19:43:12 [WARNING ] (13, 1, 'bot')
2018-11-15 19:43:12 [WARNING ] (13, 1, 'bot')
2018-11-15 19:43:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:43:12 [DEBUG   ] Finished updating board flags in 1.327 seconds
2018-11-15 19:43:12 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-15 19:43:16 [DEBUG   ] Got command BAM from MCS: ref #518155
2018-11-15 19:43:16 [INFO    ] Finished processing BAM request
2018-11-15 19:43:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:43:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518155   8 58437 70996025 A  ERROR'
2018-11-15 19:43:16 [DEBUG   ] Got command BAM from MCS: ref #518154
2018-11-15 19:43:16 [INFO    ] Finished processing BAM request
2018-11-15 19:43:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:43:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518154   8 58437 70996029 A  ERROR'
2018-11-15 19:43:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 19:43:16 [DEBUG   ] spawn_process: at 2018-11-15 19:43:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 19:43:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 19:43:17 [DEBUG   ] spawn_process: at 2018-11-15 19:43:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 19:43:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 19:43:17 [DEBUG   ] spawn_process: at 2018-11-15 19:43:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 19:43:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 19:43:17 [DEBUG   ] spawn_process: at 2018-11-15 19:43:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 19:43:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 19:43:17 [DEBUG   ] spawn_process: at 2018-11-15 19:43:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 19:43:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 19:43:17 [DEBUG   ] spawn_process: at 2018-11-15 19:43:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 19:43:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 19:43:17 [DEBUG   ] spawn_process: at 2018-11-15 19:43:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 19:43:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 19:43:17 [DEBUG   ] spawn_process: at 2018-11-15 19:43:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 19:43:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 19:43:17 [DEBUG   ] spawn_process: at 2018-11-15 19:43:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 19:43:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 19:43:17 [DEBUG   ] spawn_process: at 2018-11-15 19:43:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 19:43:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 19:43:17 [DEBUG   ] spawn_process: at 2018-11-15 19:43:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 19:43:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 19:43:17 [DEBUG   ] spawn_process: at 2018-11-15 19:43:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 19:43:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 19:43:17 [DEBUG   ] spawn_process: at 2018-11-15 19:43:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 19:43:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 19:43:17 [DEBUG   ] spawn_process: at 2018-11-15 19:43:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 19:43:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 19:43:17 [DEBUG   ] spawn_process: at 2018-11-15 19:43:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 19:43:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 19:43:17 [DEBUG   ] spawn_process: at 2018-11-15 19:43:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 19:43:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 19:43:17 [DEBUG   ] spawn_process: at 2018-11-15 19:43:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 19:43:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 19:43:17 [DEBUG   ] spawn_process: at 2018-11-15 19:43:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 19:43:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 19:43:17 [DEBUG   ] spawn_process: at 2018-11-15 19:43:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 19:43:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 19:43:17 [DEBUG   ] spawn_process: at 2018-11-15 19:43:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 19:43:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 19:43:17 [DEBUG   ] spawn_process: at 2018-11-15 19:43:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 19:43:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 19:43:17 [DEBUG   ] spawn_process: at 2018-11-15 19:43:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 19:43:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 19:43:17 [DEBUG   ] spawn_process: at 2018-11-15 19:43:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 19:43:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 19:43:17 [DEBUG   ] spawn_process: at 2018-11-15 19:43:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 19:43:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 19:43:17 [DEBUG   ] spawn_process: at 2018-11-15 19:43:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 19:43:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 19:43:17 [DEBUG   ] spawn_process: at 2018-11-15 19:43:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 19:43:22 [DEBUG   ] Got command RPT from MCS: ref #518156
2018-11-15 19:43:22 [DEBUG   ] summary = ERROR
2018-11-15 19:43:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518156  13 58437 71002853 A  ERRORERROR'
2018-11-15 19:43:23 [DEBUG   ] Got command RPT from MCS: ref #518157
2018-11-15 19:43:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 19:43:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518157  77 58437 71003045 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 19:43:23 [DEBUG   ] Got command RPT from MCS: ref #518158
2018-11-15 19:43:23 [DEBUG   ] summary = ERROR
2018-11-15 19:43:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518158  13 58437 71003249 A  ERRORERROR'
2018-11-15 19:43:23 [DEBUG   ] Got command RPT from MCS: ref #518159
2018-11-15 19:43:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 19:43:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518159  77 58437 71003453 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 19:43:23 [DEBUG   ] Got command RPT from MCS: ref #518160
2018-11-15 19:43:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 19:43:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518160  12 58437 71003645 A  ERRORB¢ff'
2018-11-15 19:43:32 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-11-15 19:43:48 [DEBUG   ] Got command BAM from MCS: ref #518162
2018-11-15 19:43:48 [INFO    ] Finished processing BAM request
2018-11-15 19:43:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:43:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518162   8 58437 71028033 A  ERROR'
2018-11-15 19:43:48 [DEBUG   ] Got command BAM from MCS: ref #518161
2018-11-15 19:43:48 [INFO    ] Finished processing BAM request
2018-11-15 19:43:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:43:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518161   8 58437 71028037 A  ERROR'
2018-11-15 19:43:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 19:43:48 [DEBUG   ] spawn_process: at 2018-11-15 19:43:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 19:43:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 19:43:48 [DEBUG   ] spawn_process: at 2018-11-15 19:43:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 19:43:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 19:43:48 [DEBUG   ] spawn_process: at 2018-11-15 19:43:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 19:43:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 19:43:48 [DEBUG   ] spawn_process: at 2018-11-15 19:43:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 19:43:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 19:43:48 [DEBUG   ] spawn_process: at 2018-11-15 19:43:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 19:43:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 19:43:48 [DEBUG   ] spawn_process: at 2018-11-15 19:43:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 19:43:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 19:43:48 [DEBUG   ] spawn_process: at 2018-11-15 19:43:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 19:43:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 19:43:48 [DEBUG   ] spawn_process: at 2018-11-15 19:43:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 19:43:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 19:43:48 [DEBUG   ] spawn_process: at 2018-11-15 19:43:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 19:43:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 19:43:48 [DEBUG   ] spawn_process: at 2018-11-15 19:43:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 19:43:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 19:43:48 [DEBUG   ] spawn_process: at 2018-11-15 19:43:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 19:43:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 19:43:48 [DEBUG   ] spawn_process: at 2018-11-15 19:43:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 19:43:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 19:43:48 [DEBUG   ] spawn_process: at 2018-11-15 19:43:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 19:43:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 19:43:48 [DEBUG   ] spawn_process: at 2018-11-15 19:43:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 19:43:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 19:43:48 [DEBUG   ] spawn_process: at 2018-11-15 19:43:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 19:43:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 19:43:48 [DEBUG   ] spawn_process: at 2018-11-15 19:43:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 19:43:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 19:43:48 [DEBUG   ] spawn_process: at 2018-11-15 19:43:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 19:43:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 19:43:48 [DEBUG   ] spawn_process: at 2018-11-15 19:43:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 19:43:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 19:43:48 [DEBUG   ] spawn_process: at 2018-11-15 19:43:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 19:43:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 19:43:48 [DEBUG   ] spawn_process: at 2018-11-15 19:43:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 19:43:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 19:43:48 [DEBUG   ] spawn_process: at 2018-11-15 19:43:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 19:43:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 19:43:48 [DEBUG   ] spawn_process: at 2018-11-15 19:43:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 19:43:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 19:43:48 [DEBUG   ] spawn_process: at 2018-11-15 19:43:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 19:43:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 19:43:48 [DEBUG   ] spawn_process: at 2018-11-15 19:43:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 19:43:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 19:43:48 [DEBUG   ] spawn_process: at 2018-11-15 19:43:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 19:43:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 19:43:48 [DEBUG   ] spawn_process: at 2018-11-15 19:43:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 19:43:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 19:44:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-15 19:44:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:44:12 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 19:44:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 19:44:12 [WARNING ] (13, 1, 'bot')
2018-11-15 19:44:12 [WARNING ] (13, 1, 'bot')
2018-11-15 19:44:12 [WARNING ] (13, 1, 'bot')
2018-11-15 19:44:12 [WARNING ] (13, 1, 'bot')
2018-11-15 19:44:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:44:12 [DEBUG   ] Finished updating board flags in 1.427 seconds
2018-11-15 19:44:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 19:44:21 [DEBUG   ] Got command BAM from MCS: ref #518164
2018-11-15 19:44:21 [INFO    ] Finished processing BAM request
2018-11-15 19:44:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:44:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518164   8 58437 71061029 A  ERROR'
2018-11-15 19:44:21 [DEBUG   ] Got command BAM from MCS: ref #518163
2018-11-15 19:44:21 [INFO    ] Finished processing BAM request
2018-11-15 19:44:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:44:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518163   8 58437 71061033 A  ERROR'
2018-11-15 19:44:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 19:44:21 [DEBUG   ] spawn_process: at 2018-11-15 19:44:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 19:44:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 19:44:21 [DEBUG   ] spawn_process: at 2018-11-15 19:44:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 19:44:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 19:44:21 [DEBUG   ] spawn_process: at 2018-11-15 19:44:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 19:44:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 19:44:21 [DEBUG   ] spawn_process: at 2018-11-15 19:44:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 19:44:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 19:44:21 [DEBUG   ] spawn_process: at 2018-11-15 19:44:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 19:44:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 19:44:21 [DEBUG   ] spawn_process: at 2018-11-15 19:44:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 19:44:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 19:44:21 [DEBUG   ] spawn_process: at 2018-11-15 19:44:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 19:44:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 19:44:21 [DEBUG   ] spawn_process: at 2018-11-15 19:44:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 19:44:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 19:44:21 [DEBUG   ] spawn_process: at 2018-11-15 19:44:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 19:44:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 19:44:21 [DEBUG   ] spawn_process: at 2018-11-15 19:44:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 19:44:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 19:44:21 [DEBUG   ] spawn_process: at 2018-11-15 19:44:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 19:44:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 19:44:21 [DEBUG   ] spawn_process: at 2018-11-15 19:44:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 19:44:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 19:44:21 [DEBUG   ] spawn_process: at 2018-11-15 19:44:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 19:44:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 19:44:21 [DEBUG   ] spawn_process: at 2018-11-15 19:44:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 19:44:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 19:44:21 [DEBUG   ] spawn_process: at 2018-11-15 19:44:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 19:44:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 19:44:21 [DEBUG   ] spawn_process: at 2018-11-15 19:44:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 19:44:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 19:44:21 [DEBUG   ] spawn_process: at 2018-11-15 19:44:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 19:44:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 19:44:21 [DEBUG   ] spawn_process: at 2018-11-15 19:44:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 19:44:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 19:44:21 [DEBUG   ] spawn_process: at 2018-11-15 19:44:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 19:44:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 19:44:21 [DEBUG   ] spawn_process: at 2018-11-15 19:44:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 19:44:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 19:44:21 [DEBUG   ] spawn_process: at 2018-11-15 19:44:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 19:44:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 19:44:21 [DEBUG   ] spawn_process: at 2018-11-15 19:44:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 19:44:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 19:44:21 [DEBUG   ] spawn_process: at 2018-11-15 19:44:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 19:44:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 19:44:21 [DEBUG   ] spawn_process: at 2018-11-15 19:44:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 19:44:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 19:44:21 [DEBUG   ] spawn_process: at 2018-11-15 19:44:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 19:44:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 19:44:21 [DEBUG   ] spawn_process: at 2018-11-15 19:44:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 19:44:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 19:44:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 19:44:54 [DEBUG   ] Got command BAM from MCS: ref #518169
2018-11-15 19:44:54 [INFO    ] Finished processing BAM request
2018-11-15 19:44:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:44:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518169   8 58437 71094029 A  ERROR'
2018-11-15 19:44:54 [DEBUG   ] Got command BAM from MCS: ref #518170
2018-11-15 19:44:54 [INFO    ] Finished processing BAM request
2018-11-15 19:44:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:44:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518170   8 58437 71094033 A  ERROR'
2018-11-15 19:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 19:44:54 [DEBUG   ] spawn_process: at 2018-11-15 19:44:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 19:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 19:44:54 [DEBUG   ] spawn_process: at 2018-11-15 19:44:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 19:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 19:44:54 [DEBUG   ] spawn_process: at 2018-11-15 19:44:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 19:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 19:44:54 [DEBUG   ] spawn_process: at 2018-11-15 19:44:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 19:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 19:44:54 [DEBUG   ] spawn_process: at 2018-11-15 19:44:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 19:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 19:44:54 [DEBUG   ] spawn_process: at 2018-11-15 19:44:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 19:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 19:44:54 [DEBUG   ] spawn_process: at 2018-11-15 19:44:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 19:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 19:44:54 [DEBUG   ] spawn_process: at 2018-11-15 19:44:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 19:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 19:44:54 [DEBUG   ] spawn_process: at 2018-11-15 19:44:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 19:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 19:44:54 [DEBUG   ] spawn_process: at 2018-11-15 19:44:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 19:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 19:44:54 [DEBUG   ] spawn_process: at 2018-11-15 19:44:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 19:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 19:44:54 [DEBUG   ] spawn_process: at 2018-11-15 19:44:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 19:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 19:44:54 [DEBUG   ] spawn_process: at 2018-11-15 19:44:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 19:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 19:44:54 [DEBUG   ] spawn_process: at 2018-11-15 19:44:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 19:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 19:44:54 [DEBUG   ] spawn_process: at 2018-11-15 19:44:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 19:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 19:44:54 [DEBUG   ] spawn_process: at 2018-11-15 19:44:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 19:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 19:44:54 [DEBUG   ] spawn_process: at 2018-11-15 19:44:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 19:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 19:44:54 [DEBUG   ] spawn_process: at 2018-11-15 19:44:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 19:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 19:44:54 [DEBUG   ] spawn_process: at 2018-11-15 19:44:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 19:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 19:44:54 [DEBUG   ] spawn_process: at 2018-11-15 19:44:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 19:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 19:44:54 [DEBUG   ] spawn_process: at 2018-11-15 19:44:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 19:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 19:44:54 [DEBUG   ] spawn_process: at 2018-11-15 19:44:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 19:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 19:44:54 [DEBUG   ] spawn_process: at 2018-11-15 19:44:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 19:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 19:44:54 [DEBUG   ] spawn_process: at 2018-11-15 19:44:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 19:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 19:44:54 [DEBUG   ] spawn_process: at 2018-11-15 19:44:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 19:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 19:44:54 [DEBUG   ] spawn_process: at 2018-11-15 19:44:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 19:45:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 19:45:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 19:45:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:45:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-15 19:45:12 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 19:45:12 [WARNING ] (13, 1, 'bot')
2018-11-15 19:45:12 [WARNING ] (13, 1, 'bot')
2018-11-15 19:45:12 [WARNING ] (13, 1, 'bot')
2018-11-15 19:45:12 [WARNING ] (13, 1, 'bot')
2018-11-15 19:45:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:45:12 [DEBUG   ] Finished updating board flags in 1.399 seconds
2018-11-15 19:45:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 19:45:27 [DEBUG   ] Got command BAM from MCS: ref #518172
2018-11-15 19:45:27 [INFO    ] Finished processing BAM request
2018-11-15 19:45:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:45:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518172   8 58437 71127029 A  ERROR'
2018-11-15 19:45:27 [DEBUG   ] Got command BAM from MCS: ref #518171
2018-11-15 19:45:27 [INFO    ] Finished processing BAM request
2018-11-15 19:45:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 19:45:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518171   8 58437 71127033 A  ERROR'
2018-11-15 19:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 19:45:27 [DEBUG   ] spawn_process: at 2018-11-15 19:45:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 19:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 19:45:27 [DEBUG   ] spawn_process: at 2018-11-15 19:45:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 19:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 19:45:27 [DEBUG   ] spawn_process: at 2018-11-15 19:45:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 19:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 19:45:27 [DEBUG   ] spawn_process: at 2018-11-15 19:45:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 19:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 19:45:27 [DEBUG   ] spawn_process: at 2018-11-15 19:45:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 19:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 19:45:27 [DEBUG   ] spawn_process: at 2018-11-15 19:45:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 19:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 19:45:27 [DEBUG   ] spawn_process: at 2018-11-15 19:45:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 19:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 19:45:27 [DEBUG   ] spawn_process: at 2018-11-15 19:45:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 19:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 19:45:27 [DEBUG   ] spawn_process: at 2018-11-15 19:45:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 19:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 19:45:27 [DEBUG   ] spawn_process: at 2018-11-15 19:45:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 19:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 19:45:27 [DEBUG   ] spawn_process: at 2018-11-15 19:45:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 19:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 19:45:27 [DEBUG   ] spawn_process: at 2018-11-15 19:45:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 19:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 19:45:27 [DEBUG   ] spawn_process: at 2018-11-15 19:45:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 19:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 19:45:27 [DEBUG   ] spawn_process: at 2018-11-15 19:45:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 19:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 19:45:27 [DEBUG   ] spawn_process: at 2018-11-15 19:45:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 19:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 19:45:27 [DEBUG   ] spawn_process: at 2018-11-15 19:45:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 19:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 19:45:27 [DEBUG   ] spawn_process: at 2018-11-15 19:45:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 19:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 19:45:27 [DEBUG   ] spawn_process: at 2018-11-15 19:45:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 19:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 19:45:27 [DEBUG   ] spawn_process: at 2018-11-15 19:45:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 19:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 19:45:27 [DEBUG   ] spawn_process: at 2018-11-15 19:45:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 19:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 19:45:27 [DEBUG   ] spawn_process: at 2018-11-15 19:45:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 19:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 19:45:27 [DEBUG   ] spawn_process: at 2018-11-15 19:45:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 19:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 19:45:27 [DEBUG   ] spawn_process: at 2018-11-15 19:45:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 19:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 19:45:27 [DEBUG   ] spawn_process: at 2018-11-15 19:45:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 19:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 19:45:27 [DEBUG   ] spawn_process: at 2018-11-15 19:45:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 19:45:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 19:45:27 [DEBUG   ] spawn_process: at 2018-11-15 19:45:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 19:45:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 19:45:39 [DEBUG   ] Got command STP from MCS: ref #518174
2018-11-15 19:45:39 [INFO    ] Finished processing BAM request
2018-11-15 19:45:39 [INFO    ] Shutdown the adder chain on beam #2
2018-11-15 19:45:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP   518174   8 58437 71139125 A  ERROR'
2018-11-15 19:45:39 [DEBUG   ] Got command STP from MCS: ref #518173
2018-11-15 19:45:39 [INFO    ] Finished processing BAM request
2018-11-15 19:45:39 [INFO    ] Shutdown the adder chain on beam #3
2018-11-15 19:45:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP   518173   8 58437 71139129 A  ERROR'
2018-11-15 19:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 19:45:39 [DEBUG   ] spawn_process: at 2018-11-15 19:45:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 19:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 19:45:39 [DEBUG   ] spawn_process: at 2018-11-15 19:45:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 19:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 19:45:39 [DEBUG   ] spawn_process: at 2018-11-15 19:45:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 19:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 19:45:39 [DEBUG   ] spawn_process: at 2018-11-15 19:45:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 19:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 19:45:39 [DEBUG   ] spawn_process: at 2018-11-15 19:45:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 19:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 19:45:39 [DEBUG   ] spawn_process: at 2018-11-15 19:45:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 19:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 19:45:39 [DEBUG   ] spawn_process: at 2018-11-15 19:45:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 19:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 19:45:39 [DEBUG   ] spawn_process: at 2018-11-15 19:45:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 19:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 19:45:39 [DEBUG   ] spawn_process: at 2018-11-15 19:45:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 19:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 19:45:39 [DEBUG   ] spawn_process: at 2018-11-15 19:45:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 19:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 19:45:39 [DEBUG   ] spawn_process: at 2018-11-15 19:45:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 19:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 19:45:39 [DEBUG   ] spawn_process: at 2018-11-15 19:45:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 19:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 19:45:39 [DEBUG   ] spawn_process: at 2018-11-15 19:45:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 19:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 19:45:39 [DEBUG   ] spawn_process: at 2018-11-15 19:45:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 19:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 19:45:39 [DEBUG   ] spawn_process: at 2018-11-15 19:45:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 19:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 19:45:39 [DEBUG   ] spawn_process: at 2018-11-15 19:45:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 19:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 19:45:39 [DEBUG   ] spawn_process: at 2018-11-15 19:45:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 19:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 19:45:39 [DEBUG   ] spawn_process: at 2018-11-15 19:45:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 19:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 19:45:39 [DEBUG   ] spawn_process: at 2018-11-15 19:45:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 19:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 19:45:39 [DEBUG   ] spawn_process: at 2018-11-15 19:45:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 19:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 19:45:39 [DEBUG   ] spawn_process: at 2018-11-15 19:45:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 19:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 19:45:39 [DEBUG   ] spawn_process: at 2018-11-15 19:45:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 19:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 19:45:39 [DEBUG   ] spawn_process: at 2018-11-15 19:45:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 19:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 19:45:39 [DEBUG   ] spawn_process: at 2018-11-15 19:45:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 19:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 19:45:39 [DEBUG   ] spawn_process: at 2018-11-15 19:45:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 19:45:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 19:45:39 [DEBUG   ] spawn_process: at 2018-11-15 19:45:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 19:45:45 [DEBUG   ] Got command RPT from MCS: ref #518175
2018-11-15 19:45:45 [DEBUG   ] summary = ERROR
2018-11-15 19:45:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518175  13 58437 71145177 A  ERRORERROR'
2018-11-15 19:45:45 [DEBUG   ] Got command RPT from MCS: ref #518176
2018-11-15 19:45:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 19:45:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518176  77 58437 71145178 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 19:45:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 19:46:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 19:46:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:46:12 [WARNING ] (13, 1, 'bot')
2018-11-15 19:46:12 [WARNING ] (13, 1, 'bot')
2018-11-15 19:46:12 [WARNING ] (13, 1, 'bot')
2018-11-15 19:46:12 [WARNING ] (13, 1, 'bot')
2018-11-15 19:46:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:46:12 [DEBUG   ] Finished updating board flags in 1.228 seconds
2018-11-15 19:46:13 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 19:46:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 19:46:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 19:47:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:47:13 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-15 19:47:13 [WARNING ] (13, 1, 'bot')
2018-11-15 19:47:13 [WARNING ] (13, 1, 'bot')
2018-11-15 19:47:13 [WARNING ] (13, 1, 'bot')
2018-11-15 19:47:13 [WARNING ] (13, 1, 'bot')
2018-11-15 19:47:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:47:13 [DEBUG   ] Finished updating board flags in 2.324 seconds
2018-11-15 19:47:33 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-15 19:47:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 19:48:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:48:12 [WARNING ] (13, 1, 'bot')
2018-11-15 19:48:12 [WARNING ] (13, 1, 'bot')
2018-11-15 19:48:12 [WARNING ] (13, 1, 'bot')
2018-11-15 19:48:12 [WARNING ] (13, 1, 'bot')
2018-11-15 19:48:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:48:12 [DEBUG   ] Finished updating board flags in 1.045 seconds
2018-11-15 19:48:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 19:48:22 [DEBUG   ] Got command RPT from MCS: ref #518198
2018-11-15 19:48:22 [DEBUG   ] summary = ERROR
2018-11-15 19:48:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518198  13 58437 71302937 A  ERRORERROR'
2018-11-15 19:48:23 [DEBUG   ] Got command RPT from MCS: ref #518199
2018-11-15 19:48:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 19:48:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518199  77 58437 71303129 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 19:48:23 [DEBUG   ] Got command RPT from MCS: ref #518200
2018-11-15 19:48:23 [DEBUG   ] summary = ERROR
2018-11-15 19:48:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518200  13 58437 71303333 A  ERRORERROR'
2018-11-15 19:48:23 [DEBUG   ] Got command RPT from MCS: ref #518202
2018-11-15 19:48:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 19:48:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518202  77 58437 71303537 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 19:48:23 [DEBUG   ] Got command RPT from MCS: ref #518203
2018-11-15 19:48:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 19:48:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518203  12 58437 71303741 A  ERRORB›™š'
2018-11-15 19:48:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 19:48:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 19:49:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:49:13 [DEBUG   ] Finished updating ant stats in 1.029 seconds
2018-11-15 19:49:13 [WARNING ] (13, 1, 'bot')
2018-11-15 19:49:13 [WARNING ] (13, 1, 'bot')
2018-11-15 19:49:13 [WARNING ] (13, 1, 'bot')
2018-11-15 19:49:13 [WARNING ] (13, 1, 'bot')
2018-11-15 19:49:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:49:13 [DEBUG   ] Finished updating board flags in 2.064 seconds
2018-11-15 19:49:33 [DEBUG   ] Finished updating ant stats in 0.974 seconds
2018-11-15 19:49:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 19:50:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:50:13 [DEBUG   ] Finished updating ant stats in 0.824 seconds
2018-11-15 19:50:13 [WARNING ] (13, 1, 'bot')
2018-11-15 19:50:13 [WARNING ] (13, 1, 'bot')
2018-11-15 19:50:13 [WARNING ] (13, 1, 'bot')
2018-11-15 19:50:13 [WARNING ] (13, 1, 'bot')
2018-11-15 19:50:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:50:13 [DEBUG   ] Finished updating board flags in 1.983 seconds
2018-11-15 19:50:33 [DEBUG   ] Finished updating ant stats in 0.774 seconds
2018-11-15 19:50:45 [DEBUG   ] Got command RPT from MCS: ref #518212
2018-11-15 19:50:45 [DEBUG   ] summary = ERROR
2018-11-15 19:50:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518212  13 58437 71445185 A  ERRORERROR'
2018-11-15 19:50:45 [DEBUG   ] Got command RPT from MCS: ref #518213
2018-11-15 19:50:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 19:50:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518213  77 58437 71445186 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 19:50:53 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-15 19:51:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:51:12 [WARNING ] (13, 1, 'bot')
2018-11-15 19:51:12 [WARNING ] (13, 1, 'bot')
2018-11-15 19:51:12 [WARNING ] (13, 1, 'bot')
2018-11-15 19:51:12 [WARNING ] (13, 1, 'bot')
2018-11-15 19:51:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:51:12 [DEBUG   ] Finished updating board flags in 1.241 seconds
2018-11-15 19:51:13 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-15 19:51:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 19:51:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 19:52:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:52:12 [WARNING ] (13, 1, 'bot')
2018-11-15 19:52:12 [WARNING ] (13, 1, 'bot')
2018-11-15 19:52:12 [WARNING ] (13, 1, 'bot')
2018-11-15 19:52:12 [WARNING ] (13, 1, 'bot')
2018-11-15 19:52:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:52:12 [DEBUG   ] Finished updating board flags in 1.162 seconds
2018-11-15 19:52:14 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-15 19:52:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 19:52:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 19:53:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:53:12 [WARNING ] (13, 1, 'bot')
2018-11-15 19:53:12 [WARNING ] (13, 1, 'bot')
2018-11-15 19:53:12 [WARNING ] (13, 1, 'bot')
2018-11-15 19:53:12 [WARNING ] (13, 1, 'bot')
2018-11-15 19:53:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:53:12 [DEBUG   ] Finished updating board flags in 1.022 seconds
2018-11-15 19:53:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 19:53:23 [DEBUG   ] Got command RPT from MCS: ref #518229
2018-11-15 19:53:23 [DEBUG   ] summary = ERROR
2018-11-15 19:53:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518229  13 58437 71603021 A  ERRORERROR'
2018-11-15 19:53:23 [DEBUG   ] Got command RPT from MCS: ref #518230
2018-11-15 19:53:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 19:53:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518230  77 58437 71603225 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 19:53:23 [DEBUG   ] Got command RPT from MCS: ref #518231
2018-11-15 19:53:23 [DEBUG   ] summary = ERROR
2018-11-15 19:53:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518231  13 58437 71603417 A  ERRORERROR'
2018-11-15 19:53:23 [DEBUG   ] Got command RPT from MCS: ref #518232
2018-11-15 19:53:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 19:53:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518232  77 58437 71603621 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 19:53:23 [DEBUG   ] Got command RPT from MCS: ref #518233
2018-11-15 19:53:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 19:53:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518233  12 58437 71603825 A  ERRORB˜™š'
2018-11-15 19:53:34 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 19:53:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 19:54:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:54:12 [WARNING ] (13, 1, 'bot')
2018-11-15 19:54:12 [WARNING ] (13, 1, 'bot')
2018-11-15 19:54:12 [WARNING ] (13, 1, 'bot')
2018-11-15 19:54:12 [WARNING ] (13, 1, 'bot')
2018-11-15 19:54:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:54:12 [DEBUG   ] Finished updating board flags in 0.952 seconds
2018-11-15 19:54:14 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 19:54:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 19:54:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 19:55:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:55:14 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2018-11-15 19:55:14 [WARNING ] (13, 1, 'bot')
2018-11-15 19:55:14 [WARNING ] (13, 1, 'bot')
2018-11-15 19:55:14 [WARNING ] (13, 1, 'bot')
2018-11-15 19:55:14 [WARNING ] (13, 1, 'bot')
2018-11-15 19:55:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:55:14 [DEBUG   ] Finished updating board flags in 2.332 seconds
2018-11-15 19:55:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 19:55:45 [DEBUG   ] Got command RPT from MCS: ref #518238
2018-11-15 19:55:45 [DEBUG   ] summary = ERROR
2018-11-15 19:55:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518238  13 58437 71745185 A  ERRORERROR'
2018-11-15 19:55:45 [DEBUG   ] Got command RPT from MCS: ref #518239
2018-11-15 19:55:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 19:55:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518239  77 58437 71745186 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 19:55:54 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 19:56:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:56:14 [WARNING ] (13, 1, 'bot')
2018-11-15 19:56:14 [WARNING ] (13, 1, 'bot')
2018-11-15 19:56:14 [WARNING ] (13, 1, 'bot')
2018-11-15 19:56:14 [WARNING ] (13, 1, 'bot')
2018-11-15 19:56:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:56:14 [DEBUG   ] Finished updating board flags in 2.045 seconds
2018-11-15 19:56:14 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-11-15 19:56:34 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-15 19:56:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 19:57:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:57:13 [WARNING ] (13, 1, 'bot')
2018-11-15 19:57:13 [WARNING ] (13, 1, 'bot')
2018-11-15 19:57:13 [WARNING ] (13, 1, 'bot')
2018-11-15 19:57:13 [WARNING ] (13, 1, 'bot')
2018-11-15 19:57:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:57:13 [DEBUG   ] Finished updating board flags in 1.187 seconds
2018-11-15 19:57:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 19:57:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 19:57:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 19:58:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:58:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 19:58:13 [WARNING ] (13, 1, 'bot')
2018-11-15 19:58:13 [WARNING ] (13, 1, 'bot')
2018-11-15 19:58:13 [WARNING ] (13, 1, 'bot')
2018-11-15 19:58:13 [WARNING ] (13, 1, 'bot')
2018-11-15 19:58:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:58:13 [DEBUG   ] Finished updating board flags in 1.016 seconds
2018-11-15 19:58:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 19:58:23 [DEBUG   ] Got command RPT from MCS: ref #518261
2018-11-15 19:58:23 [DEBUG   ] summary = ERROR
2018-11-15 19:58:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518261  13 58437 71903109 A  ERRORERROR'
2018-11-15 19:58:23 [DEBUG   ] Got command RPT from MCS: ref #518262
2018-11-15 19:58:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 19:58:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518262  77 58437 71903313 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 19:58:23 [DEBUG   ] Got command RPT from MCS: ref #518263
2018-11-15 19:58:23 [DEBUG   ] summary = ERROR
2018-11-15 19:58:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518263  13 58437 71903505 A  ERRORERROR'
2018-11-15 19:58:23 [DEBUG   ] Got command RPT from MCS: ref #518265
2018-11-15 19:58:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 19:58:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518265  77 58437 71903709 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 19:58:23 [DEBUG   ] Got command RPT from MCS: ref #518267
2018-11-15 19:58:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 19:58:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518267  12 58437 71903913 A  ERRORB˜™š'
2018-11-15 19:58:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 19:58:54 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 19:59:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 19:59:13 [WARNING ] (13, 1, 'bot')
2018-11-15 19:59:13 [WARNING ] (13, 1, 'bot')
2018-11-15 19:59:13 [WARNING ] (13, 1, 'bot')
2018-11-15 19:59:13 [WARNING ] (13, 1, 'bot')
2018-11-15 19:59:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 19:59:13 [DEBUG   ] Finished updating board flags in 0.997 seconds
2018-11-15 19:59:14 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 19:59:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 19:59:54 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-15 20:00:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:00:14 [DEBUG   ] Finished updating ant stats in 0.430 seconds
2018-11-15 20:00:14 [WARNING ] (13, 1, 'bot')
2018-11-15 20:00:14 [WARNING ] (13, 1, 'bot')
2018-11-15 20:00:14 [WARNING ] (13, 1, 'bot')
2018-11-15 20:00:14 [WARNING ] (13, 1, 'bot')
2018-11-15 20:00:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:00:14 [DEBUG   ] Finished updating board flags in 1.857 seconds
2018-11-15 20:00:34 [DEBUG   ] Finished updating ant stats in 0.374 seconds
2018-11-15 20:00:45 [DEBUG   ] Got command RPT from MCS: ref #518275
2018-11-15 20:00:45 [DEBUG   ] summary = ERROR
2018-11-15 20:00:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518275  13 58437 72045181 A  ERRORERROR'
2018-11-15 20:00:45 [DEBUG   ] Got command RPT from MCS: ref #518276
2018-11-15 20:00:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 20:00:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518276  77 58437 72045182 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 20:00:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 20:01:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:01:14 [WARNING ] (13, 1, 'bot')
2018-11-15 20:01:14 [WARNING ] (13, 1, 'bot')
2018-11-15 20:01:14 [WARNING ] (13, 1, 'bot')
2018-11-15 20:01:14 [WARNING ] (13, 1, 'bot')
2018-11-15 20:01:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:01:14 [DEBUG   ] Finished updating board flags in 1.762 seconds
2018-11-15 20:01:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 20:01:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 20:01:55 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 20:02:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:02:14 [WARNING ] (13, 1, 'bot')
2018-11-15 20:02:14 [WARNING ] (13, 1, 'bot')
2018-11-15 20:02:14 [WARNING ] (13, 1, 'bot')
2018-11-15 20:02:14 [WARNING ] (13, 1, 'bot')
2018-11-15 20:02:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:02:14 [DEBUG   ] Finished updating board flags in 1.623 seconds
2018-11-15 20:02:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 20:02:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 20:02:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 20:03:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:03:14 [WARNING ] (13, 1, 'bot')
2018-11-15 20:03:14 [WARNING ] (13, 1, 'bot')
2018-11-15 20:03:14 [WARNING ] (13, 1, 'bot')
2018-11-15 20:03:14 [WARNING ] (13, 1, 'bot')
2018-11-15 20:03:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:03:14 [DEBUG   ] Finished updating board flags in 1.602 seconds
2018-11-15 20:03:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 20:03:23 [DEBUG   ] Got command RPT from MCS: ref #518296
2018-11-15 20:03:23 [DEBUG   ] summary = ERROR
2018-11-15 20:03:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518296  13 58437 72203189 A  ERRORERROR'
2018-11-15 20:03:23 [DEBUG   ] Got command RPT from MCS: ref #518297
2018-11-15 20:03:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 20:03:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518297  77 58437 72203393 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 20:03:23 [DEBUG   ] Got command RPT from MCS: ref #518298
2018-11-15 20:03:23 [DEBUG   ] summary = ERROR
2018-11-15 20:03:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518298  13 58437 72203597 A  ERRORERROR'
2018-11-15 20:03:23 [DEBUG   ] Got command RPT from MCS: ref #518299
2018-11-15 20:03:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 20:03:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518299  77 58437 72203789 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 20:03:23 [DEBUG   ] Got command RPT from MCS: ref #518300
2018-11-15 20:03:23 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 20:03:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518300  12 58437 72203993 A  ERRORB—™š'
2018-11-15 20:03:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 20:03:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 20:04:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:04:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 20:04:13 [WARNING ] (13, 1, 'bot')
2018-11-15 20:04:13 [WARNING ] (13, 1, 'bot')
2018-11-15 20:04:13 [WARNING ] (13, 1, 'bot')
2018-11-15 20:04:13 [WARNING ] (13, 1, 'bot')
2018-11-15 20:04:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:04:13 [DEBUG   ] Finished updating board flags in 1.007 seconds
2018-11-15 20:04:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 20:04:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 20:04:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 20:05:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:05:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 20:05:13 [WARNING ] (13, 1, 'bot')
2018-11-15 20:05:13 [WARNING ] (13, 1, 'bot')
2018-11-15 20:05:13 [WARNING ] (13, 1, 'bot')
2018-11-15 20:05:13 [WARNING ] (13, 1, 'bot')
2018-11-15 20:05:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:05:13 [DEBUG   ] Finished updating board flags in 1.064 seconds
2018-11-15 20:05:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 20:05:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 20:05:45 [DEBUG   ] Got command RPT from MCS: ref #518305
2018-11-15 20:05:45 [DEBUG   ] summary = ERROR
2018-11-15 20:05:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518305  13 58437 72345189 A  ERRORERROR'
2018-11-15 20:05:45 [DEBUG   ] Got command RPT from MCS: ref #518306
2018-11-15 20:05:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 20:05:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518306  77 58437 72345190 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 20:05:55 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 20:06:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 20:06:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:06:14 [WARNING ] (13, 1, 'bot')
2018-11-15 20:06:14 [WARNING ] (13, 1, 'bot')
2018-11-15 20:06:14 [WARNING ] (13, 1, 'bot')
2018-11-15 20:06:14 [WARNING ] (13, 1, 'bot')
2018-11-15 20:06:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:06:14 [DEBUG   ] Finished updating board flags in 1.543 seconds
2018-11-15 20:06:15 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-15 20:06:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 20:06:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 20:07:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:07:14 [WARNING ] (13, 1, 'bot')
2018-11-15 20:07:14 [WARNING ] (13, 1, 'bot')
2018-11-15 20:07:14 [WARNING ] (13, 1, 'bot')
2018-11-15 20:07:14 [WARNING ] (13, 1, 'bot')
2018-11-15 20:07:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:07:14 [DEBUG   ] Finished updating board flags in 1.392 seconds
2018-11-15 20:07:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 20:07:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 20:07:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 20:08:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 20:08:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:08:14 [WARNING ] (13, 1, 'bot')
2018-11-15 20:08:14 [WARNING ] (13, 1, 'bot')
2018-11-15 20:08:14 [WARNING ] (13, 1, 'bot')
2018-11-15 20:08:14 [WARNING ] (13, 1, 'bot')
2018-11-15 20:08:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:08:14 [DEBUG   ] Finished updating board flags in 1.253 seconds
2018-11-15 20:08:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 20:08:23 [DEBUG   ] Got command RPT from MCS: ref #518324
2018-11-15 20:08:23 [DEBUG   ] summary = ERROR
2018-11-15 20:08:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518324  13 58437 72503273 A  ERRORERROR'
2018-11-15 20:08:23 [DEBUG   ] Got command RPT from MCS: ref #518325
2018-11-15 20:08:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 20:08:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518325  77 58437 72503477 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 20:08:23 [DEBUG   ] Got command RPT from MCS: ref #518326
2018-11-15 20:08:23 [DEBUG   ] summary = ERROR
2018-11-15 20:08:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518326  13 58437 72503681 A  ERRORERROR'
2018-11-15 20:08:23 [DEBUG   ] Got command RPT from MCS: ref #518328
2018-11-15 20:08:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 20:08:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518328  77 58437 72503885 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 20:08:24 [DEBUG   ] Got command RPT from MCS: ref #518329
2018-11-15 20:08:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 20:08:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518329  12 58437 72504077 A  ERRORB—™š'
2018-11-15 20:08:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 20:08:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 20:09:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:09:15 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-15 20:09:15 [WARNING ] (13, 1, 'bot')
2018-11-15 20:09:15 [WARNING ] (13, 1, 'bot')
2018-11-15 20:09:15 [WARNING ] (13, 1, 'bot')
2018-11-15 20:09:15 [WARNING ] (13, 1, 'bot')
2018-11-15 20:09:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:09:15 [DEBUG   ] Finished updating board flags in 2.071 seconds
2018-11-15 20:09:35 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-15 20:09:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 20:10:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:10:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 20:10:14 [WARNING ] (13, 1, 'bot')
2018-11-15 20:10:14 [WARNING ] (13, 1, 'bot')
2018-11-15 20:10:14 [WARNING ] (13, 1, 'bot')
2018-11-15 20:10:14 [WARNING ] (13, 1, 'bot')
2018-11-15 20:10:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:10:14 [DEBUG   ] Finished updating board flags in 1.049 seconds
2018-11-15 20:10:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 20:10:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 20:10:45 [DEBUG   ] Got command RPT from MCS: ref #518338
2018-11-15 20:10:45 [DEBUG   ] summary = ERROR
2018-11-15 20:10:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518338  13 58437 72645189 A  ERRORERROR'
2018-11-15 20:10:45 [DEBUG   ] Got command RPT from MCS: ref #518339
2018-11-15 20:10:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 20:10:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518339  77 58437 72645190 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 20:10:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 20:11:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:11:14 [WARNING ] (13, 1, 'bot')
2018-11-15 20:11:14 [WARNING ] (13, 1, 'bot')
2018-11-15 20:11:14 [WARNING ] (13, 1, 'bot')
2018-11-15 20:11:14 [WARNING ] (13, 1, 'bot')
2018-11-15 20:11:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:11:14 [DEBUG   ] Finished updating board flags in 0.991 seconds
2018-11-15 20:11:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 20:11:19 [DEBUG   ] Got command BAM from MCS: ref #518360
2018-11-15 20:11:19 [INFO    ] Finished processing BAM request
2018-11-15 20:11:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:11:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518360   8 58437 72679025 A  ERROR'
2018-11-15 20:11:19 [DEBUG   ] Got command BAM from MCS: ref #518359
2018-11-15 20:11:19 [INFO    ] Finished processing BAM request
2018-11-15 20:11:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:11:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518359   8 58437 72679029 A  ERROR'
2018-11-15 20:11:19 [DEBUG   ] Got command DRX from MCS: ref #518362
2018-11-15 20:11:19 [INFO    ] sending drx command to lwa34
2018-11-15 20:11:19 [DEBUG   ] run_process: at 2018-11-15 20:11:19 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 1 35100000.0 7 9 9']
2018-11-15 20:11:19 [DEBUG   ] drx = exited with status True, code 0x00
2018-11-15 20:11:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   518362   8 58437 72679105 A  ERROR'
2018-11-15 20:11:19 [DEBUG   ] Got command DRX from MCS: ref #518361
2018-11-15 20:11:19 [INFO    ] sending drx command to lwa16
2018-11-15 20:11:19 [DEBUG   ] run_process: at 2018-11-15 20:11:19 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 1 64500000.0 7 9 9']
2018-11-15 20:11:19 [DEBUG   ] drx = exited with status True, code 0x00
2018-11-15 20:11:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   518361   8 58437 72679109 A  ERROR'
2018-11-15 20:11:19 [DEBUG   ] Got command DRX from MCS: ref #518364
2018-11-15 20:11:19 [INFO    ] sending drx command to lwa34
2018-11-15 20:11:19 [DEBUG   ] run_process: at 2018-11-15 20:11:19 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 2 49800000.0 7 9 9']
2018-11-15 20:11:19 [DEBUG   ] drx = exited with status True, code 0x00
2018-11-15 20:11:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   518364   8 58437 72679113 A  ERROR'
2018-11-15 20:11:19 [DEBUG   ] Got command DRX from MCS: ref #518363
2018-11-15 20:11:19 [INFO    ] sending drx command to lwa16
2018-11-15 20:11:19 [DEBUG   ] run_process: at 2018-11-15 20:11:19 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 2 79200000.0 7 9 9']
2018-11-15 20:11:19 [DEBUG   ] drx = exited with status True, code 0x00
2018-11-15 20:11:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   518363   8 58437 72679117 A  ERROR'
2018-11-15 20:11:19 [INFO    ] Finished starting DRX
2018-11-15 20:11:19 [INFO    ] Finished starting DRX
2018-11-15 20:11:19 [INFO    ] Finished starting DRX
2018-11-15 20:11:19 [INFO    ] Finished starting DRX
2018-11-15 20:11:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 20:11:19 [DEBUG   ] spawn_process: at 2018-11-15 20:11:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 20:11:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 20:11:19 [DEBUG   ] spawn_process: at 2018-11-15 20:11:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 20:11:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 20:11:19 [DEBUG   ] spawn_process: at 2018-11-15 20:11:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 20:11:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 20:11:19 [DEBUG   ] spawn_process: at 2018-11-15 20:11:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 20:11:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 20:11:19 [DEBUG   ] spawn_process: at 2018-11-15 20:11:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 20:11:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 20:11:19 [DEBUG   ] spawn_process: at 2018-11-15 20:11:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 20:11:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 20:11:19 [DEBUG   ] spawn_process: at 2018-11-15 20:11:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 20:11:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 20:11:19 [DEBUG   ] spawn_process: at 2018-11-15 20:11:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 20:11:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 20:11:19 [DEBUG   ] spawn_process: at 2018-11-15 20:11:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 20:11:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 20:11:19 [DEBUG   ] spawn_process: at 2018-11-15 20:11:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 20:11:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 20:11:19 [DEBUG   ] spawn_process: at 2018-11-15 20:11:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 20:11:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 20:11:19 [DEBUG   ] spawn_process: at 2018-11-15 20:11:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 20:11:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 20:11:19 [DEBUG   ] spawn_process: at 2018-11-15 20:11:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 20:11:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 20:11:19 [DEBUG   ] spawn_process: at 2018-11-15 20:11:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 20:11:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 20:11:19 [DEBUG   ] spawn_process: at 2018-11-15 20:11:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 20:11:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 20:11:19 [DEBUG   ] spawn_process: at 2018-11-15 20:11:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 20:11:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 20:11:19 [DEBUG   ] spawn_process: at 2018-11-15 20:11:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 20:11:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 20:11:19 [DEBUG   ] spawn_process: at 2018-11-15 20:11:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 20:11:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 20:11:19 [DEBUG   ] spawn_process: at 2018-11-15 20:11:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 20:11:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 20:11:19 [DEBUG   ] spawn_process: at 2018-11-15 20:11:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 20:11:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 20:11:19 [DEBUG   ] spawn_process: at 2018-11-15 20:11:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 20:11:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 20:11:19 [DEBUG   ] spawn_process: at 2018-11-15 20:11:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 20:11:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 20:11:19 [DEBUG   ] spawn_process: at 2018-11-15 20:11:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 20:11:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 20:11:19 [DEBUG   ] spawn_process: at 2018-11-15 20:11:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 20:11:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 20:11:19 [DEBUG   ] spawn_process: at 2018-11-15 20:11:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 20:11:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 20:11:19 [DEBUG   ] spawn_process: at 2018-11-15 20:11:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 20:11:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 20:11:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 20:11:59 [DEBUG   ] Got command BAM from MCS: ref #518372
2018-11-15 20:11:59 [INFO    ] Finished processing BAM request
2018-11-15 20:11:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:11:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518372   8 58437 72719029 A  ERROR'
2018-11-15 20:11:59 [DEBUG   ] Got command BAM from MCS: ref #518371
2018-11-15 20:11:59 [INFO    ] Finished processing BAM request
2018-11-15 20:11:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:11:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518371   8 58437 72719033 A  ERROR'
2018-11-15 20:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 20:11:59 [DEBUG   ] spawn_process: at 2018-11-15 20:11:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 20:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 20:11:59 [DEBUG   ] spawn_process: at 2018-11-15 20:11:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 20:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 20:11:59 [DEBUG   ] spawn_process: at 2018-11-15 20:11:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 20:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 20:11:59 [DEBUG   ] spawn_process: at 2018-11-15 20:11:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 20:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 20:11:59 [DEBUG   ] spawn_process: at 2018-11-15 20:11:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 20:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 20:11:59 [DEBUG   ] spawn_process: at 2018-11-15 20:11:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 20:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 20:11:59 [DEBUG   ] spawn_process: at 2018-11-15 20:11:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 20:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 20:11:59 [DEBUG   ] spawn_process: at 2018-11-15 20:11:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 20:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 20:11:59 [DEBUG   ] spawn_process: at 2018-11-15 20:11:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 20:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 20:11:59 [DEBUG   ] spawn_process: at 2018-11-15 20:11:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 20:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 20:11:59 [DEBUG   ] spawn_process: at 2018-11-15 20:11:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 20:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 20:11:59 [DEBUG   ] spawn_process: at 2018-11-15 20:11:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 20:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 20:11:59 [DEBUG   ] spawn_process: at 2018-11-15 20:11:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 20:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 20:11:59 [DEBUG   ] spawn_process: at 2018-11-15 20:11:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 20:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 20:11:59 [DEBUG   ] spawn_process: at 2018-11-15 20:11:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 20:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 20:11:59 [DEBUG   ] spawn_process: at 2018-11-15 20:11:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 20:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 20:11:59 [DEBUG   ] spawn_process: at 2018-11-15 20:11:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 20:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 20:11:59 [DEBUG   ] spawn_process: at 2018-11-15 20:11:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 20:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 20:11:59 [DEBUG   ] spawn_process: at 2018-11-15 20:11:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 20:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 20:11:59 [DEBUG   ] spawn_process: at 2018-11-15 20:11:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 20:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 20:11:59 [DEBUG   ] spawn_process: at 2018-11-15 20:11:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 20:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 20:11:59 [DEBUG   ] spawn_process: at 2018-11-15 20:11:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 20:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 20:11:59 [DEBUG   ] spawn_process: at 2018-11-15 20:11:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 20:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 20:11:59 [DEBUG   ] spawn_process: at 2018-11-15 20:11:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 20:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 20:11:59 [DEBUG   ] spawn_process: at 2018-11-15 20:11:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 20:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 20:11:59 [DEBUG   ] spawn_process: at 2018-11-15 20:11:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 20:12:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:12:15 [DEBUG   ] Finished updating ant stats in 0.834 seconds
2018-11-15 20:12:15 [WARNING ] (13, 1, 'bot')
2018-11-15 20:12:15 [WARNING ] (13, 1, 'bot')
2018-11-15 20:12:15 [WARNING ] (13, 1, 'bot')
2018-11-15 20:12:15 [WARNING ] (13, 1, 'bot')
2018-11-15 20:12:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:12:15 [DEBUG   ] Finished updating board flags in 1.907 seconds
2018-11-15 20:12:35 [DEBUG   ] Finished updating ant stats in 0.770 seconds
2018-11-15 20:12:39 [DEBUG   ] Got command BAM from MCS: ref #518374
2018-11-15 20:12:39 [INFO    ] Finished processing BAM request
2018-11-15 20:12:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:12:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518374   8 58437 72759029 A  ERROR'
2018-11-15 20:12:39 [DEBUG   ] Got command BAM from MCS: ref #518373
2018-11-15 20:12:39 [INFO    ] Finished processing BAM request
2018-11-15 20:12:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:12:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518373   8 58437 72759033 A  ERROR'
2018-11-15 20:12:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 20:12:39 [DEBUG   ] spawn_process: at 2018-11-15 20:12:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 20:12:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 20:12:39 [DEBUG   ] spawn_process: at 2018-11-15 20:12:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 20:12:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 20:12:39 [DEBUG   ] spawn_process: at 2018-11-15 20:12:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 20:12:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 20:12:39 [DEBUG   ] spawn_process: at 2018-11-15 20:12:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 20:12:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 20:12:39 [DEBUG   ] spawn_process: at 2018-11-15 20:12:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 20:12:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 20:12:39 [DEBUG   ] spawn_process: at 2018-11-15 20:12:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 20:12:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 20:12:39 [DEBUG   ] spawn_process: at 2018-11-15 20:12:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 20:12:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 20:12:39 [DEBUG   ] spawn_process: at 2018-11-15 20:12:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 20:12:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 20:12:39 [DEBUG   ] spawn_process: at 2018-11-15 20:12:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 20:12:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 20:12:39 [DEBUG   ] spawn_process: at 2018-11-15 20:12:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 20:12:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 20:12:39 [DEBUG   ] spawn_process: at 2018-11-15 20:12:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 20:12:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 20:12:39 [DEBUG   ] spawn_process: at 2018-11-15 20:12:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 20:12:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 20:12:39 [DEBUG   ] spawn_process: at 2018-11-15 20:12:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 20:12:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 20:12:39 [DEBUG   ] spawn_process: at 2018-11-15 20:12:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 20:12:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 20:12:39 [DEBUG   ] spawn_process: at 2018-11-15 20:12:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 20:12:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 20:12:39 [DEBUG   ] spawn_process: at 2018-11-15 20:12:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 20:12:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 20:12:39 [DEBUG   ] spawn_process: at 2018-11-15 20:12:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 20:12:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 20:12:39 [DEBUG   ] spawn_process: at 2018-11-15 20:12:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 20:12:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 20:12:39 [DEBUG   ] spawn_process: at 2018-11-15 20:12:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 20:12:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 20:12:39 [DEBUG   ] spawn_process: at 2018-11-15 20:12:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 20:12:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 20:12:39 [DEBUG   ] spawn_process: at 2018-11-15 20:12:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 20:12:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 20:12:39 [DEBUG   ] spawn_process: at 2018-11-15 20:12:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 20:12:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 20:12:39 [DEBUG   ] spawn_process: at 2018-11-15 20:12:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 20:12:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 20:12:39 [DEBUG   ] spawn_process: at 2018-11-15 20:12:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 20:12:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 20:12:39 [DEBUG   ] spawn_process: at 2018-11-15 20:12:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 20:12:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 20:12:39 [DEBUG   ] spawn_process: at 2018-11-15 20:12:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 20:12:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 20:13:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:13:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 20:13:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-15 20:13:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-11-15 20:13:14 [WARNING ] (13, 1, 'bot')
2018-11-15 20:13:14 [WARNING ] (13, 1, 'bot')
2018-11-15 20:13:14 [WARNING ] (13, 1, 'bot')
2018-11-15 20:13:14 [WARNING ] (13, 1, 'bot')
2018-11-15 20:13:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:13:14 [DEBUG   ] Finished updating board flags in 1.178 seconds
2018-11-15 20:13:15 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-15 20:13:19 [DEBUG   ] Got command BAM from MCS: ref #518375
2018-11-15 20:13:19 [INFO    ] Finished processing BAM request
2018-11-15 20:13:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:13:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518375   8 58437 72799025 A  ERROR'
2018-11-15 20:13:19 [DEBUG   ] Got command BAM from MCS: ref #518376
2018-11-15 20:13:19 [INFO    ] Finished processing BAM request
2018-11-15 20:13:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:13:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518376   8 58437 72799029 A  ERROR'
2018-11-15 20:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 20:13:19 [DEBUG   ] spawn_process: at 2018-11-15 20:13:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 20:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 20:13:19 [DEBUG   ] spawn_process: at 2018-11-15 20:13:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 20:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 20:13:19 [DEBUG   ] spawn_process: at 2018-11-15 20:13:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 20:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 20:13:19 [DEBUG   ] spawn_process: at 2018-11-15 20:13:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 20:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 20:13:19 [DEBUG   ] spawn_process: at 2018-11-15 20:13:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 20:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 20:13:19 [DEBUG   ] spawn_process: at 2018-11-15 20:13:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 20:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 20:13:19 [DEBUG   ] spawn_process: at 2018-11-15 20:13:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 20:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 20:13:19 [DEBUG   ] spawn_process: at 2018-11-15 20:13:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 20:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 20:13:19 [DEBUG   ] spawn_process: at 2018-11-15 20:13:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 20:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 20:13:19 [DEBUG   ] spawn_process: at 2018-11-15 20:13:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 20:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 20:13:19 [DEBUG   ] spawn_process: at 2018-11-15 20:13:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 20:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 20:13:19 [DEBUG   ] spawn_process: at 2018-11-15 20:13:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 20:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 20:13:19 [DEBUG   ] spawn_process: at 2018-11-15 20:13:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 20:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 20:13:19 [DEBUG   ] spawn_process: at 2018-11-15 20:13:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 20:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 20:13:19 [DEBUG   ] spawn_process: at 2018-11-15 20:13:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 20:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 20:13:19 [DEBUG   ] spawn_process: at 2018-11-15 20:13:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 20:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 20:13:19 [DEBUG   ] spawn_process: at 2018-11-15 20:13:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 20:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 20:13:19 [DEBUG   ] spawn_process: at 2018-11-15 20:13:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 20:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 20:13:19 [DEBUG   ] spawn_process: at 2018-11-15 20:13:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 20:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 20:13:19 [DEBUG   ] spawn_process: at 2018-11-15 20:13:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 20:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 20:13:19 [DEBUG   ] spawn_process: at 2018-11-15 20:13:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 20:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 20:13:19 [DEBUG   ] spawn_process: at 2018-11-15 20:13:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 20:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 20:13:19 [DEBUG   ] spawn_process: at 2018-11-15 20:13:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 20:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 20:13:19 [DEBUG   ] spawn_process: at 2018-11-15 20:13:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 20:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 20:13:19 [DEBUG   ] spawn_process: at 2018-11-15 20:13:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 20:13:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 20:13:19 [DEBUG   ] spawn_process: at 2018-11-15 20:13:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 20:13:23 [DEBUG   ] Got command RPT from MCS: ref #518377
2018-11-15 20:13:23 [DEBUG   ] summary = ERROR
2018-11-15 20:13:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518377  13 58437 72803361 A  ERRORERROR'
2018-11-15 20:13:23 [DEBUG   ] Got command RPT from MCS: ref #518378
2018-11-15 20:13:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 20:13:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518378  77 58437 72803565 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 20:13:23 [DEBUG   ] Got command RPT from MCS: ref #518379
2018-11-15 20:13:23 [DEBUG   ] summary = ERROR
2018-11-15 20:13:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518379  13 58437 72803769 A  ERRORERROR'
2018-11-15 20:13:23 [DEBUG   ] Got command RPT from MCS: ref #518380
2018-11-15 20:13:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 20:13:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518380  77 58437 72803961 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 20:13:24 [DEBUG   ] Got command RPT from MCS: ref #518381
2018-11-15 20:13:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 20:13:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518381  12 58437 72804165 A  ERRORBžff'
2018-11-15 20:13:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 20:13:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 20:13:59 [DEBUG   ] Got command BAM from MCS: ref #518382
2018-11-15 20:13:59 [INFO    ] Finished processing BAM request
2018-11-15 20:13:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:13:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518382   8 58437 72839025 A  ERROR'
2018-11-15 20:13:59 [DEBUG   ] Got command BAM from MCS: ref #518383
2018-11-15 20:13:59 [INFO    ] Finished processing BAM request
2018-11-15 20:13:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:13:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518383   8 58437 72839029 A  ERROR'
2018-11-15 20:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 20:13:59 [DEBUG   ] spawn_process: at 2018-11-15 20:13:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 20:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 20:13:59 [DEBUG   ] spawn_process: at 2018-11-15 20:13:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 20:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 20:13:59 [DEBUG   ] spawn_process: at 2018-11-15 20:13:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 20:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 20:13:59 [DEBUG   ] spawn_process: at 2018-11-15 20:13:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 20:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 20:13:59 [DEBUG   ] spawn_process: at 2018-11-15 20:13:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 20:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 20:13:59 [DEBUG   ] spawn_process: at 2018-11-15 20:13:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 20:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 20:13:59 [DEBUG   ] spawn_process: at 2018-11-15 20:13:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 20:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 20:13:59 [DEBUG   ] spawn_process: at 2018-11-15 20:13:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 20:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 20:13:59 [DEBUG   ] spawn_process: at 2018-11-15 20:13:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 20:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 20:13:59 [DEBUG   ] spawn_process: at 2018-11-15 20:13:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 20:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 20:13:59 [DEBUG   ] spawn_process: at 2018-11-15 20:13:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 20:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 20:13:59 [DEBUG   ] spawn_process: at 2018-11-15 20:13:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 20:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 20:13:59 [DEBUG   ] spawn_process: at 2018-11-15 20:13:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 20:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 20:13:59 [DEBUG   ] spawn_process: at 2018-11-15 20:13:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 20:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 20:13:59 [DEBUG   ] spawn_process: at 2018-11-15 20:13:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 20:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 20:13:59 [DEBUG   ] spawn_process: at 2018-11-15 20:13:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 20:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 20:13:59 [DEBUG   ] spawn_process: at 2018-11-15 20:13:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 20:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 20:13:59 [DEBUG   ] spawn_process: at 2018-11-15 20:13:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 20:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 20:13:59 [DEBUG   ] spawn_process: at 2018-11-15 20:13:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 20:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 20:13:59 [DEBUG   ] spawn_process: at 2018-11-15 20:13:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 20:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 20:13:59 [DEBUG   ] spawn_process: at 2018-11-15 20:13:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 20:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 20:13:59 [DEBUG   ] spawn_process: at 2018-11-15 20:13:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 20:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 20:13:59 [DEBUG   ] spawn_process: at 2018-11-15 20:13:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 20:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 20:13:59 [DEBUG   ] spawn_process: at 2018-11-15 20:13:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 20:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 20:13:59 [DEBUG   ] spawn_process: at 2018-11-15 20:13:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 20:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 20:13:59 [DEBUG   ] spawn_process: at 2018-11-15 20:13:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 20:14:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-15 20:14:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:14:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-15 20:14:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 20:14:14 [WARNING ] (13, 1, 'bot')
2018-11-15 20:14:14 [WARNING ] (13, 1, 'bot')
2018-11-15 20:14:14 [WARNING ] (13, 1, 'bot')
2018-11-15 20:14:14 [WARNING ] (13, 1, 'bot')
2018-11-15 20:14:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:14:14 [DEBUG   ] Finished updating board flags in 1.023 seconds
2018-11-15 20:14:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 20:14:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 20:14:39 [DEBUG   ] Got command BAM from MCS: ref #518388
2018-11-15 20:14:39 [INFO    ] Finished processing BAM request
2018-11-15 20:14:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:14:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518388   8 58437 72879029 A  ERROR'
2018-11-15 20:14:39 [DEBUG   ] Got command BAM from MCS: ref #518389
2018-11-15 20:14:39 [INFO    ] Finished processing BAM request
2018-11-15 20:14:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:14:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518389   8 58437 72879033 A  ERROR'
2018-11-15 20:14:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 20:14:39 [DEBUG   ] spawn_process: at 2018-11-15 20:14:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 20:14:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 20:14:39 [DEBUG   ] spawn_process: at 2018-11-15 20:14:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 20:14:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 20:14:39 [DEBUG   ] spawn_process: at 2018-11-15 20:14:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 20:14:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 20:14:39 [DEBUG   ] spawn_process: at 2018-11-15 20:14:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 20:14:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 20:14:39 [DEBUG   ] spawn_process: at 2018-11-15 20:14:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 20:14:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 20:14:39 [DEBUG   ] spawn_process: at 2018-11-15 20:14:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 20:14:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 20:14:39 [DEBUG   ] spawn_process: at 2018-11-15 20:14:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 20:14:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 20:14:39 [DEBUG   ] spawn_process: at 2018-11-15 20:14:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 20:14:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 20:14:39 [DEBUG   ] spawn_process: at 2018-11-15 20:14:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 20:14:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 20:14:39 [DEBUG   ] spawn_process: at 2018-11-15 20:14:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 20:14:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 20:14:39 [DEBUG   ] spawn_process: at 2018-11-15 20:14:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 20:14:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 20:14:39 [DEBUG   ] spawn_process: at 2018-11-15 20:14:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 20:14:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 20:14:39 [DEBUG   ] spawn_process: at 2018-11-15 20:14:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 20:14:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 20:14:39 [DEBUG   ] spawn_process: at 2018-11-15 20:14:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 20:14:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 20:14:39 [DEBUG   ] spawn_process: at 2018-11-15 20:14:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 20:14:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 20:14:39 [DEBUG   ] spawn_process: at 2018-11-15 20:14:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 20:14:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 20:14:39 [DEBUG   ] spawn_process: at 2018-11-15 20:14:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 20:14:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 20:14:39 [DEBUG   ] spawn_process: at 2018-11-15 20:14:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 20:14:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 20:14:39 [DEBUG   ] spawn_process: at 2018-11-15 20:14:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 20:14:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 20:14:39 [DEBUG   ] spawn_process: at 2018-11-15 20:14:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 20:14:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 20:14:39 [DEBUG   ] spawn_process: at 2018-11-15 20:14:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 20:14:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 20:14:39 [DEBUG   ] spawn_process: at 2018-11-15 20:14:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 20:14:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 20:14:39 [DEBUG   ] spawn_process: at 2018-11-15 20:14:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 20:14:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 20:14:39 [DEBUG   ] spawn_process: at 2018-11-15 20:14:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 20:14:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 20:14:39 [DEBUG   ] spawn_process: at 2018-11-15 20:14:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 20:14:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 20:14:39 [DEBUG   ] spawn_process: at 2018-11-15 20:14:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 20:14:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 20:15:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:15:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 20:15:14 [WARNING ] (13, 1, 'bot')
2018-11-15 20:15:14 [WARNING ] (13, 1, 'bot')
2018-11-15 20:15:14 [WARNING ] (13, 1, 'bot')
2018-11-15 20:15:14 [WARNING ] (13, 1, 'bot')
2018-11-15 20:15:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:15:14 [DEBUG   ] Finished updating board flags in 1.007 seconds
2018-11-15 20:15:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 20:15:19 [DEBUG   ] Got command BAM from MCS: ref #518391
2018-11-15 20:15:19 [INFO    ] Finished processing BAM request
2018-11-15 20:15:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:15:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518391   8 58437 72919033 A  ERROR'
2018-11-15 20:15:19 [DEBUG   ] Got command BAM from MCS: ref #518390
2018-11-15 20:15:19 [INFO    ] Finished processing BAM request
2018-11-15 20:15:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:15:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518390   8 58437 72919037 A  ERROR'
2018-11-15 20:15:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 20:15:19 [DEBUG   ] spawn_process: at 2018-11-15 20:15:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 20:15:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 20:15:19 [DEBUG   ] spawn_process: at 2018-11-15 20:15:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 20:15:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 20:15:19 [DEBUG   ] spawn_process: at 2018-11-15 20:15:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 20:15:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 20:15:19 [DEBUG   ] spawn_process: at 2018-11-15 20:15:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 20:15:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 20:15:19 [DEBUG   ] spawn_process: at 2018-11-15 20:15:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 20:15:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 20:15:19 [DEBUG   ] spawn_process: at 2018-11-15 20:15:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 20:15:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 20:15:19 [DEBUG   ] spawn_process: at 2018-11-15 20:15:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 20:15:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 20:15:19 [DEBUG   ] spawn_process: at 2018-11-15 20:15:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 20:15:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 20:15:19 [DEBUG   ] spawn_process: at 2018-11-15 20:15:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 20:15:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 20:15:19 [DEBUG   ] spawn_process: at 2018-11-15 20:15:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 20:15:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 20:15:19 [DEBUG   ] spawn_process: at 2018-11-15 20:15:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 20:15:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 20:15:19 [DEBUG   ] spawn_process: at 2018-11-15 20:15:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 20:15:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 20:15:19 [DEBUG   ] spawn_process: at 2018-11-15 20:15:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 20:15:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 20:15:19 [DEBUG   ] spawn_process: at 2018-11-15 20:15:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 20:15:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 20:15:19 [DEBUG   ] spawn_process: at 2018-11-15 20:15:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 20:15:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 20:15:19 [DEBUG   ] spawn_process: at 2018-11-15 20:15:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 20:15:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 20:15:19 [DEBUG   ] spawn_process: at 2018-11-15 20:15:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 20:15:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 20:15:19 [DEBUG   ] spawn_process: at 2018-11-15 20:15:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 20:15:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 20:15:19 [DEBUG   ] spawn_process: at 2018-11-15 20:15:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 20:15:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 20:15:19 [DEBUG   ] spawn_process: at 2018-11-15 20:15:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 20:15:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 20:15:19 [DEBUG   ] spawn_process: at 2018-11-15 20:15:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 20:15:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 20:15:19 [DEBUG   ] spawn_process: at 2018-11-15 20:15:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 20:15:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 20:15:19 [DEBUG   ] spawn_process: at 2018-11-15 20:15:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 20:15:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 20:15:19 [DEBUG   ] spawn_process: at 2018-11-15 20:15:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 20:15:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 20:15:19 [DEBUG   ] spawn_process: at 2018-11-15 20:15:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 20:15:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 20:15:19 [DEBUG   ] spawn_process: at 2018-11-15 20:15:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 20:15:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 20:15:45 [DEBUG   ] Got command RPT from MCS: ref #518392
2018-11-15 20:15:45 [DEBUG   ] summary = ERROR
2018-11-15 20:15:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518392  13 58437 72945193 A  ERRORERROR'
2018-11-15 20:15:45 [DEBUG   ] Got command RPT from MCS: ref #518393
2018-11-15 20:15:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 20:15:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518393  77 58437 72945194 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 20:15:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 20:15:59 [DEBUG   ] Got command BAM from MCS: ref #518409
2018-11-15 20:15:59 [INFO    ] Finished processing BAM request
2018-11-15 20:15:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:15:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518409   8 58437 72959025 A  ERROR'
2018-11-15 20:15:59 [DEBUG   ] Got command BAM from MCS: ref #518410
2018-11-15 20:15:59 [INFO    ] Finished processing BAM request
2018-11-15 20:15:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:15:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518410   8 58437 72959029 A  ERROR'
2018-11-15 20:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 20:15:59 [DEBUG   ] spawn_process: at 2018-11-15 20:15:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 20:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 20:15:59 [DEBUG   ] spawn_process: at 2018-11-15 20:15:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 20:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 20:15:59 [DEBUG   ] spawn_process: at 2018-11-15 20:15:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 20:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 20:15:59 [DEBUG   ] spawn_process: at 2018-11-15 20:15:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 20:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 20:15:59 [DEBUG   ] spawn_process: at 2018-11-15 20:15:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 20:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 20:15:59 [DEBUG   ] spawn_process: at 2018-11-15 20:15:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 20:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 20:15:59 [DEBUG   ] spawn_process: at 2018-11-15 20:15:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 20:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 20:15:59 [DEBUG   ] spawn_process: at 2018-11-15 20:15:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 20:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 20:15:59 [DEBUG   ] spawn_process: at 2018-11-15 20:15:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 20:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 20:15:59 [DEBUG   ] spawn_process: at 2018-11-15 20:15:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 20:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 20:15:59 [DEBUG   ] spawn_process: at 2018-11-15 20:15:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 20:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 20:15:59 [DEBUG   ] spawn_process: at 2018-11-15 20:15:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 20:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 20:15:59 [DEBUG   ] spawn_process: at 2018-11-15 20:15:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 20:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 20:15:59 [DEBUG   ] spawn_process: at 2018-11-15 20:15:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 20:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 20:15:59 [DEBUG   ] spawn_process: at 2018-11-15 20:15:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 20:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 20:15:59 [DEBUG   ] spawn_process: at 2018-11-15 20:15:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 20:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 20:15:59 [DEBUG   ] spawn_process: at 2018-11-15 20:15:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 20:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 20:15:59 [DEBUG   ] spawn_process: at 2018-11-15 20:15:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 20:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 20:15:59 [DEBUG   ] spawn_process: at 2018-11-15 20:15:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 20:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 20:15:59 [DEBUG   ] spawn_process: at 2018-11-15 20:15:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 20:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 20:15:59 [DEBUG   ] spawn_process: at 2018-11-15 20:15:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 20:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 20:15:59 [DEBUG   ] spawn_process: at 2018-11-15 20:15:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 20:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 20:15:59 [DEBUG   ] spawn_process: at 2018-11-15 20:15:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 20:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 20:15:59 [DEBUG   ] spawn_process: at 2018-11-15 20:15:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 20:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 20:15:59 [DEBUG   ] spawn_process: at 2018-11-15 20:15:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 20:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 20:15:59 [DEBUG   ] spawn_process: at 2018-11-15 20:15:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 20:16:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:16:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-15 20:16:14 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-15 20:16:14 [WARNING ] (13, 1, 'bot')
2018-11-15 20:16:14 [WARNING ] (13, 1, 'bot')
2018-11-15 20:16:14 [WARNING ] (13, 1, 'bot')
2018-11-15 20:16:14 [WARNING ] (13, 1, 'bot')
2018-11-15 20:16:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:16:14 [DEBUG   ] Finished updating board flags in 0.993 seconds
2018-11-15 20:16:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 20:16:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 20:16:39 [DEBUG   ] Got command BAM from MCS: ref #518412
2018-11-15 20:16:39 [INFO    ] Finished processing BAM request
2018-11-15 20:16:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:16:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518412   8 58437 72999033 A  ERROR'
2018-11-15 20:16:39 [DEBUG   ] Got command BAM from MCS: ref #518411
2018-11-15 20:16:39 [INFO    ] Finished processing BAM request
2018-11-15 20:16:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:16:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518411   8 58437 72999037 A  ERROR'
2018-11-15 20:16:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 20:16:39 [DEBUG   ] spawn_process: at 2018-11-15 20:16:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 20:16:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 20:16:39 [DEBUG   ] spawn_process: at 2018-11-15 20:16:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 20:16:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 20:16:39 [DEBUG   ] spawn_process: at 2018-11-15 20:16:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 20:16:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 20:16:39 [DEBUG   ] spawn_process: at 2018-11-15 20:16:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 20:16:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 20:16:39 [DEBUG   ] spawn_process: at 2018-11-15 20:16:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 20:16:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 20:16:39 [DEBUG   ] spawn_process: at 2018-11-15 20:16:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 20:16:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 20:16:39 [DEBUG   ] spawn_process: at 2018-11-15 20:16:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 20:16:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 20:16:39 [DEBUG   ] spawn_process: at 2018-11-15 20:16:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 20:16:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 20:16:39 [DEBUG   ] spawn_process: at 2018-11-15 20:16:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 20:16:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 20:16:39 [DEBUG   ] spawn_process: at 2018-11-15 20:16:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 20:16:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 20:16:39 [DEBUG   ] spawn_process: at 2018-11-15 20:16:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 20:16:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 20:16:39 [DEBUG   ] spawn_process: at 2018-11-15 20:16:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 20:16:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 20:16:39 [DEBUG   ] spawn_process: at 2018-11-15 20:16:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 20:16:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 20:16:39 [DEBUG   ] spawn_process: at 2018-11-15 20:16:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 20:16:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 20:16:39 [DEBUG   ] spawn_process: at 2018-11-15 20:16:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 20:16:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 20:16:39 [DEBUG   ] spawn_process: at 2018-11-15 20:16:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 20:16:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 20:16:39 [DEBUG   ] spawn_process: at 2018-11-15 20:16:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 20:16:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 20:16:39 [DEBUG   ] spawn_process: at 2018-11-15 20:16:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 20:16:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 20:16:39 [DEBUG   ] spawn_process: at 2018-11-15 20:16:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 20:16:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 20:16:39 [DEBUG   ] spawn_process: at 2018-11-15 20:16:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 20:16:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 20:16:39 [DEBUG   ] spawn_process: at 2018-11-15 20:16:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 20:16:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 20:16:39 [DEBUG   ] spawn_process: at 2018-11-15 20:16:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 20:16:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 20:16:39 [DEBUG   ] spawn_process: at 2018-11-15 20:16:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 20:16:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 20:16:39 [DEBUG   ] spawn_process: at 2018-11-15 20:16:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 20:16:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 20:16:39 [DEBUG   ] spawn_process: at 2018-11-15 20:16:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 20:16:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 20:16:39 [DEBUG   ] spawn_process: at 2018-11-15 20:16:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 20:16:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 20:17:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 20:17:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 20:17:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-11-15 20:17:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:17:15 [DEBUG   ] Finished updating ant stats in 0.626 seconds
2018-11-15 20:17:15 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-11-15 20:17:15 [WARNING ] (13, 1, 'bot')
2018-11-15 20:17:15 [WARNING ] (13, 1, 'bot')
2018-11-15 20:17:15 [WARNING ] (13, 1, 'bot')
2018-11-15 20:17:15 [WARNING ] (13, 1, 'bot')
2018-11-15 20:17:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:17:15 [DEBUG   ] Finished updating board flags in 1.399 seconds
2018-11-15 20:17:19 [DEBUG   ] Got command BAM from MCS: ref #518414
2018-11-15 20:17:19 [INFO    ] Finished processing BAM request
2018-11-15 20:17:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:17:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518414   8 58437 73039025 A  ERROR'
2018-11-15 20:17:19 [DEBUG   ] Got command BAM from MCS: ref #518413
2018-11-15 20:17:19 [INFO    ] Finished processing BAM request
2018-11-15 20:17:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:17:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518413   8 58437 73039029 A  ERROR'
2018-11-15 20:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 20:17:19 [DEBUG   ] spawn_process: at 2018-11-15 20:17:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 20:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 20:17:19 [DEBUG   ] spawn_process: at 2018-11-15 20:17:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 20:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 20:17:19 [DEBUG   ] spawn_process: at 2018-11-15 20:17:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 20:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 20:17:19 [DEBUG   ] spawn_process: at 2018-11-15 20:17:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 20:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 20:17:19 [DEBUG   ] spawn_process: at 2018-11-15 20:17:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 20:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 20:17:19 [DEBUG   ] spawn_process: at 2018-11-15 20:17:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 20:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 20:17:19 [DEBUG   ] spawn_process: at 2018-11-15 20:17:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 20:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 20:17:19 [DEBUG   ] spawn_process: at 2018-11-15 20:17:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 20:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 20:17:19 [DEBUG   ] spawn_process: at 2018-11-15 20:17:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 20:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 20:17:19 [DEBUG   ] spawn_process: at 2018-11-15 20:17:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 20:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 20:17:19 [DEBUG   ] spawn_process: at 2018-11-15 20:17:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 20:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 20:17:19 [DEBUG   ] spawn_process: at 2018-11-15 20:17:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 20:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 20:17:19 [DEBUG   ] spawn_process: at 2018-11-15 20:17:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 20:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 20:17:19 [DEBUG   ] spawn_process: at 2018-11-15 20:17:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 20:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 20:17:19 [DEBUG   ] spawn_process: at 2018-11-15 20:17:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 20:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 20:17:19 [DEBUG   ] spawn_process: at 2018-11-15 20:17:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 20:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 20:17:19 [DEBUG   ] spawn_process: at 2018-11-15 20:17:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 20:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 20:17:19 [DEBUG   ] spawn_process: at 2018-11-15 20:17:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 20:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 20:17:19 [DEBUG   ] spawn_process: at 2018-11-15 20:17:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 20:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 20:17:19 [DEBUG   ] spawn_process: at 2018-11-15 20:17:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 20:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 20:17:19 [DEBUG   ] spawn_process: at 2018-11-15 20:17:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 20:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 20:17:19 [DEBUG   ] spawn_process: at 2018-11-15 20:17:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 20:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 20:17:19 [DEBUG   ] spawn_process: at 2018-11-15 20:17:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 20:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 20:17:19 [DEBUG   ] spawn_process: at 2018-11-15 20:17:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 20:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 20:17:19 [DEBUG   ] spawn_process: at 2018-11-15 20:17:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 20:17:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 20:17:19 [DEBUG   ] spawn_process: at 2018-11-15 20:17:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 20:17:35 [DEBUG   ] Finished updating ant stats in 0.574 seconds
2018-11-15 20:17:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 20:17:59 [DEBUG   ] Got command BAM from MCS: ref #518420
2018-11-15 20:17:59 [INFO    ] Finished processing BAM request
2018-11-15 20:17:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:17:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518420   8 58437 73079029 A  ERROR'
2018-11-15 20:17:59 [DEBUG   ] Got command BAM from MCS: ref #518419
2018-11-15 20:17:59 [INFO    ] Finished processing BAM request
2018-11-15 20:17:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:17:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518419   8 58437 73079033 A  ERROR'
2018-11-15 20:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 20:17:59 [DEBUG   ] spawn_process: at 2018-11-15 20:17:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 20:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 20:17:59 [DEBUG   ] spawn_process: at 2018-11-15 20:17:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 20:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 20:17:59 [DEBUG   ] spawn_process: at 2018-11-15 20:17:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 20:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 20:17:59 [DEBUG   ] spawn_process: at 2018-11-15 20:17:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 20:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 20:17:59 [DEBUG   ] spawn_process: at 2018-11-15 20:17:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 20:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 20:17:59 [DEBUG   ] spawn_process: at 2018-11-15 20:17:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 20:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 20:17:59 [DEBUG   ] spawn_process: at 2018-11-15 20:17:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 20:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 20:17:59 [DEBUG   ] spawn_process: at 2018-11-15 20:17:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 20:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 20:17:59 [DEBUG   ] spawn_process: at 2018-11-15 20:17:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 20:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 20:17:59 [DEBUG   ] spawn_process: at 2018-11-15 20:17:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 20:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 20:17:59 [DEBUG   ] spawn_process: at 2018-11-15 20:17:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 20:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 20:17:59 [DEBUG   ] spawn_process: at 2018-11-15 20:17:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 20:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 20:17:59 [DEBUG   ] spawn_process: at 2018-11-15 20:17:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 20:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 20:17:59 [DEBUG   ] spawn_process: at 2018-11-15 20:17:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 20:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 20:17:59 [DEBUG   ] spawn_process: at 2018-11-15 20:17:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 20:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 20:17:59 [DEBUG   ] spawn_process: at 2018-11-15 20:17:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 20:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 20:17:59 [DEBUG   ] spawn_process: at 2018-11-15 20:17:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 20:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 20:17:59 [DEBUG   ] spawn_process: at 2018-11-15 20:17:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 20:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 20:17:59 [DEBUG   ] spawn_process: at 2018-11-15 20:17:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 20:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 20:17:59 [DEBUG   ] spawn_process: at 2018-11-15 20:17:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 20:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 20:17:59 [DEBUG   ] spawn_process: at 2018-11-15 20:17:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 20:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 20:17:59 [DEBUG   ] spawn_process: at 2018-11-15 20:17:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 20:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 20:17:59 [DEBUG   ] spawn_process: at 2018-11-15 20:17:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 20:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 20:17:59 [DEBUG   ] spawn_process: at 2018-11-15 20:17:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 20:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 20:17:59 [DEBUG   ] spawn_process: at 2018-11-15 20:17:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 20:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 20:17:59 [DEBUG   ] spawn_process: at 2018-11-15 20:17:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 20:18:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:18:15 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-15 20:18:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2018-11-15 20:18:15 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-15 20:18:15 [WARNING ] (13, 1, 'bot')
2018-11-15 20:18:15 [WARNING ] (13, 1, 'bot')
2018-11-15 20:18:15 [WARNING ] (13, 1, 'bot')
2018-11-15 20:18:15 [WARNING ] (13, 1, 'bot')
2018-11-15 20:18:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:18:15 [DEBUG   ] Finished updating board flags in 1.372 seconds
2018-11-15 20:18:23 [DEBUG   ] Got command RPT from MCS: ref #518423
2018-11-15 20:18:23 [DEBUG   ] summary = ERROR
2018-11-15 20:18:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518423  13 58437 73103449 A  ERRORERROR'
2018-11-15 20:18:23 [DEBUG   ] Got command RPT from MCS: ref #518424
2018-11-15 20:18:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 20:18:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518424  77 58437 73103653 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 20:18:23 [DEBUG   ] Got command RPT from MCS: ref #518425
2018-11-15 20:18:23 [DEBUG   ] summary = ERROR
2018-11-15 20:18:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518425  13 58437 73103857 A  ERRORERROR'
2018-11-15 20:18:24 [DEBUG   ] Got command RPT from MCS: ref #518427
2018-11-15 20:18:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 20:18:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518427  77 58437 73104050 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 20:18:24 [DEBUG   ] Got command RPT from MCS: ref #518428
2018-11-15 20:18:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 20:18:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518428  12 58437 73104253 A  ERRORB¡ff'
2018-11-15 20:18:35 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 20:18:39 [DEBUG   ] Got command BAM from MCS: ref #518433
2018-11-15 20:18:39 [INFO    ] Finished processing BAM request
2018-11-15 20:18:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518433   8 58437 73119030 A  ERROR'
2018-11-15 20:18:39 [DEBUG   ] Got command BAM from MCS: ref #518434
2018-11-15 20:18:39 [INFO    ] Finished processing BAM request
2018-11-15 20:18:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518434   8 58437 73119034 A  ERROR'
2018-11-15 20:18:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 20:18:39 [DEBUG   ] spawn_process: at 2018-11-15 20:18:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 20:18:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 20:18:39 [DEBUG   ] spawn_process: at 2018-11-15 20:18:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 20:18:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 20:18:39 [DEBUG   ] spawn_process: at 2018-11-15 20:18:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 20:18:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 20:18:39 [DEBUG   ] spawn_process: at 2018-11-15 20:18:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 20:18:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 20:18:39 [DEBUG   ] spawn_process: at 2018-11-15 20:18:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 20:18:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 20:18:39 [DEBUG   ] spawn_process: at 2018-11-15 20:18:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 20:18:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 20:18:39 [DEBUG   ] spawn_process: at 2018-11-15 20:18:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 20:18:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 20:18:39 [DEBUG   ] spawn_process: at 2018-11-15 20:18:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 20:18:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 20:18:39 [DEBUG   ] spawn_process: at 2018-11-15 20:18:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 20:18:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 20:18:39 [DEBUG   ] spawn_process: at 2018-11-15 20:18:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 20:18:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 20:18:39 [DEBUG   ] spawn_process: at 2018-11-15 20:18:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 20:18:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 20:18:39 [DEBUG   ] spawn_process: at 2018-11-15 20:18:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 20:18:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 20:18:39 [DEBUG   ] spawn_process: at 2018-11-15 20:18:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 20:18:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 20:18:39 [DEBUG   ] spawn_process: at 2018-11-15 20:18:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 20:18:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 20:18:39 [DEBUG   ] spawn_process: at 2018-11-15 20:18:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 20:18:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 20:18:39 [DEBUG   ] spawn_process: at 2018-11-15 20:18:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 20:18:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 20:18:39 [DEBUG   ] spawn_process: at 2018-11-15 20:18:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 20:18:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 20:18:39 [DEBUG   ] spawn_process: at 2018-11-15 20:18:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 20:18:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 20:18:39 [DEBUG   ] spawn_process: at 2018-11-15 20:18:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 20:18:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 20:18:39 [DEBUG   ] spawn_process: at 2018-11-15 20:18:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 20:18:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 20:18:39 [DEBUG   ] spawn_process: at 2018-11-15 20:18:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 20:18:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 20:18:39 [DEBUG   ] spawn_process: at 2018-11-15 20:18:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 20:18:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 20:18:39 [DEBUG   ] spawn_process: at 2018-11-15 20:18:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 20:18:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 20:18:39 [DEBUG   ] spawn_process: at 2018-11-15 20:18:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 20:18:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 20:18:39 [DEBUG   ] spawn_process: at 2018-11-15 20:18:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 20:18:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 20:18:39 [DEBUG   ] spawn_process: at 2018-11-15 20:18:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 20:18:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 20:19:15 [DEBUG   ] Finished updating ant stats in 0.431 seconds
2018-11-15 20:19:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:19:16 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 20:19:16 [WARNING ] (13, 1, 'bot')
2018-11-15 20:19:16 [WARNING ] (13, 1, 'bot')
2018-11-15 20:19:16 [WARNING ] (13, 1, 'bot')
2018-11-15 20:19:16 [WARNING ] (13, 1, 'bot')
2018-11-15 20:19:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:19:16 [DEBUG   ] Finished updating board flags in 2.019 seconds
2018-11-15 20:19:19 [DEBUG   ] Got command BAM from MCS: ref #518435
2018-11-15 20:19:19 [INFO    ] Finished processing BAM request
2018-11-15 20:19:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:19:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518435   8 58437 73159034 A  ERROR'
2018-11-15 20:19:19 [DEBUG   ] Got command BAM from MCS: ref #518436
2018-11-15 20:19:19 [INFO    ] Finished processing BAM request
2018-11-15 20:19:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:19:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518436   8 58437 73159038 A  ERROR'
2018-11-15 20:19:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 20:19:19 [DEBUG   ] spawn_process: at 2018-11-15 20:19:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 20:19:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 20:19:19 [DEBUG   ] spawn_process: at 2018-11-15 20:19:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 20:19:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 20:19:19 [DEBUG   ] spawn_process: at 2018-11-15 20:19:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 20:19:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 20:19:19 [DEBUG   ] spawn_process: at 2018-11-15 20:19:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 20:19:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 20:19:19 [DEBUG   ] spawn_process: at 2018-11-15 20:19:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 20:19:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 20:19:19 [DEBUG   ] spawn_process: at 2018-11-15 20:19:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 20:19:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 20:19:19 [DEBUG   ] spawn_process: at 2018-11-15 20:19:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 20:19:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 20:19:19 [DEBUG   ] spawn_process: at 2018-11-15 20:19:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 20:19:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 20:19:19 [DEBUG   ] spawn_process: at 2018-11-15 20:19:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 20:19:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 20:19:19 [DEBUG   ] spawn_process: at 2018-11-15 20:19:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 20:19:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 20:19:19 [DEBUG   ] spawn_process: at 2018-11-15 20:19:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 20:19:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 20:19:19 [DEBUG   ] spawn_process: at 2018-11-15 20:19:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 20:19:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 20:19:19 [DEBUG   ] spawn_process: at 2018-11-15 20:19:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 20:19:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 20:19:19 [DEBUG   ] spawn_process: at 2018-11-15 20:19:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 20:19:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 20:19:19 [DEBUG   ] spawn_process: at 2018-11-15 20:19:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 20:19:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 20:19:19 [DEBUG   ] spawn_process: at 2018-11-15 20:19:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 20:19:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 20:19:19 [DEBUG   ] spawn_process: at 2018-11-15 20:19:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 20:19:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 20:19:19 [DEBUG   ] spawn_process: at 2018-11-15 20:19:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 20:19:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 20:19:19 [DEBUG   ] spawn_process: at 2018-11-15 20:19:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 20:19:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 20:19:19 [DEBUG   ] spawn_process: at 2018-11-15 20:19:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 20:19:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 20:19:19 [DEBUG   ] spawn_process: at 2018-11-15 20:19:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 20:19:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 20:19:19 [DEBUG   ] spawn_process: at 2018-11-15 20:19:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 20:19:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 20:19:19 [DEBUG   ] spawn_process: at 2018-11-15 20:19:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 20:19:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 20:19:19 [DEBUG   ] spawn_process: at 2018-11-15 20:19:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 20:19:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 20:19:19 [DEBUG   ] spawn_process: at 2018-11-15 20:19:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 20:19:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 20:19:19 [DEBUG   ] spawn_process: at 2018-11-15 20:19:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 20:19:35 [DEBUG   ] Finished updating ant stats in 0.374 seconds
2018-11-15 20:19:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 20:19:59 [DEBUG   ] Got command BAM from MCS: ref #518438
2018-11-15 20:19:59 [INFO    ] Finished processing BAM request
2018-11-15 20:19:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:19:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518438   8 58437 73199026 A  ERROR'
2018-11-15 20:19:59 [DEBUG   ] Got command BAM from MCS: ref #518437
2018-11-15 20:19:59 [INFO    ] Finished processing BAM request
2018-11-15 20:19:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:19:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518437   8 58437 73199030 A  ERROR'
2018-11-15 20:19:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 20:19:59 [DEBUG   ] spawn_process: at 2018-11-15 20:19:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 20:19:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 20:19:59 [DEBUG   ] spawn_process: at 2018-11-15 20:19:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 20:19:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 20:19:59 [DEBUG   ] spawn_process: at 2018-11-15 20:19:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 20:19:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 20:19:59 [DEBUG   ] spawn_process: at 2018-11-15 20:19:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 20:19:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 20:19:59 [DEBUG   ] spawn_process: at 2018-11-15 20:19:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 20:19:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 20:19:59 [DEBUG   ] spawn_process: at 2018-11-15 20:19:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 20:19:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 20:19:59 [DEBUG   ] spawn_process: at 2018-11-15 20:19:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 20:19:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 20:19:59 [DEBUG   ] spawn_process: at 2018-11-15 20:19:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 20:19:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 20:19:59 [DEBUG   ] spawn_process: at 2018-11-15 20:19:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 20:19:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 20:19:59 [DEBUG   ] spawn_process: at 2018-11-15 20:19:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 20:19:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 20:19:59 [DEBUG   ] spawn_process: at 2018-11-15 20:19:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 20:19:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 20:19:59 [DEBUG   ] spawn_process: at 2018-11-15 20:19:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 20:19:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 20:19:59 [DEBUG   ] spawn_process: at 2018-11-15 20:19:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 20:19:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 20:19:59 [DEBUG   ] spawn_process: at 2018-11-15 20:19:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 20:19:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 20:19:59 [DEBUG   ] spawn_process: at 2018-11-15 20:19:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 20:19:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 20:19:59 [DEBUG   ] spawn_process: at 2018-11-15 20:19:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 20:19:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 20:19:59 [DEBUG   ] spawn_process: at 2018-11-15 20:19:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 20:19:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 20:19:59 [DEBUG   ] spawn_process: at 2018-11-15 20:19:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 20:19:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 20:19:59 [DEBUG   ] spawn_process: at 2018-11-15 20:19:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 20:19:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 20:19:59 [DEBUG   ] spawn_process: at 2018-11-15 20:19:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 20:19:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 20:19:59 [DEBUG   ] spawn_process: at 2018-11-15 20:19:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 20:19:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 20:19:59 [DEBUG   ] spawn_process: at 2018-11-15 20:19:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 20:19:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 20:19:59 [DEBUG   ] spawn_process: at 2018-11-15 20:19:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 20:19:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 20:19:59 [DEBUG   ] spawn_process: at 2018-11-15 20:19:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 20:19:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 20:19:59 [DEBUG   ] spawn_process: at 2018-11-15 20:19:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 20:19:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 20:19:59 [DEBUG   ] spawn_process: at 2018-11-15 20:19:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 20:20:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 20:20:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:20:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 20:20:16 [DEBUG   ] Finished updating ant stats in 1.231 seconds
2018-11-15 20:20:16 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 20:20:16 [WARNING ] (13, 1, 'bot')
2018-11-15 20:20:16 [WARNING ] (13, 1, 'bot')
2018-11-15 20:20:16 [WARNING ] (13, 1, 'bot')
2018-11-15 20:20:16 [WARNING ] (13, 1, 'bot')
2018-11-15 20:20:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:20:16 [DEBUG   ] Finished updating board flags in 2.033 seconds
2018-11-15 20:20:36 [DEBUG   ] Finished updating ant stats in 1.170 seconds
2018-11-15 20:20:39 [DEBUG   ] Got command BAM from MCS: ref #518444
2018-11-15 20:20:39 [INFO    ] Finished processing BAM request
2018-11-15 20:20:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:20:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518444   8 58437 73239029 A  ERROR'
2018-11-15 20:20:39 [DEBUG   ] Got command BAM from MCS: ref #518443
2018-11-15 20:20:39 [INFO    ] Finished processing BAM request
2018-11-15 20:20:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:20:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518443   8 58437 73239037 A  ERROR'
2018-11-15 20:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 20:20:39 [DEBUG   ] spawn_process: at 2018-11-15 20:20:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 20:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 20:20:39 [DEBUG   ] spawn_process: at 2018-11-15 20:20:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 20:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 20:20:39 [DEBUG   ] spawn_process: at 2018-11-15 20:20:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 20:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 20:20:39 [DEBUG   ] spawn_process: at 2018-11-15 20:20:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 20:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 20:20:39 [DEBUG   ] spawn_process: at 2018-11-15 20:20:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 20:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 20:20:39 [DEBUG   ] spawn_process: at 2018-11-15 20:20:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 20:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 20:20:39 [DEBUG   ] spawn_process: at 2018-11-15 20:20:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 20:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 20:20:39 [DEBUG   ] spawn_process: at 2018-11-15 20:20:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 20:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 20:20:39 [DEBUG   ] spawn_process: at 2018-11-15 20:20:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 20:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 20:20:39 [DEBUG   ] spawn_process: at 2018-11-15 20:20:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 20:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 20:20:39 [DEBUG   ] spawn_process: at 2018-11-15 20:20:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 20:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 20:20:39 [DEBUG   ] spawn_process: at 2018-11-15 20:20:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 20:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 20:20:39 [DEBUG   ] spawn_process: at 2018-11-15 20:20:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 20:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 20:20:39 [DEBUG   ] spawn_process: at 2018-11-15 20:20:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 20:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 20:20:39 [DEBUG   ] spawn_process: at 2018-11-15 20:20:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 20:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 20:20:39 [DEBUG   ] spawn_process: at 2018-11-15 20:20:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 20:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 20:20:39 [DEBUG   ] spawn_process: at 2018-11-15 20:20:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 20:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 20:20:39 [DEBUG   ] spawn_process: at 2018-11-15 20:20:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 20:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 20:20:39 [DEBUG   ] spawn_process: at 2018-11-15 20:20:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 20:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 20:20:39 [DEBUG   ] spawn_process: at 2018-11-15 20:20:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 20:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 20:20:39 [DEBUG   ] spawn_process: at 2018-11-15 20:20:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 20:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 20:20:39 [DEBUG   ] spawn_process: at 2018-11-15 20:20:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 20:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 20:20:39 [DEBUG   ] spawn_process: at 2018-11-15 20:20:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 20:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 20:20:39 [DEBUG   ] spawn_process: at 2018-11-15 20:20:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 20:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 20:20:39 [DEBUG   ] spawn_process: at 2018-11-15 20:20:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 20:20:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 20:20:39 [DEBUG   ] spawn_process: at 2018-11-15 20:20:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 20:20:45 [DEBUG   ] Got command RPT from MCS: ref #518445
2018-11-15 20:20:45 [DEBUG   ] summary = ERROR
2018-11-15 20:20:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518445  13 58437 73245193 A  ERRORERROR'
2018-11-15 20:20:45 [DEBUG   ] Got command RPT from MCS: ref #518446
2018-11-15 20:20:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 20:20:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518446  77 58437 73245194 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 20:20:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 20:21:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 20:21:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 20:21:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-11-15 20:21:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:21:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2018-11-15 20:21:16 [DEBUG   ] Finished updating ant stats in 1.028 seconds
2018-11-15 20:21:16 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-15 20:21:16 [WARNING ] (13, 1, 'bot')
2018-11-15 20:21:16 [WARNING ] (13, 1, 'bot')
2018-11-15 20:21:16 [WARNING ] (13, 1, 'bot')
2018-11-15 20:21:16 [WARNING ] (13, 1, 'bot')
2018-11-15 20:21:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:21:16 [DEBUG   ] Finished updating board flags in 1.942 seconds
2018-11-15 20:21:19 [DEBUG   ] Got command BAM from MCS: ref #518463
2018-11-15 20:21:19 [INFO    ] Finished processing BAM request
2018-11-15 20:21:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:21:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518463   8 58437 73279033 A  ERROR'
2018-11-15 20:21:19 [DEBUG   ] Got command BAM from MCS: ref #518462
2018-11-15 20:21:19 [INFO    ] Finished processing BAM request
2018-11-15 20:21:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:21:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518462   8 58437 73279037 A  ERROR'
2018-11-15 20:21:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 20:21:19 [DEBUG   ] spawn_process: at 2018-11-15 20:21:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 20:21:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 20:21:19 [DEBUG   ] spawn_process: at 2018-11-15 20:21:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 20:21:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 20:21:19 [DEBUG   ] spawn_process: at 2018-11-15 20:21:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 20:21:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 20:21:19 [DEBUG   ] spawn_process: at 2018-11-15 20:21:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 20:21:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 20:21:19 [DEBUG   ] spawn_process: at 2018-11-15 20:21:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 20:21:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 20:21:19 [DEBUG   ] spawn_process: at 2018-11-15 20:21:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 20:21:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 20:21:19 [DEBUG   ] spawn_process: at 2018-11-15 20:21:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 20:21:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 20:21:19 [DEBUG   ] spawn_process: at 2018-11-15 20:21:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 20:21:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 20:21:19 [DEBUG   ] spawn_process: at 2018-11-15 20:21:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 20:21:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 20:21:19 [DEBUG   ] spawn_process: at 2018-11-15 20:21:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 20:21:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 20:21:19 [DEBUG   ] spawn_process: at 2018-11-15 20:21:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 20:21:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 20:21:19 [DEBUG   ] spawn_process: at 2018-11-15 20:21:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 20:21:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 20:21:19 [DEBUG   ] spawn_process: at 2018-11-15 20:21:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 20:21:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 20:21:19 [DEBUG   ] spawn_process: at 2018-11-15 20:21:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 20:21:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 20:21:19 [DEBUG   ] spawn_process: at 2018-11-15 20:21:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 20:21:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 20:21:19 [DEBUG   ] spawn_process: at 2018-11-15 20:21:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 20:21:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 20:21:19 [DEBUG   ] spawn_process: at 2018-11-15 20:21:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 20:21:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 20:21:19 [DEBUG   ] spawn_process: at 2018-11-15 20:21:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 20:21:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 20:21:19 [DEBUG   ] spawn_process: at 2018-11-15 20:21:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 20:21:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 20:21:19 [DEBUG   ] spawn_process: at 2018-11-15 20:21:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 20:21:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 20:21:19 [DEBUG   ] spawn_process: at 2018-11-15 20:21:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 20:21:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 20:21:19 [DEBUG   ] spawn_process: at 2018-11-15 20:21:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 20:21:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 20:21:19 [DEBUG   ] spawn_process: at 2018-11-15 20:21:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 20:21:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 20:21:19 [DEBUG   ] spawn_process: at 2018-11-15 20:21:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 20:21:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 20:21:19 [DEBUG   ] spawn_process: at 2018-11-15 20:21:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 20:21:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 20:21:19 [DEBUG   ] spawn_process: at 2018-11-15 20:21:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 20:21:36 [DEBUG   ] Finished updating ant stats in 0.974 seconds
2018-11-15 20:21:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 20:21:59 [DEBUG   ] Got command BAM from MCS: ref #518464
2018-11-15 20:21:59 [INFO    ] Finished processing BAM request
2018-11-15 20:21:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:21:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518464   8 58437 73319029 A  ERROR'
2018-11-15 20:21:59 [DEBUG   ] Got command BAM from MCS: ref #518465
2018-11-15 20:21:59 [INFO    ] Finished processing BAM request
2018-11-15 20:21:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:21:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518465   8 58437 73319033 A  ERROR'
2018-11-15 20:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 20:21:59 [DEBUG   ] spawn_process: at 2018-11-15 20:21:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 20:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 20:21:59 [DEBUG   ] spawn_process: at 2018-11-15 20:21:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 20:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 20:21:59 [DEBUG   ] spawn_process: at 2018-11-15 20:21:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 20:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 20:21:59 [DEBUG   ] spawn_process: at 2018-11-15 20:21:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 20:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 20:21:59 [DEBUG   ] spawn_process: at 2018-11-15 20:21:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 20:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 20:21:59 [DEBUG   ] spawn_process: at 2018-11-15 20:21:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 20:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 20:21:59 [DEBUG   ] spawn_process: at 2018-11-15 20:21:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 20:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 20:21:59 [DEBUG   ] spawn_process: at 2018-11-15 20:21:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 20:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 20:21:59 [DEBUG   ] spawn_process: at 2018-11-15 20:21:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 20:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 20:21:59 [DEBUG   ] spawn_process: at 2018-11-15 20:21:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 20:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 20:21:59 [DEBUG   ] spawn_process: at 2018-11-15 20:21:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 20:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 20:21:59 [DEBUG   ] spawn_process: at 2018-11-15 20:21:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 20:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 20:21:59 [DEBUG   ] spawn_process: at 2018-11-15 20:21:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 20:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 20:21:59 [DEBUG   ] spawn_process: at 2018-11-15 20:21:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 20:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 20:21:59 [DEBUG   ] spawn_process: at 2018-11-15 20:21:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 20:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 20:21:59 [DEBUG   ] spawn_process: at 2018-11-15 20:21:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 20:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 20:21:59 [DEBUG   ] spawn_process: at 2018-11-15 20:21:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 20:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 20:21:59 [DEBUG   ] spawn_process: at 2018-11-15 20:21:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 20:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 20:21:59 [DEBUG   ] spawn_process: at 2018-11-15 20:21:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 20:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 20:21:59 [DEBUG   ] spawn_process: at 2018-11-15 20:21:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 20:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 20:21:59 [DEBUG   ] spawn_process: at 2018-11-15 20:21:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 20:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 20:21:59 [DEBUG   ] spawn_process: at 2018-11-15 20:21:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 20:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 20:21:59 [DEBUG   ] spawn_process: at 2018-11-15 20:21:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 20:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 20:21:59 [DEBUG   ] spawn_process: at 2018-11-15 20:21:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 20:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 20:21:59 [DEBUG   ] spawn_process: at 2018-11-15 20:21:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 20:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 20:21:59 [DEBUG   ] spawn_process: at 2018-11-15 20:21:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 20:22:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:22:15 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-15 20:22:15 [WARNING ] (13, 1, 'bot')
2018-11-15 20:22:15 [WARNING ] (13, 1, 'bot')
2018-11-15 20:22:15 [WARNING ] (13, 1, 'bot')
2018-11-15 20:22:15 [WARNING ] (13, 1, 'bot')
2018-11-15 20:22:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:22:15 [DEBUG   ] Finished updating board flags in 1.243 seconds
2018-11-15 20:22:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 20:22:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 20:22:38 [DEBUG   ] Got command BAM from MCS: ref #518467
2018-11-15 20:22:38 [INFO    ] Finished processing BAM request
2018-11-15 20:22:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:22:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518467   8 58437 73358025 A  ERROR'
2018-11-15 20:22:38 [DEBUG   ] Got command BAM from MCS: ref #518466
2018-11-15 20:22:38 [INFO    ] Finished processing BAM request
2018-11-15 20:22:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:22:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518466   8 58437 73358029 A  ERROR'
2018-11-15 20:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 20:22:38 [DEBUG   ] spawn_process: at 2018-11-15 20:22:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 20:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 20:22:38 [DEBUG   ] spawn_process: at 2018-11-15 20:22:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 20:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 20:22:38 [DEBUG   ] spawn_process: at 2018-11-15 20:22:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 20:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 20:22:38 [DEBUG   ] spawn_process: at 2018-11-15 20:22:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 20:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 20:22:38 [DEBUG   ] spawn_process: at 2018-11-15 20:22:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 20:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 20:22:38 [DEBUG   ] spawn_process: at 2018-11-15 20:22:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 20:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 20:22:38 [DEBUG   ] spawn_process: at 2018-11-15 20:22:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 20:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 20:22:38 [DEBUG   ] spawn_process: at 2018-11-15 20:22:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 20:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 20:22:38 [DEBUG   ] spawn_process: at 2018-11-15 20:22:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 20:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 20:22:38 [DEBUG   ] spawn_process: at 2018-11-15 20:22:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 20:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 20:22:38 [DEBUG   ] spawn_process: at 2018-11-15 20:22:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 20:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 20:22:38 [DEBUG   ] spawn_process: at 2018-11-15 20:22:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 20:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 20:22:38 [DEBUG   ] spawn_process: at 2018-11-15 20:22:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 20:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 20:22:38 [DEBUG   ] spawn_process: at 2018-11-15 20:22:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 20:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 20:22:38 [DEBUG   ] spawn_process: at 2018-11-15 20:22:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 20:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 20:22:38 [DEBUG   ] spawn_process: at 2018-11-15 20:22:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 20:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 20:22:38 [DEBUG   ] spawn_process: at 2018-11-15 20:22:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 20:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 20:22:38 [DEBUG   ] spawn_process: at 2018-11-15 20:22:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 20:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 20:22:38 [DEBUG   ] spawn_process: at 2018-11-15 20:22:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 20:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 20:22:38 [DEBUG   ] spawn_process: at 2018-11-15 20:22:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 20:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 20:22:38 [DEBUG   ] spawn_process: at 2018-11-15 20:22:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 20:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 20:22:38 [DEBUG   ] spawn_process: at 2018-11-15 20:22:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 20:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 20:22:38 [DEBUG   ] spawn_process: at 2018-11-15 20:22:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 20:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 20:22:38 [DEBUG   ] spawn_process: at 2018-11-15 20:22:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 20:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 20:22:38 [DEBUG   ] spawn_process: at 2018-11-15 20:22:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 20:22:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 20:22:38 [DEBUG   ] spawn_process: at 2018-11-15 20:22:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 20:22:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 20:23:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:23:16 [DEBUG   ] Finished updating ant stats in 0.825 seconds
2018-11-15 20:23:16 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 20:23:16 [WARNING ] (13, 1, 'bot')
2018-11-15 20:23:16 [WARNING ] (13, 1, 'bot')
2018-11-15 20:23:16 [WARNING ] (13, 1, 'bot')
2018-11-15 20:23:16 [WARNING ] (13, 1, 'bot')
2018-11-15 20:23:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:23:16 [DEBUG   ] Finished updating board flags in 1.777 seconds
2018-11-15 20:23:17 [DEBUG   ] Got command BAM from MCS: ref #518468
2018-11-15 20:23:17 [INFO    ] Finished processing BAM request
2018-11-15 20:23:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:23:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518468   8 58437 73397033 A  ERROR'
2018-11-15 20:23:17 [DEBUG   ] Got command BAM from MCS: ref #518469
2018-11-15 20:23:17 [INFO    ] Finished processing BAM request
2018-11-15 20:23:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:23:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518469   8 58437 73397037 A  ERROR'
2018-11-15 20:23:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 20:23:17 [DEBUG   ] spawn_process: at 2018-11-15 20:23:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 20:23:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 20:23:17 [DEBUG   ] spawn_process: at 2018-11-15 20:23:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 20:23:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 20:23:17 [DEBUG   ] spawn_process: at 2018-11-15 20:23:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 20:23:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 20:23:17 [DEBUG   ] spawn_process: at 2018-11-15 20:23:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 20:23:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 20:23:17 [DEBUG   ] spawn_process: at 2018-11-15 20:23:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 20:23:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 20:23:17 [DEBUG   ] spawn_process: at 2018-11-15 20:23:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 20:23:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 20:23:17 [DEBUG   ] spawn_process: at 2018-11-15 20:23:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 20:23:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 20:23:17 [DEBUG   ] spawn_process: at 2018-11-15 20:23:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 20:23:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 20:23:17 [DEBUG   ] spawn_process: at 2018-11-15 20:23:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 20:23:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 20:23:17 [DEBUG   ] spawn_process: at 2018-11-15 20:23:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 20:23:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 20:23:17 [DEBUG   ] spawn_process: at 2018-11-15 20:23:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 20:23:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 20:23:17 [DEBUG   ] spawn_process: at 2018-11-15 20:23:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 20:23:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 20:23:17 [DEBUG   ] spawn_process: at 2018-11-15 20:23:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 20:23:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 20:23:17 [DEBUG   ] spawn_process: at 2018-11-15 20:23:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 20:23:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 20:23:17 [DEBUG   ] spawn_process: at 2018-11-15 20:23:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 20:23:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 20:23:17 [DEBUG   ] spawn_process: at 2018-11-15 20:23:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 20:23:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 20:23:17 [DEBUG   ] spawn_process: at 2018-11-15 20:23:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 20:23:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 20:23:17 [DEBUG   ] spawn_process: at 2018-11-15 20:23:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 20:23:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 20:23:17 [DEBUG   ] spawn_process: at 2018-11-15 20:23:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 20:23:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 20:23:17 [DEBUG   ] spawn_process: at 2018-11-15 20:23:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 20:23:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 20:23:17 [DEBUG   ] spawn_process: at 2018-11-15 20:23:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 20:23:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 20:23:17 [DEBUG   ] spawn_process: at 2018-11-15 20:23:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 20:23:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 20:23:17 [DEBUG   ] spawn_process: at 2018-11-15 20:23:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 20:23:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 20:23:17 [DEBUG   ] spawn_process: at 2018-11-15 20:23:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 20:23:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 20:23:17 [DEBUG   ] spawn_process: at 2018-11-15 20:23:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 20:23:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 20:23:17 [DEBUG   ] spawn_process: at 2018-11-15 20:23:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 20:23:23 [DEBUG   ] Got command RPT from MCS: ref #518470
2018-11-15 20:23:23 [DEBUG   ] summary = ERROR
2018-11-15 20:23:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518470  13 58437 73403541 A  ERRORERROR'
2018-11-15 20:23:23 [DEBUG   ] Got command RPT from MCS: ref #518471
2018-11-15 20:23:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 20:23:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518471  77 58437 73403733 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 20:23:23 [DEBUG   ] Got command RPT from MCS: ref #518472
2018-11-15 20:23:23 [DEBUG   ] summary = ERROR
2018-11-15 20:23:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518472  13 58437 73403937 A  ERRORERROR'
2018-11-15 20:23:24 [DEBUG   ] Got command RPT from MCS: ref #518473
2018-11-15 20:23:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 20:23:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518473  77 58437 73404141 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 20:23:24 [DEBUG   ] Got command RPT from MCS: ref #518474
2018-11-15 20:23:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 20:23:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518474  12 58437 73404345 A  ERRORB¢ff'
2018-11-15 20:23:36 [DEBUG   ] Finished updating ant stats in 0.774 seconds
2018-11-15 20:23:56 [DEBUG   ] Got command BAM from MCS: ref #518480
2018-11-15 20:23:56 [INFO    ] Finished processing BAM request
2018-11-15 20:23:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:23:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518480   8 58437 73436029 A  ERROR'
2018-11-15 20:23:56 [DEBUG   ] Got command BAM from MCS: ref #518479
2018-11-15 20:23:56 [INFO    ] Finished processing BAM request
2018-11-15 20:23:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:23:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518479   8 58437 73436033 A  ERROR'
2018-11-15 20:23:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 20:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 20:23:56 [DEBUG   ] spawn_process: at 2018-11-15 20:23:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 20:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 20:23:56 [DEBUG   ] spawn_process: at 2018-11-15 20:23:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 20:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 20:23:56 [DEBUG   ] spawn_process: at 2018-11-15 20:23:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 20:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 20:23:56 [DEBUG   ] spawn_process: at 2018-11-15 20:23:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 20:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 20:23:56 [DEBUG   ] spawn_process: at 2018-11-15 20:23:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 20:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 20:23:56 [DEBUG   ] spawn_process: at 2018-11-15 20:23:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 20:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 20:23:56 [DEBUG   ] spawn_process: at 2018-11-15 20:23:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 20:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 20:23:56 [DEBUG   ] spawn_process: at 2018-11-15 20:23:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 20:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 20:23:56 [DEBUG   ] spawn_process: at 2018-11-15 20:23:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 20:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 20:23:56 [DEBUG   ] spawn_process: at 2018-11-15 20:23:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 20:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 20:23:56 [DEBUG   ] spawn_process: at 2018-11-15 20:23:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 20:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 20:23:56 [DEBUG   ] spawn_process: at 2018-11-15 20:23:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 20:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 20:23:56 [DEBUG   ] spawn_process: at 2018-11-15 20:23:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 20:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 20:23:56 [DEBUG   ] spawn_process: at 2018-11-15 20:23:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 20:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 20:23:56 [DEBUG   ] spawn_process: at 2018-11-15 20:23:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 20:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 20:23:56 [DEBUG   ] spawn_process: at 2018-11-15 20:23:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 20:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 20:23:56 [DEBUG   ] spawn_process: at 2018-11-15 20:23:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 20:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 20:23:56 [DEBUG   ] spawn_process: at 2018-11-15 20:23:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 20:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 20:23:56 [DEBUG   ] spawn_process: at 2018-11-15 20:23:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 20:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 20:23:56 [DEBUG   ] spawn_process: at 2018-11-15 20:23:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 20:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 20:23:56 [DEBUG   ] spawn_process: at 2018-11-15 20:23:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 20:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 20:23:56 [DEBUG   ] spawn_process: at 2018-11-15 20:23:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 20:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 20:23:56 [DEBUG   ] spawn_process: at 2018-11-15 20:23:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 20:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 20:23:56 [DEBUG   ] spawn_process: at 2018-11-15 20:23:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 20:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 20:23:56 [DEBUG   ] spawn_process: at 2018-11-15 20:23:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 20:23:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 20:23:56 [DEBUG   ] spawn_process: at 2018-11-15 20:23:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 20:24:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:24:15 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-15 20:24:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 20:24:15 [WARNING ] (13, 1, 'bot')
2018-11-15 20:24:15 [WARNING ] (13, 1, 'bot')
2018-11-15 20:24:15 [WARNING ] (13, 1, 'bot')
2018-11-15 20:24:15 [WARNING ] (13, 1, 'bot')
2018-11-15 20:24:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:24:15 [DEBUG   ] Finished updating board flags in 1.015 seconds
2018-11-15 20:24:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 20:24:35 [DEBUG   ] Got command BAM from MCS: ref #518481
2018-11-15 20:24:35 [INFO    ] Finished processing BAM request
2018-11-15 20:24:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:24:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518481   8 58437 73475029 A  ERROR'
2018-11-15 20:24:35 [DEBUG   ] Got command BAM from MCS: ref #518482
2018-11-15 20:24:35 [INFO    ] Finished processing BAM request
2018-11-15 20:24:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:24:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518482   8 58437 73475033 A  ERROR'
2018-11-15 20:24:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 20:24:35 [DEBUG   ] spawn_process: at 2018-11-15 20:24:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 20:24:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 20:24:35 [DEBUG   ] spawn_process: at 2018-11-15 20:24:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 20:24:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 20:24:35 [DEBUG   ] spawn_process: at 2018-11-15 20:24:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 20:24:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 20:24:35 [DEBUG   ] spawn_process: at 2018-11-15 20:24:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 20:24:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 20:24:35 [DEBUG   ] spawn_process: at 2018-11-15 20:24:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 20:24:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 20:24:35 [DEBUG   ] spawn_process: at 2018-11-15 20:24:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 20:24:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 20:24:35 [DEBUG   ] spawn_process: at 2018-11-15 20:24:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 20:24:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 20:24:35 [DEBUG   ] spawn_process: at 2018-11-15 20:24:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 20:24:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 20:24:35 [DEBUG   ] spawn_process: at 2018-11-15 20:24:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 20:24:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 20:24:35 [DEBUG   ] spawn_process: at 2018-11-15 20:24:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 20:24:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 20:24:35 [DEBUG   ] spawn_process: at 2018-11-15 20:24:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 20:24:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 20:24:35 [DEBUG   ] spawn_process: at 2018-11-15 20:24:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 20:24:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 20:24:35 [DEBUG   ] spawn_process: at 2018-11-15 20:24:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 20:24:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 20:24:35 [DEBUG   ] spawn_process: at 2018-11-15 20:24:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 20:24:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 20:24:35 [DEBUG   ] spawn_process: at 2018-11-15 20:24:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 20:24:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 20:24:35 [DEBUG   ] spawn_process: at 2018-11-15 20:24:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 20:24:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 20:24:35 [DEBUG   ] spawn_process: at 2018-11-15 20:24:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 20:24:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 20:24:35 [DEBUG   ] spawn_process: at 2018-11-15 20:24:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 20:24:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 20:24:35 [DEBUG   ] spawn_process: at 2018-11-15 20:24:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 20:24:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 20:24:35 [DEBUG   ] spawn_process: at 2018-11-15 20:24:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 20:24:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 20:24:35 [DEBUG   ] spawn_process: at 2018-11-15 20:24:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 20:24:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 20:24:35 [DEBUG   ] spawn_process: at 2018-11-15 20:24:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 20:24:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 20:24:35 [DEBUG   ] spawn_process: at 2018-11-15 20:24:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 20:24:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 20:24:35 [DEBUG   ] spawn_process: at 2018-11-15 20:24:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 20:24:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 20:24:35 [DEBUG   ] spawn_process: at 2018-11-15 20:24:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 20:24:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 20:24:35 [DEBUG   ] spawn_process: at 2018-11-15 20:24:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 20:24:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 20:24:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 20:25:14 [DEBUG   ] Got command BAM from MCS: ref #518483
2018-11-15 20:25:14 [INFO    ] Finished processing BAM request
2018-11-15 20:25:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:25:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518483   8 58437 73514033 A  ERROR'
2018-11-15 20:25:14 [DEBUG   ] Got command BAM from MCS: ref #518484
2018-11-15 20:25:14 [INFO    ] Finished processing BAM request
2018-11-15 20:25:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:25:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518484   8 58437 73514037 A  ERROR'
2018-11-15 20:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 20:25:14 [DEBUG   ] spawn_process: at 2018-11-15 20:25:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 20:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 20:25:14 [DEBUG   ] spawn_process: at 2018-11-15 20:25:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 20:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 20:25:14 [DEBUG   ] spawn_process: at 2018-11-15 20:25:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 20:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 20:25:14 [DEBUG   ] spawn_process: at 2018-11-15 20:25:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 20:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 20:25:14 [DEBUG   ] spawn_process: at 2018-11-15 20:25:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 20:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 20:25:14 [DEBUG   ] spawn_process: at 2018-11-15 20:25:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 20:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 20:25:14 [DEBUG   ] spawn_process: at 2018-11-15 20:25:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 20:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 20:25:14 [DEBUG   ] spawn_process: at 2018-11-15 20:25:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 20:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 20:25:14 [DEBUG   ] spawn_process: at 2018-11-15 20:25:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 20:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 20:25:14 [DEBUG   ] spawn_process: at 2018-11-15 20:25:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 20:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 20:25:14 [DEBUG   ] spawn_process: at 2018-11-15 20:25:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 20:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 20:25:14 [DEBUG   ] spawn_process: at 2018-11-15 20:25:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 20:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 20:25:14 [DEBUG   ] spawn_process: at 2018-11-15 20:25:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 20:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 20:25:14 [DEBUG   ] spawn_process: at 2018-11-15 20:25:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 20:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 20:25:14 [DEBUG   ] spawn_process: at 2018-11-15 20:25:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 20:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 20:25:14 [DEBUG   ] spawn_process: at 2018-11-15 20:25:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 20:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 20:25:14 [DEBUG   ] spawn_process: at 2018-11-15 20:25:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 20:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 20:25:14 [DEBUG   ] spawn_process: at 2018-11-15 20:25:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 20:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 20:25:14 [DEBUG   ] spawn_process: at 2018-11-15 20:25:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 20:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 20:25:14 [DEBUG   ] spawn_process: at 2018-11-15 20:25:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 20:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 20:25:14 [DEBUG   ] spawn_process: at 2018-11-15 20:25:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 20:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 20:25:14 [DEBUG   ] spawn_process: at 2018-11-15 20:25:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 20:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 20:25:14 [DEBUG   ] spawn_process: at 2018-11-15 20:25:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 20:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 20:25:14 [DEBUG   ] spawn_process: at 2018-11-15 20:25:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 20:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 20:25:14 [DEBUG   ] spawn_process: at 2018-11-15 20:25:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 20:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 20:25:14 [DEBUG   ] spawn_process: at 2018-11-15 20:25:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 20:25:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:25:15 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 20:25:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 20:25:15 [WARNING ] (13, 1, 'bot')
2018-11-15 20:25:15 [WARNING ] (13, 1, 'bot')
2018-11-15 20:25:15 [WARNING ] (13, 1, 'bot')
2018-11-15 20:25:15 [WARNING ] (13, 1, 'bot')
2018-11-15 20:25:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:25:15 [DEBUG   ] Finished updating board flags in 1.035 seconds
2018-11-15 20:25:16 [DEBUG   ] Finished updating ant stats in 0.585 seconds
2018-11-15 20:25:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 20:25:45 [DEBUG   ] Got command RPT from MCS: ref #518485
2018-11-15 20:25:45 [DEBUG   ] summary = ERROR
2018-11-15 20:25:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518485  13 58437 73545189 A  ERRORERROR'
2018-11-15 20:25:45 [DEBUG   ] Got command RPT from MCS: ref #518486
2018-11-15 20:25:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 20:25:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518486  77 58437 73545190 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 20:25:53 [DEBUG   ] Got command BAM from MCS: ref #518502
2018-11-15 20:25:53 [INFO    ] Finished processing BAM request
2018-11-15 20:25:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:25:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518502   8 58437 73553029 A  ERROR'
2018-11-15 20:25:53 [DEBUG   ] Got command BAM from MCS: ref #518503
2018-11-15 20:25:53 [INFO    ] Finished processing BAM request
2018-11-15 20:25:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:25:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518503   8 58437 73553033 A  ERROR'
2018-11-15 20:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 20:25:53 [DEBUG   ] spawn_process: at 2018-11-15 20:25:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 20:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 20:25:53 [DEBUG   ] spawn_process: at 2018-11-15 20:25:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 20:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 20:25:53 [DEBUG   ] spawn_process: at 2018-11-15 20:25:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 20:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 20:25:53 [DEBUG   ] spawn_process: at 2018-11-15 20:25:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 20:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 20:25:53 [DEBUG   ] spawn_process: at 2018-11-15 20:25:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 20:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 20:25:53 [DEBUG   ] spawn_process: at 2018-11-15 20:25:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 20:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 20:25:53 [DEBUG   ] spawn_process: at 2018-11-15 20:25:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 20:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 20:25:53 [DEBUG   ] spawn_process: at 2018-11-15 20:25:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 20:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 20:25:53 [DEBUG   ] spawn_process: at 2018-11-15 20:25:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 20:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 20:25:53 [DEBUG   ] spawn_process: at 2018-11-15 20:25:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 20:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 20:25:53 [DEBUG   ] spawn_process: at 2018-11-15 20:25:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 20:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 20:25:53 [DEBUG   ] spawn_process: at 2018-11-15 20:25:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 20:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 20:25:53 [DEBUG   ] spawn_process: at 2018-11-15 20:25:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 20:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 20:25:53 [DEBUG   ] spawn_process: at 2018-11-15 20:25:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 20:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 20:25:53 [DEBUG   ] spawn_process: at 2018-11-15 20:25:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 20:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 20:25:53 [DEBUG   ] spawn_process: at 2018-11-15 20:25:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 20:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 20:25:53 [DEBUG   ] spawn_process: at 2018-11-15 20:25:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 20:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 20:25:53 [DEBUG   ] spawn_process: at 2018-11-15 20:25:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 20:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 20:25:53 [DEBUG   ] spawn_process: at 2018-11-15 20:25:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 20:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 20:25:53 [DEBUG   ] spawn_process: at 2018-11-15 20:25:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 20:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 20:25:53 [DEBUG   ] spawn_process: at 2018-11-15 20:25:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 20:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 20:25:53 [DEBUG   ] spawn_process: at 2018-11-15 20:25:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 20:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 20:25:53 [DEBUG   ] spawn_process: at 2018-11-15 20:25:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 20:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 20:25:53 [DEBUG   ] spawn_process: at 2018-11-15 20:25:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 20:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 20:25:53 [DEBUG   ] spawn_process: at 2018-11-15 20:25:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 20:25:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 20:25:53 [DEBUG   ] spawn_process: at 2018-11-15 20:25:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 20:25:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 20:26:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 20:26:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:26:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-15 20:26:15 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 20:26:15 [WARNING ] (13, 1, 'bot')
2018-11-15 20:26:15 [WARNING ] (13, 1, 'bot')
2018-11-15 20:26:15 [WARNING ] (13, 1, 'bot')
2018-11-15 20:26:15 [WARNING ] (13, 1, 'bot')
2018-11-15 20:26:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:26:15 [DEBUG   ] Finished updating board flags in 0.974 seconds
2018-11-15 20:26:16 [DEBUG   ] Finished updating ant stats in 0.397 seconds
2018-11-15 20:26:32 [DEBUG   ] Got command BAM from MCS: ref #518508
2018-11-15 20:26:32 [INFO    ] Finished processing BAM request
2018-11-15 20:26:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:26:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518508   8 58437 73592033 A  ERROR'
2018-11-15 20:26:32 [DEBUG   ] Got command BAM from MCS: ref #518509
2018-11-15 20:26:32 [INFO    ] Finished processing BAM request
2018-11-15 20:26:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:26:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518509   8 58437 73592037 A  ERROR'
2018-11-15 20:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 20:26:32 [DEBUG   ] spawn_process: at 2018-11-15 20:26:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 20:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 20:26:32 [DEBUG   ] spawn_process: at 2018-11-15 20:26:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 20:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 20:26:32 [DEBUG   ] spawn_process: at 2018-11-15 20:26:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 20:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 20:26:32 [DEBUG   ] spawn_process: at 2018-11-15 20:26:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 20:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 20:26:32 [DEBUG   ] spawn_process: at 2018-11-15 20:26:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 20:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 20:26:32 [DEBUG   ] spawn_process: at 2018-11-15 20:26:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 20:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 20:26:32 [DEBUG   ] spawn_process: at 2018-11-15 20:26:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 20:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 20:26:32 [DEBUG   ] spawn_process: at 2018-11-15 20:26:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 20:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 20:26:32 [DEBUG   ] spawn_process: at 2018-11-15 20:26:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 20:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 20:26:32 [DEBUG   ] spawn_process: at 2018-11-15 20:26:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 20:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 20:26:32 [DEBUG   ] spawn_process: at 2018-11-15 20:26:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 20:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 20:26:32 [DEBUG   ] spawn_process: at 2018-11-15 20:26:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 20:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 20:26:32 [DEBUG   ] spawn_process: at 2018-11-15 20:26:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 20:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 20:26:32 [DEBUG   ] spawn_process: at 2018-11-15 20:26:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 20:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 20:26:32 [DEBUG   ] spawn_process: at 2018-11-15 20:26:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 20:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 20:26:32 [DEBUG   ] spawn_process: at 2018-11-15 20:26:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 20:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 20:26:32 [DEBUG   ] spawn_process: at 2018-11-15 20:26:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 20:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 20:26:32 [DEBUG   ] spawn_process: at 2018-11-15 20:26:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 20:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 20:26:32 [DEBUG   ] spawn_process: at 2018-11-15 20:26:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 20:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 20:26:32 [DEBUG   ] spawn_process: at 2018-11-15 20:26:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 20:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 20:26:32 [DEBUG   ] spawn_process: at 2018-11-15 20:26:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 20:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 20:26:32 [DEBUG   ] spawn_process: at 2018-11-15 20:26:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 20:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 20:26:32 [DEBUG   ] spawn_process: at 2018-11-15 20:26:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 20:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 20:26:32 [DEBUG   ] spawn_process: at 2018-11-15 20:26:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 20:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 20:26:32 [DEBUG   ] spawn_process: at 2018-11-15 20:26:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 20:26:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 20:26:32 [DEBUG   ] spawn_process: at 2018-11-15 20:26:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 20:26:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 20:26:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 20:27:11 [DEBUG   ] Got command BAM from MCS: ref #518510
2018-11-15 20:27:11 [INFO    ] Finished processing BAM request
2018-11-15 20:27:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:27:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518510   8 58437 73631025 A  ERROR'
2018-11-15 20:27:11 [DEBUG   ] Got command BAM from MCS: ref #518511
2018-11-15 20:27:11 [INFO    ] Finished processing BAM request
2018-11-15 20:27:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:27:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518511   8 58437 73631029 A  ERROR'
2018-11-15 20:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 20:27:11 [DEBUG   ] spawn_process: at 2018-11-15 20:27:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 20:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 20:27:11 [DEBUG   ] spawn_process: at 2018-11-15 20:27:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 20:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 20:27:11 [DEBUG   ] spawn_process: at 2018-11-15 20:27:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 20:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 20:27:11 [DEBUG   ] spawn_process: at 2018-11-15 20:27:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 20:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 20:27:11 [DEBUG   ] spawn_process: at 2018-11-15 20:27:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 20:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 20:27:11 [DEBUG   ] spawn_process: at 2018-11-15 20:27:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 20:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 20:27:11 [DEBUG   ] spawn_process: at 2018-11-15 20:27:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 20:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 20:27:11 [DEBUG   ] spawn_process: at 2018-11-15 20:27:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 20:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 20:27:11 [DEBUG   ] spawn_process: at 2018-11-15 20:27:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 20:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 20:27:11 [DEBUG   ] spawn_process: at 2018-11-15 20:27:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 20:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 20:27:11 [DEBUG   ] spawn_process: at 2018-11-15 20:27:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 20:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 20:27:11 [DEBUG   ] spawn_process: at 2018-11-15 20:27:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 20:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 20:27:11 [DEBUG   ] spawn_process: at 2018-11-15 20:27:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 20:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 20:27:11 [DEBUG   ] spawn_process: at 2018-11-15 20:27:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 20:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 20:27:11 [DEBUG   ] spawn_process: at 2018-11-15 20:27:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 20:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 20:27:11 [DEBUG   ] spawn_process: at 2018-11-15 20:27:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 20:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 20:27:11 [DEBUG   ] spawn_process: at 2018-11-15 20:27:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 20:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 20:27:11 [DEBUG   ] spawn_process: at 2018-11-15 20:27:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 20:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 20:27:11 [DEBUG   ] spawn_process: at 2018-11-15 20:27:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 20:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 20:27:11 [DEBUG   ] spawn_process: at 2018-11-15 20:27:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 20:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 20:27:11 [DEBUG   ] spawn_process: at 2018-11-15 20:27:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 20:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 20:27:11 [DEBUG   ] spawn_process: at 2018-11-15 20:27:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 20:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 20:27:11 [DEBUG   ] spawn_process: at 2018-11-15 20:27:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 20:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 20:27:11 [DEBUG   ] spawn_process: at 2018-11-15 20:27:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 20:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 20:27:11 [DEBUG   ] spawn_process: at 2018-11-15 20:27:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 20:27:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 20:27:11 [DEBUG   ] spawn_process: at 2018-11-15 20:27:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 20:27:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 20:27:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:27:17 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-15 20:27:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-11-15 20:27:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-15 20:27:17 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 20:27:17 [WARNING ] (13, 1, 'bot')
2018-11-15 20:27:17 [WARNING ] (13, 1, 'bot')
2018-11-15 20:27:17 [WARNING ] (13, 1, 'bot')
2018-11-15 20:27:17 [WARNING ] (13, 1, 'bot')
2018-11-15 20:27:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:27:17 [DEBUG   ] Finished updating board flags in 2.493 seconds
2018-11-15 20:27:37 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-15 20:27:50 [DEBUG   ] Got command BAM from MCS: ref #518512
2018-11-15 20:27:50 [INFO    ] Finished processing BAM request
2018-11-15 20:27:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:27:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518512   8 58437 73670029 A  ERROR'
2018-11-15 20:27:50 [DEBUG   ] Got command BAM from MCS: ref #518513
2018-11-15 20:27:50 [INFO    ] Finished processing BAM request
2018-11-15 20:27:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:27:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518513   8 58437 73670033 A  ERROR'
2018-11-15 20:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 20:27:50 [DEBUG   ] spawn_process: at 2018-11-15 20:27:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 20:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 20:27:50 [DEBUG   ] spawn_process: at 2018-11-15 20:27:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 20:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 20:27:50 [DEBUG   ] spawn_process: at 2018-11-15 20:27:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 20:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 20:27:50 [DEBUG   ] spawn_process: at 2018-11-15 20:27:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 20:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 20:27:50 [DEBUG   ] spawn_process: at 2018-11-15 20:27:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 20:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 20:27:50 [DEBUG   ] spawn_process: at 2018-11-15 20:27:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 20:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 20:27:50 [DEBUG   ] spawn_process: at 2018-11-15 20:27:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 20:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 20:27:50 [DEBUG   ] spawn_process: at 2018-11-15 20:27:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 20:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 20:27:50 [DEBUG   ] spawn_process: at 2018-11-15 20:27:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 20:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 20:27:50 [DEBUG   ] spawn_process: at 2018-11-15 20:27:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 20:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 20:27:50 [DEBUG   ] spawn_process: at 2018-11-15 20:27:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 20:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 20:27:50 [DEBUG   ] spawn_process: at 2018-11-15 20:27:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 20:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 20:27:50 [DEBUG   ] spawn_process: at 2018-11-15 20:27:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 20:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 20:27:50 [DEBUG   ] spawn_process: at 2018-11-15 20:27:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 20:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 20:27:50 [DEBUG   ] spawn_process: at 2018-11-15 20:27:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 20:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 20:27:50 [DEBUG   ] spawn_process: at 2018-11-15 20:27:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 20:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 20:27:50 [DEBUG   ] spawn_process: at 2018-11-15 20:27:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 20:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 20:27:50 [DEBUG   ] spawn_process: at 2018-11-15 20:27:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 20:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 20:27:50 [DEBUG   ] spawn_process: at 2018-11-15 20:27:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 20:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 20:27:50 [DEBUG   ] spawn_process: at 2018-11-15 20:27:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 20:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 20:27:50 [DEBUG   ] spawn_process: at 2018-11-15 20:27:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 20:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 20:27:50 [DEBUG   ] spawn_process: at 2018-11-15 20:27:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 20:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 20:27:50 [DEBUG   ] spawn_process: at 2018-11-15 20:27:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 20:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 20:27:50 [DEBUG   ] spawn_process: at 2018-11-15 20:27:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 20:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 20:27:50 [DEBUG   ] spawn_process: at 2018-11-15 20:27:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 20:27:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 20:27:50 [DEBUG   ] spawn_process: at 2018-11-15 20:27:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 20:27:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 20:28:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:28:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-15 20:28:16 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 20:28:16 [WARNING ] (13, 1, 'bot')
2018-11-15 20:28:16 [WARNING ] (13, 1, 'bot')
2018-11-15 20:28:16 [WARNING ] (13, 1, 'bot')
2018-11-15 20:28:16 [WARNING ] (13, 1, 'bot')
2018-11-15 20:28:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:28:16 [DEBUG   ] Finished updating board flags in 1.270 seconds
2018-11-15 20:28:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 20:28:23 [DEBUG   ] Got command RPT from MCS: ref #518516
2018-11-15 20:28:23 [DEBUG   ] summary = ERROR
2018-11-15 20:28:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518516  13 58437 73703625 A  ERRORERROR'
2018-11-15 20:28:23 [DEBUG   ] Got command RPT from MCS: ref #518517
2018-11-15 20:28:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 20:28:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518517  77 58437 73703829 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 20:28:24 [DEBUG   ] Got command RPT from MCS: ref #518518
2018-11-15 20:28:24 [DEBUG   ] summary = ERROR
2018-11-15 20:28:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518518  13 58437 73704021 A  ERRORERROR'
2018-11-15 20:28:24 [DEBUG   ] Got command RPT from MCS: ref #518520
2018-11-15 20:28:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 20:28:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518520  77 58437 73704225 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 20:28:24 [DEBUG   ] Got command RPT from MCS: ref #518521
2018-11-15 20:28:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 20:28:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518521  12 58437 73704429 A  ERRORB¢ff'
2018-11-15 20:28:29 [DEBUG   ] Got command BAM from MCS: ref #518526
2018-11-15 20:28:29 [INFO    ] Finished processing BAM request
2018-11-15 20:28:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:28:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518526   8 58437 73709033 A  ERROR'
2018-11-15 20:28:29 [DEBUG   ] Got command BAM from MCS: ref #518527
2018-11-15 20:28:29 [INFO    ] Finished processing BAM request
2018-11-15 20:28:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:28:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518527   8 58437 73709037 A  ERROR'
2018-11-15 20:28:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 20:28:29 [DEBUG   ] spawn_process: at 2018-11-15 20:28:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 20:28:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 20:28:29 [DEBUG   ] spawn_process: at 2018-11-15 20:28:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 20:28:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 20:28:29 [DEBUG   ] spawn_process: at 2018-11-15 20:28:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 20:28:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 20:28:29 [DEBUG   ] spawn_process: at 2018-11-15 20:28:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 20:28:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 20:28:29 [DEBUG   ] spawn_process: at 2018-11-15 20:28:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 20:28:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 20:28:29 [DEBUG   ] spawn_process: at 2018-11-15 20:28:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 20:28:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 20:28:29 [DEBUG   ] spawn_process: at 2018-11-15 20:28:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 20:28:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 20:28:29 [DEBUG   ] spawn_process: at 2018-11-15 20:28:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 20:28:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 20:28:29 [DEBUG   ] spawn_process: at 2018-11-15 20:28:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 20:28:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 20:28:29 [DEBUG   ] spawn_process: at 2018-11-15 20:28:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 20:28:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 20:28:29 [DEBUG   ] spawn_process: at 2018-11-15 20:28:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 20:28:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 20:28:29 [DEBUG   ] spawn_process: at 2018-11-15 20:28:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 20:28:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 20:28:29 [DEBUG   ] spawn_process: at 2018-11-15 20:28:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 20:28:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 20:28:29 [DEBUG   ] spawn_process: at 2018-11-15 20:28:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 20:28:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 20:28:29 [DEBUG   ] spawn_process: at 2018-11-15 20:28:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 20:28:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 20:28:29 [DEBUG   ] spawn_process: at 2018-11-15 20:28:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 20:28:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 20:28:29 [DEBUG   ] spawn_process: at 2018-11-15 20:28:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 20:28:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 20:28:29 [DEBUG   ] spawn_process: at 2018-11-15 20:28:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 20:28:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 20:28:29 [DEBUG   ] spawn_process: at 2018-11-15 20:28:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 20:28:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 20:28:29 [DEBUG   ] spawn_process: at 2018-11-15 20:28:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 20:28:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 20:28:29 [DEBUG   ] spawn_process: at 2018-11-15 20:28:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 20:28:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 20:28:29 [DEBUG   ] spawn_process: at 2018-11-15 20:28:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 20:28:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 20:28:29 [DEBUG   ] spawn_process: at 2018-11-15 20:28:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 20:28:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 20:28:29 [DEBUG   ] spawn_process: at 2018-11-15 20:28:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 20:28:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 20:28:29 [DEBUG   ] spawn_process: at 2018-11-15 20:28:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 20:28:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 20:28:29 [DEBUG   ] spawn_process: at 2018-11-15 20:28:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 20:28:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 20:28:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 20:29:08 [DEBUG   ] Got command BAM from MCS: ref #518529
2018-11-15 20:29:08 [INFO    ] Finished processing BAM request
2018-11-15 20:29:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:29:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518529   8 58437 73748033 A  ERROR'
2018-11-15 20:29:08 [DEBUG   ] Got command BAM from MCS: ref #518528
2018-11-15 20:29:08 [INFO    ] Finished processing BAM request
2018-11-15 20:29:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:29:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518528   8 58437 73748037 A  ERROR'
2018-11-15 20:29:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 20:29:08 [DEBUG   ] spawn_process: at 2018-11-15 20:29:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 20:29:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 20:29:08 [DEBUG   ] spawn_process: at 2018-11-15 20:29:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 20:29:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 20:29:08 [DEBUG   ] spawn_process: at 2018-11-15 20:29:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 20:29:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 20:29:08 [DEBUG   ] spawn_process: at 2018-11-15 20:29:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 20:29:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 20:29:08 [DEBUG   ] spawn_process: at 2018-11-15 20:29:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 20:29:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 20:29:08 [DEBUG   ] spawn_process: at 2018-11-15 20:29:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 20:29:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 20:29:08 [DEBUG   ] spawn_process: at 2018-11-15 20:29:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 20:29:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 20:29:08 [DEBUG   ] spawn_process: at 2018-11-15 20:29:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 20:29:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 20:29:08 [DEBUG   ] spawn_process: at 2018-11-15 20:29:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 20:29:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 20:29:08 [DEBUG   ] spawn_process: at 2018-11-15 20:29:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 20:29:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 20:29:08 [DEBUG   ] spawn_process: at 2018-11-15 20:29:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 20:29:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 20:29:08 [DEBUG   ] spawn_process: at 2018-11-15 20:29:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 20:29:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 20:29:08 [DEBUG   ] spawn_process: at 2018-11-15 20:29:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 20:29:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 20:29:08 [DEBUG   ] spawn_process: at 2018-11-15 20:29:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 20:29:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 20:29:08 [DEBUG   ] spawn_process: at 2018-11-15 20:29:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 20:29:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 20:29:08 [DEBUG   ] spawn_process: at 2018-11-15 20:29:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 20:29:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 20:29:08 [DEBUG   ] spawn_process: at 2018-11-15 20:29:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 20:29:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 20:29:08 [DEBUG   ] spawn_process: at 2018-11-15 20:29:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 20:29:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 20:29:08 [DEBUG   ] spawn_process: at 2018-11-15 20:29:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 20:29:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 20:29:08 [DEBUG   ] spawn_process: at 2018-11-15 20:29:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 20:29:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 20:29:08 [DEBUG   ] spawn_process: at 2018-11-15 20:29:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 20:29:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 20:29:08 [DEBUG   ] spawn_process: at 2018-11-15 20:29:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 20:29:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 20:29:08 [DEBUG   ] spawn_process: at 2018-11-15 20:29:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 20:29:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 20:29:08 [DEBUG   ] spawn_process: at 2018-11-15 20:29:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 20:29:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 20:29:08 [DEBUG   ] spawn_process: at 2018-11-15 20:29:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 20:29:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 20:29:08 [DEBUG   ] spawn_process: at 2018-11-15 20:29:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 20:29:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:29:16 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 20:29:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 20:29:16 [WARNING ] (13, 1, 'bot')
2018-11-15 20:29:16 [WARNING ] (13, 1, 'bot')
2018-11-15 20:29:16 [WARNING ] (13, 1, 'bot')
2018-11-15 20:29:16 [WARNING ] (13, 1, 'bot')
2018-11-15 20:29:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:29:16 [DEBUG   ] Finished updating board flags in 1.201 seconds
2018-11-15 20:29:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 20:29:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 20:29:47 [DEBUG   ] Got command BAM from MCS: ref #518535
2018-11-15 20:29:47 [INFO    ] Finished processing BAM request
2018-11-15 20:29:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:29:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518535   8 58437 73787029 A  ERROR'
2018-11-15 20:29:47 [DEBUG   ] Got command BAM from MCS: ref #518534
2018-11-15 20:29:47 [INFO    ] Finished processing BAM request
2018-11-15 20:29:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:29:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518534   8 58437 73787033 A  ERROR'
2018-11-15 20:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 20:29:47 [DEBUG   ] spawn_process: at 2018-11-15 20:29:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 20:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 20:29:47 [DEBUG   ] spawn_process: at 2018-11-15 20:29:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 20:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 20:29:47 [DEBUG   ] spawn_process: at 2018-11-15 20:29:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 20:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 20:29:47 [DEBUG   ] spawn_process: at 2018-11-15 20:29:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 20:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 20:29:47 [DEBUG   ] spawn_process: at 2018-11-15 20:29:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 20:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 20:29:47 [DEBUG   ] spawn_process: at 2018-11-15 20:29:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 20:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 20:29:47 [DEBUG   ] spawn_process: at 2018-11-15 20:29:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 20:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 20:29:47 [DEBUG   ] spawn_process: at 2018-11-15 20:29:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 20:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 20:29:47 [DEBUG   ] spawn_process: at 2018-11-15 20:29:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 20:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 20:29:47 [DEBUG   ] spawn_process: at 2018-11-15 20:29:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 20:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 20:29:47 [DEBUG   ] spawn_process: at 2018-11-15 20:29:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 20:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 20:29:47 [DEBUG   ] spawn_process: at 2018-11-15 20:29:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 20:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 20:29:47 [DEBUG   ] spawn_process: at 2018-11-15 20:29:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 20:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 20:29:47 [DEBUG   ] spawn_process: at 2018-11-15 20:29:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 20:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 20:29:47 [DEBUG   ] spawn_process: at 2018-11-15 20:29:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 20:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 20:29:47 [DEBUG   ] spawn_process: at 2018-11-15 20:29:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 20:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 20:29:47 [DEBUG   ] spawn_process: at 2018-11-15 20:29:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 20:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 20:29:47 [DEBUG   ] spawn_process: at 2018-11-15 20:29:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 20:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 20:29:47 [DEBUG   ] spawn_process: at 2018-11-15 20:29:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 20:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 20:29:47 [DEBUG   ] spawn_process: at 2018-11-15 20:29:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 20:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 20:29:47 [DEBUG   ] spawn_process: at 2018-11-15 20:29:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 20:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 20:29:47 [DEBUG   ] spawn_process: at 2018-11-15 20:29:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 20:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 20:29:47 [DEBUG   ] spawn_process: at 2018-11-15 20:29:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 20:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 20:29:47 [DEBUG   ] spawn_process: at 2018-11-15 20:29:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 20:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 20:29:47 [DEBUG   ] spawn_process: at 2018-11-15 20:29:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 20:29:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 20:29:47 [DEBUG   ] spawn_process: at 2018-11-15 20:29:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 20:29:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 20:30:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:30:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 20:30:16 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 20:30:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 20:30:16 [WARNING ] (13, 1, 'bot')
2018-11-15 20:30:16 [WARNING ] (13, 1, 'bot')
2018-11-15 20:30:16 [WARNING ] (13, 1, 'bot')
2018-11-15 20:30:16 [WARNING ] (13, 1, 'bot')
2018-11-15 20:30:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:30:16 [DEBUG   ] Finished updating board flags in 1.196 seconds
2018-11-15 20:30:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 20:30:26 [DEBUG   ] Got command BAM from MCS: ref #518537
2018-11-15 20:30:26 [INFO    ] Finished processing BAM request
2018-11-15 20:30:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:30:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518537   8 58437 73826025 A  ERROR'
2018-11-15 20:30:26 [DEBUG   ] Got command BAM from MCS: ref #518536
2018-11-15 20:30:26 [INFO    ] Finished processing BAM request
2018-11-15 20:30:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:30:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518536   8 58437 73826029 A  ERROR'
2018-11-15 20:30:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 20:30:26 [DEBUG   ] spawn_process: at 2018-11-15 20:30:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 20:30:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 20:30:26 [DEBUG   ] spawn_process: at 2018-11-15 20:30:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 20:30:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 20:30:26 [DEBUG   ] spawn_process: at 2018-11-15 20:30:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 20:30:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 20:30:26 [DEBUG   ] spawn_process: at 2018-11-15 20:30:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 20:30:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 20:30:26 [DEBUG   ] spawn_process: at 2018-11-15 20:30:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 20:30:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 20:30:26 [DEBUG   ] spawn_process: at 2018-11-15 20:30:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 20:30:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 20:30:26 [DEBUG   ] spawn_process: at 2018-11-15 20:30:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 20:30:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 20:30:26 [DEBUG   ] spawn_process: at 2018-11-15 20:30:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 20:30:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 20:30:26 [DEBUG   ] spawn_process: at 2018-11-15 20:30:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 20:30:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 20:30:26 [DEBUG   ] spawn_process: at 2018-11-15 20:30:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 20:30:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 20:30:26 [DEBUG   ] spawn_process: at 2018-11-15 20:30:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 20:30:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 20:30:26 [DEBUG   ] spawn_process: at 2018-11-15 20:30:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 20:30:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 20:30:26 [DEBUG   ] spawn_process: at 2018-11-15 20:30:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 20:30:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 20:30:26 [DEBUG   ] spawn_process: at 2018-11-15 20:30:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 20:30:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 20:30:26 [DEBUG   ] spawn_process: at 2018-11-15 20:30:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 20:30:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 20:30:26 [DEBUG   ] spawn_process: at 2018-11-15 20:30:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 20:30:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 20:30:26 [DEBUG   ] spawn_process: at 2018-11-15 20:30:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 20:30:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 20:30:26 [DEBUG   ] spawn_process: at 2018-11-15 20:30:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 20:30:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 20:30:26 [DEBUG   ] spawn_process: at 2018-11-15 20:30:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 20:30:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 20:30:26 [DEBUG   ] spawn_process: at 2018-11-15 20:30:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 20:30:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 20:30:26 [DEBUG   ] spawn_process: at 2018-11-15 20:30:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 20:30:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 20:30:26 [DEBUG   ] spawn_process: at 2018-11-15 20:30:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 20:30:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 20:30:26 [DEBUG   ] spawn_process: at 2018-11-15 20:30:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 20:30:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 20:30:26 [DEBUG   ] spawn_process: at 2018-11-15 20:30:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 20:30:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 20:30:26 [DEBUG   ] spawn_process: at 2018-11-15 20:30:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 20:30:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 20:30:26 [DEBUG   ] spawn_process: at 2018-11-15 20:30:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 20:30:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 20:30:45 [DEBUG   ] Got command RPT from MCS: ref #518538
2018-11-15 20:30:45 [DEBUG   ] summary = ERROR
2018-11-15 20:30:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518538  13 58437 73845189 A  ERRORERROR'
2018-11-15 20:30:45 [DEBUG   ] Got command RPT from MCS: ref #518539
2018-11-15 20:30:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 20:30:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518539  77 58437 73845190 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 20:30:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 20:31:05 [DEBUG   ] Got command BAM from MCS: ref #518555
2018-11-15 20:31:05 [INFO    ] Finished processing BAM request
2018-11-15 20:31:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518555   8 58437 73865033 A  ERROR'
2018-11-15 20:31:05 [DEBUG   ] Got command BAM from MCS: ref #518556
2018-11-15 20:31:05 [INFO    ] Finished processing BAM request
2018-11-15 20:31:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:31:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518556   8 58437 73865037 A  ERROR'
2018-11-15 20:31:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 20:31:05 [DEBUG   ] spawn_process: at 2018-11-15 20:31:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 20:31:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 20:31:05 [DEBUG   ] spawn_process: at 2018-11-15 20:31:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 20:31:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 20:31:05 [DEBUG   ] spawn_process: at 2018-11-15 20:31:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 20:31:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 20:31:05 [DEBUG   ] spawn_process: at 2018-11-15 20:31:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 20:31:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 20:31:05 [DEBUG   ] spawn_process: at 2018-11-15 20:31:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 20:31:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 20:31:05 [DEBUG   ] spawn_process: at 2018-11-15 20:31:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 20:31:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 20:31:05 [DEBUG   ] spawn_process: at 2018-11-15 20:31:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 20:31:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 20:31:05 [DEBUG   ] spawn_process: at 2018-11-15 20:31:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 20:31:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 20:31:05 [DEBUG   ] spawn_process: at 2018-11-15 20:31:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 20:31:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 20:31:05 [DEBUG   ] spawn_process: at 2018-11-15 20:31:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 20:31:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 20:31:05 [DEBUG   ] spawn_process: at 2018-11-15 20:31:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 20:31:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 20:31:05 [DEBUG   ] spawn_process: at 2018-11-15 20:31:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 20:31:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 20:31:05 [DEBUG   ] spawn_process: at 2018-11-15 20:31:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 20:31:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 20:31:05 [DEBUG   ] spawn_process: at 2018-11-15 20:31:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 20:31:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 20:31:05 [DEBUG   ] spawn_process: at 2018-11-15 20:31:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 20:31:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 20:31:05 [DEBUG   ] spawn_process: at 2018-11-15 20:31:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 20:31:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 20:31:05 [DEBUG   ] spawn_process: at 2018-11-15 20:31:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 20:31:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 20:31:05 [DEBUG   ] spawn_process: at 2018-11-15 20:31:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 20:31:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 20:31:05 [DEBUG   ] spawn_process: at 2018-11-15 20:31:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 20:31:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 20:31:05 [DEBUG   ] spawn_process: at 2018-11-15 20:31:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 20:31:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 20:31:05 [DEBUG   ] spawn_process: at 2018-11-15 20:31:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 20:31:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 20:31:05 [DEBUG   ] spawn_process: at 2018-11-15 20:31:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 20:31:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 20:31:05 [DEBUG   ] spawn_process: at 2018-11-15 20:31:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 20:31:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 20:31:05 [DEBUG   ] spawn_process: at 2018-11-15 20:31:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 20:31:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 20:31:05 [DEBUG   ] spawn_process: at 2018-11-15 20:31:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 20:31:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 20:31:05 [DEBUG   ] spawn_process: at 2018-11-15 20:31:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 20:31:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 20:31:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:31:16 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 20:31:16 [WARNING ] (13, 1, 'bot')
2018-11-15 20:31:16 [WARNING ] (13, 1, 'bot')
2018-11-15 20:31:16 [WARNING ] (13, 1, 'bot')
2018-11-15 20:31:16 [WARNING ] (13, 1, 'bot')
2018-11-15 20:31:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:31:16 [DEBUG   ] Finished updating board flags in 1.460 seconds
2018-11-15 20:31:17 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-15 20:31:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 20:31:44 [DEBUG   ] Got command BAM from MCS: ref #518557
2018-11-15 20:31:44 [INFO    ] Finished processing BAM request
2018-11-15 20:31:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:31:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518557   8 58437 73904029 A  ERROR'
2018-11-15 20:31:44 [DEBUG   ] Got command BAM from MCS: ref #518558
2018-11-15 20:31:44 [INFO    ] Finished processing BAM request
2018-11-15 20:31:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:31:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518558   8 58437 73904033 A  ERROR'
2018-11-15 20:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 20:31:44 [DEBUG   ] spawn_process: at 2018-11-15 20:31:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 20:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 20:31:44 [DEBUG   ] spawn_process: at 2018-11-15 20:31:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 20:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 20:31:44 [DEBUG   ] spawn_process: at 2018-11-15 20:31:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 20:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 20:31:44 [DEBUG   ] spawn_process: at 2018-11-15 20:31:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 20:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 20:31:44 [DEBUG   ] spawn_process: at 2018-11-15 20:31:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 20:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 20:31:44 [DEBUG   ] spawn_process: at 2018-11-15 20:31:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 20:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 20:31:44 [DEBUG   ] spawn_process: at 2018-11-15 20:31:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 20:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 20:31:44 [DEBUG   ] spawn_process: at 2018-11-15 20:31:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 20:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 20:31:44 [DEBUG   ] spawn_process: at 2018-11-15 20:31:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 20:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 20:31:44 [DEBUG   ] spawn_process: at 2018-11-15 20:31:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 20:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 20:31:44 [DEBUG   ] spawn_process: at 2018-11-15 20:31:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 20:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 20:31:44 [DEBUG   ] spawn_process: at 2018-11-15 20:31:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 20:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 20:31:44 [DEBUG   ] spawn_process: at 2018-11-15 20:31:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 20:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 20:31:44 [DEBUG   ] spawn_process: at 2018-11-15 20:31:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 20:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 20:31:44 [DEBUG   ] spawn_process: at 2018-11-15 20:31:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 20:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 20:31:44 [DEBUG   ] spawn_process: at 2018-11-15 20:31:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 20:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 20:31:44 [DEBUG   ] spawn_process: at 2018-11-15 20:31:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 20:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 20:31:44 [DEBUG   ] spawn_process: at 2018-11-15 20:31:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 20:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 20:31:44 [DEBUG   ] spawn_process: at 2018-11-15 20:31:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 20:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 20:31:44 [DEBUG   ] spawn_process: at 2018-11-15 20:31:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 20:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 20:31:44 [DEBUG   ] spawn_process: at 2018-11-15 20:31:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 20:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 20:31:44 [DEBUG   ] spawn_process: at 2018-11-15 20:31:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 20:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 20:31:44 [DEBUG   ] spawn_process: at 2018-11-15 20:31:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 20:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 20:31:44 [DEBUG   ] spawn_process: at 2018-11-15 20:31:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 20:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 20:31:44 [DEBUG   ] spawn_process: at 2018-11-15 20:31:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 20:31:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 20:31:44 [DEBUG   ] spawn_process: at 2018-11-15 20:31:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 20:31:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 20:32:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-15 20:32:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:32:16 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 20:32:16 [WARNING ] (13, 1, 'bot')
2018-11-15 20:32:16 [WARNING ] (13, 1, 'bot')
2018-11-15 20:32:16 [WARNING ] (13, 1, 'bot')
2018-11-15 20:32:16 [WARNING ] (13, 1, 'bot')
2018-11-15 20:32:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:32:16 [DEBUG   ] Finished updating board flags in 1.391 seconds
2018-11-15 20:32:17 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-15 20:32:23 [DEBUG   ] Got command BAM from MCS: ref #518560
2018-11-15 20:32:23 [INFO    ] Finished processing BAM request
2018-11-15 20:32:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:32:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518560   8 58437 73943029 A  ERROR'
2018-11-15 20:32:23 [DEBUG   ] Got command BAM from MCS: ref #518559
2018-11-15 20:32:23 [INFO    ] Finished processing BAM request
2018-11-15 20:32:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:32:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518559   8 58437 73943033 A  ERROR'
2018-11-15 20:32:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 20:32:23 [DEBUG   ] spawn_process: at 2018-11-15 20:32:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 20:32:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 20:32:23 [DEBUG   ] spawn_process: at 2018-11-15 20:32:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 20:32:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 20:32:23 [DEBUG   ] spawn_process: at 2018-11-15 20:32:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 20:32:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 20:32:23 [DEBUG   ] spawn_process: at 2018-11-15 20:32:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 20:32:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 20:32:23 [DEBUG   ] spawn_process: at 2018-11-15 20:32:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 20:32:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 20:32:23 [DEBUG   ] spawn_process: at 2018-11-15 20:32:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 20:32:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 20:32:23 [DEBUG   ] spawn_process: at 2018-11-15 20:32:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 20:32:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 20:32:23 [DEBUG   ] spawn_process: at 2018-11-15 20:32:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 20:32:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 20:32:23 [DEBUG   ] spawn_process: at 2018-11-15 20:32:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 20:32:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 20:32:23 [DEBUG   ] spawn_process: at 2018-11-15 20:32:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 20:32:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 20:32:23 [DEBUG   ] spawn_process: at 2018-11-15 20:32:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 20:32:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 20:32:23 [DEBUG   ] spawn_process: at 2018-11-15 20:32:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 20:32:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 20:32:23 [DEBUG   ] spawn_process: at 2018-11-15 20:32:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 20:32:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 20:32:23 [DEBUG   ] spawn_process: at 2018-11-15 20:32:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 20:32:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 20:32:23 [DEBUG   ] spawn_process: at 2018-11-15 20:32:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 20:32:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 20:32:23 [DEBUG   ] spawn_process: at 2018-11-15 20:32:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 20:32:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 20:32:23 [DEBUG   ] spawn_process: at 2018-11-15 20:32:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 20:32:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 20:32:23 [DEBUG   ] spawn_process: at 2018-11-15 20:32:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 20:32:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 20:32:23 [DEBUG   ] spawn_process: at 2018-11-15 20:32:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 20:32:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 20:32:23 [DEBUG   ] spawn_process: at 2018-11-15 20:32:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 20:32:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 20:32:23 [DEBUG   ] spawn_process: at 2018-11-15 20:32:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 20:32:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 20:32:23 [DEBUG   ] spawn_process: at 2018-11-15 20:32:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 20:32:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 20:32:23 [DEBUG   ] spawn_process: at 2018-11-15 20:32:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 20:32:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 20:32:23 [DEBUG   ] spawn_process: at 2018-11-15 20:32:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 20:32:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 20:32:23 [DEBUG   ] spawn_process: at 2018-11-15 20:32:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 20:32:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 20:32:23 [DEBUG   ] spawn_process: at 2018-11-15 20:32:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 20:32:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 20:32:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 20:33:02 [DEBUG   ] Got command BAM from MCS: ref #518565
2018-11-15 20:33:02 [INFO    ] Finished processing BAM request
2018-11-15 20:33:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:33:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518565   8 58437 73982033 A  ERROR'
2018-11-15 20:33:02 [DEBUG   ] Got command BAM from MCS: ref #518566
2018-11-15 20:33:02 [INFO    ] Finished processing BAM request
2018-11-15 20:33:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:33:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518566   8 58437 73982037 A  ERROR'
2018-11-15 20:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 20:33:02 [DEBUG   ] spawn_process: at 2018-11-15 20:33:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 20:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 20:33:02 [DEBUG   ] spawn_process: at 2018-11-15 20:33:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 20:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 20:33:02 [DEBUG   ] spawn_process: at 2018-11-15 20:33:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 20:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 20:33:02 [DEBUG   ] spawn_process: at 2018-11-15 20:33:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 20:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 20:33:02 [DEBUG   ] spawn_process: at 2018-11-15 20:33:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 20:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 20:33:02 [DEBUG   ] spawn_process: at 2018-11-15 20:33:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 20:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 20:33:02 [DEBUG   ] spawn_process: at 2018-11-15 20:33:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 20:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 20:33:02 [DEBUG   ] spawn_process: at 2018-11-15 20:33:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 20:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 20:33:02 [DEBUG   ] spawn_process: at 2018-11-15 20:33:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 20:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 20:33:02 [DEBUG   ] spawn_process: at 2018-11-15 20:33:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 20:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 20:33:02 [DEBUG   ] spawn_process: at 2018-11-15 20:33:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 20:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 20:33:02 [DEBUG   ] spawn_process: at 2018-11-15 20:33:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 20:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 20:33:02 [DEBUG   ] spawn_process: at 2018-11-15 20:33:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 20:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 20:33:02 [DEBUG   ] spawn_process: at 2018-11-15 20:33:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 20:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 20:33:02 [DEBUG   ] spawn_process: at 2018-11-15 20:33:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 20:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 20:33:02 [DEBUG   ] spawn_process: at 2018-11-15 20:33:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 20:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 20:33:02 [DEBUG   ] spawn_process: at 2018-11-15 20:33:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 20:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 20:33:02 [DEBUG   ] spawn_process: at 2018-11-15 20:33:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 20:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 20:33:02 [DEBUG   ] spawn_process: at 2018-11-15 20:33:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 20:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 20:33:02 [DEBUG   ] spawn_process: at 2018-11-15 20:33:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 20:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 20:33:02 [DEBUG   ] spawn_process: at 2018-11-15 20:33:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 20:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 20:33:02 [DEBUG   ] spawn_process: at 2018-11-15 20:33:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 20:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 20:33:02 [DEBUG   ] spawn_process: at 2018-11-15 20:33:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 20:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 20:33:02 [DEBUG   ] spawn_process: at 2018-11-15 20:33:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 20:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 20:33:02 [DEBUG   ] spawn_process: at 2018-11-15 20:33:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 20:33:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 20:33:02 [DEBUG   ] spawn_process: at 2018-11-15 20:33:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 20:33:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:33:16 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 20:33:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 20:33:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 20:33:16 [WARNING ] (13, 1, 'bot')
2018-11-15 20:33:16 [WARNING ] (13, 1, 'bot')
2018-11-15 20:33:16 [WARNING ] (13, 1, 'bot')
2018-11-15 20:33:16 [WARNING ] (13, 1, 'bot')
2018-11-15 20:33:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:33:16 [DEBUG   ] Finished updating board flags in 1.188 seconds
2018-11-15 20:33:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 20:33:23 [DEBUG   ] Got command RPT from MCS: ref #518567
2018-11-15 20:33:23 [DEBUG   ] summary = ERROR
2018-11-15 20:33:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518567  13 58437 74003717 A  ERRORERROR'
2018-11-15 20:33:23 [DEBUG   ] Got command RPT from MCS: ref #518568
2018-11-15 20:33:23 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 20:33:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518568  77 58437 74003909 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 20:33:24 [DEBUG   ] Got command RPT from MCS: ref #518569
2018-11-15 20:33:24 [DEBUG   ] summary = ERROR
2018-11-15 20:33:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518569  13 58437 74004113 A  ERRORERROR'
2018-11-15 20:33:24 [DEBUG   ] Got command RPT from MCS: ref #518570
2018-11-15 20:33:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 20:33:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518570  77 58437 74004317 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 20:33:24 [DEBUG   ] Got command RPT from MCS: ref #518571
2018-11-15 20:33:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 20:33:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518571  12 58437 74004521 A  ERRORB¢ff'
2018-11-15 20:33:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 20:33:41 [DEBUG   ] Got command BAM from MCS: ref #518572
2018-11-15 20:33:41 [INFO    ] Finished processing BAM request
2018-11-15 20:33:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:33:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518572   8 58437 74021025 A  ERROR'
2018-11-15 20:33:41 [DEBUG   ] Got command BAM from MCS: ref #518573
2018-11-15 20:33:41 [INFO    ] Finished processing BAM request
2018-11-15 20:33:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:33:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518573   8 58437 74021029 A  ERROR'
2018-11-15 20:33:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 20:33:41 [DEBUG   ] spawn_process: at 2018-11-15 20:33:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 20:33:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 20:33:41 [DEBUG   ] spawn_process: at 2018-11-15 20:33:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 20:33:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 20:33:41 [DEBUG   ] spawn_process: at 2018-11-15 20:33:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 20:33:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 20:33:41 [DEBUG   ] spawn_process: at 2018-11-15 20:33:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 20:33:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 20:33:41 [DEBUG   ] spawn_process: at 2018-11-15 20:33:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 20:33:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 20:33:41 [DEBUG   ] spawn_process: at 2018-11-15 20:33:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 20:33:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 20:33:41 [DEBUG   ] spawn_process: at 2018-11-15 20:33:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 20:33:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 20:33:41 [DEBUG   ] spawn_process: at 2018-11-15 20:33:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 20:33:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 20:33:41 [DEBUG   ] spawn_process: at 2018-11-15 20:33:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 20:33:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 20:33:41 [DEBUG   ] spawn_process: at 2018-11-15 20:33:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 20:33:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 20:33:41 [DEBUG   ] spawn_process: at 2018-11-15 20:33:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 20:33:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 20:33:41 [DEBUG   ] spawn_process: at 2018-11-15 20:33:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 20:33:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 20:33:41 [DEBUG   ] spawn_process: at 2018-11-15 20:33:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 20:33:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 20:33:41 [DEBUG   ] spawn_process: at 2018-11-15 20:33:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 20:33:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 20:33:41 [DEBUG   ] spawn_process: at 2018-11-15 20:33:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 20:33:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 20:33:41 [DEBUG   ] spawn_process: at 2018-11-15 20:33:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 20:33:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 20:33:41 [DEBUG   ] spawn_process: at 2018-11-15 20:33:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 20:33:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 20:33:41 [DEBUG   ] spawn_process: at 2018-11-15 20:33:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 20:33:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 20:33:41 [DEBUG   ] spawn_process: at 2018-11-15 20:33:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 20:33:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 20:33:41 [DEBUG   ] spawn_process: at 2018-11-15 20:33:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 20:33:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 20:33:41 [DEBUG   ] spawn_process: at 2018-11-15 20:33:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 20:33:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 20:33:41 [DEBUG   ] spawn_process: at 2018-11-15 20:33:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 20:33:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 20:33:41 [DEBUG   ] spawn_process: at 2018-11-15 20:33:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 20:33:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 20:33:41 [DEBUG   ] spawn_process: at 2018-11-15 20:33:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 20:33:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 20:33:41 [DEBUG   ] spawn_process: at 2018-11-15 20:33:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 20:33:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 20:33:41 [DEBUG   ] spawn_process: at 2018-11-15 20:33:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 20:33:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 20:34:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 20:34:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:34:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-15 20:34:16 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 20:34:16 [WARNING ] (13, 1, 'bot')
2018-11-15 20:34:16 [WARNING ] (13, 1, 'bot')
2018-11-15 20:34:16 [WARNING ] (13, 1, 'bot')
2018-11-15 20:34:16 [WARNING ] (13, 1, 'bot')
2018-11-15 20:34:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:34:16 [DEBUG   ] Finished updating board flags in 1.062 seconds
2018-11-15 20:34:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 20:34:20 [DEBUG   ] Got command BAM from MCS: ref #518574
2018-11-15 20:34:20 [INFO    ] Finished processing BAM request
2018-11-15 20:34:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:34:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518574   8 58437 74060025 A  ERROR'
2018-11-15 20:34:20 [DEBUG   ] Got command BAM from MCS: ref #518575
2018-11-15 20:34:20 [INFO    ] Finished processing BAM request
2018-11-15 20:34:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:34:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518575   8 58437 74060029 A  ERROR'
2018-11-15 20:34:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 20:34:20 [DEBUG   ] spawn_process: at 2018-11-15 20:34:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 20:34:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 20:34:20 [DEBUG   ] spawn_process: at 2018-11-15 20:34:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 20:34:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 20:34:20 [DEBUG   ] spawn_process: at 2018-11-15 20:34:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 20:34:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 20:34:20 [DEBUG   ] spawn_process: at 2018-11-15 20:34:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 20:34:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 20:34:20 [DEBUG   ] spawn_process: at 2018-11-15 20:34:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 20:34:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 20:34:20 [DEBUG   ] spawn_process: at 2018-11-15 20:34:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 20:34:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 20:34:20 [DEBUG   ] spawn_process: at 2018-11-15 20:34:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 20:34:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 20:34:20 [DEBUG   ] spawn_process: at 2018-11-15 20:34:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 20:34:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 20:34:20 [DEBUG   ] spawn_process: at 2018-11-15 20:34:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 20:34:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 20:34:20 [DEBUG   ] spawn_process: at 2018-11-15 20:34:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 20:34:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 20:34:20 [DEBUG   ] spawn_process: at 2018-11-15 20:34:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 20:34:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 20:34:20 [DEBUG   ] spawn_process: at 2018-11-15 20:34:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 20:34:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 20:34:20 [DEBUG   ] spawn_process: at 2018-11-15 20:34:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 20:34:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 20:34:20 [DEBUG   ] spawn_process: at 2018-11-15 20:34:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 20:34:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 20:34:20 [DEBUG   ] spawn_process: at 2018-11-15 20:34:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 20:34:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 20:34:20 [DEBUG   ] spawn_process: at 2018-11-15 20:34:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 20:34:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 20:34:20 [DEBUG   ] spawn_process: at 2018-11-15 20:34:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 20:34:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 20:34:20 [DEBUG   ] spawn_process: at 2018-11-15 20:34:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 20:34:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 20:34:20 [DEBUG   ] spawn_process: at 2018-11-15 20:34:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 20:34:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 20:34:20 [DEBUG   ] spawn_process: at 2018-11-15 20:34:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 20:34:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 20:34:20 [DEBUG   ] spawn_process: at 2018-11-15 20:34:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 20:34:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 20:34:20 [DEBUG   ] spawn_process: at 2018-11-15 20:34:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 20:34:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 20:34:20 [DEBUG   ] spawn_process: at 2018-11-15 20:34:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 20:34:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 20:34:20 [DEBUG   ] spawn_process: at 2018-11-15 20:34:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 20:34:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 20:34:20 [DEBUG   ] spawn_process: at 2018-11-15 20:34:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 20:34:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 20:34:20 [DEBUG   ] spawn_process: at 2018-11-15 20:34:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 20:34:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 20:34:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 20:34:59 [DEBUG   ] Got command BAM from MCS: ref #518576
2018-11-15 20:34:59 [INFO    ] Finished processing BAM request
2018-11-15 20:34:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:34:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518576   8 58437 74099025 A  ERROR'
2018-11-15 20:34:59 [DEBUG   ] Got command BAM from MCS: ref #518577
2018-11-15 20:34:59 [INFO    ] Finished processing BAM request
2018-11-15 20:34:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:34:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518577   8 58437 74099029 A  ERROR'
2018-11-15 20:34:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 20:34:59 [DEBUG   ] spawn_process: at 2018-11-15 20:34:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 20:34:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 20:34:59 [DEBUG   ] spawn_process: at 2018-11-15 20:34:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 20:34:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 20:34:59 [DEBUG   ] spawn_process: at 2018-11-15 20:34:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 20:34:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 20:34:59 [DEBUG   ] spawn_process: at 2018-11-15 20:34:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 20:34:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 20:34:59 [DEBUG   ] spawn_process: at 2018-11-15 20:34:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 20:34:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 20:34:59 [DEBUG   ] spawn_process: at 2018-11-15 20:34:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 20:34:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 20:34:59 [DEBUG   ] spawn_process: at 2018-11-15 20:34:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 20:34:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 20:34:59 [DEBUG   ] spawn_process: at 2018-11-15 20:34:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 20:34:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 20:34:59 [DEBUG   ] spawn_process: at 2018-11-15 20:34:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 20:34:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 20:34:59 [DEBUG   ] spawn_process: at 2018-11-15 20:34:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 20:34:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 20:34:59 [DEBUG   ] spawn_process: at 2018-11-15 20:34:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 20:34:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 20:34:59 [DEBUG   ] spawn_process: at 2018-11-15 20:34:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 20:34:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 20:34:59 [DEBUG   ] spawn_process: at 2018-11-15 20:34:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 20:34:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 20:34:59 [DEBUG   ] spawn_process: at 2018-11-15 20:34:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 20:34:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 20:34:59 [DEBUG   ] spawn_process: at 2018-11-15 20:34:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 20:34:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 20:34:59 [DEBUG   ] spawn_process: at 2018-11-15 20:34:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 20:34:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 20:34:59 [DEBUG   ] spawn_process: at 2018-11-15 20:34:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 20:34:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 20:34:59 [DEBUG   ] spawn_process: at 2018-11-15 20:34:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 20:34:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 20:34:59 [DEBUG   ] spawn_process: at 2018-11-15 20:34:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 20:34:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 20:34:59 [DEBUG   ] spawn_process: at 2018-11-15 20:34:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 20:34:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 20:34:59 [DEBUG   ] spawn_process: at 2018-11-15 20:34:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 20:34:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 20:34:59 [DEBUG   ] spawn_process: at 2018-11-15 20:34:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 20:34:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 20:34:59 [DEBUG   ] spawn_process: at 2018-11-15 20:34:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 20:34:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 20:34:59 [DEBUG   ] spawn_process: at 2018-11-15 20:34:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 20:34:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 20:34:59 [DEBUG   ] spawn_process: at 2018-11-15 20:34:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 20:34:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 20:34:59 [DEBUG   ] spawn_process: at 2018-11-15 20:34:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 20:35:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 20:35:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 20:35:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 20:35:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:35:16 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 20:35:16 [WARNING ] (13, 1, 'bot')
2018-11-15 20:35:16 [WARNING ] (13, 1, 'bot')
2018-11-15 20:35:16 [WARNING ] (13, 1, 'bot')
2018-11-15 20:35:16 [WARNING ] (13, 1, 'bot')
2018-11-15 20:35:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:35:16 [DEBUG   ] Finished updating board flags in 0.950 seconds
2018-11-15 20:35:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 20:35:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 20:35:38 [DEBUG   ] Got command BAM from MCS: ref #518582
2018-11-15 20:35:38 [INFO    ] Finished processing BAM request
2018-11-15 20:35:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:35:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518582   8 58437 74138025 A  ERROR'
2018-11-15 20:35:38 [DEBUG   ] Got command BAM from MCS: ref #518583
2018-11-15 20:35:38 [INFO    ] Finished processing BAM request
2018-11-15 20:35:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:35:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518583   8 58437 74138029 A  ERROR'
2018-11-15 20:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 20:35:38 [DEBUG   ] spawn_process: at 2018-11-15 20:35:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 20:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 20:35:38 [DEBUG   ] spawn_process: at 2018-11-15 20:35:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 20:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 20:35:38 [DEBUG   ] spawn_process: at 2018-11-15 20:35:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 20:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 20:35:38 [DEBUG   ] spawn_process: at 2018-11-15 20:35:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 20:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 20:35:38 [DEBUG   ] spawn_process: at 2018-11-15 20:35:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 20:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 20:35:38 [DEBUG   ] spawn_process: at 2018-11-15 20:35:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 20:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 20:35:38 [DEBUG   ] spawn_process: at 2018-11-15 20:35:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 20:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 20:35:38 [DEBUG   ] spawn_process: at 2018-11-15 20:35:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 20:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 20:35:38 [DEBUG   ] spawn_process: at 2018-11-15 20:35:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 20:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 20:35:38 [DEBUG   ] spawn_process: at 2018-11-15 20:35:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 20:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 20:35:38 [DEBUG   ] spawn_process: at 2018-11-15 20:35:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 20:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 20:35:38 [DEBUG   ] spawn_process: at 2018-11-15 20:35:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 20:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 20:35:38 [DEBUG   ] spawn_process: at 2018-11-15 20:35:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 20:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 20:35:38 [DEBUG   ] spawn_process: at 2018-11-15 20:35:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 20:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 20:35:38 [DEBUG   ] spawn_process: at 2018-11-15 20:35:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 20:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 20:35:38 [DEBUG   ] spawn_process: at 2018-11-15 20:35:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 20:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 20:35:38 [DEBUG   ] spawn_process: at 2018-11-15 20:35:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 20:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 20:35:38 [DEBUG   ] spawn_process: at 2018-11-15 20:35:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 20:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 20:35:38 [DEBUG   ] spawn_process: at 2018-11-15 20:35:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 20:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 20:35:38 [DEBUG   ] spawn_process: at 2018-11-15 20:35:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 20:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 20:35:38 [DEBUG   ] spawn_process: at 2018-11-15 20:35:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 20:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 20:35:38 [DEBUG   ] spawn_process: at 2018-11-15 20:35:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 20:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 20:35:38 [DEBUG   ] spawn_process: at 2018-11-15 20:35:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 20:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 20:35:38 [DEBUG   ] spawn_process: at 2018-11-15 20:35:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 20:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 20:35:38 [DEBUG   ] spawn_process: at 2018-11-15 20:35:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 20:35:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 20:35:38 [DEBUG   ] spawn_process: at 2018-11-15 20:35:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 20:35:45 [DEBUG   ] Got command RPT from MCS: ref #518584
2018-11-15 20:35:45 [DEBUG   ] summary = ERROR
2018-11-15 20:35:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518584  13 58437 74145197 A  ERRORERROR'
2018-11-15 20:35:45 [DEBUG   ] Got command RPT from MCS: ref #518585
2018-11-15 20:35:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 20:35:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518585  77 58437 74145198 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 20:35:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 20:36:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:36:17 [DEBUG   ] Got command BAM from MCS: ref #518601
2018-11-15 20:36:17 [INFO    ] Finished processing BAM request
2018-11-15 20:36:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:36:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518601   8 58437 74177025 A  ERROR'
2018-11-15 20:36:17 [DEBUG   ] Got command BAM from MCS: ref #518602
2018-11-15 20:36:17 [INFO    ] Finished processing BAM request
2018-11-15 20:36:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:36:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518602   8 58437 74177029 A  ERROR'
2018-11-15 20:36:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-11-15 20:36:17 [DEBUG   ] Finished updating ant stats in 0.628 seconds
2018-11-15 20:36:17 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 20:36:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 20:36:17 [WARNING ] (13, 1, 'bot')
2018-11-15 20:36:17 [WARNING ] (13, 1, 'bot')
2018-11-15 20:36:17 [WARNING ] (13, 1, 'bot')
2018-11-15 20:36:17 [WARNING ] (13, 1, 'bot')
2018-11-15 20:36:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:36:17 [DEBUG   ] Finished updating board flags in 1.434 seconds
2018-11-15 20:36:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 20:36:17 [DEBUG   ] spawn_process: at 2018-11-15 20:36:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 20:36:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 20:36:17 [DEBUG   ] spawn_process: at 2018-11-15 20:36:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 20:36:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 20:36:17 [DEBUG   ] spawn_process: at 2018-11-15 20:36:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 20:36:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 20:36:17 [DEBUG   ] spawn_process: at 2018-11-15 20:36:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 20:36:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 20:36:17 [DEBUG   ] spawn_process: at 2018-11-15 20:36:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 20:36:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 20:36:17 [DEBUG   ] spawn_process: at 2018-11-15 20:36:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 20:36:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 20:36:17 [DEBUG   ] spawn_process: at 2018-11-15 20:36:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 20:36:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 20:36:17 [DEBUG   ] spawn_process: at 2018-11-15 20:36:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 20:36:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 20:36:17 [DEBUG   ] spawn_process: at 2018-11-15 20:36:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 20:36:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 20:36:17 [DEBUG   ] spawn_process: at 2018-11-15 20:36:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 20:36:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 20:36:17 [DEBUG   ] spawn_process: at 2018-11-15 20:36:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 20:36:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 20:36:17 [DEBUG   ] spawn_process: at 2018-11-15 20:36:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 20:36:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 20:36:17 [DEBUG   ] spawn_process: at 2018-11-15 20:36:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 20:36:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 20:36:17 [DEBUG   ] spawn_process: at 2018-11-15 20:36:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 20:36:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 20:36:17 [DEBUG   ] spawn_process: at 2018-11-15 20:36:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 20:36:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 20:36:17 [DEBUG   ] spawn_process: at 2018-11-15 20:36:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 20:36:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 20:36:17 [DEBUG   ] spawn_process: at 2018-11-15 20:36:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 20:36:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 20:36:17 [DEBUG   ] spawn_process: at 2018-11-15 20:36:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 20:36:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 20:36:17 [DEBUG   ] spawn_process: at 2018-11-15 20:36:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 20:36:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 20:36:17 [DEBUG   ] spawn_process: at 2018-11-15 20:36:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 20:36:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 20:36:17 [DEBUG   ] spawn_process: at 2018-11-15 20:36:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 20:36:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 20:36:17 [DEBUG   ] spawn_process: at 2018-11-15 20:36:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 20:36:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 20:36:17 [DEBUG   ] spawn_process: at 2018-11-15 20:36:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 20:36:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 20:36:17 [DEBUG   ] spawn_process: at 2018-11-15 20:36:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 20:36:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 20:36:17 [DEBUG   ] spawn_process: at 2018-11-15 20:36:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 20:36:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 20:36:17 [DEBUG   ] spawn_process: at 2018-11-15 20:36:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 20:36:37 [DEBUG   ] Finished updating ant stats in 0.571 seconds
2018-11-15 20:36:56 [DEBUG   ] Got command BAM from MCS: ref #518604
2018-11-15 20:36:56 [INFO    ] Finished processing BAM request
2018-11-15 20:36:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:36:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518604   8 58437 74216029 A  ERROR'
2018-11-15 20:36:56 [DEBUG   ] Got command BAM from MCS: ref #518603
2018-11-15 20:36:56 [INFO    ] Finished processing BAM request
2018-11-15 20:36:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:36:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518603   8 58437 74216033 A  ERROR'
2018-11-15 20:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 20:36:56 [DEBUG   ] spawn_process: at 2018-11-15 20:36:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 20:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 20:36:56 [DEBUG   ] spawn_process: at 2018-11-15 20:36:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 20:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 20:36:56 [DEBUG   ] spawn_process: at 2018-11-15 20:36:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 20:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 20:36:56 [DEBUG   ] spawn_process: at 2018-11-15 20:36:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 20:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 20:36:56 [DEBUG   ] spawn_process: at 2018-11-15 20:36:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 20:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 20:36:56 [DEBUG   ] spawn_process: at 2018-11-15 20:36:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 20:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 20:36:56 [DEBUG   ] spawn_process: at 2018-11-15 20:36:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 20:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 20:36:56 [DEBUG   ] spawn_process: at 2018-11-15 20:36:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 20:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 20:36:56 [DEBUG   ] spawn_process: at 2018-11-15 20:36:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 20:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 20:36:56 [DEBUG   ] spawn_process: at 2018-11-15 20:36:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 20:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 20:36:56 [DEBUG   ] spawn_process: at 2018-11-15 20:36:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 20:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 20:36:56 [DEBUG   ] spawn_process: at 2018-11-15 20:36:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 20:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 20:36:56 [DEBUG   ] spawn_process: at 2018-11-15 20:36:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 20:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 20:36:56 [DEBUG   ] spawn_process: at 2018-11-15 20:36:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 20:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 20:36:56 [DEBUG   ] spawn_process: at 2018-11-15 20:36:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 20:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 20:36:56 [DEBUG   ] spawn_process: at 2018-11-15 20:36:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 20:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 20:36:56 [DEBUG   ] spawn_process: at 2018-11-15 20:36:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 20:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 20:36:56 [DEBUG   ] spawn_process: at 2018-11-15 20:36:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 20:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 20:36:56 [DEBUG   ] spawn_process: at 2018-11-15 20:36:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 20:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 20:36:56 [DEBUG   ] spawn_process: at 2018-11-15 20:36:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 20:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 20:36:56 [DEBUG   ] spawn_process: at 2018-11-15 20:36:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 20:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 20:36:56 [DEBUG   ] spawn_process: at 2018-11-15 20:36:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 20:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 20:36:56 [DEBUG   ] spawn_process: at 2018-11-15 20:36:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 20:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 20:36:56 [DEBUG   ] spawn_process: at 2018-11-15 20:36:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 20:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 20:36:56 [DEBUG   ] spawn_process: at 2018-11-15 20:36:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 20:36:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 20:36:56 [DEBUG   ] spawn_process: at 2018-11-15 20:36:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 20:36:57 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 20:37:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:37:17 [DEBUG   ] Finished updating ant stats in 0.429 seconds
2018-11-15 20:37:17 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 20:37:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 20:37:17 [WARNING ] (13, 1, 'bot')
2018-11-15 20:37:17 [WARNING ] (13, 1, 'bot')
2018-11-15 20:37:17 [WARNING ] (13, 1, 'bot')
2018-11-15 20:37:17 [WARNING ] (13, 1, 'bot')
2018-11-15 20:37:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:37:17 [DEBUG   ] Finished updating board flags in 1.320 seconds
2018-11-15 20:37:35 [DEBUG   ] Got command BAM from MCS: ref #518605
2018-11-15 20:37:35 [INFO    ] Finished processing BAM request
2018-11-15 20:37:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518605   8 58437 74255029 A  ERROR'
2018-11-15 20:37:35 [DEBUG   ] Got command BAM from MCS: ref #518606
2018-11-15 20:37:35 [INFO    ] Finished processing BAM request
2018-11-15 20:37:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:37:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518606   8 58437 74255033 A  ERROR'
2018-11-15 20:37:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 20:37:35 [DEBUG   ] spawn_process: at 2018-11-15 20:37:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 20:37:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 20:37:35 [DEBUG   ] spawn_process: at 2018-11-15 20:37:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 20:37:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 20:37:35 [DEBUG   ] spawn_process: at 2018-11-15 20:37:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 20:37:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 20:37:35 [DEBUG   ] spawn_process: at 2018-11-15 20:37:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 20:37:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 20:37:35 [DEBUG   ] spawn_process: at 2018-11-15 20:37:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 20:37:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 20:37:35 [DEBUG   ] spawn_process: at 2018-11-15 20:37:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 20:37:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 20:37:35 [DEBUG   ] spawn_process: at 2018-11-15 20:37:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 20:37:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 20:37:35 [DEBUG   ] spawn_process: at 2018-11-15 20:37:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 20:37:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 20:37:35 [DEBUG   ] spawn_process: at 2018-11-15 20:37:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 20:37:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 20:37:35 [DEBUG   ] spawn_process: at 2018-11-15 20:37:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 20:37:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 20:37:35 [DEBUG   ] spawn_process: at 2018-11-15 20:37:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 20:37:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 20:37:35 [DEBUG   ] spawn_process: at 2018-11-15 20:37:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 20:37:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 20:37:35 [DEBUG   ] spawn_process: at 2018-11-15 20:37:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 20:37:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 20:37:35 [DEBUG   ] spawn_process: at 2018-11-15 20:37:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 20:37:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 20:37:35 [DEBUG   ] spawn_process: at 2018-11-15 20:37:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 20:37:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 20:37:35 [DEBUG   ] spawn_process: at 2018-11-15 20:37:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 20:37:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 20:37:35 [DEBUG   ] spawn_process: at 2018-11-15 20:37:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 20:37:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 20:37:35 [DEBUG   ] spawn_process: at 2018-11-15 20:37:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 20:37:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 20:37:35 [DEBUG   ] spawn_process: at 2018-11-15 20:37:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 20:37:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 20:37:35 [DEBUG   ] spawn_process: at 2018-11-15 20:37:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 20:37:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 20:37:35 [DEBUG   ] spawn_process: at 2018-11-15 20:37:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 20:37:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 20:37:35 [DEBUG   ] spawn_process: at 2018-11-15 20:37:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 20:37:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 20:37:35 [DEBUG   ] spawn_process: at 2018-11-15 20:37:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 20:37:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 20:37:35 [DEBUG   ] spawn_process: at 2018-11-15 20:37:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 20:37:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 20:37:35 [DEBUG   ] spawn_process: at 2018-11-15 20:37:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 20:37:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 20:37:35 [DEBUG   ] spawn_process: at 2018-11-15 20:37:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 20:37:37 [DEBUG   ] Finished updating ant stats in 0.374 seconds
2018-11-15 20:37:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 20:38:14 [DEBUG   ] Got command BAM from MCS: ref #518607
2018-11-15 20:38:14 [INFO    ] Finished processing BAM request
2018-11-15 20:38:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:38:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518607   8 58437 74294029 A  ERROR'
2018-11-15 20:38:14 [DEBUG   ] Got command BAM from MCS: ref #518608
2018-11-15 20:38:14 [INFO    ] Finished processing BAM request
2018-11-15 20:38:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:38:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518608   8 58437 74294033 A  ERROR'
2018-11-15 20:38:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 20:38:14 [DEBUG   ] spawn_process: at 2018-11-15 20:38:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 20:38:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 20:38:14 [DEBUG   ] spawn_process: at 2018-11-15 20:38:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 20:38:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 20:38:14 [DEBUG   ] spawn_process: at 2018-11-15 20:38:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 20:38:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 20:38:14 [DEBUG   ] spawn_process: at 2018-11-15 20:38:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 20:38:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 20:38:14 [DEBUG   ] spawn_process: at 2018-11-15 20:38:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 20:38:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 20:38:14 [DEBUG   ] spawn_process: at 2018-11-15 20:38:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 20:38:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 20:38:14 [DEBUG   ] spawn_process: at 2018-11-15 20:38:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 20:38:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 20:38:14 [DEBUG   ] spawn_process: at 2018-11-15 20:38:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 20:38:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 20:38:14 [DEBUG   ] spawn_process: at 2018-11-15 20:38:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 20:38:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 20:38:14 [DEBUG   ] spawn_process: at 2018-11-15 20:38:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 20:38:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 20:38:14 [DEBUG   ] spawn_process: at 2018-11-15 20:38:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 20:38:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 20:38:14 [DEBUG   ] spawn_process: at 2018-11-15 20:38:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 20:38:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 20:38:14 [DEBUG   ] spawn_process: at 2018-11-15 20:38:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 20:38:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 20:38:14 [DEBUG   ] spawn_process: at 2018-11-15 20:38:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 20:38:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 20:38:14 [DEBUG   ] spawn_process: at 2018-11-15 20:38:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 20:38:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 20:38:14 [DEBUG   ] spawn_process: at 2018-11-15 20:38:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 20:38:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 20:38:14 [DEBUG   ] spawn_process: at 2018-11-15 20:38:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 20:38:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 20:38:14 [DEBUG   ] spawn_process: at 2018-11-15 20:38:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 20:38:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 20:38:14 [DEBUG   ] spawn_process: at 2018-11-15 20:38:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 20:38:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 20:38:14 [DEBUG   ] spawn_process: at 2018-11-15 20:38:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 20:38:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 20:38:14 [DEBUG   ] spawn_process: at 2018-11-15 20:38:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 20:38:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 20:38:14 [DEBUG   ] spawn_process: at 2018-11-15 20:38:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 20:38:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 20:38:14 [DEBUG   ] spawn_process: at 2018-11-15 20:38:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 20:38:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 20:38:14 [DEBUG   ] spawn_process: at 2018-11-15 20:38:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 20:38:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 20:38:14 [DEBUG   ] spawn_process: at 2018-11-15 20:38:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 20:38:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 20:38:14 [DEBUG   ] spawn_process: at 2018-11-15 20:38:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 20:38:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 20:38:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:38:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 20:38:18 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-15 20:38:18 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 20:38:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 20:38:18 [WARNING ] (13, 1, 'bot')
2018-11-15 20:38:18 [WARNING ] (13, 1, 'bot')
2018-11-15 20:38:18 [WARNING ] (13, 1, 'bot')
2018-11-15 20:38:18 [WARNING ] (13, 1, 'bot')
2018-11-15 20:38:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:38:18 [DEBUG   ] Finished updating board flags in 2.337 seconds
2018-11-15 20:38:23 [DEBUG   ] Got command RPT from MCS: ref #518611
2018-11-15 20:38:23 [DEBUG   ] summary = ERROR
2018-11-15 20:38:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518611  13 58437 74303797 A  ERRORERROR'
2018-11-15 20:38:24 [DEBUG   ] Got command RPT from MCS: ref #518612
2018-11-15 20:38:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 20:38:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518612  77 58437 74304001 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 20:38:24 [DEBUG   ] Got command RPT from MCS: ref #518613
2018-11-15 20:38:24 [DEBUG   ] summary = ERROR
2018-11-15 20:38:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518613  13 58437 74304205 A  ERRORERROR'
2018-11-15 20:38:24 [DEBUG   ] Got command RPT from MCS: ref #518615
2018-11-15 20:38:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 20:38:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518615  77 58437 74304397 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 20:38:24 [DEBUG   ] Got command RPT from MCS: ref #518616
2018-11-15 20:38:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 20:38:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518616  12 58437 74304601 A  ERRORB¢ff'
2018-11-15 20:38:38 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-15 20:38:53 [DEBUG   ] Got command BAM from MCS: ref #518625
2018-11-15 20:38:53 [INFO    ] Finished processing BAM request
2018-11-15 20:38:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:38:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518625   8 58437 74333033 A  ERROR'
2018-11-15 20:38:53 [DEBUG   ] Got command BAM from MCS: ref #518626
2018-11-15 20:38:53 [INFO    ] Finished processing BAM request
2018-11-15 20:38:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:38:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518626   8 58437 74333037 A  ERROR'
2018-11-15 20:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 20:38:53 [DEBUG   ] spawn_process: at 2018-11-15 20:38:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 20:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 20:38:53 [DEBUG   ] spawn_process: at 2018-11-15 20:38:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 20:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 20:38:53 [DEBUG   ] spawn_process: at 2018-11-15 20:38:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 20:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 20:38:53 [DEBUG   ] spawn_process: at 2018-11-15 20:38:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 20:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 20:38:53 [DEBUG   ] spawn_process: at 2018-11-15 20:38:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 20:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 20:38:53 [DEBUG   ] spawn_process: at 2018-11-15 20:38:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 20:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 20:38:53 [DEBUG   ] spawn_process: at 2018-11-15 20:38:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 20:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 20:38:53 [DEBUG   ] spawn_process: at 2018-11-15 20:38:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 20:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 20:38:53 [DEBUG   ] spawn_process: at 2018-11-15 20:38:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 20:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 20:38:53 [DEBUG   ] spawn_process: at 2018-11-15 20:38:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 20:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 20:38:53 [DEBUG   ] spawn_process: at 2018-11-15 20:38:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 20:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 20:38:53 [DEBUG   ] spawn_process: at 2018-11-15 20:38:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 20:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 20:38:53 [DEBUG   ] spawn_process: at 2018-11-15 20:38:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 20:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 20:38:53 [DEBUG   ] spawn_process: at 2018-11-15 20:38:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 20:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 20:38:53 [DEBUG   ] spawn_process: at 2018-11-15 20:38:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 20:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 20:38:53 [DEBUG   ] spawn_process: at 2018-11-15 20:38:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 20:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 20:38:53 [DEBUG   ] spawn_process: at 2018-11-15 20:38:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 20:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 20:38:53 [DEBUG   ] spawn_process: at 2018-11-15 20:38:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 20:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 20:38:53 [DEBUG   ] spawn_process: at 2018-11-15 20:38:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 20:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 20:38:53 [DEBUG   ] spawn_process: at 2018-11-15 20:38:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 20:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 20:38:53 [DEBUG   ] spawn_process: at 2018-11-15 20:38:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 20:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 20:38:53 [DEBUG   ] spawn_process: at 2018-11-15 20:38:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 20:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 20:38:53 [DEBUG   ] spawn_process: at 2018-11-15 20:38:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 20:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 20:38:53 [DEBUG   ] spawn_process: at 2018-11-15 20:38:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 20:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 20:38:53 [DEBUG   ] spawn_process: at 2018-11-15 20:38:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 20:38:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 20:38:53 [DEBUG   ] spawn_process: at 2018-11-15 20:38:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 20:38:58 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 20:39:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:39:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-11-15 20:39:18 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 20:39:18 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-15 20:39:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 20:39:18 [WARNING ] (13, 1, 'bot')
2018-11-15 20:39:18 [WARNING ] (13, 1, 'bot')
2018-11-15 20:39:18 [WARNING ] (13, 1, 'bot')
2018-11-15 20:39:18 [WARNING ] (13, 1, 'bot')
2018-11-15 20:39:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:39:18 [DEBUG   ] Finished updating board flags in 2.009 seconds
2018-11-15 20:39:32 [DEBUG   ] Got command BAM from MCS: ref #518628
2018-11-15 20:39:32 [INFO    ] Finished processing BAM request
2018-11-15 20:39:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:39:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518628   8 58437 74372033 A  ERROR'
2018-11-15 20:39:32 [DEBUG   ] Got command BAM from MCS: ref #518627
2018-11-15 20:39:32 [INFO    ] Finished processing BAM request
2018-11-15 20:39:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:39:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518627   8 58437 74372037 A  ERROR'
2018-11-15 20:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 20:39:32 [DEBUG   ] spawn_process: at 2018-11-15 20:39:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 20:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 20:39:32 [DEBUG   ] spawn_process: at 2018-11-15 20:39:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 20:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 20:39:32 [DEBUG   ] spawn_process: at 2018-11-15 20:39:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 20:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 20:39:32 [DEBUG   ] spawn_process: at 2018-11-15 20:39:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 20:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 20:39:32 [DEBUG   ] spawn_process: at 2018-11-15 20:39:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 20:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 20:39:32 [DEBUG   ] spawn_process: at 2018-11-15 20:39:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 20:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 20:39:32 [DEBUG   ] spawn_process: at 2018-11-15 20:39:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 20:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 20:39:32 [DEBUG   ] spawn_process: at 2018-11-15 20:39:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 20:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 20:39:32 [DEBUG   ] spawn_process: at 2018-11-15 20:39:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 20:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 20:39:32 [DEBUG   ] spawn_process: at 2018-11-15 20:39:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 20:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 20:39:32 [DEBUG   ] spawn_process: at 2018-11-15 20:39:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 20:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 20:39:32 [DEBUG   ] spawn_process: at 2018-11-15 20:39:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 20:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 20:39:32 [DEBUG   ] spawn_process: at 2018-11-15 20:39:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 20:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 20:39:32 [DEBUG   ] spawn_process: at 2018-11-15 20:39:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 20:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 20:39:32 [DEBUG   ] spawn_process: at 2018-11-15 20:39:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 20:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 20:39:32 [DEBUG   ] spawn_process: at 2018-11-15 20:39:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 20:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 20:39:32 [DEBUG   ] spawn_process: at 2018-11-15 20:39:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 20:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 20:39:32 [DEBUG   ] spawn_process: at 2018-11-15 20:39:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 20:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 20:39:32 [DEBUG   ] spawn_process: at 2018-11-15 20:39:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 20:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 20:39:32 [DEBUG   ] spawn_process: at 2018-11-15 20:39:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 20:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 20:39:32 [DEBUG   ] spawn_process: at 2018-11-15 20:39:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 20:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 20:39:32 [DEBUG   ] spawn_process: at 2018-11-15 20:39:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 20:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 20:39:32 [DEBUG   ] spawn_process: at 2018-11-15 20:39:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 20:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 20:39:32 [DEBUG   ] spawn_process: at 2018-11-15 20:39:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 20:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 20:39:32 [DEBUG   ] spawn_process: at 2018-11-15 20:39:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 20:39:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 20:39:32 [DEBUG   ] spawn_process: at 2018-11-15 20:39:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 20:39:38 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-15 20:39:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 20:40:11 [DEBUG   ] Got command BAM from MCS: ref #518630
2018-11-15 20:40:11 [INFO    ] Finished processing BAM request
2018-11-15 20:40:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:40:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518630   8 58437 74411025 A  ERROR'
2018-11-15 20:40:11 [DEBUG   ] Got command BAM from MCS: ref #518629
2018-11-15 20:40:11 [INFO    ] Finished processing BAM request
2018-11-15 20:40:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:40:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518629   8 58437 74411029 A  ERROR'
2018-11-15 20:40:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 20:40:11 [DEBUG   ] spawn_process: at 2018-11-15 20:40:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 20:40:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 20:40:11 [DEBUG   ] spawn_process: at 2018-11-15 20:40:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 20:40:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 20:40:11 [DEBUG   ] spawn_process: at 2018-11-15 20:40:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 20:40:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 20:40:11 [DEBUG   ] spawn_process: at 2018-11-15 20:40:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 20:40:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 20:40:11 [DEBUG   ] spawn_process: at 2018-11-15 20:40:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 20:40:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 20:40:11 [DEBUG   ] spawn_process: at 2018-11-15 20:40:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 20:40:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 20:40:11 [DEBUG   ] spawn_process: at 2018-11-15 20:40:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 20:40:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 20:40:11 [DEBUG   ] spawn_process: at 2018-11-15 20:40:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 20:40:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 20:40:11 [DEBUG   ] spawn_process: at 2018-11-15 20:40:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 20:40:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 20:40:11 [DEBUG   ] spawn_process: at 2018-11-15 20:40:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 20:40:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 20:40:11 [DEBUG   ] spawn_process: at 2018-11-15 20:40:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 20:40:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 20:40:11 [DEBUG   ] spawn_process: at 2018-11-15 20:40:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 20:40:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 20:40:11 [DEBUG   ] spawn_process: at 2018-11-15 20:40:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 20:40:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 20:40:11 [DEBUG   ] spawn_process: at 2018-11-15 20:40:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 20:40:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 20:40:11 [DEBUG   ] spawn_process: at 2018-11-15 20:40:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 20:40:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 20:40:11 [DEBUG   ] spawn_process: at 2018-11-15 20:40:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 20:40:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 20:40:11 [DEBUG   ] spawn_process: at 2018-11-15 20:40:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 20:40:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 20:40:11 [DEBUG   ] spawn_process: at 2018-11-15 20:40:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 20:40:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 20:40:11 [DEBUG   ] spawn_process: at 2018-11-15 20:40:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 20:40:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 20:40:11 [DEBUG   ] spawn_process: at 2018-11-15 20:40:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 20:40:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 20:40:11 [DEBUG   ] spawn_process: at 2018-11-15 20:40:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 20:40:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 20:40:11 [DEBUG   ] spawn_process: at 2018-11-15 20:40:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 20:40:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 20:40:11 [DEBUG   ] spawn_process: at 2018-11-15 20:40:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 20:40:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 20:40:11 [DEBUG   ] spawn_process: at 2018-11-15 20:40:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 20:40:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 20:40:11 [DEBUG   ] spawn_process: at 2018-11-15 20:40:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 20:40:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 20:40:11 [DEBUG   ] spawn_process: at 2018-11-15 20:40:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 20:40:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-15 20:40:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:40:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-15 20:40:17 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 20:40:17 [WARNING ] (13, 1, 'bot')
2018-11-15 20:40:17 [WARNING ] (13, 1, 'bot')
2018-11-15 20:40:17 [WARNING ] (13, 1, 'bot')
2018-11-15 20:40:17 [WARNING ] (13, 1, 'bot')
2018-11-15 20:40:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:40:17 [DEBUG   ] Finished updating board flags in 1.035 seconds
2018-11-15 20:40:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 20:40:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 20:40:45 [DEBUG   ] Got command RPT from MCS: ref #518631
2018-11-15 20:40:45 [DEBUG   ] summary = ERROR
2018-11-15 20:40:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518631  13 58437 74445189 A  ERRORERROR'
2018-11-15 20:40:45 [DEBUG   ] Got command RPT from MCS: ref #518632
2018-11-15 20:40:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 20:40:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518632  77 58437 74445190 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 20:40:50 [DEBUG   ] Got command BAM from MCS: ref #518648
2018-11-15 20:40:50 [INFO    ] Finished processing BAM request
2018-11-15 20:40:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:40:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518648   8 58437 74450029 A  ERROR'
2018-11-15 20:40:50 [DEBUG   ] Got command BAM from MCS: ref #518649
2018-11-15 20:40:50 [INFO    ] Finished processing BAM request
2018-11-15 20:40:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:40:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518649   8 58437 74450033 A  ERROR'
2018-11-15 20:40:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 20:40:50 [DEBUG   ] spawn_process: at 2018-11-15 20:40:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 20:40:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 20:40:50 [DEBUG   ] spawn_process: at 2018-11-15 20:40:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 20:40:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 20:40:50 [DEBUG   ] spawn_process: at 2018-11-15 20:40:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 20:40:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 20:40:50 [DEBUG   ] spawn_process: at 2018-11-15 20:40:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 20:40:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 20:40:50 [DEBUG   ] spawn_process: at 2018-11-15 20:40:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 20:40:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 20:40:50 [DEBUG   ] spawn_process: at 2018-11-15 20:40:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 20:40:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 20:40:50 [DEBUG   ] spawn_process: at 2018-11-15 20:40:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 20:40:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 20:40:50 [DEBUG   ] spawn_process: at 2018-11-15 20:40:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 20:40:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 20:40:50 [DEBUG   ] spawn_process: at 2018-11-15 20:40:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 20:40:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 20:40:50 [DEBUG   ] spawn_process: at 2018-11-15 20:40:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 20:40:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 20:40:50 [DEBUG   ] spawn_process: at 2018-11-15 20:40:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 20:40:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 20:40:50 [DEBUG   ] spawn_process: at 2018-11-15 20:40:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 20:40:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 20:40:50 [DEBUG   ] spawn_process: at 2018-11-15 20:40:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 20:40:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 20:40:50 [DEBUG   ] spawn_process: at 2018-11-15 20:40:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 20:40:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 20:40:50 [DEBUG   ] spawn_process: at 2018-11-15 20:40:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 20:40:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 20:40:50 [DEBUG   ] spawn_process: at 2018-11-15 20:40:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 20:40:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 20:40:50 [DEBUG   ] spawn_process: at 2018-11-15 20:40:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 20:40:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 20:40:50 [DEBUG   ] spawn_process: at 2018-11-15 20:40:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 20:40:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 20:40:50 [DEBUG   ] spawn_process: at 2018-11-15 20:40:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 20:40:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 20:40:50 [DEBUG   ] spawn_process: at 2018-11-15 20:40:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 20:40:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 20:40:50 [DEBUG   ] spawn_process: at 2018-11-15 20:40:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 20:40:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 20:40:50 [DEBUG   ] spawn_process: at 2018-11-15 20:40:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 20:40:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 20:40:50 [DEBUG   ] spawn_process: at 2018-11-15 20:40:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 20:40:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 20:40:50 [DEBUG   ] spawn_process: at 2018-11-15 20:40:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 20:40:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 20:40:50 [DEBUG   ] spawn_process: at 2018-11-15 20:40:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 20:40:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 20:40:50 [DEBUG   ] spawn_process: at 2018-11-15 20:40:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 20:40:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 20:41:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 20:41:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:41:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 20:41:17 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 20:41:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 20:41:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2018-11-15 20:41:17 [WARNING ] (13, 1, 'bot')
2018-11-15 20:41:17 [WARNING ] (13, 1, 'bot')
2018-11-15 20:41:17 [WARNING ] (13, 1, 'bot')
2018-11-15 20:41:17 [WARNING ] (13, 1, 'bot')
2018-11-15 20:41:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:41:17 [DEBUG   ] Finished updating board flags in 1.003 seconds
2018-11-15 20:41:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 20:41:29 [DEBUG   ] Got command BAM from MCS: ref #518651
2018-11-15 20:41:29 [INFO    ] Finished processing BAM request
2018-11-15 20:41:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:41:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518651   8 58437 74489025 A  ERROR'
2018-11-15 20:41:29 [DEBUG   ] Got command BAM from MCS: ref #518650
2018-11-15 20:41:29 [INFO    ] Finished processing BAM request
2018-11-15 20:41:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:41:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518650   8 58437 74489029 A  ERROR'
2018-11-15 20:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 20:41:29 [DEBUG   ] spawn_process: at 2018-11-15 20:41:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 20:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 20:41:29 [DEBUG   ] spawn_process: at 2018-11-15 20:41:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 20:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 20:41:29 [DEBUG   ] spawn_process: at 2018-11-15 20:41:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 20:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 20:41:29 [DEBUG   ] spawn_process: at 2018-11-15 20:41:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 20:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 20:41:29 [DEBUG   ] spawn_process: at 2018-11-15 20:41:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 20:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 20:41:29 [DEBUG   ] spawn_process: at 2018-11-15 20:41:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 20:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 20:41:29 [DEBUG   ] spawn_process: at 2018-11-15 20:41:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 20:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 20:41:29 [DEBUG   ] spawn_process: at 2018-11-15 20:41:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 20:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 20:41:29 [DEBUG   ] spawn_process: at 2018-11-15 20:41:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 20:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 20:41:29 [DEBUG   ] spawn_process: at 2018-11-15 20:41:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 20:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 20:41:29 [DEBUG   ] spawn_process: at 2018-11-15 20:41:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 20:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 20:41:29 [DEBUG   ] spawn_process: at 2018-11-15 20:41:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 20:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 20:41:29 [DEBUG   ] spawn_process: at 2018-11-15 20:41:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 20:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 20:41:29 [DEBUG   ] spawn_process: at 2018-11-15 20:41:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 20:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 20:41:29 [DEBUG   ] spawn_process: at 2018-11-15 20:41:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 20:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 20:41:29 [DEBUG   ] spawn_process: at 2018-11-15 20:41:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 20:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 20:41:29 [DEBUG   ] spawn_process: at 2018-11-15 20:41:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 20:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 20:41:29 [DEBUG   ] spawn_process: at 2018-11-15 20:41:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 20:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 20:41:29 [DEBUG   ] spawn_process: at 2018-11-15 20:41:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 20:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 20:41:29 [DEBUG   ] spawn_process: at 2018-11-15 20:41:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 20:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 20:41:29 [DEBUG   ] spawn_process: at 2018-11-15 20:41:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 20:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 20:41:29 [DEBUG   ] spawn_process: at 2018-11-15 20:41:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 20:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 20:41:29 [DEBUG   ] spawn_process: at 2018-11-15 20:41:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 20:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 20:41:29 [DEBUG   ] spawn_process: at 2018-11-15 20:41:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 20:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 20:41:29 [DEBUG   ] spawn_process: at 2018-11-15 20:41:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 20:41:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 20:41:29 [DEBUG   ] spawn_process: at 2018-11-15 20:41:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 20:41:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 20:41:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 20:42:08 [DEBUG   ] Got command BAM from MCS: ref #518657
2018-11-15 20:42:08 [INFO    ] Finished processing BAM request
2018-11-15 20:42:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:42:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518657   8 58437 74528029 A  ERROR'
2018-11-15 20:42:08 [DEBUG   ] Got command BAM from MCS: ref #518656
2018-11-15 20:42:08 [INFO    ] Finished processing BAM request
2018-11-15 20:42:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:42:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518656   8 58437 74528033 A  ERROR'
2018-11-15 20:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 20:42:08 [DEBUG   ] spawn_process: at 2018-11-15 20:42:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 20:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 20:42:08 [DEBUG   ] spawn_process: at 2018-11-15 20:42:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 20:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 20:42:08 [DEBUG   ] spawn_process: at 2018-11-15 20:42:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 20:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 20:42:08 [DEBUG   ] spawn_process: at 2018-11-15 20:42:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 20:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 20:42:08 [DEBUG   ] spawn_process: at 2018-11-15 20:42:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 20:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 20:42:08 [DEBUG   ] spawn_process: at 2018-11-15 20:42:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 20:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 20:42:08 [DEBUG   ] spawn_process: at 2018-11-15 20:42:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 20:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 20:42:08 [DEBUG   ] spawn_process: at 2018-11-15 20:42:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 20:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 20:42:08 [DEBUG   ] spawn_process: at 2018-11-15 20:42:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 20:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 20:42:08 [DEBUG   ] spawn_process: at 2018-11-15 20:42:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 20:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 20:42:08 [DEBUG   ] spawn_process: at 2018-11-15 20:42:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 20:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 20:42:08 [DEBUG   ] spawn_process: at 2018-11-15 20:42:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 20:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 20:42:08 [DEBUG   ] spawn_process: at 2018-11-15 20:42:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 20:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 20:42:08 [DEBUG   ] spawn_process: at 2018-11-15 20:42:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 20:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 20:42:08 [DEBUG   ] spawn_process: at 2018-11-15 20:42:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 20:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 20:42:08 [DEBUG   ] spawn_process: at 2018-11-15 20:42:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 20:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 20:42:08 [DEBUG   ] spawn_process: at 2018-11-15 20:42:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 20:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 20:42:08 [DEBUG   ] spawn_process: at 2018-11-15 20:42:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 20:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 20:42:08 [DEBUG   ] spawn_process: at 2018-11-15 20:42:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 20:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 20:42:08 [DEBUG   ] spawn_process: at 2018-11-15 20:42:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 20:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 20:42:08 [DEBUG   ] spawn_process: at 2018-11-15 20:42:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 20:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 20:42:08 [DEBUG   ] spawn_process: at 2018-11-15 20:42:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 20:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 20:42:08 [DEBUG   ] spawn_process: at 2018-11-15 20:42:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 20:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 20:42:08 [DEBUG   ] spawn_process: at 2018-11-15 20:42:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 20:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 20:42:08 [DEBUG   ] spawn_process: at 2018-11-15 20:42:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 20:42:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 20:42:08 [DEBUG   ] spawn_process: at 2018-11-15 20:42:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 20:42:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-15 20:42:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:42:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 20:42:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-11-15 20:42:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-15 20:42:17 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 20:42:17 [WARNING ] (13, 1, 'bot')
2018-11-15 20:42:17 [WARNING ] (13, 1, 'bot')
2018-11-15 20:42:17 [WARNING ] (13, 1, 'bot')
2018-11-15 20:42:17 [WARNING ] (13, 1, 'bot')
2018-11-15 20:42:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:42:17 [DEBUG   ] Finished updating board flags in 1.012 seconds
2018-11-15 20:42:18 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-15 20:42:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 20:42:47 [DEBUG   ] Got command BAM from MCS: ref #518659
2018-11-15 20:42:47 [INFO    ] Finished processing BAM request
2018-11-15 20:42:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:42:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518659   8 58437 74567033 A  ERROR'
2018-11-15 20:42:47 [DEBUG   ] Got command BAM from MCS: ref #518658
2018-11-15 20:42:47 [INFO    ] Finished processing BAM request
2018-11-15 20:42:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:42:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518658   8 58437 74567037 A  ERROR'
2018-11-15 20:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 20:42:47 [DEBUG   ] spawn_process: at 2018-11-15 20:42:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 20:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 20:42:47 [DEBUG   ] spawn_process: at 2018-11-15 20:42:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 20:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 20:42:47 [DEBUG   ] spawn_process: at 2018-11-15 20:42:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 20:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 20:42:47 [DEBUG   ] spawn_process: at 2018-11-15 20:42:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 20:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 20:42:47 [DEBUG   ] spawn_process: at 2018-11-15 20:42:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 20:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 20:42:47 [DEBUG   ] spawn_process: at 2018-11-15 20:42:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 20:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 20:42:47 [DEBUG   ] spawn_process: at 2018-11-15 20:42:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 20:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 20:42:47 [DEBUG   ] spawn_process: at 2018-11-15 20:42:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 20:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 20:42:47 [DEBUG   ] spawn_process: at 2018-11-15 20:42:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 20:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 20:42:47 [DEBUG   ] spawn_process: at 2018-11-15 20:42:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 20:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 20:42:47 [DEBUG   ] spawn_process: at 2018-11-15 20:42:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 20:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 20:42:47 [DEBUG   ] spawn_process: at 2018-11-15 20:42:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 20:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 20:42:47 [DEBUG   ] spawn_process: at 2018-11-15 20:42:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 20:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 20:42:47 [DEBUG   ] spawn_process: at 2018-11-15 20:42:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 20:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 20:42:47 [DEBUG   ] spawn_process: at 2018-11-15 20:42:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 20:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 20:42:47 [DEBUG   ] spawn_process: at 2018-11-15 20:42:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 20:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 20:42:47 [DEBUG   ] spawn_process: at 2018-11-15 20:42:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 20:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 20:42:47 [DEBUG   ] spawn_process: at 2018-11-15 20:42:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 20:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 20:42:47 [DEBUG   ] spawn_process: at 2018-11-15 20:42:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 20:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 20:42:47 [DEBUG   ] spawn_process: at 2018-11-15 20:42:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 20:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 20:42:47 [DEBUG   ] spawn_process: at 2018-11-15 20:42:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 20:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 20:42:47 [DEBUG   ] spawn_process: at 2018-11-15 20:42:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 20:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 20:42:47 [DEBUG   ] spawn_process: at 2018-11-15 20:42:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 20:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 20:42:47 [DEBUG   ] spawn_process: at 2018-11-15 20:42:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 20:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 20:42:47 [DEBUG   ] spawn_process: at 2018-11-15 20:42:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 20:42:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 20:42:47 [DEBUG   ] spawn_process: at 2018-11-15 20:42:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 20:42:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 20:43:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:43:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-15 20:43:17 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-15 20:43:17 [WARNING ] (13, 1, 'bot')
2018-11-15 20:43:17 [WARNING ] (13, 1, 'bot')
2018-11-15 20:43:17 [WARNING ] (13, 1, 'bot')
2018-11-15 20:43:17 [WARNING ] (13, 1, 'bot')
2018-11-15 20:43:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:43:17 [DEBUG   ] Finished updating board flags in 1.002 seconds
2018-11-15 20:43:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 20:43:23 [DEBUG   ] Got command RPT from MCS: ref #518660
2018-11-15 20:43:23 [DEBUG   ] summary = ERROR
2018-11-15 20:43:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518660  13 58437 74603881 A  ERRORERROR'
2018-11-15 20:43:24 [DEBUG   ] Got command RPT from MCS: ref #518661
2018-11-15 20:43:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 20:43:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518661  77 58437 74604085 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 20:43:24 [DEBUG   ] Got command RPT from MCS: ref #518662
2018-11-15 20:43:24 [DEBUG   ] summary = ERROR
2018-11-15 20:43:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518662  13 58437 74604289 A  ERRORERROR'
2018-11-15 20:43:24 [DEBUG   ] Got command RPT from MCS: ref #518663
2018-11-15 20:43:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 20:43:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518663  77 58437 74604493 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 20:43:24 [DEBUG   ] Got command RPT from MCS: ref #518664
2018-11-15 20:43:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 20:43:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518664  12 58437 74604685 A  ERRORB¡ff'
2018-11-15 20:43:26 [DEBUG   ] Got command BAM from MCS: ref #518665
2018-11-15 20:43:26 [INFO    ] Finished processing BAM request
2018-11-15 20:43:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:43:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518665   8 58437 74606033 A  ERROR'
2018-11-15 20:43:26 [DEBUG   ] Got command BAM from MCS: ref #518666
2018-11-15 20:43:26 [INFO    ] Finished processing BAM request
2018-11-15 20:43:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:43:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518666   8 58437 74606037 A  ERROR'
2018-11-15 20:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 20:43:26 [DEBUG   ] spawn_process: at 2018-11-15 20:43:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 20:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 20:43:26 [DEBUG   ] spawn_process: at 2018-11-15 20:43:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 20:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 20:43:26 [DEBUG   ] spawn_process: at 2018-11-15 20:43:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 20:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 20:43:26 [DEBUG   ] spawn_process: at 2018-11-15 20:43:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 20:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 20:43:26 [DEBUG   ] spawn_process: at 2018-11-15 20:43:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 20:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 20:43:26 [DEBUG   ] spawn_process: at 2018-11-15 20:43:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 20:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 20:43:26 [DEBUG   ] spawn_process: at 2018-11-15 20:43:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 20:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 20:43:26 [DEBUG   ] spawn_process: at 2018-11-15 20:43:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 20:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 20:43:26 [DEBUG   ] spawn_process: at 2018-11-15 20:43:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 20:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 20:43:26 [DEBUG   ] spawn_process: at 2018-11-15 20:43:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 20:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 20:43:26 [DEBUG   ] spawn_process: at 2018-11-15 20:43:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 20:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 20:43:26 [DEBUG   ] spawn_process: at 2018-11-15 20:43:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 20:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 20:43:26 [DEBUG   ] spawn_process: at 2018-11-15 20:43:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 20:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 20:43:26 [DEBUG   ] spawn_process: at 2018-11-15 20:43:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 20:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 20:43:26 [DEBUG   ] spawn_process: at 2018-11-15 20:43:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 20:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 20:43:26 [DEBUG   ] spawn_process: at 2018-11-15 20:43:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 20:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 20:43:26 [DEBUG   ] spawn_process: at 2018-11-15 20:43:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 20:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 20:43:26 [DEBUG   ] spawn_process: at 2018-11-15 20:43:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 20:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 20:43:26 [DEBUG   ] spawn_process: at 2018-11-15 20:43:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 20:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 20:43:26 [DEBUG   ] spawn_process: at 2018-11-15 20:43:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 20:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 20:43:26 [DEBUG   ] spawn_process: at 2018-11-15 20:43:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 20:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 20:43:26 [DEBUG   ] spawn_process: at 2018-11-15 20:43:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 20:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 20:43:26 [DEBUG   ] spawn_process: at 2018-11-15 20:43:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 20:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 20:43:26 [DEBUG   ] spawn_process: at 2018-11-15 20:43:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 20:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 20:43:26 [DEBUG   ] spawn_process: at 2018-11-15 20:43:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 20:43:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 20:43:26 [DEBUG   ] spawn_process: at 2018-11-15 20:43:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 20:43:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 20:43:58 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-15 20:44:05 [DEBUG   ] Got command BAM from MCS: ref #518668
2018-11-15 20:44:05 [INFO    ] Finished processing BAM request
2018-11-15 20:44:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:44:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518668   8 58437 74645033 A  ERROR'
2018-11-15 20:44:05 [DEBUG   ] Got command BAM from MCS: ref #518667
2018-11-15 20:44:05 [INFO    ] Finished processing BAM request
2018-11-15 20:44:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:44:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518667   8 58437 74645037 A  ERROR'
2018-11-15 20:44:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 20:44:05 [DEBUG   ] spawn_process: at 2018-11-15 20:44:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 20:44:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 20:44:05 [DEBUG   ] spawn_process: at 2018-11-15 20:44:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 20:44:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 20:44:05 [DEBUG   ] spawn_process: at 2018-11-15 20:44:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 20:44:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 20:44:05 [DEBUG   ] spawn_process: at 2018-11-15 20:44:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 20:44:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 20:44:05 [DEBUG   ] spawn_process: at 2018-11-15 20:44:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 20:44:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 20:44:05 [DEBUG   ] spawn_process: at 2018-11-15 20:44:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 20:44:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 20:44:05 [DEBUG   ] spawn_process: at 2018-11-15 20:44:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 20:44:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 20:44:05 [DEBUG   ] spawn_process: at 2018-11-15 20:44:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 20:44:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 20:44:05 [DEBUG   ] spawn_process: at 2018-11-15 20:44:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 20:44:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 20:44:05 [DEBUG   ] spawn_process: at 2018-11-15 20:44:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 20:44:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 20:44:05 [DEBUG   ] spawn_process: at 2018-11-15 20:44:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 20:44:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 20:44:05 [DEBUG   ] spawn_process: at 2018-11-15 20:44:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 20:44:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 20:44:05 [DEBUG   ] spawn_process: at 2018-11-15 20:44:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 20:44:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 20:44:05 [DEBUG   ] spawn_process: at 2018-11-15 20:44:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 20:44:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 20:44:05 [DEBUG   ] spawn_process: at 2018-11-15 20:44:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 20:44:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 20:44:05 [DEBUG   ] spawn_process: at 2018-11-15 20:44:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 20:44:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 20:44:05 [DEBUG   ] spawn_process: at 2018-11-15 20:44:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 20:44:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 20:44:05 [DEBUG   ] spawn_process: at 2018-11-15 20:44:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 20:44:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 20:44:05 [DEBUG   ] spawn_process: at 2018-11-15 20:44:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 20:44:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 20:44:05 [DEBUG   ] spawn_process: at 2018-11-15 20:44:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 20:44:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 20:44:05 [DEBUG   ] spawn_process: at 2018-11-15 20:44:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 20:44:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 20:44:05 [DEBUG   ] spawn_process: at 2018-11-15 20:44:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 20:44:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 20:44:05 [DEBUG   ] spawn_process: at 2018-11-15 20:44:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 20:44:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 20:44:05 [DEBUG   ] spawn_process: at 2018-11-15 20:44:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 20:44:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 20:44:05 [DEBUG   ] spawn_process: at 2018-11-15 20:44:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 20:44:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 20:44:05 [DEBUG   ] spawn_process: at 2018-11-15 20:44:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 20:44:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-15 20:44:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:44:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 20:44:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-11-15 20:44:17 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-15 20:44:17 [WARNING ] (13, 1, 'bot')
2018-11-15 20:44:17 [WARNING ] (13, 1, 'bot')
2018-11-15 20:44:17 [WARNING ] (13, 1, 'bot')
2018-11-15 20:44:17 [WARNING ] (13, 1, 'bot')
2018-11-15 20:44:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:44:17 [DEBUG   ] Finished updating board flags in 0.984 seconds
2018-11-15 20:44:18 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 20:44:38 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 20:44:44 [DEBUG   ] Got command BAM from MCS: ref #518673
2018-11-15 20:44:44 [INFO    ] Finished processing BAM request
2018-11-15 20:44:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:44:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518673   8 58437 74684025 A  ERROR'
2018-11-15 20:44:44 [DEBUG   ] Got command BAM from MCS: ref #518674
2018-11-15 20:44:44 [INFO    ] Finished processing BAM request
2018-11-15 20:44:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:44:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518674   8 58437 74684029 A  ERROR'
2018-11-15 20:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 20:44:44 [DEBUG   ] spawn_process: at 2018-11-15 20:44:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 20:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 20:44:44 [DEBUG   ] spawn_process: at 2018-11-15 20:44:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 20:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 20:44:44 [DEBUG   ] spawn_process: at 2018-11-15 20:44:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 20:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 20:44:44 [DEBUG   ] spawn_process: at 2018-11-15 20:44:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 20:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 20:44:44 [DEBUG   ] spawn_process: at 2018-11-15 20:44:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 20:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 20:44:44 [DEBUG   ] spawn_process: at 2018-11-15 20:44:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 20:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 20:44:44 [DEBUG   ] spawn_process: at 2018-11-15 20:44:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 20:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 20:44:44 [DEBUG   ] spawn_process: at 2018-11-15 20:44:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 20:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 20:44:44 [DEBUG   ] spawn_process: at 2018-11-15 20:44:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 20:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 20:44:44 [DEBUG   ] spawn_process: at 2018-11-15 20:44:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 20:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 20:44:44 [DEBUG   ] spawn_process: at 2018-11-15 20:44:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 20:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 20:44:44 [DEBUG   ] spawn_process: at 2018-11-15 20:44:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 20:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 20:44:44 [DEBUG   ] spawn_process: at 2018-11-15 20:44:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 20:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 20:44:44 [DEBUG   ] spawn_process: at 2018-11-15 20:44:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 20:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 20:44:44 [DEBUG   ] spawn_process: at 2018-11-15 20:44:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 20:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 20:44:44 [DEBUG   ] spawn_process: at 2018-11-15 20:44:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 20:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 20:44:44 [DEBUG   ] spawn_process: at 2018-11-15 20:44:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 20:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 20:44:44 [DEBUG   ] spawn_process: at 2018-11-15 20:44:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 20:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 20:44:44 [DEBUG   ] spawn_process: at 2018-11-15 20:44:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 20:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 20:44:44 [DEBUG   ] spawn_process: at 2018-11-15 20:44:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 20:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 20:44:44 [DEBUG   ] spawn_process: at 2018-11-15 20:44:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 20:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 20:44:44 [DEBUG   ] spawn_process: at 2018-11-15 20:44:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 20:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 20:44:44 [DEBUG   ] spawn_process: at 2018-11-15 20:44:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 20:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 20:44:44 [DEBUG   ] spawn_process: at 2018-11-15 20:44:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 20:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 20:44:44 [DEBUG   ] spawn_process: at 2018-11-15 20:44:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 20:44:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 20:44:44 [DEBUG   ] spawn_process: at 2018-11-15 20:44:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 20:44:58 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 20:45:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-11-15 20:45:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:45:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 20:45:18 [DEBUG   ] Finished updating ant stats in 0.424 seconds
2018-11-15 20:45:18 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 20:45:18 [WARNING ] (13, 1, 'bot')
2018-11-15 20:45:18 [WARNING ] (13, 1, 'bot')
2018-11-15 20:45:18 [WARNING ] (13, 1, 'bot')
2018-11-15 20:45:18 [WARNING ] (13, 1, 'bot')
2018-11-15 20:45:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:45:18 [DEBUG   ] Finished updating board flags in 1.878 seconds
2018-11-15 20:45:23 [DEBUG   ] Got command BAM from MCS: ref #518675
2018-11-15 20:45:23 [INFO    ] Finished processing BAM request
2018-11-15 20:45:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:45:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518675   8 58437 74723025 A  ERROR'
2018-11-15 20:45:23 [DEBUG   ] Got command BAM from MCS: ref #518676
2018-11-15 20:45:23 [INFO    ] Finished processing BAM request
2018-11-15 20:45:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:45:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518676   8 58437 74723029 A  ERROR'
2018-11-15 20:45:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 20:45:23 [DEBUG   ] spawn_process: at 2018-11-15 20:45:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 20:45:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 20:45:23 [DEBUG   ] spawn_process: at 2018-11-15 20:45:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 20:45:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 20:45:23 [DEBUG   ] spawn_process: at 2018-11-15 20:45:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 20:45:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 20:45:23 [DEBUG   ] spawn_process: at 2018-11-15 20:45:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 20:45:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 20:45:23 [DEBUG   ] spawn_process: at 2018-11-15 20:45:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 20:45:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 20:45:23 [DEBUG   ] spawn_process: at 2018-11-15 20:45:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 20:45:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 20:45:23 [DEBUG   ] spawn_process: at 2018-11-15 20:45:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 20:45:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 20:45:23 [DEBUG   ] spawn_process: at 2018-11-15 20:45:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 20:45:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 20:45:23 [DEBUG   ] spawn_process: at 2018-11-15 20:45:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 20:45:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 20:45:23 [DEBUG   ] spawn_process: at 2018-11-15 20:45:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 20:45:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 20:45:23 [DEBUG   ] spawn_process: at 2018-11-15 20:45:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 20:45:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 20:45:23 [DEBUG   ] spawn_process: at 2018-11-15 20:45:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 20:45:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 20:45:23 [DEBUG   ] spawn_process: at 2018-11-15 20:45:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 20:45:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 20:45:23 [DEBUG   ] spawn_process: at 2018-11-15 20:45:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 20:45:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 20:45:23 [DEBUG   ] spawn_process: at 2018-11-15 20:45:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 20:45:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 20:45:23 [DEBUG   ] spawn_process: at 2018-11-15 20:45:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 20:45:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 20:45:23 [DEBUG   ] spawn_process: at 2018-11-15 20:45:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 20:45:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 20:45:23 [DEBUG   ] spawn_process: at 2018-11-15 20:45:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 20:45:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 20:45:23 [DEBUG   ] spawn_process: at 2018-11-15 20:45:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 20:45:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 20:45:23 [DEBUG   ] spawn_process: at 2018-11-15 20:45:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 20:45:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 20:45:23 [DEBUG   ] spawn_process: at 2018-11-15 20:45:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 20:45:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 20:45:23 [DEBUG   ] spawn_process: at 2018-11-15 20:45:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 20:45:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 20:45:23 [DEBUG   ] spawn_process: at 2018-11-15 20:45:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 20:45:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 20:45:23 [DEBUG   ] spawn_process: at 2018-11-15 20:45:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 20:45:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 20:45:23 [DEBUG   ] spawn_process: at 2018-11-15 20:45:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 20:45:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 20:45:23 [DEBUG   ] spawn_process: at 2018-11-15 20:45:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 20:45:38 [DEBUG   ] Finished updating ant stats in 0.374 seconds
2018-11-15 20:45:45 [DEBUG   ] Got command RPT from MCS: ref #518677
2018-11-15 20:45:45 [DEBUG   ] summary = ERROR
2018-11-15 20:45:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518677  13 58437 74745201 A  ERRORERROR'
2018-11-15 20:45:45 [DEBUG   ] Got command RPT from MCS: ref #518678
2018-11-15 20:45:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 20:45:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518678  77 58437 74745202 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 20:45:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 20:46:02 [DEBUG   ] Got command BAM from MCS: ref #518695
2018-11-15 20:46:02 [INFO    ] Finished processing BAM request
2018-11-15 20:46:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:46:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518695   8 58437 74762033 A  ERROR'
2018-11-15 20:46:02 [DEBUG   ] Got command BAM from MCS: ref #518694
2018-11-15 20:46:02 [INFO    ] Finished processing BAM request
2018-11-15 20:46:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:46:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518694   8 58437 74762037 A  ERROR'
2018-11-15 20:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 20:46:02 [DEBUG   ] spawn_process: at 2018-11-15 20:46:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 20:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 20:46:02 [DEBUG   ] spawn_process: at 2018-11-15 20:46:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 20:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 20:46:02 [DEBUG   ] spawn_process: at 2018-11-15 20:46:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 20:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 20:46:02 [DEBUG   ] spawn_process: at 2018-11-15 20:46:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 20:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 20:46:02 [DEBUG   ] spawn_process: at 2018-11-15 20:46:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 20:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 20:46:02 [DEBUG   ] spawn_process: at 2018-11-15 20:46:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 20:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 20:46:02 [DEBUG   ] spawn_process: at 2018-11-15 20:46:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 20:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 20:46:02 [DEBUG   ] spawn_process: at 2018-11-15 20:46:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 20:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 20:46:02 [DEBUG   ] spawn_process: at 2018-11-15 20:46:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 20:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 20:46:02 [DEBUG   ] spawn_process: at 2018-11-15 20:46:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 20:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 20:46:02 [DEBUG   ] spawn_process: at 2018-11-15 20:46:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 20:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 20:46:02 [DEBUG   ] spawn_process: at 2018-11-15 20:46:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 20:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 20:46:02 [DEBUG   ] spawn_process: at 2018-11-15 20:46:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 20:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 20:46:02 [DEBUG   ] spawn_process: at 2018-11-15 20:46:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 20:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 20:46:02 [DEBUG   ] spawn_process: at 2018-11-15 20:46:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 20:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 20:46:02 [DEBUG   ] spawn_process: at 2018-11-15 20:46:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 20:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 20:46:02 [DEBUG   ] spawn_process: at 2018-11-15 20:46:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 20:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 20:46:02 [DEBUG   ] spawn_process: at 2018-11-15 20:46:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 20:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 20:46:02 [DEBUG   ] spawn_process: at 2018-11-15 20:46:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 20:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 20:46:02 [DEBUG   ] spawn_process: at 2018-11-15 20:46:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 20:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 20:46:02 [DEBUG   ] spawn_process: at 2018-11-15 20:46:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 20:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 20:46:02 [DEBUG   ] spawn_process: at 2018-11-15 20:46:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 20:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 20:46:02 [DEBUG   ] spawn_process: at 2018-11-15 20:46:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 20:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 20:46:02 [DEBUG   ] spawn_process: at 2018-11-15 20:46:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 20:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 20:46:02 [DEBUG   ] spawn_process: at 2018-11-15 20:46:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 20:46:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 20:46:02 [DEBUG   ] spawn_process: at 2018-11-15 20:46:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 20:46:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 20:46:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 20:46:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-15 20:46:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:46:17 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 20:46:17 [WARNING ] (13, 1, 'bot')
2018-11-15 20:46:17 [WARNING ] (13, 1, 'bot')
2018-11-15 20:46:17 [WARNING ] (13, 1, 'bot')
2018-11-15 20:46:17 [WARNING ] (13, 1, 'bot')
2018-11-15 20:46:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:46:17 [DEBUG   ] Finished updating board flags in 1.177 seconds
2018-11-15 20:46:19 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-15 20:46:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 20:46:41 [DEBUG   ] Got command BAM from MCS: ref #518697
2018-11-15 20:46:41 [INFO    ] Finished processing BAM request
2018-11-15 20:46:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:46:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518697   8 58437 74801029 A  ERROR'
2018-11-15 20:46:41 [DEBUG   ] Got command BAM from MCS: ref #518696
2018-11-15 20:46:41 [INFO    ] Finished processing BAM request
2018-11-15 20:46:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:46:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518696   8 58437 74801033 A  ERROR'
2018-11-15 20:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 20:46:41 [DEBUG   ] spawn_process: at 2018-11-15 20:46:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 20:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 20:46:41 [DEBUG   ] spawn_process: at 2018-11-15 20:46:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 20:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 20:46:41 [DEBUG   ] spawn_process: at 2018-11-15 20:46:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 20:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 20:46:41 [DEBUG   ] spawn_process: at 2018-11-15 20:46:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 20:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 20:46:41 [DEBUG   ] spawn_process: at 2018-11-15 20:46:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 20:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 20:46:41 [DEBUG   ] spawn_process: at 2018-11-15 20:46:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 20:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 20:46:41 [DEBUG   ] spawn_process: at 2018-11-15 20:46:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 20:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 20:46:41 [DEBUG   ] spawn_process: at 2018-11-15 20:46:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 20:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 20:46:41 [DEBUG   ] spawn_process: at 2018-11-15 20:46:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 20:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 20:46:41 [DEBUG   ] spawn_process: at 2018-11-15 20:46:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 20:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 20:46:41 [DEBUG   ] spawn_process: at 2018-11-15 20:46:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 20:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 20:46:41 [DEBUG   ] spawn_process: at 2018-11-15 20:46:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 20:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 20:46:41 [DEBUG   ] spawn_process: at 2018-11-15 20:46:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 20:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 20:46:41 [DEBUG   ] spawn_process: at 2018-11-15 20:46:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 20:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 20:46:41 [DEBUG   ] spawn_process: at 2018-11-15 20:46:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 20:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 20:46:41 [DEBUG   ] spawn_process: at 2018-11-15 20:46:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 20:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 20:46:41 [DEBUG   ] spawn_process: at 2018-11-15 20:46:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 20:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 20:46:41 [DEBUG   ] spawn_process: at 2018-11-15 20:46:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 20:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 20:46:41 [DEBUG   ] spawn_process: at 2018-11-15 20:46:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 20:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 20:46:41 [DEBUG   ] spawn_process: at 2018-11-15 20:46:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 20:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 20:46:41 [DEBUG   ] spawn_process: at 2018-11-15 20:46:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 20:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 20:46:41 [DEBUG   ] spawn_process: at 2018-11-15 20:46:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 20:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 20:46:41 [DEBUG   ] spawn_process: at 2018-11-15 20:46:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 20:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 20:46:41 [DEBUG   ] spawn_process: at 2018-11-15 20:46:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 20:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 20:46:41 [DEBUG   ] spawn_process: at 2018-11-15 20:46:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 20:46:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 20:46:41 [DEBUG   ] spawn_process: at 2018-11-15 20:46:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 20:46:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 20:47:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 20:47:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-15 20:47:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-11-15 20:47:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:47:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 20:47:17 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 20:47:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 20:47:17 [WARNING ] (13, 1, 'bot')
2018-11-15 20:47:17 [WARNING ] (13, 1, 'bot')
2018-11-15 20:47:17 [WARNING ] (13, 1, 'bot')
2018-11-15 20:47:17 [WARNING ] (13, 1, 'bot')
2018-11-15 20:47:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:47:17 [DEBUG   ] Finished updating board flags in 1.040 seconds
2018-11-15 20:47:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 20:47:20 [DEBUG   ] Got command BAM from MCS: ref #518698
2018-11-15 20:47:20 [INFO    ] Finished processing BAM request
2018-11-15 20:47:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:47:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518698   8 58437 74840025 A  ERROR'
2018-11-15 20:47:20 [DEBUG   ] Got command BAM from MCS: ref #518699
2018-11-15 20:47:20 [INFO    ] Finished processing BAM request
2018-11-15 20:47:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:47:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518699   8 58437 74840029 A  ERROR'
2018-11-15 20:47:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 20:47:20 [DEBUG   ] spawn_process: at 2018-11-15 20:47:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 20:47:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 20:47:20 [DEBUG   ] spawn_process: at 2018-11-15 20:47:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 20:47:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 20:47:20 [DEBUG   ] spawn_process: at 2018-11-15 20:47:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 20:47:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 20:47:20 [DEBUG   ] spawn_process: at 2018-11-15 20:47:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 20:47:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 20:47:20 [DEBUG   ] spawn_process: at 2018-11-15 20:47:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 20:47:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 20:47:20 [DEBUG   ] spawn_process: at 2018-11-15 20:47:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 20:47:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 20:47:20 [DEBUG   ] spawn_process: at 2018-11-15 20:47:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 20:47:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 20:47:20 [DEBUG   ] spawn_process: at 2018-11-15 20:47:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 20:47:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 20:47:20 [DEBUG   ] spawn_process: at 2018-11-15 20:47:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 20:47:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 20:47:20 [DEBUG   ] spawn_process: at 2018-11-15 20:47:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 20:47:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 20:47:20 [DEBUG   ] spawn_process: at 2018-11-15 20:47:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 20:47:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 20:47:20 [DEBUG   ] spawn_process: at 2018-11-15 20:47:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 20:47:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 20:47:20 [DEBUG   ] spawn_process: at 2018-11-15 20:47:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 20:47:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 20:47:20 [DEBUG   ] spawn_process: at 2018-11-15 20:47:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 20:47:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 20:47:20 [DEBUG   ] spawn_process: at 2018-11-15 20:47:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 20:47:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 20:47:20 [DEBUG   ] spawn_process: at 2018-11-15 20:47:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 20:47:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 20:47:20 [DEBUG   ] spawn_process: at 2018-11-15 20:47:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 20:47:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 20:47:20 [DEBUG   ] spawn_process: at 2018-11-15 20:47:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 20:47:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 20:47:20 [DEBUG   ] spawn_process: at 2018-11-15 20:47:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 20:47:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 20:47:20 [DEBUG   ] spawn_process: at 2018-11-15 20:47:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 20:47:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 20:47:20 [DEBUG   ] spawn_process: at 2018-11-15 20:47:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 20:47:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 20:47:20 [DEBUG   ] spawn_process: at 2018-11-15 20:47:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 20:47:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 20:47:20 [DEBUG   ] spawn_process: at 2018-11-15 20:47:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 20:47:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 20:47:20 [DEBUG   ] spawn_process: at 2018-11-15 20:47:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 20:47:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 20:47:20 [DEBUG   ] spawn_process: at 2018-11-15 20:47:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 20:47:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 20:47:20 [DEBUG   ] spawn_process: at 2018-11-15 20:47:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 20:47:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 20:47:59 [DEBUG   ] Got command BAM from MCS: ref #518704
2018-11-15 20:47:59 [INFO    ] Finished processing BAM request
2018-11-15 20:47:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:47:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518704   8 58437 74879025 A  ERROR'
2018-11-15 20:47:59 [DEBUG   ] Got command BAM from MCS: ref #518705
2018-11-15 20:47:59 [INFO    ] Finished processing BAM request
2018-11-15 20:47:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:47:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518705   8 58437 74879029 A  ERROR'
2018-11-15 20:47:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 20:47:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 20:47:59 [DEBUG   ] spawn_process: at 2018-11-15 20:47:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 20:47:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 20:47:59 [DEBUG   ] spawn_process: at 2018-11-15 20:47:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 20:47:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 20:47:59 [DEBUG   ] spawn_process: at 2018-11-15 20:47:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 20:47:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 20:47:59 [DEBUG   ] spawn_process: at 2018-11-15 20:47:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 20:47:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 20:47:59 [DEBUG   ] spawn_process: at 2018-11-15 20:47:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 20:47:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 20:47:59 [DEBUG   ] spawn_process: at 2018-11-15 20:47:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 20:47:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 20:47:59 [DEBUG   ] spawn_process: at 2018-11-15 20:47:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 20:47:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 20:47:59 [DEBUG   ] spawn_process: at 2018-11-15 20:47:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 20:47:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 20:47:59 [DEBUG   ] spawn_process: at 2018-11-15 20:47:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 20:47:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 20:47:59 [DEBUG   ] spawn_process: at 2018-11-15 20:47:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 20:47:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 20:47:59 [DEBUG   ] spawn_process: at 2018-11-15 20:47:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 20:47:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 20:47:59 [DEBUG   ] spawn_process: at 2018-11-15 20:47:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 20:47:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 20:47:59 [DEBUG   ] spawn_process: at 2018-11-15 20:47:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 20:47:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 20:47:59 [DEBUG   ] spawn_process: at 2018-11-15 20:47:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 20:47:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 20:47:59 [DEBUG   ] spawn_process: at 2018-11-15 20:47:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 20:47:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 20:47:59 [DEBUG   ] spawn_process: at 2018-11-15 20:47:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 20:47:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 20:47:59 [DEBUG   ] spawn_process: at 2018-11-15 20:47:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 20:47:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 20:47:59 [DEBUG   ] spawn_process: at 2018-11-15 20:47:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 20:47:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 20:47:59 [DEBUG   ] spawn_process: at 2018-11-15 20:47:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 20:47:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 20:47:59 [DEBUG   ] spawn_process: at 2018-11-15 20:47:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 20:47:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 20:47:59 [DEBUG   ] spawn_process: at 2018-11-15 20:47:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 20:47:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 20:47:59 [DEBUG   ] spawn_process: at 2018-11-15 20:47:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 20:47:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 20:47:59 [DEBUG   ] spawn_process: at 2018-11-15 20:47:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 20:47:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 20:47:59 [DEBUG   ] spawn_process: at 2018-11-15 20:47:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 20:47:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 20:47:59 [DEBUG   ] spawn_process: at 2018-11-15 20:47:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 20:47:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 20:47:59 [DEBUG   ] spawn_process: at 2018-11-15 20:47:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 20:48:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 20:48:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-15 20:48:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:48:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 20:48:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-15 20:48:19 [DEBUG   ] Finished updating ant stats in 1.031 seconds
2018-11-15 20:48:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-11-15 20:48:19 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 20:48:19 [WARNING ] (13, 1, 'bot')
2018-11-15 20:48:19 [WARNING ] (13, 1, 'bot')
2018-11-15 20:48:19 [WARNING ] (13, 1, 'bot')
2018-11-15 20:48:19 [WARNING ] (13, 1, 'bot')
2018-11-15 20:48:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:48:19 [DEBUG   ] Finished updating board flags in 2.591 seconds
2018-11-15 20:48:23 [DEBUG   ] Got command RPT from MCS: ref #518708
2018-11-15 20:48:23 [DEBUG   ] summary = ERROR
2018-11-15 20:48:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518708  13 58437 74903977 A  ERRORERROR'
2018-11-15 20:48:24 [DEBUG   ] Got command RPT from MCS: ref #518709
2018-11-15 20:48:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 20:48:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518709  77 58437 74904169 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 20:48:24 [DEBUG   ] Got command RPT from MCS: ref #518710
2018-11-15 20:48:24 [DEBUG   ] summary = ERROR
2018-11-15 20:48:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518710  13 58437 74904373 A  ERRORERROR'
2018-11-15 20:48:24 [DEBUG   ] Got command RPT from MCS: ref #518712
2018-11-15 20:48:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 20:48:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518712  77 58437 74904577 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 20:48:24 [DEBUG   ] Got command RPT from MCS: ref #518714
2018-11-15 20:48:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 20:48:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518714  12 58437 74904769 A  ERRORB¢ff'
2018-11-15 20:48:38 [DEBUG   ] Got command BAM from MCS: ref #518718
2018-11-15 20:48:38 [INFO    ] Finished processing BAM request
2018-11-15 20:48:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:48:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518718   8 58437 74918033 A  ERROR'
2018-11-15 20:48:38 [DEBUG   ] Got command BAM from MCS: ref #518719
2018-11-15 20:48:38 [INFO    ] Finished processing BAM request
2018-11-15 20:48:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:48:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518719   8 58437 74918037 A  ERROR'
2018-11-15 20:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 20:48:38 [DEBUG   ] spawn_process: at 2018-11-15 20:48:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 20:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 20:48:38 [DEBUG   ] spawn_process: at 2018-11-15 20:48:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 20:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 20:48:38 [DEBUG   ] spawn_process: at 2018-11-15 20:48:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 20:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 20:48:38 [DEBUG   ] spawn_process: at 2018-11-15 20:48:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 20:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 20:48:38 [DEBUG   ] spawn_process: at 2018-11-15 20:48:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 20:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 20:48:38 [DEBUG   ] spawn_process: at 2018-11-15 20:48:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 20:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 20:48:38 [DEBUG   ] spawn_process: at 2018-11-15 20:48:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 20:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 20:48:38 [DEBUG   ] spawn_process: at 2018-11-15 20:48:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 20:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 20:48:38 [DEBUG   ] spawn_process: at 2018-11-15 20:48:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 20:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 20:48:38 [DEBUG   ] spawn_process: at 2018-11-15 20:48:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 20:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 20:48:38 [DEBUG   ] spawn_process: at 2018-11-15 20:48:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 20:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 20:48:38 [DEBUG   ] spawn_process: at 2018-11-15 20:48:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 20:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 20:48:38 [DEBUG   ] spawn_process: at 2018-11-15 20:48:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 20:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 20:48:38 [DEBUG   ] spawn_process: at 2018-11-15 20:48:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 20:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 20:48:38 [DEBUG   ] spawn_process: at 2018-11-15 20:48:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 20:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 20:48:38 [DEBUG   ] spawn_process: at 2018-11-15 20:48:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 20:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 20:48:38 [DEBUG   ] spawn_process: at 2018-11-15 20:48:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 20:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 20:48:38 [DEBUG   ] spawn_process: at 2018-11-15 20:48:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 20:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 20:48:38 [DEBUG   ] spawn_process: at 2018-11-15 20:48:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 20:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 20:48:38 [DEBUG   ] spawn_process: at 2018-11-15 20:48:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 20:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 20:48:38 [DEBUG   ] spawn_process: at 2018-11-15 20:48:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 20:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 20:48:38 [DEBUG   ] spawn_process: at 2018-11-15 20:48:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 20:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 20:48:38 [DEBUG   ] spawn_process: at 2018-11-15 20:48:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 20:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 20:48:38 [DEBUG   ] spawn_process: at 2018-11-15 20:48:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 20:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 20:48:38 [DEBUG   ] spawn_process: at 2018-11-15 20:48:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 20:48:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 20:48:38 [DEBUG   ] spawn_process: at 2018-11-15 20:48:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 20:48:39 [DEBUG   ] Finished updating ant stats in 0.975 seconds
2018-11-15 20:48:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 20:49:17 [DEBUG   ] Got command BAM from MCS: ref #518720
2018-11-15 20:49:17 [INFO    ] Finished processing BAM request
2018-11-15 20:49:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:49:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518720   8 58437 74957033 A  ERROR'
2018-11-15 20:49:17 [DEBUG   ] Got command BAM from MCS: ref #518721
2018-11-15 20:49:17 [INFO    ] Finished processing BAM request
2018-11-15 20:49:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:49:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518721   8 58437 74957037 A  ERROR'
2018-11-15 20:49:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 20:49:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 20:49:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 20:49:17 [DEBUG   ] spawn_process: at 2018-11-15 20:49:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 20:49:17 [DEBUG   ] spawn_process: at 2018-11-15 20:49:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 20:49:17 [DEBUG   ] spawn_process: at 2018-11-15 20:49:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 20:49:17 [DEBUG   ] spawn_process: at 2018-11-15 20:49:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 20:49:17 [DEBUG   ] spawn_process: at 2018-11-15 20:49:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 20:49:17 [DEBUG   ] spawn_process: at 2018-11-15 20:49:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 20:49:17 [DEBUG   ] spawn_process: at 2018-11-15 20:49:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 20:49:17 [DEBUG   ] spawn_process: at 2018-11-15 20:49:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 20:49:17 [DEBUG   ] spawn_process: at 2018-11-15 20:49:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 20:49:17 [DEBUG   ] spawn_process: at 2018-11-15 20:49:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 20:49:17 [DEBUG   ] spawn_process: at 2018-11-15 20:49:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 20:49:17 [DEBUG   ] spawn_process: at 2018-11-15 20:49:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 20:49:17 [DEBUG   ] spawn_process: at 2018-11-15 20:49:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 20:49:17 [DEBUG   ] spawn_process: at 2018-11-15 20:49:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 20:49:17 [DEBUG   ] spawn_process: at 2018-11-15 20:49:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 20:49:17 [DEBUG   ] spawn_process: at 2018-11-15 20:49:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 20:49:17 [DEBUG   ] spawn_process: at 2018-11-15 20:49:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 20:49:17 [DEBUG   ] spawn_process: at 2018-11-15 20:49:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 20:49:17 [DEBUG   ] spawn_process: at 2018-11-15 20:49:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 20:49:17 [DEBUG   ] spawn_process: at 2018-11-15 20:49:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 20:49:17 [DEBUG   ] spawn_process: at 2018-11-15 20:49:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 20:49:17 [DEBUG   ] spawn_process: at 2018-11-15 20:49:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 20:49:17 [DEBUG   ] spawn_process: at 2018-11-15 20:49:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 20:49:17 [DEBUG   ] spawn_process: at 2018-11-15 20:49:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 20:49:17 [DEBUG   ] spawn_process: at 2018-11-15 20:49:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 20:49:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 20:49:17 [DEBUG   ] spawn_process: at 2018-11-15 20:49:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 20:49:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-11-15 20:49:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-15 20:49:18 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 20:49:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 20:49:18 [WARNING ] (13, 1, 'bot')
2018-11-15 20:49:18 [WARNING ] (13, 1, 'bot')
2018-11-15 20:49:18 [WARNING ] (13, 1, 'bot')
2018-11-15 20:49:18 [WARNING ] (13, 1, 'bot')
2018-11-15 20:49:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:49:18 [DEBUG   ] Finished updating board flags in 1.324 seconds
2018-11-15 20:49:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 20:49:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 20:49:56 [DEBUG   ] Got command BAM from MCS: ref #518723
2018-11-15 20:49:56 [INFO    ] Finished processing BAM request
2018-11-15 20:49:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:49:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518723   8 58437 74996033 A  ERROR'
2018-11-15 20:49:56 [DEBUG   ] Got command BAM from MCS: ref #518722
2018-11-15 20:49:56 [INFO    ] Finished processing BAM request
2018-11-15 20:49:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:49:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518722   8 58437 74996037 A  ERROR'
2018-11-15 20:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 20:49:56 [DEBUG   ] spawn_process: at 2018-11-15 20:49:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 20:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 20:49:56 [DEBUG   ] spawn_process: at 2018-11-15 20:49:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 20:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 20:49:56 [DEBUG   ] spawn_process: at 2018-11-15 20:49:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 20:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 20:49:56 [DEBUG   ] spawn_process: at 2018-11-15 20:49:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 20:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 20:49:56 [DEBUG   ] spawn_process: at 2018-11-15 20:49:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 20:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 20:49:56 [DEBUG   ] spawn_process: at 2018-11-15 20:49:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 20:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 20:49:56 [DEBUG   ] spawn_process: at 2018-11-15 20:49:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 20:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 20:49:56 [DEBUG   ] spawn_process: at 2018-11-15 20:49:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 20:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 20:49:56 [DEBUG   ] spawn_process: at 2018-11-15 20:49:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 20:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 20:49:56 [DEBUG   ] spawn_process: at 2018-11-15 20:49:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 20:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 20:49:56 [DEBUG   ] spawn_process: at 2018-11-15 20:49:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 20:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 20:49:56 [DEBUG   ] spawn_process: at 2018-11-15 20:49:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 20:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 20:49:56 [DEBUG   ] spawn_process: at 2018-11-15 20:49:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 20:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 20:49:56 [DEBUG   ] spawn_process: at 2018-11-15 20:49:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 20:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 20:49:56 [DEBUG   ] spawn_process: at 2018-11-15 20:49:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 20:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 20:49:56 [DEBUG   ] spawn_process: at 2018-11-15 20:49:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 20:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 20:49:56 [DEBUG   ] spawn_process: at 2018-11-15 20:49:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 20:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 20:49:56 [DEBUG   ] spawn_process: at 2018-11-15 20:49:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 20:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 20:49:56 [DEBUG   ] spawn_process: at 2018-11-15 20:49:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 20:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 20:49:56 [DEBUG   ] spawn_process: at 2018-11-15 20:49:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 20:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 20:49:56 [DEBUG   ] spawn_process: at 2018-11-15 20:49:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 20:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 20:49:56 [DEBUG   ] spawn_process: at 2018-11-15 20:49:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 20:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 20:49:56 [DEBUG   ] spawn_process: at 2018-11-15 20:49:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 20:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 20:49:56 [DEBUG   ] spawn_process: at 2018-11-15 20:49:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 20:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 20:49:56 [DEBUG   ] spawn_process: at 2018-11-15 20:49:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 20:49:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 20:49:56 [DEBUG   ] spawn_process: at 2018-11-15 20:49:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 20:49:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 20:50:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:50:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-15 20:50:18 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 20:50:18 [WARNING ] (13, 1, 'bot')
2018-11-15 20:50:18 [WARNING ] (13, 1, 'bot')
2018-11-15 20:50:18 [WARNING ] (13, 1, 'bot')
2018-11-15 20:50:18 [WARNING ] (13, 1, 'bot')
2018-11-15 20:50:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:50:18 [DEBUG   ] Finished updating board flags in 1.266 seconds
2018-11-15 20:50:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 20:50:35 [DEBUG   ] Got command BAM from MCS: ref #518729
2018-11-15 20:50:35 [INFO    ] Finished processing BAM request
2018-11-15 20:50:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:50:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518729   8 58437 75035029 A  ERROR'
2018-11-15 20:50:35 [DEBUG   ] Got command BAM from MCS: ref #518728
2018-11-15 20:50:35 [INFO    ] Finished processing BAM request
2018-11-15 20:50:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:50:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518728   8 58437 75035033 A  ERROR'
2018-11-15 20:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 20:50:35 [DEBUG   ] spawn_process: at 2018-11-15 20:50:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 20:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 20:50:35 [DEBUG   ] spawn_process: at 2018-11-15 20:50:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 20:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 20:50:35 [DEBUG   ] spawn_process: at 2018-11-15 20:50:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 20:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 20:50:35 [DEBUG   ] spawn_process: at 2018-11-15 20:50:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 20:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 20:50:35 [DEBUG   ] spawn_process: at 2018-11-15 20:50:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 20:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 20:50:35 [DEBUG   ] spawn_process: at 2018-11-15 20:50:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 20:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 20:50:35 [DEBUG   ] spawn_process: at 2018-11-15 20:50:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 20:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 20:50:35 [DEBUG   ] spawn_process: at 2018-11-15 20:50:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 20:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 20:50:35 [DEBUG   ] spawn_process: at 2018-11-15 20:50:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 20:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 20:50:35 [DEBUG   ] spawn_process: at 2018-11-15 20:50:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 20:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 20:50:35 [DEBUG   ] spawn_process: at 2018-11-15 20:50:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 20:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 20:50:35 [DEBUG   ] spawn_process: at 2018-11-15 20:50:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 20:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 20:50:35 [DEBUG   ] spawn_process: at 2018-11-15 20:50:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 20:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 20:50:35 [DEBUG   ] spawn_process: at 2018-11-15 20:50:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 20:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 20:50:35 [DEBUG   ] spawn_process: at 2018-11-15 20:50:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 20:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 20:50:35 [DEBUG   ] spawn_process: at 2018-11-15 20:50:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 20:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 20:50:35 [DEBUG   ] spawn_process: at 2018-11-15 20:50:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 20:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 20:50:35 [DEBUG   ] spawn_process: at 2018-11-15 20:50:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 20:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 20:50:35 [DEBUG   ] spawn_process: at 2018-11-15 20:50:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 20:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 20:50:35 [DEBUG   ] spawn_process: at 2018-11-15 20:50:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 20:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 20:50:35 [DEBUG   ] spawn_process: at 2018-11-15 20:50:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 20:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 20:50:35 [DEBUG   ] spawn_process: at 2018-11-15 20:50:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 20:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 20:50:35 [DEBUG   ] spawn_process: at 2018-11-15 20:50:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 20:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 20:50:35 [DEBUG   ] spawn_process: at 2018-11-15 20:50:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 20:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 20:50:35 [DEBUG   ] spawn_process: at 2018-11-15 20:50:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 20:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 20:50:35 [DEBUG   ] spawn_process: at 2018-11-15 20:50:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 20:50:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 20:50:45 [DEBUG   ] Got command RPT from MCS: ref #518730
2018-11-15 20:50:45 [DEBUG   ] summary = ERROR
2018-11-15 20:50:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518730  13 58437 75045201 A  ERRORERROR'
2018-11-15 20:50:45 [DEBUG   ] Got command RPT from MCS: ref #518731
2018-11-15 20:50:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 20:50:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518731  77 58437 75045202 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 20:50:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 20:51:14 [DEBUG   ] Got command BAM from MCS: ref #518748
2018-11-15 20:51:14 [INFO    ] Finished processing BAM request
2018-11-15 20:51:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:51:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518748   8 58437 75074033 A  ERROR'
2018-11-15 20:51:14 [DEBUG   ] Got command BAM from MCS: ref #518747
2018-11-15 20:51:14 [INFO    ] Finished processing BAM request
2018-11-15 20:51:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:51:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518747   8 58437 75074037 A  ERROR'
2018-11-15 20:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 20:51:14 [DEBUG   ] spawn_process: at 2018-11-15 20:51:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 20:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 20:51:14 [DEBUG   ] spawn_process: at 2018-11-15 20:51:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 20:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 20:51:14 [DEBUG   ] spawn_process: at 2018-11-15 20:51:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 20:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 20:51:14 [DEBUG   ] spawn_process: at 2018-11-15 20:51:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 20:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 20:51:14 [DEBUG   ] spawn_process: at 2018-11-15 20:51:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 20:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 20:51:14 [DEBUG   ] spawn_process: at 2018-11-15 20:51:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 20:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 20:51:14 [DEBUG   ] spawn_process: at 2018-11-15 20:51:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 20:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 20:51:14 [DEBUG   ] spawn_process: at 2018-11-15 20:51:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 20:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 20:51:14 [DEBUG   ] spawn_process: at 2018-11-15 20:51:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 20:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 20:51:14 [DEBUG   ] spawn_process: at 2018-11-15 20:51:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 20:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 20:51:14 [DEBUG   ] spawn_process: at 2018-11-15 20:51:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 20:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 20:51:14 [DEBUG   ] spawn_process: at 2018-11-15 20:51:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 20:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 20:51:14 [DEBUG   ] spawn_process: at 2018-11-15 20:51:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 20:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 20:51:14 [DEBUG   ] spawn_process: at 2018-11-15 20:51:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 20:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 20:51:14 [DEBUG   ] spawn_process: at 2018-11-15 20:51:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 20:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 20:51:14 [DEBUG   ] spawn_process: at 2018-11-15 20:51:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 20:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 20:51:14 [DEBUG   ] spawn_process: at 2018-11-15 20:51:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 20:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 20:51:14 [DEBUG   ] spawn_process: at 2018-11-15 20:51:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 20:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 20:51:14 [DEBUG   ] spawn_process: at 2018-11-15 20:51:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 20:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 20:51:14 [DEBUG   ] spawn_process: at 2018-11-15 20:51:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 20:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 20:51:14 [DEBUG   ] spawn_process: at 2018-11-15 20:51:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 20:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 20:51:14 [DEBUG   ] spawn_process: at 2018-11-15 20:51:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 20:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 20:51:14 [DEBUG   ] spawn_process: at 2018-11-15 20:51:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 20:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 20:51:14 [DEBUG   ] spawn_process: at 2018-11-15 20:51:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 20:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 20:51:14 [DEBUG   ] spawn_process: at 2018-11-15 20:51:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 20:51:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 20:51:14 [DEBUG   ] spawn_process: at 2018-11-15 20:51:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 20:51:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-15 20:51:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:51:18 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 20:51:18 [WARNING ] (13, 1, 'bot')
2018-11-15 20:51:18 [WARNING ] (13, 1, 'bot')
2018-11-15 20:51:18 [WARNING ] (13, 1, 'bot')
2018-11-15 20:51:18 [WARNING ] (13, 1, 'bot')
2018-11-15 20:51:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:51:18 [DEBUG   ] Finished updating board flags in 1.139 seconds
2018-11-15 20:51:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 20:51:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 20:51:53 [DEBUG   ] Got command BAM from MCS: ref #518749
2018-11-15 20:51:53 [INFO    ] Finished processing BAM request
2018-11-15 20:51:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:51:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518749   8 58437 75113029 A  ERROR'
2018-11-15 20:51:53 [DEBUG   ] Got command BAM from MCS: ref #518750
2018-11-15 20:51:53 [INFO    ] Finished processing BAM request
2018-11-15 20:51:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:51:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518750   8 58437 75113033 A  ERROR'
2018-11-15 20:51:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 20:51:53 [DEBUG   ] spawn_process: at 2018-11-15 20:51:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 20:51:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 20:51:53 [DEBUG   ] spawn_process: at 2018-11-15 20:51:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 20:51:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 20:51:53 [DEBUG   ] spawn_process: at 2018-11-15 20:51:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 20:51:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 20:51:53 [DEBUG   ] spawn_process: at 2018-11-15 20:51:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 20:51:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 20:51:53 [DEBUG   ] spawn_process: at 2018-11-15 20:51:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 20:51:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 20:51:53 [DEBUG   ] spawn_process: at 2018-11-15 20:51:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 20:51:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 20:51:53 [DEBUG   ] spawn_process: at 2018-11-15 20:51:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 20:51:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 20:51:53 [DEBUG   ] spawn_process: at 2018-11-15 20:51:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 20:51:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 20:51:53 [DEBUG   ] spawn_process: at 2018-11-15 20:51:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 20:51:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 20:51:53 [DEBUG   ] spawn_process: at 2018-11-15 20:51:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 20:51:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 20:51:53 [DEBUG   ] spawn_process: at 2018-11-15 20:51:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 20:51:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 20:51:53 [DEBUG   ] spawn_process: at 2018-11-15 20:51:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 20:51:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 20:51:53 [DEBUG   ] spawn_process: at 2018-11-15 20:51:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 20:51:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 20:51:53 [DEBUG   ] spawn_process: at 2018-11-15 20:51:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 20:51:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 20:51:53 [DEBUG   ] spawn_process: at 2018-11-15 20:51:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 20:51:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 20:51:53 [DEBUG   ] spawn_process: at 2018-11-15 20:51:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 20:51:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 20:51:53 [DEBUG   ] spawn_process: at 2018-11-15 20:51:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 20:51:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 20:51:53 [DEBUG   ] spawn_process: at 2018-11-15 20:51:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 20:51:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 20:51:53 [DEBUG   ] spawn_process: at 2018-11-15 20:51:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 20:51:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 20:51:53 [DEBUG   ] spawn_process: at 2018-11-15 20:51:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 20:51:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 20:51:53 [DEBUG   ] spawn_process: at 2018-11-15 20:51:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 20:51:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 20:51:53 [DEBUG   ] spawn_process: at 2018-11-15 20:51:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 20:51:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 20:51:53 [DEBUG   ] spawn_process: at 2018-11-15 20:51:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 20:51:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 20:51:53 [DEBUG   ] spawn_process: at 2018-11-15 20:51:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 20:51:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 20:51:53 [DEBUG   ] spawn_process: at 2018-11-15 20:51:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 20:51:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 20:51:53 [DEBUG   ] spawn_process: at 2018-11-15 20:51:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 20:51:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 20:52:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:52:18 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 20:52:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2018-11-15 20:52:18 [WARNING ] (13, 1, 'bot')
2018-11-15 20:52:18 [WARNING ] (13, 1, 'bot')
2018-11-15 20:52:18 [WARNING ] (13, 1, 'bot')
2018-11-15 20:52:18 [WARNING ] (13, 1, 'bot')
2018-11-15 20:52:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:52:18 [DEBUG   ] Finished updating board flags in 1.043 seconds
2018-11-15 20:52:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 20:52:32 [DEBUG   ] Got command BAM from MCS: ref #518751
2018-11-15 20:52:32 [INFO    ] Finished processing BAM request
2018-11-15 20:52:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:52:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518751   8 58437 75152025 A  ERROR'
2018-11-15 20:52:32 [DEBUG   ] Got command BAM from MCS: ref #518752
2018-11-15 20:52:32 [INFO    ] Finished processing BAM request
2018-11-15 20:52:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:52:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518752   8 58437 75152029 A  ERROR'
2018-11-15 20:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 20:52:32 [DEBUG   ] spawn_process: at 2018-11-15 20:52:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 20:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 20:52:32 [DEBUG   ] spawn_process: at 2018-11-15 20:52:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 20:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 20:52:32 [DEBUG   ] spawn_process: at 2018-11-15 20:52:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 20:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 20:52:32 [DEBUG   ] spawn_process: at 2018-11-15 20:52:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 20:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 20:52:32 [DEBUG   ] spawn_process: at 2018-11-15 20:52:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 20:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 20:52:32 [DEBUG   ] spawn_process: at 2018-11-15 20:52:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 20:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 20:52:32 [DEBUG   ] spawn_process: at 2018-11-15 20:52:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 20:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 20:52:32 [DEBUG   ] spawn_process: at 2018-11-15 20:52:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 20:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 20:52:32 [DEBUG   ] spawn_process: at 2018-11-15 20:52:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 20:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 20:52:32 [DEBUG   ] spawn_process: at 2018-11-15 20:52:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 20:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 20:52:32 [DEBUG   ] spawn_process: at 2018-11-15 20:52:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 20:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 20:52:32 [DEBUG   ] spawn_process: at 2018-11-15 20:52:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 20:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 20:52:32 [DEBUG   ] spawn_process: at 2018-11-15 20:52:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 20:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 20:52:32 [DEBUG   ] spawn_process: at 2018-11-15 20:52:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 20:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 20:52:32 [DEBUG   ] spawn_process: at 2018-11-15 20:52:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 20:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 20:52:32 [DEBUG   ] spawn_process: at 2018-11-15 20:52:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 20:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 20:52:32 [DEBUG   ] spawn_process: at 2018-11-15 20:52:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 20:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 20:52:32 [DEBUG   ] spawn_process: at 2018-11-15 20:52:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 20:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 20:52:32 [DEBUG   ] spawn_process: at 2018-11-15 20:52:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 20:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 20:52:32 [DEBUG   ] spawn_process: at 2018-11-15 20:52:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 20:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 20:52:32 [DEBUG   ] spawn_process: at 2018-11-15 20:52:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 20:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 20:52:32 [DEBUG   ] spawn_process: at 2018-11-15 20:52:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 20:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 20:52:32 [DEBUG   ] spawn_process: at 2018-11-15 20:52:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 20:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 20:52:32 [DEBUG   ] spawn_process: at 2018-11-15 20:52:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 20:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 20:52:32 [DEBUG   ] spawn_process: at 2018-11-15 20:52:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 20:52:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 20:52:32 [DEBUG   ] spawn_process: at 2018-11-15 20:52:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 20:52:39 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 20:52:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 20:53:11 [DEBUG   ] Got command BAM from MCS: ref #518753
2018-11-15 20:53:11 [INFO    ] Finished processing BAM request
2018-11-15 20:53:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:53:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518753   8 58437 75191025 A  ERROR'
2018-11-15 20:53:11 [DEBUG   ] Got command BAM from MCS: ref #518754
2018-11-15 20:53:11 [INFO    ] Finished processing BAM request
2018-11-15 20:53:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:53:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518754   8 58437 75191029 A  ERROR'
2018-11-15 20:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 20:53:11 [DEBUG   ] spawn_process: at 2018-11-15 20:53:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 20:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 20:53:11 [DEBUG   ] spawn_process: at 2018-11-15 20:53:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 20:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 20:53:11 [DEBUG   ] spawn_process: at 2018-11-15 20:53:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 20:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 20:53:11 [DEBUG   ] spawn_process: at 2018-11-15 20:53:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 20:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 20:53:11 [DEBUG   ] spawn_process: at 2018-11-15 20:53:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 20:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 20:53:11 [DEBUG   ] spawn_process: at 2018-11-15 20:53:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 20:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 20:53:11 [DEBUG   ] spawn_process: at 2018-11-15 20:53:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 20:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 20:53:11 [DEBUG   ] spawn_process: at 2018-11-15 20:53:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 20:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 20:53:11 [DEBUG   ] spawn_process: at 2018-11-15 20:53:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 20:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 20:53:11 [DEBUG   ] spawn_process: at 2018-11-15 20:53:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 20:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 20:53:11 [DEBUG   ] spawn_process: at 2018-11-15 20:53:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 20:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 20:53:11 [DEBUG   ] spawn_process: at 2018-11-15 20:53:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 20:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 20:53:11 [DEBUG   ] spawn_process: at 2018-11-15 20:53:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 20:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 20:53:11 [DEBUG   ] spawn_process: at 2018-11-15 20:53:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 20:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 20:53:11 [DEBUG   ] spawn_process: at 2018-11-15 20:53:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 20:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 20:53:11 [DEBUG   ] spawn_process: at 2018-11-15 20:53:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 20:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 20:53:11 [DEBUG   ] spawn_process: at 2018-11-15 20:53:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 20:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 20:53:11 [DEBUG   ] spawn_process: at 2018-11-15 20:53:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 20:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 20:53:11 [DEBUG   ] spawn_process: at 2018-11-15 20:53:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 20:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 20:53:11 [DEBUG   ] spawn_process: at 2018-11-15 20:53:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 20:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 20:53:11 [DEBUG   ] spawn_process: at 2018-11-15 20:53:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 20:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 20:53:11 [DEBUG   ] spawn_process: at 2018-11-15 20:53:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 20:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 20:53:11 [DEBUG   ] spawn_process: at 2018-11-15 20:53:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 20:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 20:53:11 [DEBUG   ] spawn_process: at 2018-11-15 20:53:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 20:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 20:53:11 [DEBUG   ] spawn_process: at 2018-11-15 20:53:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 20:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 20:53:11 [DEBUG   ] spawn_process: at 2018-11-15 20:53:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 20:53:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:53:19 [DEBUG   ] Finished updating ant stats in 0.830 seconds
2018-11-15 20:53:19 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 20:53:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 20:53:19 [WARNING ] (13, 1, 'bot')
2018-11-15 20:53:19 [WARNING ] (13, 1, 'bot')
2018-11-15 20:53:19 [WARNING ] (13, 1, 'bot')
2018-11-15 20:53:19 [WARNING ] (13, 1, 'bot')
2018-11-15 20:53:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:53:19 [DEBUG   ] Finished updating board flags in 2.034 seconds
2018-11-15 20:53:24 [DEBUG   ] Got command RPT from MCS: ref #518755
2018-11-15 20:53:24 [DEBUG   ] summary = ERROR
2018-11-15 20:53:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518755  13 58437 75204061 A  ERRORERROR'
2018-11-15 20:53:24 [DEBUG   ] Got command RPT from MCS: ref #518756
2018-11-15 20:53:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 20:53:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518756  77 58437 75204265 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 20:53:24 [DEBUG   ] Got command RPT from MCS: ref #518757
2018-11-15 20:53:24 [DEBUG   ] summary = ERROR
2018-11-15 20:53:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518757  13 58437 75204457 A  ERRORERROR'
2018-11-15 20:53:24 [DEBUG   ] Got command RPT from MCS: ref #518758
2018-11-15 20:53:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 20:53:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518758  77 58437 75204661 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 20:53:24 [DEBUG   ] Got command RPT from MCS: ref #518759
2018-11-15 20:53:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 20:53:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518759  12 58437 75204865 A  ERRORB¢ff'
2018-11-15 20:53:39 [DEBUG   ] Finished updating ant stats in 0.774 seconds
2018-11-15 20:53:50 [DEBUG   ] Got command BAM from MCS: ref #518765
2018-11-15 20:53:50 [INFO    ] Finished processing BAM request
2018-11-15 20:53:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:53:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518765   8 58437 75230033 A  ERROR'
2018-11-15 20:53:50 [DEBUG   ] Got command BAM from MCS: ref #518764
2018-11-15 20:53:50 [INFO    ] Finished processing BAM request
2018-11-15 20:53:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:53:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518764   8 58437 75230037 A  ERROR'
2018-11-15 20:53:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 20:53:50 [DEBUG   ] spawn_process: at 2018-11-15 20:53:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 20:53:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 20:53:50 [DEBUG   ] spawn_process: at 2018-11-15 20:53:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 20:53:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 20:53:50 [DEBUG   ] spawn_process: at 2018-11-15 20:53:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 20:53:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 20:53:50 [DEBUG   ] spawn_process: at 2018-11-15 20:53:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 20:53:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 20:53:50 [DEBUG   ] spawn_process: at 2018-11-15 20:53:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 20:53:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 20:53:50 [DEBUG   ] spawn_process: at 2018-11-15 20:53:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 20:53:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 20:53:50 [DEBUG   ] spawn_process: at 2018-11-15 20:53:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 20:53:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 20:53:50 [DEBUG   ] spawn_process: at 2018-11-15 20:53:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 20:53:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 20:53:50 [DEBUG   ] spawn_process: at 2018-11-15 20:53:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 20:53:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 20:53:50 [DEBUG   ] spawn_process: at 2018-11-15 20:53:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 20:53:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 20:53:50 [DEBUG   ] spawn_process: at 2018-11-15 20:53:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 20:53:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 20:53:50 [DEBUG   ] spawn_process: at 2018-11-15 20:53:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 20:53:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 20:53:50 [DEBUG   ] spawn_process: at 2018-11-15 20:53:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 20:53:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 20:53:50 [DEBUG   ] spawn_process: at 2018-11-15 20:53:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 20:53:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 20:53:50 [DEBUG   ] spawn_process: at 2018-11-15 20:53:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 20:53:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 20:53:50 [DEBUG   ] spawn_process: at 2018-11-15 20:53:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 20:53:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 20:53:50 [DEBUG   ] spawn_process: at 2018-11-15 20:53:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 20:53:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 20:53:50 [DEBUG   ] spawn_process: at 2018-11-15 20:53:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 20:53:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 20:53:50 [DEBUG   ] spawn_process: at 2018-11-15 20:53:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 20:53:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 20:53:50 [DEBUG   ] spawn_process: at 2018-11-15 20:53:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 20:53:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 20:53:50 [DEBUG   ] spawn_process: at 2018-11-15 20:53:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 20:53:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 20:53:50 [DEBUG   ] spawn_process: at 2018-11-15 20:53:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 20:53:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 20:53:50 [DEBUG   ] spawn_process: at 2018-11-15 20:53:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 20:53:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 20:53:50 [DEBUG   ] spawn_process: at 2018-11-15 20:53:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 20:53:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 20:53:50 [DEBUG   ] spawn_process: at 2018-11-15 20:53:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 20:53:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 20:53:50 [DEBUG   ] spawn_process: at 2018-11-15 20:53:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 20:53:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 20:54:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:54:18 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 20:54:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 20:54:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2018-11-15 20:54:18 [WARNING ] (13, 1, 'bot')
2018-11-15 20:54:18 [WARNING ] (13, 1, 'bot')
2018-11-15 20:54:18 [WARNING ] (13, 1, 'bot')
2018-11-15 20:54:18 [WARNING ] (13, 1, 'bot')
2018-11-15 20:54:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:54:18 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-11-15 20:54:19 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-15 20:54:29 [DEBUG   ] Got command BAM from MCS: ref #518767
2018-11-15 20:54:29 [INFO    ] Finished processing BAM request
2018-11-15 20:54:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:54:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518767   8 58437 75269029 A  ERROR'
2018-11-15 20:54:29 [DEBUG   ] Got command BAM from MCS: ref #518766
2018-11-15 20:54:29 [INFO    ] Finished processing BAM request
2018-11-15 20:54:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:54:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518766   8 58437 75269033 A  ERROR'
2018-11-15 20:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 20:54:29 [DEBUG   ] spawn_process: at 2018-11-15 20:54:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 20:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 20:54:29 [DEBUG   ] spawn_process: at 2018-11-15 20:54:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 20:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 20:54:29 [DEBUG   ] spawn_process: at 2018-11-15 20:54:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 20:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 20:54:29 [DEBUG   ] spawn_process: at 2018-11-15 20:54:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 20:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 20:54:29 [DEBUG   ] spawn_process: at 2018-11-15 20:54:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 20:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 20:54:29 [DEBUG   ] spawn_process: at 2018-11-15 20:54:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 20:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 20:54:29 [DEBUG   ] spawn_process: at 2018-11-15 20:54:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 20:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 20:54:29 [DEBUG   ] spawn_process: at 2018-11-15 20:54:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 20:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 20:54:29 [DEBUG   ] spawn_process: at 2018-11-15 20:54:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 20:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 20:54:29 [DEBUG   ] spawn_process: at 2018-11-15 20:54:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 20:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 20:54:29 [DEBUG   ] spawn_process: at 2018-11-15 20:54:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 20:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 20:54:29 [DEBUG   ] spawn_process: at 2018-11-15 20:54:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 20:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 20:54:29 [DEBUG   ] spawn_process: at 2018-11-15 20:54:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 20:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 20:54:29 [DEBUG   ] spawn_process: at 2018-11-15 20:54:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 20:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 20:54:29 [DEBUG   ] spawn_process: at 2018-11-15 20:54:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 20:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 20:54:29 [DEBUG   ] spawn_process: at 2018-11-15 20:54:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 20:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 20:54:29 [DEBUG   ] spawn_process: at 2018-11-15 20:54:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 20:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 20:54:29 [DEBUG   ] spawn_process: at 2018-11-15 20:54:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 20:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 20:54:29 [DEBUG   ] spawn_process: at 2018-11-15 20:54:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 20:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 20:54:29 [DEBUG   ] spawn_process: at 2018-11-15 20:54:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 20:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 20:54:29 [DEBUG   ] spawn_process: at 2018-11-15 20:54:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 20:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 20:54:29 [DEBUG   ] spawn_process: at 2018-11-15 20:54:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 20:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 20:54:29 [DEBUG   ] spawn_process: at 2018-11-15 20:54:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 20:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 20:54:29 [DEBUG   ] spawn_process: at 2018-11-15 20:54:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 20:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 20:54:29 [DEBUG   ] spawn_process: at 2018-11-15 20:54:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 20:54:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 20:54:29 [DEBUG   ] spawn_process: at 2018-11-15 20:54:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 20:54:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 20:54:59 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 20:55:08 [DEBUG   ] Got command BAM from MCS: ref #518768
2018-11-15 20:55:08 [INFO    ] Finished processing BAM request
2018-11-15 20:55:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:55:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518768   8 58437 75308037 A  ERROR'
2018-11-15 20:55:08 [DEBUG   ] Got command BAM from MCS: ref #518769
2018-11-15 20:55:08 [INFO    ] Finished processing BAM request
2018-11-15 20:55:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:55:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518769   8 58437 75308045 A  ERROR'
2018-11-15 20:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 20:55:08 [DEBUG   ] spawn_process: at 2018-11-15 20:55:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 20:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 20:55:08 [DEBUG   ] spawn_process: at 2018-11-15 20:55:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 20:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 20:55:08 [DEBUG   ] spawn_process: at 2018-11-15 20:55:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 20:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 20:55:08 [DEBUG   ] spawn_process: at 2018-11-15 20:55:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 20:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 20:55:08 [DEBUG   ] spawn_process: at 2018-11-15 20:55:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 20:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 20:55:08 [DEBUG   ] spawn_process: at 2018-11-15 20:55:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 20:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 20:55:08 [DEBUG   ] spawn_process: at 2018-11-15 20:55:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 20:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 20:55:08 [DEBUG   ] spawn_process: at 2018-11-15 20:55:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 20:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 20:55:08 [DEBUG   ] spawn_process: at 2018-11-15 20:55:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 20:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 20:55:08 [DEBUG   ] spawn_process: at 2018-11-15 20:55:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 20:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 20:55:08 [DEBUG   ] spawn_process: at 2018-11-15 20:55:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 20:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 20:55:08 [DEBUG   ] spawn_process: at 2018-11-15 20:55:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 20:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 20:55:08 [DEBUG   ] spawn_process: at 2018-11-15 20:55:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 20:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 20:55:08 [DEBUG   ] spawn_process: at 2018-11-15 20:55:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 20:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 20:55:08 [DEBUG   ] spawn_process: at 2018-11-15 20:55:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 20:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 20:55:08 [DEBUG   ] spawn_process: at 2018-11-15 20:55:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 20:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 20:55:08 [DEBUG   ] spawn_process: at 2018-11-15 20:55:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 20:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 20:55:08 [DEBUG   ] spawn_process: at 2018-11-15 20:55:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 20:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 20:55:08 [DEBUG   ] spawn_process: at 2018-11-15 20:55:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 20:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 20:55:08 [DEBUG   ] spawn_process: at 2018-11-15 20:55:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 20:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 20:55:08 [DEBUG   ] spawn_process: at 2018-11-15 20:55:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 20:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 20:55:08 [DEBUG   ] spawn_process: at 2018-11-15 20:55:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 20:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 20:55:08 [DEBUG   ] spawn_process: at 2018-11-15 20:55:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 20:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 20:55:08 [DEBUG   ] spawn_process: at 2018-11-15 20:55:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 20:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 20:55:08 [DEBUG   ] spawn_process: at 2018-11-15 20:55:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 20:55:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 20:55:08 [DEBUG   ] spawn_process: at 2018-11-15 20:55:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 20:55:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-15 20:55:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 20:55:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:55:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-15 20:55:18 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 20:55:18 [WARNING ] (13, 1, 'bot')
2018-11-15 20:55:18 [WARNING ] (13, 1, 'bot')
2018-11-15 20:55:18 [WARNING ] (13, 1, 'bot')
2018-11-15 20:55:18 [WARNING ] (13, 1, 'bot')
2018-11-15 20:55:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:55:18 [DEBUG   ] Finished updating board flags in 1.441 seconds
2018-11-15 20:55:19 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-15 20:55:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 20:55:45 [DEBUG   ] Got command RPT from MCS: ref #518770
2018-11-15 20:55:45 [DEBUG   ] summary = ERROR
2018-11-15 20:55:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518770  13 58437 75345201 A  ERRORERROR'
2018-11-15 20:55:45 [DEBUG   ] Got command RPT from MCS: ref #518771
2018-11-15 20:55:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 20:55:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518771  77 58437 75345202 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 20:55:47 [DEBUG   ] Got command BAM from MCS: ref #518788
2018-11-15 20:55:47 [INFO    ] Finished processing BAM request
2018-11-15 20:55:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:55:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518788   8 58437 75347029 A  ERROR'
2018-11-15 20:55:47 [DEBUG   ] Got command BAM from MCS: ref #518787
2018-11-15 20:55:47 [INFO    ] Finished processing BAM request
2018-11-15 20:55:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:55:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518787   8 58437 75347033 A  ERROR'
2018-11-15 20:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 20:55:47 [DEBUG   ] spawn_process: at 2018-11-15 20:55:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 20:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 20:55:47 [DEBUG   ] spawn_process: at 2018-11-15 20:55:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 20:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 20:55:47 [DEBUG   ] spawn_process: at 2018-11-15 20:55:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 20:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 20:55:47 [DEBUG   ] spawn_process: at 2018-11-15 20:55:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 20:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 20:55:47 [DEBUG   ] spawn_process: at 2018-11-15 20:55:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 20:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 20:55:47 [DEBUG   ] spawn_process: at 2018-11-15 20:55:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 20:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 20:55:47 [DEBUG   ] spawn_process: at 2018-11-15 20:55:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 20:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 20:55:47 [DEBUG   ] spawn_process: at 2018-11-15 20:55:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 20:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 20:55:47 [DEBUG   ] spawn_process: at 2018-11-15 20:55:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 20:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 20:55:47 [DEBUG   ] spawn_process: at 2018-11-15 20:55:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 20:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 20:55:47 [DEBUG   ] spawn_process: at 2018-11-15 20:55:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 20:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 20:55:47 [DEBUG   ] spawn_process: at 2018-11-15 20:55:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 20:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 20:55:47 [DEBUG   ] spawn_process: at 2018-11-15 20:55:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 20:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 20:55:47 [DEBUG   ] spawn_process: at 2018-11-15 20:55:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 20:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 20:55:47 [DEBUG   ] spawn_process: at 2018-11-15 20:55:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 20:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 20:55:47 [DEBUG   ] spawn_process: at 2018-11-15 20:55:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 20:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 20:55:47 [DEBUG   ] spawn_process: at 2018-11-15 20:55:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 20:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 20:55:47 [DEBUG   ] spawn_process: at 2018-11-15 20:55:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 20:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 20:55:47 [DEBUG   ] spawn_process: at 2018-11-15 20:55:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 20:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 20:55:47 [DEBUG   ] spawn_process: at 2018-11-15 20:55:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 20:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 20:55:47 [DEBUG   ] spawn_process: at 2018-11-15 20:55:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 20:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 20:55:47 [DEBUG   ] spawn_process: at 2018-11-15 20:55:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 20:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 20:55:47 [DEBUG   ] spawn_process: at 2018-11-15 20:55:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 20:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 20:55:47 [DEBUG   ] spawn_process: at 2018-11-15 20:55:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 20:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 20:55:47 [DEBUG   ] spawn_process: at 2018-11-15 20:55:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 20:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 20:55:47 [DEBUG   ] spawn_process: at 2018-11-15 20:55:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 20:56:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 20:56:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 20:56:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:56:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 20:56:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-15 20:56:19 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 20:56:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 20:56:19 [WARNING ] (13, 1, 'bot')
2018-11-15 20:56:19 [WARNING ] (13, 1, 'bot')
2018-11-15 20:56:19 [WARNING ] (13, 1, 'bot')
2018-11-15 20:56:19 [WARNING ] (13, 1, 'bot')
2018-11-15 20:56:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:56:19 [DEBUG   ] Finished updating board flags in 1.938 seconds
2018-11-15 20:56:20 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-15 20:56:26 [DEBUG   ] Got command BAM from MCS: ref #518790
2018-11-15 20:56:26 [INFO    ] Finished processing BAM request
2018-11-15 20:56:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:56:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518790   8 58437 75386033 A  ERROR'
2018-11-15 20:56:26 [DEBUG   ] Got command BAM from MCS: ref #518789
2018-11-15 20:56:26 [INFO    ] Finished processing BAM request
2018-11-15 20:56:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:56:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518789   8 58437 75386037 A  ERROR'
2018-11-15 20:56:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 20:56:26 [DEBUG   ] spawn_process: at 2018-11-15 20:56:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 20:56:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 20:56:26 [DEBUG   ] spawn_process: at 2018-11-15 20:56:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 20:56:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 20:56:26 [DEBUG   ] spawn_process: at 2018-11-15 20:56:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 20:56:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 20:56:26 [DEBUG   ] spawn_process: at 2018-11-15 20:56:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 20:56:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 20:56:26 [DEBUG   ] spawn_process: at 2018-11-15 20:56:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 20:56:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 20:56:26 [DEBUG   ] spawn_process: at 2018-11-15 20:56:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 20:56:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 20:56:26 [DEBUG   ] spawn_process: at 2018-11-15 20:56:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 20:56:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 20:56:26 [DEBUG   ] spawn_process: at 2018-11-15 20:56:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 20:56:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 20:56:26 [DEBUG   ] spawn_process: at 2018-11-15 20:56:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 20:56:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 20:56:26 [DEBUG   ] spawn_process: at 2018-11-15 20:56:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 20:56:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 20:56:26 [DEBUG   ] spawn_process: at 2018-11-15 20:56:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 20:56:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 20:56:26 [DEBUG   ] spawn_process: at 2018-11-15 20:56:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 20:56:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 20:56:26 [DEBUG   ] spawn_process: at 2018-11-15 20:56:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 20:56:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 20:56:26 [DEBUG   ] spawn_process: at 2018-11-15 20:56:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 20:56:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 20:56:26 [DEBUG   ] spawn_process: at 2018-11-15 20:56:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 20:56:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 20:56:26 [DEBUG   ] spawn_process: at 2018-11-15 20:56:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 20:56:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 20:56:26 [DEBUG   ] spawn_process: at 2018-11-15 20:56:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 20:56:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 20:56:26 [DEBUG   ] spawn_process: at 2018-11-15 20:56:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 20:56:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 20:56:26 [DEBUG   ] spawn_process: at 2018-11-15 20:56:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 20:56:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 20:56:26 [DEBUG   ] spawn_process: at 2018-11-15 20:56:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 20:56:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 20:56:26 [DEBUG   ] spawn_process: at 2018-11-15 20:56:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 20:56:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 20:56:26 [DEBUG   ] spawn_process: at 2018-11-15 20:56:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 20:56:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 20:56:26 [DEBUG   ] spawn_process: at 2018-11-15 20:56:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 20:56:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 20:56:26 [DEBUG   ] spawn_process: at 2018-11-15 20:56:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 20:56:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 20:56:26 [DEBUG   ] spawn_process: at 2018-11-15 20:56:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 20:56:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 20:56:26 [DEBUG   ] spawn_process: at 2018-11-15 20:56:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 20:56:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 20:57:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 20:57:05 [DEBUG   ] Got command BAM from MCS: ref #518795
2018-11-15 20:57:05 [INFO    ] Finished processing BAM request
2018-11-15 20:57:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:57:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518795   8 58437 75425029 A  ERROR'
2018-11-15 20:57:05 [DEBUG   ] Got command BAM from MCS: ref #518796
2018-11-15 20:57:05 [INFO    ] Finished processing BAM request
2018-11-15 20:57:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:57:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518796   8 58437 75425033 A  ERROR'
2018-11-15 20:57:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 20:57:05 [DEBUG   ] spawn_process: at 2018-11-15 20:57:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 20:57:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 20:57:05 [DEBUG   ] spawn_process: at 2018-11-15 20:57:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 20:57:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 20:57:05 [DEBUG   ] spawn_process: at 2018-11-15 20:57:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 20:57:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 20:57:05 [DEBUG   ] spawn_process: at 2018-11-15 20:57:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 20:57:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 20:57:05 [DEBUG   ] spawn_process: at 2018-11-15 20:57:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 20:57:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 20:57:05 [DEBUG   ] spawn_process: at 2018-11-15 20:57:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 20:57:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 20:57:05 [DEBUG   ] spawn_process: at 2018-11-15 20:57:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 20:57:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 20:57:05 [DEBUG   ] spawn_process: at 2018-11-15 20:57:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 20:57:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 20:57:05 [DEBUG   ] spawn_process: at 2018-11-15 20:57:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 20:57:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 20:57:05 [DEBUG   ] spawn_process: at 2018-11-15 20:57:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 20:57:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 20:57:05 [DEBUG   ] spawn_process: at 2018-11-15 20:57:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 20:57:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 20:57:05 [DEBUG   ] spawn_process: at 2018-11-15 20:57:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 20:57:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 20:57:05 [DEBUG   ] spawn_process: at 2018-11-15 20:57:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 20:57:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 20:57:05 [DEBUG   ] spawn_process: at 2018-11-15 20:57:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 20:57:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 20:57:05 [DEBUG   ] spawn_process: at 2018-11-15 20:57:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 20:57:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 20:57:05 [DEBUG   ] spawn_process: at 2018-11-15 20:57:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 20:57:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 20:57:05 [DEBUG   ] spawn_process: at 2018-11-15 20:57:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 20:57:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 20:57:05 [DEBUG   ] spawn_process: at 2018-11-15 20:57:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 20:57:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 20:57:05 [DEBUG   ] spawn_process: at 2018-11-15 20:57:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 20:57:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 20:57:05 [DEBUG   ] spawn_process: at 2018-11-15 20:57:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 20:57:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 20:57:05 [DEBUG   ] spawn_process: at 2018-11-15 20:57:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 20:57:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 20:57:05 [DEBUG   ] spawn_process: at 2018-11-15 20:57:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 20:57:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 20:57:05 [DEBUG   ] spawn_process: at 2018-11-15 20:57:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 20:57:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 20:57:05 [DEBUG   ] spawn_process: at 2018-11-15 20:57:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 20:57:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 20:57:05 [DEBUG   ] spawn_process: at 2018-11-15 20:57:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 20:57:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 20:57:05 [DEBUG   ] spawn_process: at 2018-11-15 20:57:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 20:57:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 20:57:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:57:18 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 20:57:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 20:57:18 [WARNING ] (13, 1, 'bot')
2018-11-15 20:57:18 [WARNING ] (13, 1, 'bot')
2018-11-15 20:57:18 [WARNING ] (13, 1, 'bot')
2018-11-15 20:57:18 [WARNING ] (13, 1, 'bot')
2018-11-15 20:57:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:57:18 [DEBUG   ] Finished updating board flags in 1.188 seconds
2018-11-15 20:57:20 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2018-11-15 20:57:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 20:57:44 [DEBUG   ] Got command BAM from MCS: ref #518797
2018-11-15 20:57:44 [INFO    ] Finished processing BAM request
2018-11-15 20:57:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:57:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518797   8 58437 75464033 A  ERROR'
2018-11-15 20:57:44 [DEBUG   ] Got command BAM from MCS: ref #518798
2018-11-15 20:57:44 [INFO    ] Finished processing BAM request
2018-11-15 20:57:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:57:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518798   8 58437 75464037 A  ERROR'
2018-11-15 20:57:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 20:57:44 [DEBUG   ] spawn_process: at 2018-11-15 20:57:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 20:57:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 20:57:44 [DEBUG   ] spawn_process: at 2018-11-15 20:57:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 20:57:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 20:57:44 [DEBUG   ] spawn_process: at 2018-11-15 20:57:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 20:57:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 20:57:44 [DEBUG   ] spawn_process: at 2018-11-15 20:57:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 20:57:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 20:57:44 [DEBUG   ] spawn_process: at 2018-11-15 20:57:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 20:57:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 20:57:44 [DEBUG   ] spawn_process: at 2018-11-15 20:57:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 20:57:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 20:57:44 [DEBUG   ] spawn_process: at 2018-11-15 20:57:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 20:57:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 20:57:44 [DEBUG   ] spawn_process: at 2018-11-15 20:57:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 20:57:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 20:57:44 [DEBUG   ] spawn_process: at 2018-11-15 20:57:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 20:57:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 20:57:44 [DEBUG   ] spawn_process: at 2018-11-15 20:57:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 20:57:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 20:57:44 [DEBUG   ] spawn_process: at 2018-11-15 20:57:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 20:57:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 20:57:44 [DEBUG   ] spawn_process: at 2018-11-15 20:57:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 20:57:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 20:57:44 [DEBUG   ] spawn_process: at 2018-11-15 20:57:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 20:57:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 20:57:44 [DEBUG   ] spawn_process: at 2018-11-15 20:57:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 20:57:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 20:57:44 [DEBUG   ] spawn_process: at 2018-11-15 20:57:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 20:57:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 20:57:44 [DEBUG   ] spawn_process: at 2018-11-15 20:57:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 20:57:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 20:57:44 [DEBUG   ] spawn_process: at 2018-11-15 20:57:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 20:57:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 20:57:44 [DEBUG   ] spawn_process: at 2018-11-15 20:57:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 20:57:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 20:57:44 [DEBUG   ] spawn_process: at 2018-11-15 20:57:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 20:57:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 20:57:44 [DEBUG   ] spawn_process: at 2018-11-15 20:57:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 20:57:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 20:57:44 [DEBUG   ] spawn_process: at 2018-11-15 20:57:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 20:57:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 20:57:44 [DEBUG   ] spawn_process: at 2018-11-15 20:57:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 20:57:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 20:57:44 [DEBUG   ] spawn_process: at 2018-11-15 20:57:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 20:57:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 20:57:44 [DEBUG   ] spawn_process: at 2018-11-15 20:57:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 20:57:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 20:57:44 [DEBUG   ] spawn_process: at 2018-11-15 20:57:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 20:57:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 20:57:44 [DEBUG   ] spawn_process: at 2018-11-15 20:57:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 20:58:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 20:58:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:58:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 20:58:18 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 20:58:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 20:58:18 [WARNING ] (13, 1, 'bot')
2018-11-15 20:58:18 [WARNING ] (13, 1, 'bot')
2018-11-15 20:58:18 [WARNING ] (13, 1, 'bot')
2018-11-15 20:58:18 [WARNING ] (13, 1, 'bot')
2018-11-15 20:58:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:58:18 [DEBUG   ] Finished updating board flags in 1.066 seconds
2018-11-15 20:58:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 20:58:23 [DEBUG   ] Got command BAM from MCS: ref #518801
2018-11-15 20:58:23 [INFO    ] Finished processing BAM request
2018-11-15 20:58:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:58:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518801   8 58437 75503029 A  ERROR'
2018-11-15 20:58:23 [DEBUG   ] Got command BAM from MCS: ref #518802
2018-11-15 20:58:23 [INFO    ] Finished processing BAM request
2018-11-15 20:58:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:58:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518802   8 58437 75503033 A  ERROR'
2018-11-15 20:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 20:58:23 [DEBUG   ] spawn_process: at 2018-11-15 20:58:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 20:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 20:58:23 [DEBUG   ] spawn_process: at 2018-11-15 20:58:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 20:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 20:58:23 [DEBUG   ] spawn_process: at 2018-11-15 20:58:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 20:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 20:58:23 [DEBUG   ] spawn_process: at 2018-11-15 20:58:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 20:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 20:58:23 [DEBUG   ] spawn_process: at 2018-11-15 20:58:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 20:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 20:58:23 [DEBUG   ] spawn_process: at 2018-11-15 20:58:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 20:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 20:58:23 [DEBUG   ] spawn_process: at 2018-11-15 20:58:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 20:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 20:58:23 [DEBUG   ] spawn_process: at 2018-11-15 20:58:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 20:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 20:58:23 [DEBUG   ] spawn_process: at 2018-11-15 20:58:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 20:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 20:58:23 [DEBUG   ] spawn_process: at 2018-11-15 20:58:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 20:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 20:58:23 [DEBUG   ] spawn_process: at 2018-11-15 20:58:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 20:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 20:58:23 [DEBUG   ] spawn_process: at 2018-11-15 20:58:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 20:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 20:58:23 [DEBUG   ] spawn_process: at 2018-11-15 20:58:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 20:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 20:58:23 [DEBUG   ] spawn_process: at 2018-11-15 20:58:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 20:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 20:58:23 [DEBUG   ] spawn_process: at 2018-11-15 20:58:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 20:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 20:58:23 [DEBUG   ] spawn_process: at 2018-11-15 20:58:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 20:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 20:58:23 [DEBUG   ] spawn_process: at 2018-11-15 20:58:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 20:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 20:58:23 [DEBUG   ] spawn_process: at 2018-11-15 20:58:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 20:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 20:58:23 [DEBUG   ] spawn_process: at 2018-11-15 20:58:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 20:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 20:58:23 [DEBUG   ] spawn_process: at 2018-11-15 20:58:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 20:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 20:58:23 [DEBUG   ] spawn_process: at 2018-11-15 20:58:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 20:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 20:58:23 [DEBUG   ] spawn_process: at 2018-11-15 20:58:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 20:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 20:58:23 [DEBUG   ] spawn_process: at 2018-11-15 20:58:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 20:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 20:58:23 [DEBUG   ] spawn_process: at 2018-11-15 20:58:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 20:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 20:58:23 [DEBUG   ] spawn_process: at 2018-11-15 20:58:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 20:58:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 20:58:23 [DEBUG   ] spawn_process: at 2018-11-15 20:58:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 20:58:24 [DEBUG   ] Got command RPT from MCS: ref #518803
2018-11-15 20:58:24 [DEBUG   ] summary = ERROR
2018-11-15 20:58:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518803  13 58437 75504153 A  ERRORERROR'
2018-11-15 20:58:24 [DEBUG   ] Got command RPT from MCS: ref #518804
2018-11-15 20:58:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 20:58:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518804  77 58437 75504345 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 20:58:24 [DEBUG   ] Got command RPT from MCS: ref #518805
2018-11-15 20:58:24 [DEBUG   ] summary = ERROR
2018-11-15 20:58:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518805  13 58437 75504549 A  ERRORERROR'
2018-11-15 20:58:24 [DEBUG   ] Got command RPT from MCS: ref #518807
2018-11-15 20:58:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 20:58:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518807  77 58437 75504753 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 20:58:24 [DEBUG   ] Got command RPT from MCS: ref #518808
2018-11-15 20:58:24 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 20:58:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518808  12 58437 75504945 A  ERRORB¢ff'
2018-11-15 20:58:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 20:59:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 20:59:02 [DEBUG   ] Got command BAM from MCS: ref #518814
2018-11-15 20:59:02 [INFO    ] Finished processing BAM request
2018-11-15 20:59:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:59:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518814   8 58437 75542033 A  ERROR'
2018-11-15 20:59:02 [DEBUG   ] Got command BAM from MCS: ref #518813
2018-11-15 20:59:02 [INFO    ] Finished processing BAM request
2018-11-15 20:59:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:59:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518813   8 58437 75542037 A  ERROR'
2018-11-15 20:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 20:59:02 [DEBUG   ] spawn_process: at 2018-11-15 20:59:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 20:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 20:59:02 [DEBUG   ] spawn_process: at 2018-11-15 20:59:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 20:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 20:59:02 [DEBUG   ] spawn_process: at 2018-11-15 20:59:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 20:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 20:59:02 [DEBUG   ] spawn_process: at 2018-11-15 20:59:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 20:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 20:59:02 [DEBUG   ] spawn_process: at 2018-11-15 20:59:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 20:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 20:59:02 [DEBUG   ] spawn_process: at 2018-11-15 20:59:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 20:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 20:59:02 [DEBUG   ] spawn_process: at 2018-11-15 20:59:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 20:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 20:59:02 [DEBUG   ] spawn_process: at 2018-11-15 20:59:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 20:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 20:59:02 [DEBUG   ] spawn_process: at 2018-11-15 20:59:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 20:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 20:59:02 [DEBUG   ] spawn_process: at 2018-11-15 20:59:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 20:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 20:59:02 [DEBUG   ] spawn_process: at 2018-11-15 20:59:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 20:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 20:59:02 [DEBUG   ] spawn_process: at 2018-11-15 20:59:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 20:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 20:59:02 [DEBUG   ] spawn_process: at 2018-11-15 20:59:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 20:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 20:59:02 [DEBUG   ] spawn_process: at 2018-11-15 20:59:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 20:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 20:59:02 [DEBUG   ] spawn_process: at 2018-11-15 20:59:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 20:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 20:59:02 [DEBUG   ] spawn_process: at 2018-11-15 20:59:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 20:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 20:59:02 [DEBUG   ] spawn_process: at 2018-11-15 20:59:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 20:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 20:59:02 [DEBUG   ] spawn_process: at 2018-11-15 20:59:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 20:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 20:59:02 [DEBUG   ] spawn_process: at 2018-11-15 20:59:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 20:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 20:59:02 [DEBUG   ] spawn_process: at 2018-11-15 20:59:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 20:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 20:59:02 [DEBUG   ] spawn_process: at 2018-11-15 20:59:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 20:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 20:59:02 [DEBUG   ] spawn_process: at 2018-11-15 20:59:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 20:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 20:59:02 [DEBUG   ] spawn_process: at 2018-11-15 20:59:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 20:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 20:59:02 [DEBUG   ] spawn_process: at 2018-11-15 20:59:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 20:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 20:59:02 [DEBUG   ] spawn_process: at 2018-11-15 20:59:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 20:59:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 20:59:02 [DEBUG   ] spawn_process: at 2018-11-15 20:59:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 20:59:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 20:59:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 20:59:18 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 20:59:18 [WARNING ] (13, 1, 'bot')
2018-11-15 20:59:18 [WARNING ] (13, 1, 'bot')
2018-11-15 20:59:18 [WARNING ] (13, 1, 'bot')
2018-11-15 20:59:18 [WARNING ] (13, 1, 'bot')
2018-11-15 20:59:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 20:59:18 [DEBUG   ] Finished updating board flags in 0.943 seconds
2018-11-15 20:59:20 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-15 20:59:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 20:59:41 [DEBUG   ] Got command BAM from MCS: ref #518820
2018-11-15 20:59:41 [INFO    ] Finished processing BAM request
2018-11-15 20:59:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:59:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518820   8 58437 75581033 A  ERROR'
2018-11-15 20:59:41 [DEBUG   ] Got command BAM from MCS: ref #518819
2018-11-15 20:59:41 [INFO    ] Finished processing BAM request
2018-11-15 20:59:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 20:59:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518819   8 58437 75581037 A  ERROR'
2018-11-15 20:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 20:59:41 [DEBUG   ] spawn_process: at 2018-11-15 20:59:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 20:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 20:59:41 [DEBUG   ] spawn_process: at 2018-11-15 20:59:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 20:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 20:59:41 [DEBUG   ] spawn_process: at 2018-11-15 20:59:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 20:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 20:59:41 [DEBUG   ] spawn_process: at 2018-11-15 20:59:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 20:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 20:59:41 [DEBUG   ] spawn_process: at 2018-11-15 20:59:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 20:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 20:59:41 [DEBUG   ] spawn_process: at 2018-11-15 20:59:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 20:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 20:59:41 [DEBUG   ] spawn_process: at 2018-11-15 20:59:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 20:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 20:59:41 [DEBUG   ] spawn_process: at 2018-11-15 20:59:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 20:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 20:59:41 [DEBUG   ] spawn_process: at 2018-11-15 20:59:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 20:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 20:59:41 [DEBUG   ] spawn_process: at 2018-11-15 20:59:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 20:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 20:59:41 [DEBUG   ] spawn_process: at 2018-11-15 20:59:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 20:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 20:59:41 [DEBUG   ] spawn_process: at 2018-11-15 20:59:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 20:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 20:59:41 [DEBUG   ] spawn_process: at 2018-11-15 20:59:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 20:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 20:59:41 [DEBUG   ] spawn_process: at 2018-11-15 20:59:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 20:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 20:59:41 [DEBUG   ] spawn_process: at 2018-11-15 20:59:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 20:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 20:59:41 [DEBUG   ] spawn_process: at 2018-11-15 20:59:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 20:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 20:59:41 [DEBUG   ] spawn_process: at 2018-11-15 20:59:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 20:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 20:59:41 [DEBUG   ] spawn_process: at 2018-11-15 20:59:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 20:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 20:59:41 [DEBUG   ] spawn_process: at 2018-11-15 20:59:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 20:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 20:59:41 [DEBUG   ] spawn_process: at 2018-11-15 20:59:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 20:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 20:59:41 [DEBUG   ] spawn_process: at 2018-11-15 20:59:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 20:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 20:59:41 [DEBUG   ] spawn_process: at 2018-11-15 20:59:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 20:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 20:59:41 [DEBUG   ] spawn_process: at 2018-11-15 20:59:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 20:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 20:59:41 [DEBUG   ] spawn_process: at 2018-11-15 20:59:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 20:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 20:59:41 [DEBUG   ] spawn_process: at 2018-11-15 20:59:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 20:59:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 20:59:41 [DEBUG   ] spawn_process: at 2018-11-15 20:59:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 21:00:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 21:00:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 21:00:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-11-15 21:00:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:00:19 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 21:00:19 [WARNING ] (13, 1, 'bot')
2018-11-15 21:00:19 [WARNING ] (13, 1, 'bot')
2018-11-15 21:00:19 [WARNING ] (13, 1, 'bot')
2018-11-15 21:00:19 [WARNING ] (13, 1, 'bot')
2018-11-15 21:00:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:00:19 [DEBUG   ] Finished updating board flags in 1.357 seconds
2018-11-15 21:00:20 [DEBUG   ] Got command BAM from MCS: ref #518821
2018-11-15 21:00:20 [INFO    ] Finished processing BAM request
2018-11-15 21:00:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:00:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518821   8 58437 75620033 A  ERROR'
2018-11-15 21:00:20 [DEBUG   ] Got command BAM from MCS: ref #518822
2018-11-15 21:00:20 [INFO    ] Finished processing BAM request
2018-11-15 21:00:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:00:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518822   8 58437 75620037 A  ERROR'
2018-11-15 21:00:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 21:00:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 21:00:20 [DEBUG   ] spawn_process: at 2018-11-15 21:00:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 21:00:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 21:00:20 [DEBUG   ] spawn_process: at 2018-11-15 21:00:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 21:00:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 21:00:20 [DEBUG   ] spawn_process: at 2018-11-15 21:00:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 21:00:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 21:00:20 [DEBUG   ] spawn_process: at 2018-11-15 21:00:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 21:00:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 21:00:20 [DEBUG   ] spawn_process: at 2018-11-15 21:00:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 21:00:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 21:00:20 [DEBUG   ] spawn_process: at 2018-11-15 21:00:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 21:00:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 21:00:20 [DEBUG   ] spawn_process: at 2018-11-15 21:00:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 21:00:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 21:00:20 [DEBUG   ] spawn_process: at 2018-11-15 21:00:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 21:00:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 21:00:20 [DEBUG   ] spawn_process: at 2018-11-15 21:00:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 21:00:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 21:00:20 [DEBUG   ] spawn_process: at 2018-11-15 21:00:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 21:00:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 21:00:20 [DEBUG   ] spawn_process: at 2018-11-15 21:00:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 21:00:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 21:00:20 [DEBUG   ] spawn_process: at 2018-11-15 21:00:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 21:00:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 21:00:20 [DEBUG   ] spawn_process: at 2018-11-15 21:00:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 21:00:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 21:00:20 [DEBUG   ] spawn_process: at 2018-11-15 21:00:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 21:00:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 21:00:20 [DEBUG   ] spawn_process: at 2018-11-15 21:00:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 21:00:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 21:00:20 [DEBUG   ] spawn_process: at 2018-11-15 21:00:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 21:00:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 21:00:20 [DEBUG   ] spawn_process: at 2018-11-15 21:00:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 21:00:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 21:00:20 [DEBUG   ] spawn_process: at 2018-11-15 21:00:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 21:00:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 21:00:20 [DEBUG   ] spawn_process: at 2018-11-15 21:00:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 21:00:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 21:00:20 [DEBUG   ] spawn_process: at 2018-11-15 21:00:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 21:00:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 21:00:20 [DEBUG   ] spawn_process: at 2018-11-15 21:00:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 21:00:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 21:00:20 [DEBUG   ] spawn_process: at 2018-11-15 21:00:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 21:00:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 21:00:20 [DEBUG   ] spawn_process: at 2018-11-15 21:00:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 21:00:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 21:00:20 [DEBUG   ] spawn_process: at 2018-11-15 21:00:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 21:00:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 21:00:20 [DEBUG   ] spawn_process: at 2018-11-15 21:00:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 21:00:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 21:00:20 [DEBUG   ] spawn_process: at 2018-11-15 21:00:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 21:00:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 21:00:45 [DEBUG   ] Got command RPT from MCS: ref #518823
2018-11-15 21:00:45 [DEBUG   ] summary = ERROR
2018-11-15 21:00:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518823  13 58437 75645197 A  ERRORERROR'
2018-11-15 21:00:45 [DEBUG   ] Got command RPT from MCS: ref #518824
2018-11-15 21:00:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 21:00:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518824  77 58437 75645198 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 21:00:59 [DEBUG   ] Got command BAM from MCS: ref #518841
2018-11-15 21:00:59 [INFO    ] Finished processing BAM request
2018-11-15 21:00:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:00:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518841   8 58437 75659025 A  ERROR'
2018-11-15 21:00:59 [DEBUG   ] Got command BAM from MCS: ref #518840
2018-11-15 21:00:59 [INFO    ] Finished processing BAM request
2018-11-15 21:00:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:00:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518840   8 58437 75659029 A  ERROR'
2018-11-15 21:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 21:00:59 [DEBUG   ] spawn_process: at 2018-11-15 21:00:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 21:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 21:00:59 [DEBUG   ] spawn_process: at 2018-11-15 21:00:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 21:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 21:00:59 [DEBUG   ] spawn_process: at 2018-11-15 21:00:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 21:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 21:00:59 [DEBUG   ] spawn_process: at 2018-11-15 21:00:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 21:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 21:00:59 [DEBUG   ] spawn_process: at 2018-11-15 21:00:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 21:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 21:00:59 [DEBUG   ] spawn_process: at 2018-11-15 21:00:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 21:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 21:00:59 [DEBUG   ] spawn_process: at 2018-11-15 21:00:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 21:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 21:00:59 [DEBUG   ] spawn_process: at 2018-11-15 21:00:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 21:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 21:00:59 [DEBUG   ] spawn_process: at 2018-11-15 21:00:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 21:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 21:00:59 [DEBUG   ] spawn_process: at 2018-11-15 21:00:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 21:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 21:00:59 [DEBUG   ] spawn_process: at 2018-11-15 21:00:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 21:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 21:00:59 [DEBUG   ] spawn_process: at 2018-11-15 21:00:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 21:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 21:00:59 [DEBUG   ] spawn_process: at 2018-11-15 21:00:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 21:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 21:00:59 [DEBUG   ] spawn_process: at 2018-11-15 21:00:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 21:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 21:00:59 [DEBUG   ] spawn_process: at 2018-11-15 21:00:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 21:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 21:00:59 [DEBUG   ] spawn_process: at 2018-11-15 21:00:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 21:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 21:00:59 [DEBUG   ] spawn_process: at 2018-11-15 21:00:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 21:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 21:00:59 [DEBUG   ] spawn_process: at 2018-11-15 21:00:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 21:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 21:00:59 [DEBUG   ] spawn_process: at 2018-11-15 21:00:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 21:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 21:00:59 [DEBUG   ] spawn_process: at 2018-11-15 21:00:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 21:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 21:00:59 [DEBUG   ] spawn_process: at 2018-11-15 21:00:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 21:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 21:00:59 [DEBUG   ] spawn_process: at 2018-11-15 21:00:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 21:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 21:00:59 [DEBUG   ] spawn_process: at 2018-11-15 21:00:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 21:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 21:00:59 [DEBUG   ] spawn_process: at 2018-11-15 21:00:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 21:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 21:00:59 [DEBUG   ] spawn_process: at 2018-11-15 21:00:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 21:00:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 21:00:59 [DEBUG   ] spawn_process: at 2018-11-15 21:00:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 21:01:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 21:01:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 21:01:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:01:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-15 21:01:19 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 21:01:19 [WARNING ] (13, 1, 'bot')
2018-11-15 21:01:19 [WARNING ] (13, 1, 'bot')
2018-11-15 21:01:19 [WARNING ] (13, 1, 'bot')
2018-11-15 21:01:19 [WARNING ] (13, 1, 'bot')
2018-11-15 21:01:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:01:19 [DEBUG   ] Finished updating board flags in 1.197 seconds
2018-11-15 21:01:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 21:01:39 [DEBUG   ] Got command BAM from MCS: ref #518843
2018-11-15 21:01:39 [INFO    ] Finished processing BAM request
2018-11-15 21:01:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:01:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518843   8 58437 75699025 A  ERROR'
2018-11-15 21:01:39 [DEBUG   ] Got command BAM from MCS: ref #518842
2018-11-15 21:01:39 [INFO    ] Finished processing BAM request
2018-11-15 21:01:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:01:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518842   8 58437 75699033 A  ERROR'
2018-11-15 21:01:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 21:01:39 [DEBUG   ] spawn_process: at 2018-11-15 21:01:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 21:01:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 21:01:39 [DEBUG   ] spawn_process: at 2018-11-15 21:01:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 21:01:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 21:01:39 [DEBUG   ] spawn_process: at 2018-11-15 21:01:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 21:01:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 21:01:39 [DEBUG   ] spawn_process: at 2018-11-15 21:01:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 21:01:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 21:01:39 [DEBUG   ] spawn_process: at 2018-11-15 21:01:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 21:01:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 21:01:39 [DEBUG   ] spawn_process: at 2018-11-15 21:01:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 21:01:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 21:01:39 [DEBUG   ] spawn_process: at 2018-11-15 21:01:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 21:01:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 21:01:39 [DEBUG   ] spawn_process: at 2018-11-15 21:01:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 21:01:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 21:01:39 [DEBUG   ] spawn_process: at 2018-11-15 21:01:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 21:01:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 21:01:39 [DEBUG   ] spawn_process: at 2018-11-15 21:01:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 21:01:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 21:01:39 [DEBUG   ] spawn_process: at 2018-11-15 21:01:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 21:01:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 21:01:39 [DEBUG   ] spawn_process: at 2018-11-15 21:01:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 21:01:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 21:01:39 [DEBUG   ] spawn_process: at 2018-11-15 21:01:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 21:01:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 21:01:39 [DEBUG   ] spawn_process: at 2018-11-15 21:01:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 21:01:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 21:01:39 [DEBUG   ] spawn_process: at 2018-11-15 21:01:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 21:01:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 21:01:39 [DEBUG   ] spawn_process: at 2018-11-15 21:01:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 21:01:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 21:01:39 [DEBUG   ] spawn_process: at 2018-11-15 21:01:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 21:01:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 21:01:39 [DEBUG   ] spawn_process: at 2018-11-15 21:01:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 21:01:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 21:01:39 [DEBUG   ] spawn_process: at 2018-11-15 21:01:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 21:01:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 21:01:39 [DEBUG   ] spawn_process: at 2018-11-15 21:01:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 21:01:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 21:01:39 [DEBUG   ] spawn_process: at 2018-11-15 21:01:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 21:01:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 21:01:39 [DEBUG   ] spawn_process: at 2018-11-15 21:01:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 21:01:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 21:01:39 [DEBUG   ] spawn_process: at 2018-11-15 21:01:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 21:01:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 21:01:39 [DEBUG   ] spawn_process: at 2018-11-15 21:01:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 21:01:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 21:01:39 [DEBUG   ] spawn_process: at 2018-11-15 21:01:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 21:01:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 21:01:39 [DEBUG   ] spawn_process: at 2018-11-15 21:01:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 21:01:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 21:02:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 21:02:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-11-15 21:02:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:02:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-15 21:02:19 [DEBUG   ] Got command BAM from MCS: ref #518845
2018-11-15 21:02:19 [INFO    ] Finished processing BAM request
2018-11-15 21:02:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:02:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518845   8 58437 75739033 A  ERROR'
2018-11-15 21:02:19 [DEBUG   ] Got command BAM from MCS: ref #518844
2018-11-15 21:02:19 [INFO    ] Finished processing BAM request
2018-11-15 21:02:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:02:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518844   8 58437 75739041 A  ERROR'
2018-11-15 21:02:19 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 21:02:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 21:02:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2018-11-15 21:02:19 [WARNING ] (13, 1, 'bot')
2018-11-15 21:02:19 [WARNING ] (13, 1, 'bot')
2018-11-15 21:02:19 [WARNING ] (13, 1, 'bot')
2018-11-15 21:02:19 [WARNING ] (13, 1, 'bot')
2018-11-15 21:02:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:02:19 [DEBUG   ] Finished updating board flags in 1.076 seconds
2018-11-15 21:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 21:02:19 [DEBUG   ] spawn_process: at 2018-11-15 21:02:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 21:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 21:02:19 [DEBUG   ] spawn_process: at 2018-11-15 21:02:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 21:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 21:02:19 [DEBUG   ] spawn_process: at 2018-11-15 21:02:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 21:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 21:02:19 [DEBUG   ] spawn_process: at 2018-11-15 21:02:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 21:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 21:02:19 [DEBUG   ] spawn_process: at 2018-11-15 21:02:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 21:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 21:02:19 [DEBUG   ] spawn_process: at 2018-11-15 21:02:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 21:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 21:02:19 [DEBUG   ] spawn_process: at 2018-11-15 21:02:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 21:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 21:02:19 [DEBUG   ] spawn_process: at 2018-11-15 21:02:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 21:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 21:02:19 [DEBUG   ] spawn_process: at 2018-11-15 21:02:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 21:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 21:02:19 [DEBUG   ] spawn_process: at 2018-11-15 21:02:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 21:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 21:02:19 [DEBUG   ] spawn_process: at 2018-11-15 21:02:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 21:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 21:02:19 [DEBUG   ] spawn_process: at 2018-11-15 21:02:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 21:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 21:02:19 [DEBUG   ] spawn_process: at 2018-11-15 21:02:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 21:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 21:02:19 [DEBUG   ] spawn_process: at 2018-11-15 21:02:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 21:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 21:02:19 [DEBUG   ] spawn_process: at 2018-11-15 21:02:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 21:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 21:02:19 [DEBUG   ] spawn_process: at 2018-11-15 21:02:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 21:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 21:02:19 [DEBUG   ] spawn_process: at 2018-11-15 21:02:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 21:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 21:02:19 [DEBUG   ] spawn_process: at 2018-11-15 21:02:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 21:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 21:02:19 [DEBUG   ] spawn_process: at 2018-11-15 21:02:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 21:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 21:02:19 [DEBUG   ] spawn_process: at 2018-11-15 21:02:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 21:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 21:02:19 [DEBUG   ] spawn_process: at 2018-11-15 21:02:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 21:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 21:02:19 [DEBUG   ] spawn_process: at 2018-11-15 21:02:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 21:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 21:02:19 [DEBUG   ] spawn_process: at 2018-11-15 21:02:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 21:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 21:02:19 [DEBUG   ] spawn_process: at 2018-11-15 21:02:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 21:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 21:02:19 [DEBUG   ] spawn_process: at 2018-11-15 21:02:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 21:02:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 21:02:19 [DEBUG   ] spawn_process: at 2018-11-15 21:02:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 21:02:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 21:02:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 21:02:59 [DEBUG   ] Got command BAM from MCS: ref #518851
2018-11-15 21:02:59 [INFO    ] Finished processing BAM request
2018-11-15 21:02:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:02:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518851   8 58437 75779029 A  ERROR'
2018-11-15 21:02:59 [DEBUG   ] Got command BAM from MCS: ref #518850
2018-11-15 21:02:59 [INFO    ] Finished processing BAM request
2018-11-15 21:02:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:02:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518850   8 58437 75779033 A  ERROR'
2018-11-15 21:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 21:02:59 [DEBUG   ] spawn_process: at 2018-11-15 21:02:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 21:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 21:02:59 [DEBUG   ] spawn_process: at 2018-11-15 21:02:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 21:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 21:02:59 [DEBUG   ] spawn_process: at 2018-11-15 21:02:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 21:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 21:02:59 [DEBUG   ] spawn_process: at 2018-11-15 21:02:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 21:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 21:02:59 [DEBUG   ] spawn_process: at 2018-11-15 21:02:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 21:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 21:02:59 [DEBUG   ] spawn_process: at 2018-11-15 21:02:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 21:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 21:02:59 [DEBUG   ] spawn_process: at 2018-11-15 21:02:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 21:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 21:02:59 [DEBUG   ] spawn_process: at 2018-11-15 21:02:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 21:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 21:02:59 [DEBUG   ] spawn_process: at 2018-11-15 21:02:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 21:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 21:02:59 [DEBUG   ] spawn_process: at 2018-11-15 21:02:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 21:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 21:02:59 [DEBUG   ] spawn_process: at 2018-11-15 21:02:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 21:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 21:02:59 [DEBUG   ] spawn_process: at 2018-11-15 21:02:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 21:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 21:02:59 [DEBUG   ] spawn_process: at 2018-11-15 21:02:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 21:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 21:02:59 [DEBUG   ] spawn_process: at 2018-11-15 21:02:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 21:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 21:02:59 [DEBUG   ] spawn_process: at 2018-11-15 21:02:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 21:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 21:02:59 [DEBUG   ] spawn_process: at 2018-11-15 21:02:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 21:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 21:02:59 [DEBUG   ] spawn_process: at 2018-11-15 21:02:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 21:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 21:02:59 [DEBUG   ] spawn_process: at 2018-11-15 21:02:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 21:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 21:02:59 [DEBUG   ] spawn_process: at 2018-11-15 21:02:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 21:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 21:02:59 [DEBUG   ] spawn_process: at 2018-11-15 21:02:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 21:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 21:02:59 [DEBUG   ] spawn_process: at 2018-11-15 21:02:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 21:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 21:02:59 [DEBUG   ] spawn_process: at 2018-11-15 21:02:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 21:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 21:02:59 [DEBUG   ] spawn_process: at 2018-11-15 21:02:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 21:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 21:02:59 [DEBUG   ] spawn_process: at 2018-11-15 21:02:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 21:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 21:02:59 [DEBUG   ] spawn_process: at 2018-11-15 21:02:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 21:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 21:02:59 [DEBUG   ] spawn_process: at 2018-11-15 21:02:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 21:03:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 21:03:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 21:03:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:03:20 [DEBUG   ] Finished updating ant stats in 0.631 seconds
2018-11-15 21:03:20 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 21:03:20 [WARNING ] (13, 1, 'bot')
2018-11-15 21:03:20 [WARNING ] (13, 1, 'bot')
2018-11-15 21:03:20 [WARNING ] (13, 1, 'bot')
2018-11-15 21:03:20 [WARNING ] (13, 1, 'bot')
2018-11-15 21:03:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:03:20 [DEBUG   ] Finished updating board flags in 2.004 seconds
2018-11-15 21:03:24 [DEBUG   ] Got command RPT from MCS: ref #518852
2018-11-15 21:03:24 [DEBUG   ] summary = ERROR
2018-11-15 21:03:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518852  13 58437 75804237 A  ERRORERROR'
2018-11-15 21:03:24 [DEBUG   ] Got command RPT from MCS: ref #518853
2018-11-15 21:03:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 21:03:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518853  77 58437 75804429 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 21:03:24 [DEBUG   ] Got command RPT from MCS: ref #518854
2018-11-15 21:03:24 [DEBUG   ] summary = ERROR
2018-11-15 21:03:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518854  13 58437 75804633 A  ERRORERROR'
2018-11-15 21:03:24 [DEBUG   ] Got command RPT from MCS: ref #518855
2018-11-15 21:03:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 21:03:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518855  77 58437 75804837 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 21:03:25 [DEBUG   ] Got command RPT from MCS: ref #518856
2018-11-15 21:03:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 21:03:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518856  12 58437 75805041 A  ERRORB£ff'
2018-11-15 21:03:39 [DEBUG   ] Got command BAM from MCS: ref #518857
2018-11-15 21:03:39 [INFO    ] Finished processing BAM request
2018-11-15 21:03:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518857   8 58437 75819025 A  ERROR'
2018-11-15 21:03:39 [DEBUG   ] Got command BAM from MCS: ref #518858
2018-11-15 21:03:39 [INFO    ] Finished processing BAM request
2018-11-15 21:03:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518858   8 58437 75819029 A  ERROR'
2018-11-15 21:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 21:03:39 [DEBUG   ] spawn_process: at 2018-11-15 21:03:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 21:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 21:03:39 [DEBUG   ] spawn_process: at 2018-11-15 21:03:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 21:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 21:03:39 [DEBUG   ] spawn_process: at 2018-11-15 21:03:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 21:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 21:03:39 [DEBUG   ] spawn_process: at 2018-11-15 21:03:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 21:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 21:03:39 [DEBUG   ] spawn_process: at 2018-11-15 21:03:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 21:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 21:03:39 [DEBUG   ] spawn_process: at 2018-11-15 21:03:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 21:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 21:03:39 [DEBUG   ] spawn_process: at 2018-11-15 21:03:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 21:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 21:03:39 [DEBUG   ] spawn_process: at 2018-11-15 21:03:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 21:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 21:03:39 [DEBUG   ] spawn_process: at 2018-11-15 21:03:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 21:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 21:03:39 [DEBUG   ] spawn_process: at 2018-11-15 21:03:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 21:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 21:03:39 [DEBUG   ] spawn_process: at 2018-11-15 21:03:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 21:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 21:03:39 [DEBUG   ] spawn_process: at 2018-11-15 21:03:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 21:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 21:03:39 [DEBUG   ] spawn_process: at 2018-11-15 21:03:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 21:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 21:03:39 [DEBUG   ] spawn_process: at 2018-11-15 21:03:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 21:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 21:03:39 [DEBUG   ] spawn_process: at 2018-11-15 21:03:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 21:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 21:03:39 [DEBUG   ] spawn_process: at 2018-11-15 21:03:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 21:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 21:03:39 [DEBUG   ] spawn_process: at 2018-11-15 21:03:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 21:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 21:03:39 [DEBUG   ] spawn_process: at 2018-11-15 21:03:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 21:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 21:03:39 [DEBUG   ] spawn_process: at 2018-11-15 21:03:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 21:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 21:03:39 [DEBUG   ] spawn_process: at 2018-11-15 21:03:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 21:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 21:03:39 [DEBUG   ] spawn_process: at 2018-11-15 21:03:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 21:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 21:03:39 [DEBUG   ] spawn_process: at 2018-11-15 21:03:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 21:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 21:03:39 [DEBUG   ] spawn_process: at 2018-11-15 21:03:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 21:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 21:03:39 [DEBUG   ] spawn_process: at 2018-11-15 21:03:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 21:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 21:03:39 [DEBUG   ] spawn_process: at 2018-11-15 21:03:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 21:03:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 21:03:39 [DEBUG   ] spawn_process: at 2018-11-15 21:03:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 21:03:40 [DEBUG   ] Finished updating ant stats in 0.575 seconds
2018-11-15 21:04:00 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 21:04:19 [DEBUG   ] Got command BAM from MCS: ref #518860
2018-11-15 21:04:19 [INFO    ] Finished processing BAM request
2018-11-15 21:04:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:04:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518860   8 58437 75859029 A  ERROR'
2018-11-15 21:04:19 [DEBUG   ] Got command BAM from MCS: ref #518859
2018-11-15 21:04:19 [INFO    ] Finished processing BAM request
2018-11-15 21:04:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:04:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518859   8 58437 75859033 A  ERROR'
2018-11-15 21:04:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 21:04:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 21:04:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-11-15 21:04:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:04:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-15 21:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 21:04:19 [DEBUG   ] spawn_process: at 2018-11-15 21:04:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 21:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 21:04:19 [DEBUG   ] spawn_process: at 2018-11-15 21:04:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 21:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 21:04:19 [DEBUG   ] spawn_process: at 2018-11-15 21:04:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 21:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 21:04:19 [DEBUG   ] spawn_process: at 2018-11-15 21:04:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 21:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 21:04:19 [DEBUG   ] spawn_process: at 2018-11-15 21:04:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 21:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 21:04:19 [DEBUG   ] spawn_process: at 2018-11-15 21:04:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 21:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 21:04:19 [DEBUG   ] spawn_process: at 2018-11-15 21:04:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 21:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 21:04:19 [DEBUG   ] spawn_process: at 2018-11-15 21:04:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 21:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 21:04:19 [DEBUG   ] spawn_process: at 2018-11-15 21:04:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 21:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 21:04:19 [DEBUG   ] spawn_process: at 2018-11-15 21:04:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 21:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 21:04:19 [DEBUG   ] spawn_process: at 2018-11-15 21:04:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 21:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 21:04:19 [DEBUG   ] spawn_process: at 2018-11-15 21:04:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 21:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 21:04:19 [DEBUG   ] spawn_process: at 2018-11-15 21:04:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 21:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 21:04:19 [DEBUG   ] spawn_process: at 2018-11-15 21:04:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 21:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 21:04:19 [DEBUG   ] spawn_process: at 2018-11-15 21:04:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 21:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 21:04:19 [DEBUG   ] spawn_process: at 2018-11-15 21:04:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 21:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 21:04:19 [DEBUG   ] spawn_process: at 2018-11-15 21:04:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 21:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 21:04:19 [DEBUG   ] spawn_process: at 2018-11-15 21:04:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 21:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 21:04:19 [DEBUG   ] spawn_process: at 2018-11-15 21:04:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 21:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 21:04:19 [DEBUG   ] spawn_process: at 2018-11-15 21:04:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 21:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 21:04:19 [DEBUG   ] spawn_process: at 2018-11-15 21:04:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 21:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 21:04:19 [DEBUG   ] spawn_process: at 2018-11-15 21:04:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 21:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 21:04:19 [DEBUG   ] spawn_process: at 2018-11-15 21:04:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 21:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 21:04:19 [DEBUG   ] spawn_process: at 2018-11-15 21:04:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 21:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 21:04:19 [DEBUG   ] spawn_process: at 2018-11-15 21:04:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 21:04:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 21:04:19 [DEBUG   ] spawn_process: at 2018-11-15 21:04:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 21:04:20 [DEBUG   ] Finished updating ant stats in 0.430 seconds
2018-11-15 21:04:20 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 21:04:20 [WARNING ] (13, 1, 'bot')
2018-11-15 21:04:20 [WARNING ] (13, 1, 'bot')
2018-11-15 21:04:20 [WARNING ] (13, 1, 'bot')
2018-11-15 21:04:20 [WARNING ] (13, 1, 'bot')
2018-11-15 21:04:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:04:20 [DEBUG   ] Finished updating board flags in 1.998 seconds
2018-11-15 21:04:40 [DEBUG   ] Finished updating ant stats in 0.374 seconds
2018-11-15 21:04:59 [DEBUG   ] Got command BAM from MCS: ref #518861
2018-11-15 21:04:59 [INFO    ] Finished processing BAM request
2018-11-15 21:04:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:04:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518861   8 58437 75899033 A  ERROR'
2018-11-15 21:04:59 [DEBUG   ] Got command BAM from MCS: ref #518862
2018-11-15 21:04:59 [INFO    ] Finished processing BAM request
2018-11-15 21:04:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:04:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518862   8 58437 75899037 A  ERROR'
2018-11-15 21:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 21:04:59 [DEBUG   ] spawn_process: at 2018-11-15 21:04:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 21:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 21:04:59 [DEBUG   ] spawn_process: at 2018-11-15 21:04:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 21:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 21:04:59 [DEBUG   ] spawn_process: at 2018-11-15 21:04:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 21:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 21:04:59 [DEBUG   ] spawn_process: at 2018-11-15 21:04:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 21:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 21:04:59 [DEBUG   ] spawn_process: at 2018-11-15 21:04:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 21:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 21:04:59 [DEBUG   ] spawn_process: at 2018-11-15 21:04:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 21:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 21:04:59 [DEBUG   ] spawn_process: at 2018-11-15 21:04:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 21:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 21:04:59 [DEBUG   ] spawn_process: at 2018-11-15 21:04:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 21:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 21:04:59 [DEBUG   ] spawn_process: at 2018-11-15 21:04:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 21:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 21:04:59 [DEBUG   ] spawn_process: at 2018-11-15 21:04:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 21:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 21:04:59 [DEBUG   ] spawn_process: at 2018-11-15 21:04:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 21:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 21:04:59 [DEBUG   ] spawn_process: at 2018-11-15 21:04:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 21:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 21:04:59 [DEBUG   ] spawn_process: at 2018-11-15 21:04:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 21:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 21:04:59 [DEBUG   ] spawn_process: at 2018-11-15 21:04:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 21:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 21:04:59 [DEBUG   ] spawn_process: at 2018-11-15 21:04:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 21:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 21:04:59 [DEBUG   ] spawn_process: at 2018-11-15 21:04:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 21:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 21:04:59 [DEBUG   ] spawn_process: at 2018-11-15 21:04:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 21:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 21:04:59 [DEBUG   ] spawn_process: at 2018-11-15 21:04:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 21:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 21:04:59 [DEBUG   ] spawn_process: at 2018-11-15 21:04:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 21:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 21:04:59 [DEBUG   ] spawn_process: at 2018-11-15 21:04:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 21:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 21:04:59 [DEBUG   ] spawn_process: at 2018-11-15 21:04:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 21:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 21:04:59 [DEBUG   ] spawn_process: at 2018-11-15 21:04:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 21:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 21:04:59 [DEBUG   ] spawn_process: at 2018-11-15 21:04:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 21:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 21:04:59 [DEBUG   ] spawn_process: at 2018-11-15 21:04:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 21:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 21:04:59 [DEBUG   ] spawn_process: at 2018-11-15 21:04:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 21:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 21:04:59 [DEBUG   ] spawn_process: at 2018-11-15 21:04:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 21:05:01 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 21:05:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:05:19 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 21:05:19 [WARNING ] (13, 1, 'bot')
2018-11-15 21:05:19 [WARNING ] (13, 1, 'bot')
2018-11-15 21:05:19 [WARNING ] (13, 1, 'bot')
2018-11-15 21:05:19 [WARNING ] (13, 1, 'bot')
2018-11-15 21:05:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:05:19 [DEBUG   ] Finished updating board flags in 1.180 seconds
2018-11-15 21:05:21 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 21:05:39 [DEBUG   ] Got command BAM from MCS: ref #518867
2018-11-15 21:05:39 [INFO    ] Finished processing BAM request
2018-11-15 21:05:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:05:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518867   8 58437 75939025 A  ERROR'
2018-11-15 21:05:39 [DEBUG   ] Got command BAM from MCS: ref #518868
2018-11-15 21:05:39 [INFO    ] Finished processing BAM request
2018-11-15 21:05:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:05:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518868   8 58437 75939029 A  ERROR'
2018-11-15 21:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 21:05:39 [DEBUG   ] spawn_process: at 2018-11-15 21:05:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 21:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 21:05:39 [DEBUG   ] spawn_process: at 2018-11-15 21:05:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 21:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 21:05:39 [DEBUG   ] spawn_process: at 2018-11-15 21:05:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 21:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 21:05:39 [DEBUG   ] spawn_process: at 2018-11-15 21:05:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 21:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 21:05:39 [DEBUG   ] spawn_process: at 2018-11-15 21:05:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 21:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 21:05:39 [DEBUG   ] spawn_process: at 2018-11-15 21:05:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 21:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 21:05:39 [DEBUG   ] spawn_process: at 2018-11-15 21:05:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 21:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 21:05:39 [DEBUG   ] spawn_process: at 2018-11-15 21:05:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 21:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 21:05:39 [DEBUG   ] spawn_process: at 2018-11-15 21:05:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 21:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 21:05:39 [DEBUG   ] spawn_process: at 2018-11-15 21:05:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 21:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 21:05:39 [DEBUG   ] spawn_process: at 2018-11-15 21:05:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 21:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 21:05:39 [DEBUG   ] spawn_process: at 2018-11-15 21:05:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 21:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 21:05:39 [DEBUG   ] spawn_process: at 2018-11-15 21:05:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 21:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 21:05:39 [DEBUG   ] spawn_process: at 2018-11-15 21:05:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 21:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 21:05:39 [DEBUG   ] spawn_process: at 2018-11-15 21:05:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 21:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 21:05:39 [DEBUG   ] spawn_process: at 2018-11-15 21:05:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 21:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 21:05:39 [DEBUG   ] spawn_process: at 2018-11-15 21:05:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 21:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 21:05:39 [DEBUG   ] spawn_process: at 2018-11-15 21:05:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 21:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 21:05:39 [DEBUG   ] spawn_process: at 2018-11-15 21:05:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 21:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 21:05:39 [DEBUG   ] spawn_process: at 2018-11-15 21:05:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 21:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 21:05:39 [DEBUG   ] spawn_process: at 2018-11-15 21:05:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 21:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 21:05:39 [DEBUG   ] spawn_process: at 2018-11-15 21:05:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 21:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 21:05:39 [DEBUG   ] spawn_process: at 2018-11-15 21:05:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 21:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 21:05:39 [DEBUG   ] spawn_process: at 2018-11-15 21:05:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 21:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 21:05:39 [DEBUG   ] spawn_process: at 2018-11-15 21:05:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 21:05:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 21:05:39 [DEBUG   ] spawn_process: at 2018-11-15 21:05:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 21:05:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 21:05:45 [DEBUG   ] Got command RPT from MCS: ref #518869
2018-11-15 21:05:45 [DEBUG   ] summary = ERROR
2018-11-15 21:05:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518869  13 58437 75945197 A  ERRORERROR'
2018-11-15 21:05:45 [DEBUG   ] Got command RPT from MCS: ref #518870
2018-11-15 21:05:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 21:05:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518870  77 58437 75945198 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 21:06:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 21:06:19 [DEBUG   ] Got command BAM from MCS: ref #518886
2018-11-15 21:06:19 [INFO    ] Finished processing BAM request
2018-11-15 21:06:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:06:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518886   8 58437 75979025 A  ERROR'
2018-11-15 21:06:19 [DEBUG   ] Got command BAM from MCS: ref #518887
2018-11-15 21:06:19 [INFO    ] Finished processing BAM request
2018-11-15 21:06:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:06:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518887   8 58437 75979029 A  ERROR'
2018-11-15 21:06:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-15 21:06:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:06:19 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 21:06:19 [WARNING ] (13, 1, 'bot')
2018-11-15 21:06:19 [WARNING ] (13, 1, 'bot')
2018-11-15 21:06:19 [WARNING ] (13, 1, 'bot')
2018-11-15 21:06:19 [WARNING ] (13, 1, 'bot')
2018-11-15 21:06:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:06:19 [DEBUG   ] Finished updating board flags in 1.022 seconds
2018-11-15 21:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 21:06:19 [DEBUG   ] spawn_process: at 2018-11-15 21:06:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 21:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 21:06:19 [DEBUG   ] spawn_process: at 2018-11-15 21:06:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 21:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 21:06:19 [DEBUG   ] spawn_process: at 2018-11-15 21:06:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 21:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 21:06:19 [DEBUG   ] spawn_process: at 2018-11-15 21:06:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 21:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 21:06:19 [DEBUG   ] spawn_process: at 2018-11-15 21:06:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 21:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 21:06:19 [DEBUG   ] spawn_process: at 2018-11-15 21:06:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 21:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 21:06:19 [DEBUG   ] spawn_process: at 2018-11-15 21:06:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 21:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 21:06:19 [DEBUG   ] spawn_process: at 2018-11-15 21:06:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 21:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 21:06:19 [DEBUG   ] spawn_process: at 2018-11-15 21:06:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 21:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 21:06:19 [DEBUG   ] spawn_process: at 2018-11-15 21:06:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 21:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 21:06:19 [DEBUG   ] spawn_process: at 2018-11-15 21:06:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 21:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 21:06:19 [DEBUG   ] spawn_process: at 2018-11-15 21:06:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 21:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 21:06:19 [DEBUG   ] spawn_process: at 2018-11-15 21:06:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 21:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 21:06:19 [DEBUG   ] spawn_process: at 2018-11-15 21:06:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 21:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 21:06:19 [DEBUG   ] spawn_process: at 2018-11-15 21:06:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 21:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 21:06:19 [DEBUG   ] spawn_process: at 2018-11-15 21:06:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 21:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 21:06:19 [DEBUG   ] spawn_process: at 2018-11-15 21:06:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 21:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 21:06:19 [DEBUG   ] spawn_process: at 2018-11-15 21:06:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 21:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 21:06:19 [DEBUG   ] spawn_process: at 2018-11-15 21:06:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 21:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 21:06:19 [DEBUG   ] spawn_process: at 2018-11-15 21:06:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 21:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 21:06:19 [DEBUG   ] spawn_process: at 2018-11-15 21:06:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 21:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 21:06:19 [DEBUG   ] spawn_process: at 2018-11-15 21:06:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 21:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 21:06:19 [DEBUG   ] spawn_process: at 2018-11-15 21:06:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 21:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 21:06:19 [DEBUG   ] spawn_process: at 2018-11-15 21:06:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 21:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 21:06:19 [DEBUG   ] spawn_process: at 2018-11-15 21:06:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 21:06:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 21:06:19 [DEBUG   ] spawn_process: at 2018-11-15 21:06:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 21:06:21 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 21:06:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 21:06:59 [DEBUG   ] Got command BAM from MCS: ref #518889
2018-11-15 21:06:59 [INFO    ] Finished processing BAM request
2018-11-15 21:06:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:06:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518889   8 58437 76019029 A  ERROR'
2018-11-15 21:06:59 [DEBUG   ] Got command BAM from MCS: ref #518888
2018-11-15 21:06:59 [INFO    ] Finished processing BAM request
2018-11-15 21:06:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:06:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518888   8 58437 76019033 A  ERROR'
2018-11-15 21:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 21:06:59 [DEBUG   ] spawn_process: at 2018-11-15 21:06:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 21:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 21:06:59 [DEBUG   ] spawn_process: at 2018-11-15 21:06:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 21:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 21:06:59 [DEBUG   ] spawn_process: at 2018-11-15 21:06:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 21:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 21:06:59 [DEBUG   ] spawn_process: at 2018-11-15 21:06:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 21:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 21:06:59 [DEBUG   ] spawn_process: at 2018-11-15 21:06:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 21:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 21:06:59 [DEBUG   ] spawn_process: at 2018-11-15 21:06:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 21:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 21:06:59 [DEBUG   ] spawn_process: at 2018-11-15 21:06:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 21:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 21:06:59 [DEBUG   ] spawn_process: at 2018-11-15 21:06:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 21:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 21:06:59 [DEBUG   ] spawn_process: at 2018-11-15 21:06:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 21:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 21:06:59 [DEBUG   ] spawn_process: at 2018-11-15 21:06:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 21:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 21:06:59 [DEBUG   ] spawn_process: at 2018-11-15 21:06:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 21:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 21:06:59 [DEBUG   ] spawn_process: at 2018-11-15 21:06:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 21:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 21:06:59 [DEBUG   ] spawn_process: at 2018-11-15 21:06:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 21:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 21:06:59 [DEBUG   ] spawn_process: at 2018-11-15 21:06:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 21:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 21:06:59 [DEBUG   ] spawn_process: at 2018-11-15 21:06:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 21:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 21:06:59 [DEBUG   ] spawn_process: at 2018-11-15 21:06:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 21:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 21:06:59 [DEBUG   ] spawn_process: at 2018-11-15 21:06:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 21:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 21:06:59 [DEBUG   ] spawn_process: at 2018-11-15 21:06:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 21:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 21:06:59 [DEBUG   ] spawn_process: at 2018-11-15 21:06:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 21:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 21:06:59 [DEBUG   ] spawn_process: at 2018-11-15 21:06:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 21:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 21:06:59 [DEBUG   ] spawn_process: at 2018-11-15 21:06:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 21:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 21:06:59 [DEBUG   ] spawn_process: at 2018-11-15 21:06:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 21:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 21:06:59 [DEBUG   ] spawn_process: at 2018-11-15 21:06:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 21:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 21:06:59 [DEBUG   ] spawn_process: at 2018-11-15 21:06:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 21:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 21:06:59 [DEBUG   ] spawn_process: at 2018-11-15 21:06:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 21:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 21:06:59 [DEBUG   ] spawn_process: at 2018-11-15 21:06:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 21:07:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 21:07:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-15 21:07:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:07:19 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 21:07:19 [WARNING ] (13, 1, 'bot')
2018-11-15 21:07:19 [WARNING ] (13, 1, 'bot')
2018-11-15 21:07:19 [WARNING ] (13, 1, 'bot')
2018-11-15 21:07:19 [WARNING ] (13, 1, 'bot')
2018-11-15 21:07:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:07:19 [DEBUG   ] Finished updating board flags in 1.017 seconds
2018-11-15 21:07:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 21:07:39 [DEBUG   ] Got command BAM from MCS: ref #518890
2018-11-15 21:07:39 [INFO    ] Finished processing BAM request
2018-11-15 21:07:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:07:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518890   8 58437 76059033 A  ERROR'
2018-11-15 21:07:39 [DEBUG   ] Got command BAM from MCS: ref #518891
2018-11-15 21:07:39 [INFO    ] Finished processing BAM request
2018-11-15 21:07:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:07:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518891   8 58437 76059037 A  ERROR'
2018-11-15 21:07:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 21:07:39 [DEBUG   ] spawn_process: at 2018-11-15 21:07:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 21:07:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 21:07:39 [DEBUG   ] spawn_process: at 2018-11-15 21:07:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 21:07:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 21:07:39 [DEBUG   ] spawn_process: at 2018-11-15 21:07:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 21:07:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 21:07:39 [DEBUG   ] spawn_process: at 2018-11-15 21:07:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 21:07:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 21:07:39 [DEBUG   ] spawn_process: at 2018-11-15 21:07:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 21:07:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 21:07:39 [DEBUG   ] spawn_process: at 2018-11-15 21:07:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 21:07:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 21:07:39 [DEBUG   ] spawn_process: at 2018-11-15 21:07:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 21:07:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 21:07:39 [DEBUG   ] spawn_process: at 2018-11-15 21:07:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 21:07:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 21:07:39 [DEBUG   ] spawn_process: at 2018-11-15 21:07:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 21:07:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 21:07:39 [DEBUG   ] spawn_process: at 2018-11-15 21:07:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 21:07:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 21:07:39 [DEBUG   ] spawn_process: at 2018-11-15 21:07:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 21:07:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 21:07:39 [DEBUG   ] spawn_process: at 2018-11-15 21:07:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 21:07:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 21:07:39 [DEBUG   ] spawn_process: at 2018-11-15 21:07:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 21:07:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 21:07:39 [DEBUG   ] spawn_process: at 2018-11-15 21:07:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 21:07:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 21:07:39 [DEBUG   ] spawn_process: at 2018-11-15 21:07:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 21:07:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 21:07:39 [DEBUG   ] spawn_process: at 2018-11-15 21:07:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 21:07:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 21:07:39 [DEBUG   ] spawn_process: at 2018-11-15 21:07:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 21:07:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 21:07:39 [DEBUG   ] spawn_process: at 2018-11-15 21:07:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 21:07:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 21:07:39 [DEBUG   ] spawn_process: at 2018-11-15 21:07:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 21:07:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 21:07:39 [DEBUG   ] spawn_process: at 2018-11-15 21:07:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 21:07:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 21:07:39 [DEBUG   ] spawn_process: at 2018-11-15 21:07:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 21:07:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 21:07:39 [DEBUG   ] spawn_process: at 2018-11-15 21:07:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 21:07:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 21:07:39 [DEBUG   ] spawn_process: at 2018-11-15 21:07:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 21:07:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 21:07:39 [DEBUG   ] spawn_process: at 2018-11-15 21:07:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 21:07:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 21:07:39 [DEBUG   ] spawn_process: at 2018-11-15 21:07:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 21:07:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 21:07:39 [DEBUG   ] spawn_process: at 2018-11-15 21:07:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 21:07:41 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 21:08:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 21:08:19 [DEBUG   ] Got command BAM from MCS: ref #518895
2018-11-15 21:08:19 [INFO    ] Finished processing BAM request
2018-11-15 21:08:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:08:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518895   8 58437 76099041 A  ERROR'
2018-11-15 21:08:19 [DEBUG   ] Got command BAM from MCS: ref #518894
2018-11-15 21:08:19 [INFO    ] Finished processing BAM request
2018-11-15 21:08:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:08:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518894   8 58437 76099049 A  ERROR'
2018-11-15 21:08:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 21:08:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 21:08:19 [DEBUG   ] spawn_process: at 2018-11-15 21:08:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 21:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 21:08:19 [DEBUG   ] spawn_process: at 2018-11-15 21:08:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 21:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 21:08:19 [DEBUG   ] spawn_process: at 2018-11-15 21:08:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 21:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 21:08:19 [DEBUG   ] spawn_process: at 2018-11-15 21:08:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 21:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 21:08:19 [DEBUG   ] spawn_process: at 2018-11-15 21:08:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 21:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 21:08:19 [DEBUG   ] spawn_process: at 2018-11-15 21:08:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 21:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 21:08:19 [DEBUG   ] spawn_process: at 2018-11-15 21:08:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 21:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 21:08:19 [DEBUG   ] spawn_process: at 2018-11-15 21:08:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 21:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 21:08:19 [DEBUG   ] spawn_process: at 2018-11-15 21:08:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 21:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 21:08:19 [DEBUG   ] spawn_process: at 2018-11-15 21:08:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 21:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 21:08:19 [DEBUG   ] spawn_process: at 2018-11-15 21:08:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 21:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 21:08:19 [DEBUG   ] spawn_process: at 2018-11-15 21:08:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 21:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 21:08:19 [DEBUG   ] spawn_process: at 2018-11-15 21:08:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 21:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 21:08:19 [DEBUG   ] spawn_process: at 2018-11-15 21:08:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 21:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 21:08:19 [DEBUG   ] spawn_process: at 2018-11-15 21:08:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 21:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 21:08:19 [DEBUG   ] spawn_process: at 2018-11-15 21:08:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 21:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 21:08:19 [DEBUG   ] spawn_process: at 2018-11-15 21:08:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 21:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 21:08:19 [DEBUG   ] spawn_process: at 2018-11-15 21:08:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 21:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 21:08:19 [DEBUG   ] spawn_process: at 2018-11-15 21:08:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 21:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 21:08:19 [DEBUG   ] spawn_process: at 2018-11-15 21:08:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 21:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 21:08:19 [DEBUG   ] spawn_process: at 2018-11-15 21:08:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 21:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 21:08:19 [DEBUG   ] spawn_process: at 2018-11-15 21:08:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 21:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 21:08:19 [DEBUG   ] spawn_process: at 2018-11-15 21:08:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 21:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 21:08:19 [DEBUG   ] spawn_process: at 2018-11-15 21:08:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 21:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 21:08:19 [DEBUG   ] spawn_process: at 2018-11-15 21:08:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 21:08:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 21:08:19 [DEBUG   ] spawn_process: at 2018-11-15 21:08:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 21:08:20 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 21:08:20 [WARNING ] (13, 1, 'bot')
2018-11-15 21:08:20 [WARNING ] (13, 1, 'bot')
2018-11-15 21:08:20 [WARNING ] (13, 1, 'bot')
2018-11-15 21:08:20 [WARNING ] (13, 1, 'bot')
2018-11-15 21:08:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:08:20 [DEBUG   ] Finished updating board flags in 1.548 seconds
2018-11-15 21:08:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 21:08:24 [DEBUG   ] Got command RPT from MCS: ref #518896
2018-11-15 21:08:24 [DEBUG   ] summary = ERROR
2018-11-15 21:08:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518896  13 58437 76104317 A  ERRORERROR'
2018-11-15 21:08:24 [DEBUG   ] Got command RPT from MCS: ref #518897
2018-11-15 21:08:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 21:08:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518897  77 58437 76104521 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 21:08:24 [DEBUG   ] Got command RPT from MCS: ref #518898
2018-11-15 21:08:24 [DEBUG   ] summary = ERROR
2018-11-15 21:08:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518898  13 58437 76104725 A  ERRORERROR'
2018-11-15 21:08:24 [DEBUG   ] Got command RPT from MCS: ref #518900
2018-11-15 21:08:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 21:08:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518900  77 58437 76104917 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 21:08:25 [DEBUG   ] Got command RPT from MCS: ref #518902
2018-11-15 21:08:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 21:08:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518902  12 58437 76105121 A  ERRORB¢ff'
2018-11-15 21:08:41 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 21:08:59 [DEBUG   ] Got command BAM from MCS: ref #518911
2018-11-15 21:08:59 [INFO    ] Finished processing BAM request
2018-11-15 21:08:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:08:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518911   8 58437 76139033 A  ERROR'
2018-11-15 21:08:59 [DEBUG   ] Got command BAM from MCS: ref #518910
2018-11-15 21:08:59 [INFO    ] Finished processing BAM request
2018-11-15 21:08:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:08:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518910   8 58437 76139037 A  ERROR'
2018-11-15 21:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 21:08:59 [DEBUG   ] spawn_process: at 2018-11-15 21:08:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 21:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 21:08:59 [DEBUG   ] spawn_process: at 2018-11-15 21:08:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 21:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 21:08:59 [DEBUG   ] spawn_process: at 2018-11-15 21:08:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 21:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 21:08:59 [DEBUG   ] spawn_process: at 2018-11-15 21:08:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 21:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 21:08:59 [DEBUG   ] spawn_process: at 2018-11-15 21:08:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 21:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 21:08:59 [DEBUG   ] spawn_process: at 2018-11-15 21:08:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 21:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 21:08:59 [DEBUG   ] spawn_process: at 2018-11-15 21:08:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 21:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 21:08:59 [DEBUG   ] spawn_process: at 2018-11-15 21:08:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 21:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 21:08:59 [DEBUG   ] spawn_process: at 2018-11-15 21:08:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 21:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 21:08:59 [DEBUG   ] spawn_process: at 2018-11-15 21:08:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 21:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 21:08:59 [DEBUG   ] spawn_process: at 2018-11-15 21:08:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 21:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 21:08:59 [DEBUG   ] spawn_process: at 2018-11-15 21:08:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 21:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 21:08:59 [DEBUG   ] spawn_process: at 2018-11-15 21:08:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 21:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 21:08:59 [DEBUG   ] spawn_process: at 2018-11-15 21:08:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 21:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 21:08:59 [DEBUG   ] spawn_process: at 2018-11-15 21:08:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 21:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 21:08:59 [DEBUG   ] spawn_process: at 2018-11-15 21:08:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 21:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 21:08:59 [DEBUG   ] spawn_process: at 2018-11-15 21:08:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 21:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 21:08:59 [DEBUG   ] spawn_process: at 2018-11-15 21:08:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 21:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 21:08:59 [DEBUG   ] spawn_process: at 2018-11-15 21:08:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 21:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 21:08:59 [DEBUG   ] spawn_process: at 2018-11-15 21:08:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 21:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 21:08:59 [DEBUG   ] spawn_process: at 2018-11-15 21:08:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 21:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 21:08:59 [DEBUG   ] spawn_process: at 2018-11-15 21:08:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 21:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 21:08:59 [DEBUG   ] spawn_process: at 2018-11-15 21:08:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 21:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 21:08:59 [DEBUG   ] spawn_process: at 2018-11-15 21:08:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 21:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 21:08:59 [DEBUG   ] spawn_process: at 2018-11-15 21:08:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 21:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 21:08:59 [DEBUG   ] spawn_process: at 2018-11-15 21:08:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 21:09:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 21:09:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:09:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-15 21:09:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 21:09:20 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 21:09:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 21:09:20 [WARNING ] (13, 1, 'bot')
2018-11-15 21:09:20 [WARNING ] (13, 1, 'bot')
2018-11-15 21:09:20 [WARNING ] (13, 1, 'bot')
2018-11-15 21:09:20 [WARNING ] (13, 1, 'bot')
2018-11-15 21:09:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:09:20 [DEBUG   ] Finished updating board flags in 1.426 seconds
2018-11-15 21:09:21 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 21:09:39 [DEBUG   ] Got command BAM from MCS: ref #518913
2018-11-15 21:09:39 [INFO    ] Finished processing BAM request
2018-11-15 21:09:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:09:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518913   8 58437 76179033 A  ERROR'
2018-11-15 21:09:39 [DEBUG   ] Got command BAM from MCS: ref #518912
2018-11-15 21:09:39 [INFO    ] Finished processing BAM request
2018-11-15 21:09:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:09:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518912   8 58437 76179037 A  ERROR'
2018-11-15 21:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 21:09:39 [DEBUG   ] spawn_process: at 2018-11-15 21:09:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 21:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 21:09:39 [DEBUG   ] spawn_process: at 2018-11-15 21:09:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 21:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 21:09:39 [DEBUG   ] spawn_process: at 2018-11-15 21:09:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 21:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 21:09:39 [DEBUG   ] spawn_process: at 2018-11-15 21:09:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 21:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 21:09:39 [DEBUG   ] spawn_process: at 2018-11-15 21:09:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 21:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 21:09:39 [DEBUG   ] spawn_process: at 2018-11-15 21:09:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 21:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 21:09:39 [DEBUG   ] spawn_process: at 2018-11-15 21:09:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 21:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 21:09:39 [DEBUG   ] spawn_process: at 2018-11-15 21:09:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 21:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 21:09:39 [DEBUG   ] spawn_process: at 2018-11-15 21:09:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 21:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 21:09:39 [DEBUG   ] spawn_process: at 2018-11-15 21:09:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 21:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 21:09:39 [DEBUG   ] spawn_process: at 2018-11-15 21:09:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 21:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 21:09:39 [DEBUG   ] spawn_process: at 2018-11-15 21:09:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 21:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 21:09:39 [DEBUG   ] spawn_process: at 2018-11-15 21:09:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 21:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 21:09:39 [DEBUG   ] spawn_process: at 2018-11-15 21:09:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 21:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 21:09:39 [DEBUG   ] spawn_process: at 2018-11-15 21:09:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 21:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 21:09:39 [DEBUG   ] spawn_process: at 2018-11-15 21:09:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 21:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 21:09:39 [DEBUG   ] spawn_process: at 2018-11-15 21:09:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 21:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 21:09:39 [DEBUG   ] spawn_process: at 2018-11-15 21:09:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 21:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 21:09:39 [DEBUG   ] spawn_process: at 2018-11-15 21:09:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 21:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 21:09:39 [DEBUG   ] spawn_process: at 2018-11-15 21:09:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 21:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 21:09:39 [DEBUG   ] spawn_process: at 2018-11-15 21:09:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 21:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 21:09:39 [DEBUG   ] spawn_process: at 2018-11-15 21:09:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 21:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 21:09:39 [DEBUG   ] spawn_process: at 2018-11-15 21:09:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 21:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 21:09:39 [DEBUG   ] spawn_process: at 2018-11-15 21:09:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 21:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 21:09:39 [DEBUG   ] spawn_process: at 2018-11-15 21:09:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 21:09:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 21:09:39 [DEBUG   ] spawn_process: at 2018-11-15 21:09:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 21:09:41 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 21:10:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 21:10:19 [DEBUG   ] Got command BAM from MCS: ref #518914
2018-11-15 21:10:19 [INFO    ] Finished processing BAM request
2018-11-15 21:10:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:10:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518914   8 58437 76219033 A  ERROR'
2018-11-15 21:10:19 [DEBUG   ] Got command BAM from MCS: ref #518915
2018-11-15 21:10:19 [INFO    ] Finished processing BAM request
2018-11-15 21:10:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:10:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518915   8 58437 76219037 A  ERROR'
2018-11-15 21:10:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 21:10:19 [DEBUG   ] spawn_process: at 2018-11-15 21:10:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 21:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 21:10:19 [DEBUG   ] spawn_process: at 2018-11-15 21:10:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 21:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 21:10:19 [DEBUG   ] spawn_process: at 2018-11-15 21:10:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 21:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 21:10:19 [DEBUG   ] spawn_process: at 2018-11-15 21:10:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 21:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 21:10:19 [DEBUG   ] spawn_process: at 2018-11-15 21:10:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 21:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 21:10:19 [DEBUG   ] spawn_process: at 2018-11-15 21:10:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 21:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 21:10:19 [DEBUG   ] spawn_process: at 2018-11-15 21:10:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 21:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 21:10:19 [DEBUG   ] spawn_process: at 2018-11-15 21:10:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 21:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 21:10:19 [DEBUG   ] spawn_process: at 2018-11-15 21:10:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 21:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 21:10:19 [DEBUG   ] spawn_process: at 2018-11-15 21:10:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 21:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 21:10:19 [DEBUG   ] spawn_process: at 2018-11-15 21:10:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 21:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 21:10:19 [DEBUG   ] spawn_process: at 2018-11-15 21:10:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 21:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 21:10:19 [DEBUG   ] spawn_process: at 2018-11-15 21:10:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 21:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 21:10:19 [DEBUG   ] spawn_process: at 2018-11-15 21:10:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 21:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 21:10:19 [DEBUG   ] spawn_process: at 2018-11-15 21:10:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 21:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 21:10:19 [DEBUG   ] spawn_process: at 2018-11-15 21:10:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 21:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 21:10:19 [DEBUG   ] spawn_process: at 2018-11-15 21:10:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 21:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 21:10:19 [DEBUG   ] spawn_process: at 2018-11-15 21:10:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 21:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 21:10:19 [DEBUG   ] spawn_process: at 2018-11-15 21:10:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 21:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 21:10:19 [DEBUG   ] spawn_process: at 2018-11-15 21:10:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 21:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 21:10:19 [DEBUG   ] spawn_process: at 2018-11-15 21:10:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 21:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 21:10:19 [DEBUG   ] spawn_process: at 2018-11-15 21:10:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 21:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 21:10:19 [DEBUG   ] spawn_process: at 2018-11-15 21:10:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 21:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 21:10:19 [DEBUG   ] spawn_process: at 2018-11-15 21:10:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 21:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 21:10:19 [DEBUG   ] spawn_process: at 2018-11-15 21:10:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 21:10:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 21:10:19 [DEBUG   ] spawn_process: at 2018-11-15 21:10:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 21:10:20 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 21:10:20 [WARNING ] (13, 1, 'bot')
2018-11-15 21:10:20 [WARNING ] (13, 1, 'bot')
2018-11-15 21:10:20 [WARNING ] (13, 1, 'bot')
2018-11-15 21:10:20 [WARNING ] (13, 1, 'bot')
2018-11-15 21:10:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:10:20 [DEBUG   ] Finished updating board flags in 1.484 seconds
2018-11-15 21:10:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 21:10:41 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 21:10:45 [DEBUG   ] Got command RPT from MCS: ref #518916
2018-11-15 21:10:45 [DEBUG   ] summary = ERROR
2018-11-15 21:10:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518916  13 58437 76245205 A  ERRORERROR'
2018-11-15 21:10:45 [DEBUG   ] Got command RPT from MCS: ref #518917
2018-11-15 21:10:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 21:10:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518917  77 58437 76245206 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 21:10:59 [DEBUG   ] Got command BAM from MCS: ref #518933
2018-11-15 21:10:59 [INFO    ] Finished processing BAM request
2018-11-15 21:10:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:10:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518933   8 58437 76259033 A  ERROR'
2018-11-15 21:10:59 [DEBUG   ] Got command BAM from MCS: ref #518934
2018-11-15 21:10:59 [INFO    ] Finished processing BAM request
2018-11-15 21:10:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:10:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   518934   8 58437 76259037 A  ERROR'
2018-11-15 21:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 21:10:59 [DEBUG   ] spawn_process: at 2018-11-15 21:10:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 21:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 21:10:59 [DEBUG   ] spawn_process: at 2018-11-15 21:10:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 21:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 21:10:59 [DEBUG   ] spawn_process: at 2018-11-15 21:10:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 21:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 21:10:59 [DEBUG   ] spawn_process: at 2018-11-15 21:10:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 21:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 21:10:59 [DEBUG   ] spawn_process: at 2018-11-15 21:10:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 21:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 21:10:59 [DEBUG   ] spawn_process: at 2018-11-15 21:10:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 21:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 21:10:59 [DEBUG   ] spawn_process: at 2018-11-15 21:10:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 21:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 21:10:59 [DEBUG   ] spawn_process: at 2018-11-15 21:10:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 21:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 21:10:59 [DEBUG   ] spawn_process: at 2018-11-15 21:10:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 21:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 21:10:59 [DEBUG   ] spawn_process: at 2018-11-15 21:10:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 21:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 21:10:59 [DEBUG   ] spawn_process: at 2018-11-15 21:10:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 21:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 21:10:59 [DEBUG   ] spawn_process: at 2018-11-15 21:10:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 21:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 21:10:59 [DEBUG   ] spawn_process: at 2018-11-15 21:10:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 21:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 21:10:59 [DEBUG   ] spawn_process: at 2018-11-15 21:10:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 21:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 21:10:59 [DEBUG   ] spawn_process: at 2018-11-15 21:10:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 21:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 21:10:59 [DEBUG   ] spawn_process: at 2018-11-15 21:10:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 21:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 21:10:59 [DEBUG   ] spawn_process: at 2018-11-15 21:10:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 21:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 21:10:59 [DEBUG   ] spawn_process: at 2018-11-15 21:10:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 21:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 21:10:59 [DEBUG   ] spawn_process: at 2018-11-15 21:10:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 21:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 21:10:59 [DEBUG   ] spawn_process: at 2018-11-15 21:10:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 21:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 21:10:59 [DEBUG   ] spawn_process: at 2018-11-15 21:10:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 21:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 21:10:59 [DEBUG   ] spawn_process: at 2018-11-15 21:10:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 21:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 21:10:59 [DEBUG   ] spawn_process: at 2018-11-15 21:10:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 21:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 21:10:59 [DEBUG   ] spawn_process: at 2018-11-15 21:10:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 21:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 21:10:59 [DEBUG   ] spawn_process: at 2018-11-15 21:10:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 21:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 21:10:59 [DEBUG   ] spawn_process: at 2018-11-15 21:10:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 21:11:01 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 21:11:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:11:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 21:11:20 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 21:11:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 21:11:20 [WARNING ] (13, 1, 'bot')
2018-11-15 21:11:20 [WARNING ] (13, 1, 'bot')
2018-11-15 21:11:20 [WARNING ] (13, 1, 'bot')
2018-11-15 21:11:20 [WARNING ] (13, 1, 'bot')
2018-11-15 21:11:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:11:20 [DEBUG   ] Finished updating board flags in 1.304 seconds
2018-11-15 21:11:21 [DEBUG   ] Got command STP from MCS: ref #518935
2018-11-15 21:11:21 [INFO    ] Finished processing BAM request
2018-11-15 21:11:21 [INFO    ] Shutdown the adder chain on beam #3
2018-11-15 21:11:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP   518935   8 58437 76281117 A  ERROR'
2018-11-15 21:11:21 [DEBUG   ] Got command STP from MCS: ref #518936
2018-11-15 21:11:21 [INFO    ] Finished processing BAM request
2018-11-15 21:11:21 [INFO    ] Shutdown the adder chain on beam #2
2018-11-15 21:11:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP   518936   8 58437 76281121 A  ERROR'
2018-11-15 21:11:21 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 21:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 21:11:21 [DEBUG   ] spawn_process: at 2018-11-15 21:11:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 21:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 21:11:21 [DEBUG   ] spawn_process: at 2018-11-15 21:11:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 21:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 21:11:21 [DEBUG   ] spawn_process: at 2018-11-15 21:11:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 21:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 21:11:21 [DEBUG   ] spawn_process: at 2018-11-15 21:11:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 21:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 21:11:21 [DEBUG   ] spawn_process: at 2018-11-15 21:11:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 21:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 21:11:21 [DEBUG   ] spawn_process: at 2018-11-15 21:11:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 21:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 21:11:21 [DEBUG   ] spawn_process: at 2018-11-15 21:11:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 21:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 21:11:21 [DEBUG   ] spawn_process: at 2018-11-15 21:11:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 21:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 21:11:21 [DEBUG   ] spawn_process: at 2018-11-15 21:11:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 21:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 21:11:21 [DEBUG   ] spawn_process: at 2018-11-15 21:11:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 21:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 21:11:21 [DEBUG   ] spawn_process: at 2018-11-15 21:11:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 21:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 21:11:21 [DEBUG   ] spawn_process: at 2018-11-15 21:11:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 21:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 21:11:21 [DEBUG   ] spawn_process: at 2018-11-15 21:11:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 21:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 21:11:21 [DEBUG   ] spawn_process: at 2018-11-15 21:11:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 21:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 21:11:21 [DEBUG   ] spawn_process: at 2018-11-15 21:11:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 21:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 21:11:21 [DEBUG   ] spawn_process: at 2018-11-15 21:11:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 21:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 21:11:21 [DEBUG   ] spawn_process: at 2018-11-15 21:11:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 21:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 21:11:21 [DEBUG   ] spawn_process: at 2018-11-15 21:11:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 21:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 21:11:21 [DEBUG   ] spawn_process: at 2018-11-15 21:11:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 21:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 21:11:21 [DEBUG   ] spawn_process: at 2018-11-15 21:11:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 21:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 21:11:21 [DEBUG   ] spawn_process: at 2018-11-15 21:11:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 21:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 21:11:21 [DEBUG   ] spawn_process: at 2018-11-15 21:11:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 21:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 21:11:21 [DEBUG   ] spawn_process: at 2018-11-15 21:11:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 21:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 21:11:21 [DEBUG   ] spawn_process: at 2018-11-15 21:11:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 21:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 21:11:21 [DEBUG   ] spawn_process: at 2018-11-15 21:11:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 21:11:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 21:11:21 [DEBUG   ] spawn_process: at 2018-11-15 21:11:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 21:11:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 21:12:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 21:12:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:12:20 [WARNING ] (13, 1, 'bot')
2018-11-15 21:12:20 [WARNING ] (13, 1, 'bot')
2018-11-15 21:12:20 [WARNING ] (13, 1, 'bot')
2018-11-15 21:12:20 [WARNING ] (13, 1, 'bot')
2018-11-15 21:12:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:12:20 [DEBUG   ] Finished updating board flags in 1.197 seconds
2018-11-15 21:12:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 21:12:41 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 21:13:01 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 21:13:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:13:21 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 21:13:21 [DEBUG   ] Finished updating ant stats in 1.230 seconds
2018-11-15 21:13:21 [WARNING ] (13, 1, 'bot')
2018-11-15 21:13:21 [WARNING ] (13, 1, 'bot')
2018-11-15 21:13:21 [WARNING ] (13, 1, 'bot')
2018-11-15 21:13:21 [WARNING ] (13, 1, 'bot')
2018-11-15 21:13:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:13:21 [DEBUG   ] Finished updating board flags in 2.056 seconds
2018-11-15 21:13:24 [DEBUG   ] Got command RPT from MCS: ref #518941
2018-11-15 21:13:24 [DEBUG   ] summary = ERROR
2018-11-15 21:13:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518941  13 58437 76404405 A  ERRORERROR'
2018-11-15 21:13:24 [DEBUG   ] Got command RPT from MCS: ref #518942
2018-11-15 21:13:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 21:13:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518942  77 58437 76404609 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 21:13:24 [DEBUG   ] Got command RPT from MCS: ref #518943
2018-11-15 21:13:24 [DEBUG   ] summary = ERROR
2018-11-15 21:13:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518943  13 58437 76404801 A  ERRORERROR'
2018-11-15 21:13:25 [DEBUG   ] Got command RPT from MCS: ref #518944
2018-11-15 21:13:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 21:13:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518944  77 58437 76405005 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 21:13:25 [DEBUG   ] Got command RPT from MCS: ref #518945
2018-11-15 21:13:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 21:13:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518945  12 58437 76405209 A  ERRORB›™š'
2018-11-15 21:13:41 [DEBUG   ] Finished updating ant stats in 1.175 seconds
2018-11-15 21:14:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 21:14:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:14:21 [DEBUG   ] Finished updating ant stats in 1.030 seconds
2018-11-15 21:14:21 [WARNING ] (13, 1, 'bot')
2018-11-15 21:14:21 [WARNING ] (13, 1, 'bot')
2018-11-15 21:14:21 [WARNING ] (13, 1, 'bot')
2018-11-15 21:14:21 [WARNING ] (13, 1, 'bot')
2018-11-15 21:14:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:14:21 [DEBUG   ] Finished updating board flags in 1.982 seconds
2018-11-15 21:14:41 [DEBUG   ] Finished updating ant stats in 0.974 seconds
2018-11-15 21:15:01 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 21:15:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:15:21 [DEBUG   ] Finished updating ant stats in 0.830 seconds
2018-11-15 21:15:21 [WARNING ] (13, 1, 'bot')
2018-11-15 21:15:21 [WARNING ] (13, 1, 'bot')
2018-11-15 21:15:21 [WARNING ] (13, 1, 'bot')
2018-11-15 21:15:21 [WARNING ] (13, 1, 'bot')
2018-11-15 21:15:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:15:21 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-11-15 21:15:41 [DEBUG   ] Finished updating ant stats in 0.774 seconds
2018-11-15 21:15:45 [DEBUG   ] Got command RPT from MCS: ref #518950
2018-11-15 21:15:45 [DEBUG   ] summary = ERROR
2018-11-15 21:15:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518950  13 58437 76545201 A  ERRORERROR'
2018-11-15 21:15:45 [DEBUG   ] Got command RPT from MCS: ref #518951
2018-11-15 21:15:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 21:15:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518951  77 58437 76545202 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 21:16:01 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 21:16:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:16:21 [DEBUG   ] Finished updating ant stats in 0.630 seconds
2018-11-15 21:16:21 [WARNING ] (13, 1, 'bot')
2018-11-15 21:16:21 [WARNING ] (13, 1, 'bot')
2018-11-15 21:16:21 [WARNING ] (13, 1, 'bot')
2018-11-15 21:16:21 [WARNING ] (13, 1, 'bot')
2018-11-15 21:16:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:16:21 [DEBUG   ] Finished updating board flags in 1.782 seconds
2018-11-15 21:16:41 [DEBUG   ] Finished updating ant stats in 0.574 seconds
2018-11-15 21:17:01 [DEBUG   ] Finished updating ant stats in 0.447 seconds
2018-11-15 21:17:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 21:17:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:17:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-15 21:17:20 [WARNING ] (13, 1, 'bot')
2018-11-15 21:17:20 [WARNING ] (13, 1, 'bot')
2018-11-15 21:17:20 [WARNING ] (13, 1, 'bot')
2018-11-15 21:17:20 [WARNING ] (13, 1, 'bot')
2018-11-15 21:17:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:17:20 [DEBUG   ] Finished updating board flags in 0.995 seconds
2018-11-15 21:17:21 [DEBUG   ] Finished updating ant stats in 0.358 seconds
2018-11-15 21:17:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 21:18:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 21:18:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:18:21 [WARNING ] (13, 1, 'bot')
2018-11-15 21:18:21 [WARNING ] (13, 1, 'bot')
2018-11-15 21:18:21 [WARNING ] (13, 1, 'bot')
2018-11-15 21:18:21 [WARNING ] (13, 1, 'bot')
2018-11-15 21:18:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:18:21 [DEBUG   ] Finished updating board flags in 1.389 seconds
2018-11-15 21:18:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 21:18:24 [DEBUG   ] Got command RPT from MCS: ref #518973
2018-11-15 21:18:24 [DEBUG   ] summary = ERROR
2018-11-15 21:18:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518973  13 58437 76704489 A  ERRORERROR'
2018-11-15 21:18:24 [DEBUG   ] Got command RPT from MCS: ref #518974
2018-11-15 21:18:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 21:18:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518974  77 58437 76704693 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 21:18:24 [DEBUG   ] Got command RPT from MCS: ref #518975
2018-11-15 21:18:24 [DEBUG   ] summary = ERROR
2018-11-15 21:18:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518975  13 58437 76704897 A  ERRORERROR'
2018-11-15 21:18:25 [DEBUG   ] Got command RPT from MCS: ref #518977
2018-11-15 21:18:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 21:18:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518977  77 58437 76705089 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 21:18:25 [DEBUG   ] Got command RPT from MCS: ref #518978
2018-11-15 21:18:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 21:18:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518978  12 58437 76705293 A  ERRORB˜™š'
2018-11-15 21:18:42 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 21:19:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 21:19:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:19:21 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 21:19:21 [WARNING ] (13, 1, 'bot')
2018-11-15 21:19:21 [WARNING ] (13, 1, 'bot')
2018-11-15 21:19:21 [WARNING ] (13, 1, 'bot')
2018-11-15 21:19:21 [WARNING ] (13, 1, 'bot')
2018-11-15 21:19:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:19:21 [DEBUG   ] Finished updating board flags in 1.194 seconds
2018-11-15 21:19:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 21:19:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 21:20:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 21:20:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:20:22 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 21:20:22 [DEBUG   ] Finished updating ant stats in 1.230 seconds
2018-11-15 21:20:22 [WARNING ] (13, 1, 'bot')
2018-11-15 21:20:22 [WARNING ] (13, 1, 'bot')
2018-11-15 21:20:22 [WARNING ] (13, 1, 'bot')
2018-11-15 21:20:22 [WARNING ] (13, 1, 'bot')
2018-11-15 21:20:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:20:22 [DEBUG   ] Finished updating board flags in 2.040 seconds
2018-11-15 21:20:42 [DEBUG   ] Finished updating ant stats in 1.175 seconds
2018-11-15 21:20:45 [DEBUG   ] Got command RPT from MCS: ref #518987
2018-11-15 21:20:45 [DEBUG   ] summary = ERROR
2018-11-15 21:20:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518987  13 58437 76845197 A  ERRORERROR'
2018-11-15 21:20:45 [DEBUG   ] Got command RPT from MCS: ref #518988
2018-11-15 21:20:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 21:20:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   518988  77 58437 76845198 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 21:21:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 21:21:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:21:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-15 21:21:21 [WARNING ] (13, 1, 'bot')
2018-11-15 21:21:21 [WARNING ] (13, 1, 'bot')
2018-11-15 21:21:21 [WARNING ] (13, 1, 'bot')
2018-11-15 21:21:21 [WARNING ] (13, 1, 'bot')
2018-11-15 21:21:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:21:21 [DEBUG   ] Finished updating board flags in 1.407 seconds
2018-11-15 21:21:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 21:21:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 21:22:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 21:22:22 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-15 21:22:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:22:22 [WARNING ] (13, 1, 'bot')
2018-11-15 21:22:22 [WARNING ] (13, 1, 'bot')
2018-11-15 21:22:22 [WARNING ] (13, 1, 'bot')
2018-11-15 21:22:22 [WARNING ] (13, 1, 'bot')
2018-11-15 21:22:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:22:22 [DEBUG   ] Finished updating board flags in 2.386 seconds
2018-11-15 21:22:42 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-15 21:23:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 21:23:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:23:21 [WARNING ] (13, 1, 'bot')
2018-11-15 21:23:21 [WARNING ] (13, 1, 'bot')
2018-11-15 21:23:21 [WARNING ] (13, 1, 'bot')
2018-11-15 21:23:21 [WARNING ] (13, 1, 'bot')
2018-11-15 21:23:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:23:21 [DEBUG   ] Finished updating board flags in 1.227 seconds
2018-11-15 21:23:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 21:23:24 [DEBUG   ] Got command RPT from MCS: ref #519004
2018-11-15 21:23:24 [DEBUG   ] summary = ERROR
2018-11-15 21:23:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519004  13 58437 77004573 A  ERRORERROR'
2018-11-15 21:23:24 [DEBUG   ] Got command RPT from MCS: ref #519005
2018-11-15 21:23:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 21:23:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519005  77 58437 77004777 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 21:23:24 [DEBUG   ] Got command RPT from MCS: ref #519006
2018-11-15 21:23:24 [DEBUG   ] summary = ERROR
2018-11-15 21:23:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519006  13 58437 77004981 A  ERRORERROR'
2018-11-15 21:23:25 [DEBUG   ] Got command RPT from MCS: ref #519007
2018-11-15 21:23:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 21:23:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519007  77 58437 77005173 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 21:23:25 [DEBUG   ] Got command RPT from MCS: ref #519008
2018-11-15 21:23:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 21:23:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519008  12 58437 77005377 A  ERRORB˜™š'
2018-11-15 21:23:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 21:24:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 21:24:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:24:22 [DEBUG   ] Finished updating ant stats in 0.830 seconds
2018-11-15 21:24:22 [WARNING ] (13, 1, 'bot')
2018-11-15 21:24:22 [WARNING ] (13, 1, 'bot')
2018-11-15 21:24:22 [WARNING ] (13, 1, 'bot')
2018-11-15 21:24:22 [WARNING ] (13, 1, 'bot')
2018-11-15 21:24:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:24:22 [DEBUG   ] Finished updating board flags in 1.792 seconds
2018-11-15 21:24:42 [DEBUG   ] Finished updating ant stats in 0.775 seconds
2018-11-15 21:25:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 21:25:12 [DEBUG   ] Got command BAM from MCS: ref #519017
2018-11-15 21:25:12 [INFO    ] Finished processing BAM request
2018-11-15 21:25:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:25:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519017   8 58437 77112029 A  ERROR'
2018-11-15 21:25:12 [DEBUG   ] Got command BAM from MCS: ref #519018
2018-11-15 21:25:12 [INFO    ] Finished processing BAM request
2018-11-15 21:25:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:25:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519018   8 58437 77112033 A  ERROR'
2018-11-15 21:25:12 [DEBUG   ] Got command DRX from MCS: ref #519020
2018-11-15 21:25:12 [INFO    ] sending drx command to lwa34
2018-11-15 21:25:12 [DEBUG   ] run_process: at 2018-11-15 21:25:12 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 1 35100000.0 7 9 9']
2018-11-15 21:25:12 [DEBUG   ] drx = exited with status True, code 0x00
2018-11-15 21:25:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   519020   8 58437 77112097 A  ERROR'
2018-11-15 21:25:12 [DEBUG   ] Got command DRX from MCS: ref #519019
2018-11-15 21:25:12 [INFO    ] sending drx command to lwa16
2018-11-15 21:25:12 [DEBUG   ] run_process: at 2018-11-15 21:25:12 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 1 64500000.0 7 9 9']
2018-11-15 21:25:12 [DEBUG   ] drx = exited with status True, code 0x00
2018-11-15 21:25:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   519019   8 58437 77112101 A  ERROR'
2018-11-15 21:25:12 [DEBUG   ] Got command DRX from MCS: ref #519022
2018-11-15 21:25:12 [INFO    ] sending drx command to lwa34
2018-11-15 21:25:12 [DEBUG   ] run_process: at 2018-11-15 21:25:12 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 2 49800000.0 7 9 9']
2018-11-15 21:25:12 [DEBUG   ] drx = exited with status True, code 0x00
2018-11-15 21:25:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   519022   8 58437 77112105 A  ERROR'
2018-11-15 21:25:12 [DEBUG   ] Got command DRX from MCS: ref #519021
2018-11-15 21:25:12 [INFO    ] sending drx command to lwa16
2018-11-15 21:25:12 [DEBUG   ] run_process: at 2018-11-15 21:25:12 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 2 79200000.0 7 9 9']
2018-11-15 21:25:12 [DEBUG   ] drx = exited with status True, code 0x00
2018-11-15 21:25:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   519021   8 58437 77112109 A  ERROR'
2018-11-15 21:25:12 [INFO    ] Finished starting DRX
2018-11-15 21:25:12 [INFO    ] Finished starting DRX
2018-11-15 21:25:12 [INFO    ] Finished starting DRX
2018-11-15 21:25:12 [INFO    ] Finished starting DRX
2018-11-15 21:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 21:25:12 [DEBUG   ] spawn_process: at 2018-11-15 21:25:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 21:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 21:25:12 [DEBUG   ] spawn_process: at 2018-11-15 21:25:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 21:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 21:25:12 [DEBUG   ] spawn_process: at 2018-11-15 21:25:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 21:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 21:25:12 [DEBUG   ] spawn_process: at 2018-11-15 21:25:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 21:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 21:25:12 [DEBUG   ] spawn_process: at 2018-11-15 21:25:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 21:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 21:25:12 [DEBUG   ] spawn_process: at 2018-11-15 21:25:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 21:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 21:25:12 [DEBUG   ] spawn_process: at 2018-11-15 21:25:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 21:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 21:25:12 [DEBUG   ] spawn_process: at 2018-11-15 21:25:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 21:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 21:25:12 [DEBUG   ] spawn_process: at 2018-11-15 21:25:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 21:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 21:25:12 [DEBUG   ] spawn_process: at 2018-11-15 21:25:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 21:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 21:25:12 [DEBUG   ] spawn_process: at 2018-11-15 21:25:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 21:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 21:25:12 [DEBUG   ] spawn_process: at 2018-11-15 21:25:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 21:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 21:25:12 [DEBUG   ] spawn_process: at 2018-11-15 21:25:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 21:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 21:25:12 [DEBUG   ] spawn_process: at 2018-11-15 21:25:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 21:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 21:25:12 [DEBUG   ] spawn_process: at 2018-11-15 21:25:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 21:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 21:25:12 [DEBUG   ] spawn_process: at 2018-11-15 21:25:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 21:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 21:25:12 [DEBUG   ] spawn_process: at 2018-11-15 21:25:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 21:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 21:25:12 [DEBUG   ] spawn_process: at 2018-11-15 21:25:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 21:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 21:25:12 [DEBUG   ] spawn_process: at 2018-11-15 21:25:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 21:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 21:25:12 [DEBUG   ] spawn_process: at 2018-11-15 21:25:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 21:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 21:25:12 [DEBUG   ] spawn_process: at 2018-11-15 21:25:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 21:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 21:25:12 [DEBUG   ] spawn_process: at 2018-11-15 21:25:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 21:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 21:25:12 [DEBUG   ] spawn_process: at 2018-11-15 21:25:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 21:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 21:25:12 [DEBUG   ] spawn_process: at 2018-11-15 21:25:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 21:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 21:25:12 [DEBUG   ] spawn_process: at 2018-11-15 21:25:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 21:25:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 21:25:12 [DEBUG   ] spawn_process: at 2018-11-15 21:25:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 21:25:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:25:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-11-15 21:25:21 [WARNING ] (13, 1, 'bot')
2018-11-15 21:25:21 [WARNING ] (13, 1, 'bot')
2018-11-15 21:25:21 [WARNING ] (13, 1, 'bot')
2018-11-15 21:25:21 [WARNING ] (13, 1, 'bot')
2018-11-15 21:25:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:25:21 [DEBUG   ] Finished updating board flags in 0.994 seconds
2018-11-15 21:25:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 21:25:36 [DEBUG   ] Got command BAM from MCS: ref #519025
2018-11-15 21:25:36 [INFO    ] Finished processing BAM request
2018-11-15 21:25:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:25:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519025   8 58437 77136029 A  ERROR'
2018-11-15 21:25:36 [DEBUG   ] Got command BAM from MCS: ref #519026
2018-11-15 21:25:36 [INFO    ] Finished processing BAM request
2018-11-15 21:25:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:25:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519026   8 58437 77136033 A  ERROR'
2018-11-15 21:25:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 21:25:36 [DEBUG   ] spawn_process: at 2018-11-15 21:25:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 21:25:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 21:25:36 [DEBUG   ] spawn_process: at 2018-11-15 21:25:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 21:25:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 21:25:36 [DEBUG   ] spawn_process: at 2018-11-15 21:25:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 21:25:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 21:25:36 [DEBUG   ] spawn_process: at 2018-11-15 21:25:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 21:25:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 21:25:36 [DEBUG   ] spawn_process: at 2018-11-15 21:25:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 21:25:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 21:25:36 [DEBUG   ] spawn_process: at 2018-11-15 21:25:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 21:25:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 21:25:36 [DEBUG   ] spawn_process: at 2018-11-15 21:25:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 21:25:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 21:25:36 [DEBUG   ] spawn_process: at 2018-11-15 21:25:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 21:25:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 21:25:36 [DEBUG   ] spawn_process: at 2018-11-15 21:25:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 21:25:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 21:25:36 [DEBUG   ] spawn_process: at 2018-11-15 21:25:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 21:25:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 21:25:36 [DEBUG   ] spawn_process: at 2018-11-15 21:25:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 21:25:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 21:25:36 [DEBUG   ] spawn_process: at 2018-11-15 21:25:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 21:25:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 21:25:36 [DEBUG   ] spawn_process: at 2018-11-15 21:25:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 21:25:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 21:25:36 [DEBUG   ] spawn_process: at 2018-11-15 21:25:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 21:25:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 21:25:36 [DEBUG   ] spawn_process: at 2018-11-15 21:25:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 21:25:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 21:25:36 [DEBUG   ] spawn_process: at 2018-11-15 21:25:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 21:25:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 21:25:36 [DEBUG   ] spawn_process: at 2018-11-15 21:25:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 21:25:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 21:25:36 [DEBUG   ] spawn_process: at 2018-11-15 21:25:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 21:25:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 21:25:36 [DEBUG   ] spawn_process: at 2018-11-15 21:25:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 21:25:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 21:25:36 [DEBUG   ] spawn_process: at 2018-11-15 21:25:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 21:25:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 21:25:36 [DEBUG   ] spawn_process: at 2018-11-15 21:25:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 21:25:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 21:25:36 [DEBUG   ] spawn_process: at 2018-11-15 21:25:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 21:25:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 21:25:36 [DEBUG   ] spawn_process: at 2018-11-15 21:25:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 21:25:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 21:25:36 [DEBUG   ] spawn_process: at 2018-11-15 21:25:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 21:25:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 21:25:36 [DEBUG   ] spawn_process: at 2018-11-15 21:25:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 21:25:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 21:25:36 [DEBUG   ] spawn_process: at 2018-11-15 21:25:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 21:25:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 21:25:45 [DEBUG   ] Got command RPT from MCS: ref #519027
2018-11-15 21:25:45 [DEBUG   ] summary = ERROR
2018-11-15 21:25:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519027  13 58437 77145205 A  ERRORERROR'
2018-11-15 21:25:45 [DEBUG   ] Got command RPT from MCS: ref #519028
2018-11-15 21:25:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 21:25:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519028  77 58437 77145206 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 21:26:00 [DEBUG   ] Got command BAM from MCS: ref #519044
2018-11-15 21:26:00 [INFO    ] Finished processing BAM request
2018-11-15 21:26:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:26:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519044   8 58437 77160033 A  ERROR'
2018-11-15 21:26:00 [DEBUG   ] Got command BAM from MCS: ref #519045
2018-11-15 21:26:00 [INFO    ] Finished processing BAM request
2018-11-15 21:26:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:26:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519045   8 58437 77160037 A  ERROR'
2018-11-15 21:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 21:26:00 [DEBUG   ] spawn_process: at 2018-11-15 21:26:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 21:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 21:26:00 [DEBUG   ] spawn_process: at 2018-11-15 21:26:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 21:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 21:26:00 [DEBUG   ] spawn_process: at 2018-11-15 21:26:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 21:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 21:26:00 [DEBUG   ] spawn_process: at 2018-11-15 21:26:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 21:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 21:26:00 [DEBUG   ] spawn_process: at 2018-11-15 21:26:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 21:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 21:26:00 [DEBUG   ] spawn_process: at 2018-11-15 21:26:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 21:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 21:26:00 [DEBUG   ] spawn_process: at 2018-11-15 21:26:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 21:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 21:26:00 [DEBUG   ] spawn_process: at 2018-11-15 21:26:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 21:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 21:26:00 [DEBUG   ] spawn_process: at 2018-11-15 21:26:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 21:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 21:26:00 [DEBUG   ] spawn_process: at 2018-11-15 21:26:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 21:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 21:26:00 [DEBUG   ] spawn_process: at 2018-11-15 21:26:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 21:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 21:26:00 [DEBUG   ] spawn_process: at 2018-11-15 21:26:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 21:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 21:26:00 [DEBUG   ] spawn_process: at 2018-11-15 21:26:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 21:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 21:26:00 [DEBUG   ] spawn_process: at 2018-11-15 21:26:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 21:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 21:26:00 [DEBUG   ] spawn_process: at 2018-11-15 21:26:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 21:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 21:26:00 [DEBUG   ] spawn_process: at 2018-11-15 21:26:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 21:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 21:26:00 [DEBUG   ] spawn_process: at 2018-11-15 21:26:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 21:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 21:26:00 [DEBUG   ] spawn_process: at 2018-11-15 21:26:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 21:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 21:26:00 [DEBUG   ] spawn_process: at 2018-11-15 21:26:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 21:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 21:26:00 [DEBUG   ] spawn_process: at 2018-11-15 21:26:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 21:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 21:26:00 [DEBUG   ] spawn_process: at 2018-11-15 21:26:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 21:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 21:26:00 [DEBUG   ] spawn_process: at 2018-11-15 21:26:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 21:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 21:26:00 [DEBUG   ] spawn_process: at 2018-11-15 21:26:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 21:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 21:26:00 [DEBUG   ] spawn_process: at 2018-11-15 21:26:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 21:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 21:26:00 [DEBUG   ] spawn_process: at 2018-11-15 21:26:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 21:26:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 21:26:00 [DEBUG   ] spawn_process: at 2018-11-15 21:26:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 21:26:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 21:26:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-15 21:26:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:26:22 [DEBUG   ] Finished updating ant stats in 0.629 seconds
2018-11-15 21:26:22 [WARNING ] (13, 1, 'bot')
2018-11-15 21:26:22 [WARNING ] (13, 1, 'bot')
2018-11-15 21:26:22 [WARNING ] (13, 1, 'bot')
2018-11-15 21:26:22 [WARNING ] (13, 1, 'bot')
2018-11-15 21:26:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:26:22 [DEBUG   ] Finished updating board flags in 1.397 seconds
2018-11-15 21:26:24 [DEBUG   ] Got command BAM from MCS: ref #519046
2018-11-15 21:26:24 [INFO    ] Finished processing BAM request
2018-11-15 21:26:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:26:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519046   8 58437 77184033 A  ERROR'
2018-11-15 21:26:24 [DEBUG   ] Got command BAM from MCS: ref #519047
2018-11-15 21:26:24 [INFO    ] Finished processing BAM request
2018-11-15 21:26:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:26:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519047   8 58437 77184037 A  ERROR'
2018-11-15 21:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 21:26:24 [DEBUG   ] spawn_process: at 2018-11-15 21:26:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 21:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 21:26:24 [DEBUG   ] spawn_process: at 2018-11-15 21:26:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 21:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 21:26:24 [DEBUG   ] spawn_process: at 2018-11-15 21:26:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 21:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 21:26:24 [DEBUG   ] spawn_process: at 2018-11-15 21:26:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 21:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 21:26:24 [DEBUG   ] spawn_process: at 2018-11-15 21:26:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 21:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 21:26:24 [DEBUG   ] spawn_process: at 2018-11-15 21:26:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 21:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 21:26:24 [DEBUG   ] spawn_process: at 2018-11-15 21:26:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 21:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 21:26:24 [DEBUG   ] spawn_process: at 2018-11-15 21:26:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 21:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 21:26:24 [DEBUG   ] spawn_process: at 2018-11-15 21:26:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 21:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 21:26:24 [DEBUG   ] spawn_process: at 2018-11-15 21:26:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 21:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 21:26:24 [DEBUG   ] spawn_process: at 2018-11-15 21:26:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 21:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 21:26:24 [DEBUG   ] spawn_process: at 2018-11-15 21:26:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 21:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 21:26:24 [DEBUG   ] spawn_process: at 2018-11-15 21:26:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 21:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 21:26:24 [DEBUG   ] spawn_process: at 2018-11-15 21:26:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 21:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 21:26:24 [DEBUG   ] spawn_process: at 2018-11-15 21:26:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 21:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 21:26:24 [DEBUG   ] spawn_process: at 2018-11-15 21:26:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 21:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 21:26:24 [DEBUG   ] spawn_process: at 2018-11-15 21:26:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 21:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 21:26:24 [DEBUG   ] spawn_process: at 2018-11-15 21:26:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 21:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 21:26:24 [DEBUG   ] spawn_process: at 2018-11-15 21:26:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 21:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 21:26:24 [DEBUG   ] spawn_process: at 2018-11-15 21:26:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 21:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 21:26:24 [DEBUG   ] spawn_process: at 2018-11-15 21:26:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 21:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 21:26:24 [DEBUG   ] spawn_process: at 2018-11-15 21:26:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 21:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 21:26:24 [DEBUG   ] spawn_process: at 2018-11-15 21:26:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 21:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 21:26:24 [DEBUG   ] spawn_process: at 2018-11-15 21:26:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 21:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 21:26:24 [DEBUG   ] spawn_process: at 2018-11-15 21:26:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 21:26:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 21:26:24 [DEBUG   ] spawn_process: at 2018-11-15 21:26:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 21:26:42 [DEBUG   ] Finished updating ant stats in 0.574 seconds
2018-11-15 21:26:48 [DEBUG   ] Got command BAM from MCS: ref #519052
2018-11-15 21:26:48 [INFO    ] Finished processing BAM request
2018-11-15 21:26:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:26:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519052   8 58437 77208033 A  ERROR'
2018-11-15 21:26:48 [DEBUG   ] Got command BAM from MCS: ref #519053
2018-11-15 21:26:48 [INFO    ] Finished processing BAM request
2018-11-15 21:26:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:26:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519053   8 58437 77208037 A  ERROR'
2018-11-15 21:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 21:26:48 [DEBUG   ] spawn_process: at 2018-11-15 21:26:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 21:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 21:26:48 [DEBUG   ] spawn_process: at 2018-11-15 21:26:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 21:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 21:26:48 [DEBUG   ] spawn_process: at 2018-11-15 21:26:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 21:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 21:26:48 [DEBUG   ] spawn_process: at 2018-11-15 21:26:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 21:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 21:26:48 [DEBUG   ] spawn_process: at 2018-11-15 21:26:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 21:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 21:26:48 [DEBUG   ] spawn_process: at 2018-11-15 21:26:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 21:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 21:26:48 [DEBUG   ] spawn_process: at 2018-11-15 21:26:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 21:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 21:26:48 [DEBUG   ] spawn_process: at 2018-11-15 21:26:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 21:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 21:26:48 [DEBUG   ] spawn_process: at 2018-11-15 21:26:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 21:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 21:26:48 [DEBUG   ] spawn_process: at 2018-11-15 21:26:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 21:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 21:26:48 [DEBUG   ] spawn_process: at 2018-11-15 21:26:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 21:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 21:26:48 [DEBUG   ] spawn_process: at 2018-11-15 21:26:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 21:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 21:26:48 [DEBUG   ] spawn_process: at 2018-11-15 21:26:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 21:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 21:26:48 [DEBUG   ] spawn_process: at 2018-11-15 21:26:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 21:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 21:26:48 [DEBUG   ] spawn_process: at 2018-11-15 21:26:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 21:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 21:26:48 [DEBUG   ] spawn_process: at 2018-11-15 21:26:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 21:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 21:26:48 [DEBUG   ] spawn_process: at 2018-11-15 21:26:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 21:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 21:26:48 [DEBUG   ] spawn_process: at 2018-11-15 21:26:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 21:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 21:26:48 [DEBUG   ] spawn_process: at 2018-11-15 21:26:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 21:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 21:26:48 [DEBUG   ] spawn_process: at 2018-11-15 21:26:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 21:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 21:26:48 [DEBUG   ] spawn_process: at 2018-11-15 21:26:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 21:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 21:26:48 [DEBUG   ] spawn_process: at 2018-11-15 21:26:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 21:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 21:26:48 [DEBUG   ] spawn_process: at 2018-11-15 21:26:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 21:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 21:26:48 [DEBUG   ] spawn_process: at 2018-11-15 21:26:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 21:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 21:26:48 [DEBUG   ] spawn_process: at 2018-11-15 21:26:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 21:26:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 21:26:48 [DEBUG   ] spawn_process: at 2018-11-15 21:26:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 21:27:02 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 21:27:12 [DEBUG   ] Got command BAM from MCS: ref #519054
2018-11-15 21:27:12 [INFO    ] Finished processing BAM request
2018-11-15 21:27:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:27:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519054   8 58437 77232029 A  ERROR'
2018-11-15 21:27:12 [DEBUG   ] Got command BAM from MCS: ref #519055
2018-11-15 21:27:12 [INFO    ] Finished processing BAM request
2018-11-15 21:27:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:27:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519055   8 58437 77232033 A  ERROR'
2018-11-15 21:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 21:27:12 [DEBUG   ] spawn_process: at 2018-11-15 21:27:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 21:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 21:27:12 [DEBUG   ] spawn_process: at 2018-11-15 21:27:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 21:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 21:27:12 [DEBUG   ] spawn_process: at 2018-11-15 21:27:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 21:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 21:27:12 [DEBUG   ] spawn_process: at 2018-11-15 21:27:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 21:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 21:27:12 [DEBUG   ] spawn_process: at 2018-11-15 21:27:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 21:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 21:27:12 [DEBUG   ] spawn_process: at 2018-11-15 21:27:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 21:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 21:27:12 [DEBUG   ] spawn_process: at 2018-11-15 21:27:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 21:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 21:27:12 [DEBUG   ] spawn_process: at 2018-11-15 21:27:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 21:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 21:27:12 [DEBUG   ] spawn_process: at 2018-11-15 21:27:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 21:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 21:27:12 [DEBUG   ] spawn_process: at 2018-11-15 21:27:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 21:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 21:27:12 [DEBUG   ] spawn_process: at 2018-11-15 21:27:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 21:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 21:27:12 [DEBUG   ] spawn_process: at 2018-11-15 21:27:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 21:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 21:27:12 [DEBUG   ] spawn_process: at 2018-11-15 21:27:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 21:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 21:27:12 [DEBUG   ] spawn_process: at 2018-11-15 21:27:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 21:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 21:27:12 [DEBUG   ] spawn_process: at 2018-11-15 21:27:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 21:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 21:27:12 [DEBUG   ] spawn_process: at 2018-11-15 21:27:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 21:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 21:27:12 [DEBUG   ] spawn_process: at 2018-11-15 21:27:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 21:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 21:27:12 [DEBUG   ] spawn_process: at 2018-11-15 21:27:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 21:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 21:27:12 [DEBUG   ] spawn_process: at 2018-11-15 21:27:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 21:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 21:27:12 [DEBUG   ] spawn_process: at 2018-11-15 21:27:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 21:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 21:27:12 [DEBUG   ] spawn_process: at 2018-11-15 21:27:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 21:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 21:27:12 [DEBUG   ] spawn_process: at 2018-11-15 21:27:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 21:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 21:27:12 [DEBUG   ] spawn_process: at 2018-11-15 21:27:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 21:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 21:27:12 [DEBUG   ] spawn_process: at 2018-11-15 21:27:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 21:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 21:27:12 [DEBUG   ] spawn_process: at 2018-11-15 21:27:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 21:27:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 21:27:12 [DEBUG   ] spawn_process: at 2018-11-15 21:27:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 21:27:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:27:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-15 21:27:22 [DEBUG   ] Finished updating ant stats in 0.428 seconds
2018-11-15 21:27:22 [WARNING ] (13, 1, 'bot')
2018-11-15 21:27:22 [WARNING ] (13, 1, 'bot')
2018-11-15 21:27:22 [WARNING ] (13, 1, 'bot')
2018-11-15 21:27:22 [WARNING ] (13, 1, 'bot')
2018-11-15 21:27:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:27:22 [DEBUG   ] Finished updating board flags in 1.172 seconds
2018-11-15 21:27:36 [DEBUG   ] Got command BAM from MCS: ref #519057
2018-11-15 21:27:36 [INFO    ] Finished processing BAM request
2018-11-15 21:27:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:27:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519057   8 58437 77256033 A  ERROR'
2018-11-15 21:27:36 [DEBUG   ] Got command BAM from MCS: ref #519056
2018-11-15 21:27:36 [INFO    ] Finished processing BAM request
2018-11-15 21:27:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:27:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519056   8 58437 77256037 A  ERROR'
2018-11-15 21:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 21:27:36 [DEBUG   ] spawn_process: at 2018-11-15 21:27:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 21:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 21:27:36 [DEBUG   ] spawn_process: at 2018-11-15 21:27:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 21:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 21:27:36 [DEBUG   ] spawn_process: at 2018-11-15 21:27:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 21:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 21:27:36 [DEBUG   ] spawn_process: at 2018-11-15 21:27:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 21:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 21:27:36 [DEBUG   ] spawn_process: at 2018-11-15 21:27:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 21:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 21:27:36 [DEBUG   ] spawn_process: at 2018-11-15 21:27:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 21:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 21:27:36 [DEBUG   ] spawn_process: at 2018-11-15 21:27:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 21:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 21:27:36 [DEBUG   ] spawn_process: at 2018-11-15 21:27:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 21:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 21:27:36 [DEBUG   ] spawn_process: at 2018-11-15 21:27:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 21:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 21:27:36 [DEBUG   ] spawn_process: at 2018-11-15 21:27:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 21:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 21:27:36 [DEBUG   ] spawn_process: at 2018-11-15 21:27:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 21:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 21:27:36 [DEBUG   ] spawn_process: at 2018-11-15 21:27:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 21:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 21:27:36 [DEBUG   ] spawn_process: at 2018-11-15 21:27:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 21:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 21:27:36 [DEBUG   ] spawn_process: at 2018-11-15 21:27:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 21:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 21:27:36 [DEBUG   ] spawn_process: at 2018-11-15 21:27:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 21:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 21:27:36 [DEBUG   ] spawn_process: at 2018-11-15 21:27:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 21:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 21:27:36 [DEBUG   ] spawn_process: at 2018-11-15 21:27:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 21:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 21:27:36 [DEBUG   ] spawn_process: at 2018-11-15 21:27:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 21:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 21:27:36 [DEBUG   ] spawn_process: at 2018-11-15 21:27:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 21:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 21:27:36 [DEBUG   ] spawn_process: at 2018-11-15 21:27:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 21:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 21:27:36 [DEBUG   ] spawn_process: at 2018-11-15 21:27:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 21:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 21:27:36 [DEBUG   ] spawn_process: at 2018-11-15 21:27:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 21:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 21:27:36 [DEBUG   ] spawn_process: at 2018-11-15 21:27:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 21:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 21:27:36 [DEBUG   ] spawn_process: at 2018-11-15 21:27:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 21:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 21:27:36 [DEBUG   ] spawn_process: at 2018-11-15 21:27:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 21:27:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 21:27:36 [DEBUG   ] spawn_process: at 2018-11-15 21:27:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 21:27:42 [DEBUG   ] Finished updating ant stats in 0.375 seconds
2018-11-15 21:28:00 [DEBUG   ] Got command BAM from MCS: ref #519058
2018-11-15 21:28:00 [INFO    ] Finished processing BAM request
2018-11-15 21:28:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:28:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519058   8 58437 77280033 A  ERROR'
2018-11-15 21:28:00 [DEBUG   ] Got command BAM from MCS: ref #519059
2018-11-15 21:28:00 [INFO    ] Finished processing BAM request
2018-11-15 21:28:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:28:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519059   8 58437 77280037 A  ERROR'
2018-11-15 21:28:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 21:28:00 [DEBUG   ] spawn_process: at 2018-11-15 21:28:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 21:28:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 21:28:00 [DEBUG   ] spawn_process: at 2018-11-15 21:28:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 21:28:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 21:28:00 [DEBUG   ] spawn_process: at 2018-11-15 21:28:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 21:28:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 21:28:00 [DEBUG   ] spawn_process: at 2018-11-15 21:28:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 21:28:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 21:28:00 [DEBUG   ] spawn_process: at 2018-11-15 21:28:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 21:28:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 21:28:00 [DEBUG   ] spawn_process: at 2018-11-15 21:28:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 21:28:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 21:28:00 [DEBUG   ] spawn_process: at 2018-11-15 21:28:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 21:28:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 21:28:00 [DEBUG   ] spawn_process: at 2018-11-15 21:28:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 21:28:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 21:28:00 [DEBUG   ] spawn_process: at 2018-11-15 21:28:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 21:28:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 21:28:00 [DEBUG   ] spawn_process: at 2018-11-15 21:28:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 21:28:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 21:28:00 [DEBUG   ] spawn_process: at 2018-11-15 21:28:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 21:28:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 21:28:00 [DEBUG   ] spawn_process: at 2018-11-15 21:28:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 21:28:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 21:28:00 [DEBUG   ] spawn_process: at 2018-11-15 21:28:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 21:28:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 21:28:00 [DEBUG   ] spawn_process: at 2018-11-15 21:28:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 21:28:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 21:28:00 [DEBUG   ] spawn_process: at 2018-11-15 21:28:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 21:28:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 21:28:00 [DEBUG   ] spawn_process: at 2018-11-15 21:28:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 21:28:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 21:28:00 [DEBUG   ] spawn_process: at 2018-11-15 21:28:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 21:28:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 21:28:00 [DEBUG   ] spawn_process: at 2018-11-15 21:28:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 21:28:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 21:28:00 [DEBUG   ] spawn_process: at 2018-11-15 21:28:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 21:28:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 21:28:00 [DEBUG   ] spawn_process: at 2018-11-15 21:28:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 21:28:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 21:28:00 [DEBUG   ] spawn_process: at 2018-11-15 21:28:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 21:28:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 21:28:00 [DEBUG   ] spawn_process: at 2018-11-15 21:28:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 21:28:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 21:28:00 [DEBUG   ] spawn_process: at 2018-11-15 21:28:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 21:28:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 21:28:00 [DEBUG   ] spawn_process: at 2018-11-15 21:28:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 21:28:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 21:28:00 [DEBUG   ] spawn_process: at 2018-11-15 21:28:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 21:28:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 21:28:00 [DEBUG   ] spawn_process: at 2018-11-15 21:28:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 21:28:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 21:28:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-11-15 21:28:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:28:23 [DEBUG   ] Finished updating ant stats in 1.225 seconds
2018-11-15 21:28:23 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-11-15 21:28:23 [WARNING ] (13, 1, 'bot')
2018-11-15 21:28:23 [WARNING ] (13, 1, 'bot')
2018-11-15 21:28:23 [WARNING ] (13, 1, 'bot')
2018-11-15 21:28:23 [WARNING ] (13, 1, 'bot')
2018-11-15 21:28:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:28:23 [DEBUG   ] Finished updating board flags in 2.028 seconds
2018-11-15 21:28:24 [DEBUG   ] Got command BAM from MCS: ref #519063
2018-11-15 21:28:24 [INFO    ] Finished processing BAM request
2018-11-15 21:28:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:28:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519063   8 58437 77304025 A  ERROR'
2018-11-15 21:28:24 [DEBUG   ] Got command BAM from MCS: ref #519062
2018-11-15 21:28:24 [INFO    ] Finished processing BAM request
2018-11-15 21:28:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:28:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519062   8 58437 77304029 A  ERROR'
2018-11-15 21:28:24 [DEBUG   ] Got command RPT from MCS: ref #519064
2018-11-15 21:28:24 [DEBUG   ] summary = ERROR
2018-11-15 21:28:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519064  13 58437 77304653 A  ERRORERROR'
2018-11-15 21:28:24 [DEBUG   ] Got command RPT from MCS: ref #519065
2018-11-15 21:28:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 21:28:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519065  77 58437 77304857 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 21:28:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 21:28:24 [DEBUG   ] spawn_process: at 2018-11-15 21:28:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 21:28:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 21:28:24 [DEBUG   ] spawn_process: at 2018-11-15 21:28:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 21:28:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 21:28:24 [DEBUG   ] spawn_process: at 2018-11-15 21:28:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 21:28:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 21:28:24 [DEBUG   ] spawn_process: at 2018-11-15 21:28:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 21:28:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 21:28:24 [DEBUG   ] spawn_process: at 2018-11-15 21:28:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 21:28:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 21:28:24 [DEBUG   ] spawn_process: at 2018-11-15 21:28:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 21:28:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 21:28:24 [DEBUG   ] spawn_process: at 2018-11-15 21:28:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 21:28:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 21:28:24 [DEBUG   ] spawn_process: at 2018-11-15 21:28:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 21:28:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 21:28:24 [DEBUG   ] spawn_process: at 2018-11-15 21:28:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 21:28:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 21:28:24 [DEBUG   ] spawn_process: at 2018-11-15 21:28:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 21:28:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 21:28:24 [DEBUG   ] spawn_process: at 2018-11-15 21:28:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 21:28:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 21:28:24 [DEBUG   ] spawn_process: at 2018-11-15 21:28:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 21:28:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 21:28:24 [DEBUG   ] spawn_process: at 2018-11-15 21:28:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 21:28:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 21:28:24 [DEBUG   ] spawn_process: at 2018-11-15 21:28:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 21:28:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 21:28:24 [DEBUG   ] spawn_process: at 2018-11-15 21:28:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 21:28:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 21:28:24 [DEBUG   ] spawn_process: at 2018-11-15 21:28:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 21:28:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 21:28:24 [DEBUG   ] spawn_process: at 2018-11-15 21:28:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 21:28:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 21:28:24 [DEBUG   ] spawn_process: at 2018-11-15 21:28:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 21:28:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 21:28:24 [DEBUG   ] spawn_process: at 2018-11-15 21:28:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 21:28:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 21:28:24 [DEBUG   ] spawn_process: at 2018-11-15 21:28:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 21:28:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 21:28:24 [DEBUG   ] spawn_process: at 2018-11-15 21:28:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 21:28:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 21:28:24 [DEBUG   ] spawn_process: at 2018-11-15 21:28:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 21:28:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 21:28:24 [DEBUG   ] spawn_process: at 2018-11-15 21:28:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 21:28:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 21:28:24 [DEBUG   ] spawn_process: at 2018-11-15 21:28:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 21:28:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 21:28:24 [DEBUG   ] spawn_process: at 2018-11-15 21:28:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 21:28:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 21:28:24 [DEBUG   ] spawn_process: at 2018-11-15 21:28:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 21:28:25 [DEBUG   ] Got command RPT from MCS: ref #519066
2018-11-15 21:28:25 [DEBUG   ] summary = ERROR
2018-11-15 21:28:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519066  13 58437 77305061 A  ERRORERROR'
2018-11-15 21:28:25 [DEBUG   ] Got command RPT from MCS: ref #519068
2018-11-15 21:28:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 21:28:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519068  77 58437 77305265 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 21:28:25 [DEBUG   ] Got command RPT from MCS: ref #519070
2018-11-15 21:28:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 21:28:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519070  12 58437 77305457 A  ERRORB ff'
2018-11-15 21:28:43 [DEBUG   ] Finished updating ant stats in 1.175 seconds
2018-11-15 21:28:48 [DEBUG   ] Got command BAM from MCS: ref #519074
2018-11-15 21:28:48 [INFO    ] Finished processing BAM request
2018-11-15 21:28:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:28:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519074   8 58437 77328029 A  ERROR'
2018-11-15 21:28:48 [DEBUG   ] Got command BAM from MCS: ref #519075
2018-11-15 21:28:48 [INFO    ] Finished processing BAM request
2018-11-15 21:28:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:28:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519075   8 58437 77328033 A  ERROR'
2018-11-15 21:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 21:28:48 [DEBUG   ] spawn_process: at 2018-11-15 21:28:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 21:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 21:28:48 [DEBUG   ] spawn_process: at 2018-11-15 21:28:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 21:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 21:28:48 [DEBUG   ] spawn_process: at 2018-11-15 21:28:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 21:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 21:28:48 [DEBUG   ] spawn_process: at 2018-11-15 21:28:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 21:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 21:28:48 [DEBUG   ] spawn_process: at 2018-11-15 21:28:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 21:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 21:28:48 [DEBUG   ] spawn_process: at 2018-11-15 21:28:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 21:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 21:28:48 [DEBUG   ] spawn_process: at 2018-11-15 21:28:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 21:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 21:28:48 [DEBUG   ] spawn_process: at 2018-11-15 21:28:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 21:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 21:28:48 [DEBUG   ] spawn_process: at 2018-11-15 21:28:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 21:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 21:28:48 [DEBUG   ] spawn_process: at 2018-11-15 21:28:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 21:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 21:28:48 [DEBUG   ] spawn_process: at 2018-11-15 21:28:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 21:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 21:28:48 [DEBUG   ] spawn_process: at 2018-11-15 21:28:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 21:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 21:28:48 [DEBUG   ] spawn_process: at 2018-11-15 21:28:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 21:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 21:28:48 [DEBUG   ] spawn_process: at 2018-11-15 21:28:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 21:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 21:28:48 [DEBUG   ] spawn_process: at 2018-11-15 21:28:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 21:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 21:28:48 [DEBUG   ] spawn_process: at 2018-11-15 21:28:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 21:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 21:28:48 [DEBUG   ] spawn_process: at 2018-11-15 21:28:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 21:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 21:28:48 [DEBUG   ] spawn_process: at 2018-11-15 21:28:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 21:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 21:28:48 [DEBUG   ] spawn_process: at 2018-11-15 21:28:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 21:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 21:28:48 [DEBUG   ] spawn_process: at 2018-11-15 21:28:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 21:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 21:28:48 [DEBUG   ] spawn_process: at 2018-11-15 21:28:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 21:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 21:28:48 [DEBUG   ] spawn_process: at 2018-11-15 21:28:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 21:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 21:28:48 [DEBUG   ] spawn_process: at 2018-11-15 21:28:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 21:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 21:28:48 [DEBUG   ] spawn_process: at 2018-11-15 21:28:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 21:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 21:28:48 [DEBUG   ] spawn_process: at 2018-11-15 21:28:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 21:28:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 21:28:48 [DEBUG   ] spawn_process: at 2018-11-15 21:28:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 21:29:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 21:29:12 [DEBUG   ] Got command BAM from MCS: ref #519077
2018-11-15 21:29:12 [INFO    ] Finished processing BAM request
2018-11-15 21:29:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:29:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519077   8 58437 77352025 A  ERROR'
2018-11-15 21:29:12 [DEBUG   ] Got command BAM from MCS: ref #519076
2018-11-15 21:29:12 [INFO    ] Finished processing BAM request
2018-11-15 21:29:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:29:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519076   8 58437 77352029 A  ERROR'
2018-11-15 21:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 21:29:12 [DEBUG   ] spawn_process: at 2018-11-15 21:29:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 21:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 21:29:12 [DEBUG   ] spawn_process: at 2018-11-15 21:29:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 21:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 21:29:12 [DEBUG   ] spawn_process: at 2018-11-15 21:29:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 21:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 21:29:12 [DEBUG   ] spawn_process: at 2018-11-15 21:29:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 21:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 21:29:12 [DEBUG   ] spawn_process: at 2018-11-15 21:29:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 21:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 21:29:12 [DEBUG   ] spawn_process: at 2018-11-15 21:29:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 21:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 21:29:12 [DEBUG   ] spawn_process: at 2018-11-15 21:29:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 21:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 21:29:12 [DEBUG   ] spawn_process: at 2018-11-15 21:29:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 21:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 21:29:12 [DEBUG   ] spawn_process: at 2018-11-15 21:29:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 21:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 21:29:12 [DEBUG   ] spawn_process: at 2018-11-15 21:29:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 21:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 21:29:12 [DEBUG   ] spawn_process: at 2018-11-15 21:29:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 21:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 21:29:12 [DEBUG   ] spawn_process: at 2018-11-15 21:29:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 21:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 21:29:12 [DEBUG   ] spawn_process: at 2018-11-15 21:29:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 21:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 21:29:12 [DEBUG   ] spawn_process: at 2018-11-15 21:29:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 21:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 21:29:12 [DEBUG   ] spawn_process: at 2018-11-15 21:29:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 21:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 21:29:12 [DEBUG   ] spawn_process: at 2018-11-15 21:29:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 21:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 21:29:12 [DEBUG   ] spawn_process: at 2018-11-15 21:29:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 21:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 21:29:12 [DEBUG   ] spawn_process: at 2018-11-15 21:29:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 21:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 21:29:12 [DEBUG   ] spawn_process: at 2018-11-15 21:29:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 21:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 21:29:12 [DEBUG   ] spawn_process: at 2018-11-15 21:29:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 21:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 21:29:12 [DEBUG   ] spawn_process: at 2018-11-15 21:29:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 21:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 21:29:12 [DEBUG   ] spawn_process: at 2018-11-15 21:29:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 21:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 21:29:12 [DEBUG   ] spawn_process: at 2018-11-15 21:29:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 21:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 21:29:12 [DEBUG   ] spawn_process: at 2018-11-15 21:29:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 21:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 21:29:12 [DEBUG   ] spawn_process: at 2018-11-15 21:29:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 21:29:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 21:29:12 [DEBUG   ] spawn_process: at 2018-11-15 21:29:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 21:29:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:29:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-15 21:29:22 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-11-15 21:29:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 21:29:22 [WARNING ] (13, 1, 'bot')
2018-11-15 21:29:22 [WARNING ] (13, 1, 'bot')
2018-11-15 21:29:22 [WARNING ] (13, 1, 'bot')
2018-11-15 21:29:22 [WARNING ] (13, 1, 'bot')
2018-11-15 21:29:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:29:22 [DEBUG   ] Finished updating board flags in 1.430 seconds
2018-11-15 21:29:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 21:29:36 [DEBUG   ] Got command BAM from MCS: ref #519082
2018-11-15 21:29:36 [INFO    ] Finished processing BAM request
2018-11-15 21:29:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:29:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519082   8 58437 77376025 A  ERROR'
2018-11-15 21:29:36 [DEBUG   ] Got command BAM from MCS: ref #519083
2018-11-15 21:29:36 [INFO    ] Finished processing BAM request
2018-11-15 21:29:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:29:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519083   8 58437 77376029 A  ERROR'
2018-11-15 21:29:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 21:29:36 [DEBUG   ] spawn_process: at 2018-11-15 21:29:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 21:29:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 21:29:36 [DEBUG   ] spawn_process: at 2018-11-15 21:29:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 21:29:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 21:29:36 [DEBUG   ] spawn_process: at 2018-11-15 21:29:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 21:29:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 21:29:36 [DEBUG   ] spawn_process: at 2018-11-15 21:29:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 21:29:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 21:29:36 [DEBUG   ] spawn_process: at 2018-11-15 21:29:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 21:29:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 21:29:36 [DEBUG   ] spawn_process: at 2018-11-15 21:29:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 21:29:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 21:29:36 [DEBUG   ] spawn_process: at 2018-11-15 21:29:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 21:29:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 21:29:36 [DEBUG   ] spawn_process: at 2018-11-15 21:29:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 21:29:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 21:29:36 [DEBUG   ] spawn_process: at 2018-11-15 21:29:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 21:29:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 21:29:36 [DEBUG   ] spawn_process: at 2018-11-15 21:29:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 21:29:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 21:29:36 [DEBUG   ] spawn_process: at 2018-11-15 21:29:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 21:29:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 21:29:36 [DEBUG   ] spawn_process: at 2018-11-15 21:29:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 21:29:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 21:29:36 [DEBUG   ] spawn_process: at 2018-11-15 21:29:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 21:29:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 21:29:36 [DEBUG   ] spawn_process: at 2018-11-15 21:29:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 21:29:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 21:29:36 [DEBUG   ] spawn_process: at 2018-11-15 21:29:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 21:29:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 21:29:36 [DEBUG   ] spawn_process: at 2018-11-15 21:29:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 21:29:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 21:29:36 [DEBUG   ] spawn_process: at 2018-11-15 21:29:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 21:29:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 21:29:36 [DEBUG   ] spawn_process: at 2018-11-15 21:29:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 21:29:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 21:29:36 [DEBUG   ] spawn_process: at 2018-11-15 21:29:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 21:29:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 21:29:36 [DEBUG   ] spawn_process: at 2018-11-15 21:29:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 21:29:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 21:29:36 [DEBUG   ] spawn_process: at 2018-11-15 21:29:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 21:29:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 21:29:36 [DEBUG   ] spawn_process: at 2018-11-15 21:29:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 21:29:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 21:29:36 [DEBUG   ] spawn_process: at 2018-11-15 21:29:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 21:29:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 21:29:36 [DEBUG   ] spawn_process: at 2018-11-15 21:29:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 21:29:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 21:29:36 [DEBUG   ] spawn_process: at 2018-11-15 21:29:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 21:29:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 21:29:36 [DEBUG   ] spawn_process: at 2018-11-15 21:29:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 21:29:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 21:30:00 [DEBUG   ] Got command BAM from MCS: ref #519084
2018-11-15 21:30:00 [INFO    ] Finished processing BAM request
2018-11-15 21:30:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:30:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519084   8 58437 77400025 A  ERROR'
2018-11-15 21:30:00 [DEBUG   ] Got command BAM from MCS: ref #519085
2018-11-15 21:30:00 [INFO    ] Finished processing BAM request
2018-11-15 21:30:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:30:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519085   8 58437 77400029 A  ERROR'
2018-11-15 21:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 21:30:00 [DEBUG   ] spawn_process: at 2018-11-15 21:30:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 21:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 21:30:00 [DEBUG   ] spawn_process: at 2018-11-15 21:30:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 21:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 21:30:00 [DEBUG   ] spawn_process: at 2018-11-15 21:30:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 21:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 21:30:00 [DEBUG   ] spawn_process: at 2018-11-15 21:30:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 21:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 21:30:00 [DEBUG   ] spawn_process: at 2018-11-15 21:30:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 21:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 21:30:00 [DEBUG   ] spawn_process: at 2018-11-15 21:30:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 21:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 21:30:00 [DEBUG   ] spawn_process: at 2018-11-15 21:30:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 21:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 21:30:00 [DEBUG   ] spawn_process: at 2018-11-15 21:30:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 21:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 21:30:00 [DEBUG   ] spawn_process: at 2018-11-15 21:30:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 21:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 21:30:00 [DEBUG   ] spawn_process: at 2018-11-15 21:30:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 21:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 21:30:00 [DEBUG   ] spawn_process: at 2018-11-15 21:30:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 21:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 21:30:00 [DEBUG   ] spawn_process: at 2018-11-15 21:30:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 21:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 21:30:00 [DEBUG   ] spawn_process: at 2018-11-15 21:30:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 21:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 21:30:00 [DEBUG   ] spawn_process: at 2018-11-15 21:30:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 21:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 21:30:00 [DEBUG   ] spawn_process: at 2018-11-15 21:30:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 21:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 21:30:00 [DEBUG   ] spawn_process: at 2018-11-15 21:30:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 21:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 21:30:00 [DEBUG   ] spawn_process: at 2018-11-15 21:30:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 21:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 21:30:00 [DEBUG   ] spawn_process: at 2018-11-15 21:30:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 21:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 21:30:00 [DEBUG   ] spawn_process: at 2018-11-15 21:30:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 21:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 21:30:00 [DEBUG   ] spawn_process: at 2018-11-15 21:30:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 21:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 21:30:00 [DEBUG   ] spawn_process: at 2018-11-15 21:30:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 21:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 21:30:00 [DEBUG   ] spawn_process: at 2018-11-15 21:30:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 21:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 21:30:00 [DEBUG   ] spawn_process: at 2018-11-15 21:30:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 21:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 21:30:00 [DEBUG   ] spawn_process: at 2018-11-15 21:30:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 21:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 21:30:00 [DEBUG   ] spawn_process: at 2018-11-15 21:30:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 21:30:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 21:30:00 [DEBUG   ] spawn_process: at 2018-11-15 21:30:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 21:30:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 21:30:23 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-11-15 21:30:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:30:24 [DEBUG   ] Got command BAM from MCS: ref #519086
2018-11-15 21:30:24 [INFO    ] Finished processing BAM request
2018-11-15 21:30:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:30:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519086   8 58437 77424029 A  ERROR'
2018-11-15 21:30:24 [DEBUG   ] Got command BAM from MCS: ref #519087
2018-11-15 21:30:24 [INFO    ] Finished processing BAM request
2018-11-15 21:30:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:30:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519087   8 58437 77424033 A  ERROR'
2018-11-15 21:30:24 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-11-15 21:30:24 [WARNING ] (13, 1, 'bot')
2018-11-15 21:30:24 [WARNING ] (13, 1, 'bot')
2018-11-15 21:30:24 [WARNING ] (13, 1, 'bot')
2018-11-15 21:30:24 [WARNING ] (13, 1, 'bot')
2018-11-15 21:30:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:30:24 [DEBUG   ] Finished updating board flags in 2.929 seconds
2018-11-15 21:30:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 21:30:24 [DEBUG   ] spawn_process: at 2018-11-15 21:30:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 21:30:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 21:30:24 [DEBUG   ] spawn_process: at 2018-11-15 21:30:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 21:30:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 21:30:24 [DEBUG   ] spawn_process: at 2018-11-15 21:30:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 21:30:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 21:30:24 [DEBUG   ] spawn_process: at 2018-11-15 21:30:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 21:30:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 21:30:24 [DEBUG   ] spawn_process: at 2018-11-15 21:30:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 21:30:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 21:30:24 [DEBUG   ] spawn_process: at 2018-11-15 21:30:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 21:30:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 21:30:24 [DEBUG   ] spawn_process: at 2018-11-15 21:30:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 21:30:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 21:30:24 [DEBUG   ] spawn_process: at 2018-11-15 21:30:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 21:30:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 21:30:24 [DEBUG   ] spawn_process: at 2018-11-15 21:30:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 21:30:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 21:30:24 [DEBUG   ] spawn_process: at 2018-11-15 21:30:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 21:30:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 21:30:24 [DEBUG   ] spawn_process: at 2018-11-15 21:30:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 21:30:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 21:30:24 [DEBUG   ] spawn_process: at 2018-11-15 21:30:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 21:30:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 21:30:24 [DEBUG   ] spawn_process: at 2018-11-15 21:30:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 21:30:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 21:30:24 [DEBUG   ] spawn_process: at 2018-11-15 21:30:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 21:30:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 21:30:24 [DEBUG   ] spawn_process: at 2018-11-15 21:30:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 21:30:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 21:30:24 [DEBUG   ] spawn_process: at 2018-11-15 21:30:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 21:30:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 21:30:24 [DEBUG   ] spawn_process: at 2018-11-15 21:30:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 21:30:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 21:30:24 [DEBUG   ] spawn_process: at 2018-11-15 21:30:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 21:30:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 21:30:24 [DEBUG   ] spawn_process: at 2018-11-15 21:30:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 21:30:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 21:30:24 [DEBUG   ] spawn_process: at 2018-11-15 21:30:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 21:30:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 21:30:24 [DEBUG   ] spawn_process: at 2018-11-15 21:30:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 21:30:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 21:30:24 [DEBUG   ] spawn_process: at 2018-11-15 21:30:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 21:30:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 21:30:24 [DEBUG   ] spawn_process: at 2018-11-15 21:30:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 21:30:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 21:30:24 [DEBUG   ] spawn_process: at 2018-11-15 21:30:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 21:30:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 21:30:24 [DEBUG   ] spawn_process: at 2018-11-15 21:30:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 21:30:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 21:30:24 [DEBUG   ] spawn_process: at 2018-11-15 21:30:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 21:30:43 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-15 21:30:45 [DEBUG   ] Got command RPT from MCS: ref #519088
2018-11-15 21:30:45 [DEBUG   ] summary = ERROR
2018-11-15 21:30:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519088  13 58437 77445201 A  ERRORERROR'
2018-11-15 21:30:45 [DEBUG   ] Got command RPT from MCS: ref #519089
2018-11-15 21:30:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 21:30:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519089  77 58437 77445202 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 21:30:48 [DEBUG   ] Got command BAM from MCS: ref #519105
2018-11-15 21:30:48 [INFO    ] Finished processing BAM request
2018-11-15 21:30:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:30:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519105   8 58437 77448025 A  ERROR'
2018-11-15 21:30:48 [DEBUG   ] Got command BAM from MCS: ref #519106
2018-11-15 21:30:48 [INFO    ] Finished processing BAM request
2018-11-15 21:30:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:30:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519106   8 58437 77448029 A  ERROR'
2018-11-15 21:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 21:30:48 [DEBUG   ] spawn_process: at 2018-11-15 21:30:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 21:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 21:30:48 [DEBUG   ] spawn_process: at 2018-11-15 21:30:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 21:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 21:30:48 [DEBUG   ] spawn_process: at 2018-11-15 21:30:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 21:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 21:30:48 [DEBUG   ] spawn_process: at 2018-11-15 21:30:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 21:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 21:30:48 [DEBUG   ] spawn_process: at 2018-11-15 21:30:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 21:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 21:30:48 [DEBUG   ] spawn_process: at 2018-11-15 21:30:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 21:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 21:30:48 [DEBUG   ] spawn_process: at 2018-11-15 21:30:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 21:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 21:30:48 [DEBUG   ] spawn_process: at 2018-11-15 21:30:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 21:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 21:30:48 [DEBUG   ] spawn_process: at 2018-11-15 21:30:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 21:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 21:30:48 [DEBUG   ] spawn_process: at 2018-11-15 21:30:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 21:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 21:30:48 [DEBUG   ] spawn_process: at 2018-11-15 21:30:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 21:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 21:30:48 [DEBUG   ] spawn_process: at 2018-11-15 21:30:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 21:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 21:30:48 [DEBUG   ] spawn_process: at 2018-11-15 21:30:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 21:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 21:30:48 [DEBUG   ] spawn_process: at 2018-11-15 21:30:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 21:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 21:30:48 [DEBUG   ] spawn_process: at 2018-11-15 21:30:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 21:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 21:30:48 [DEBUG   ] spawn_process: at 2018-11-15 21:30:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 21:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 21:30:48 [DEBUG   ] spawn_process: at 2018-11-15 21:30:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 21:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 21:30:48 [DEBUG   ] spawn_process: at 2018-11-15 21:30:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 21:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 21:30:48 [DEBUG   ] spawn_process: at 2018-11-15 21:30:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 21:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 21:30:48 [DEBUG   ] spawn_process: at 2018-11-15 21:30:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 21:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 21:30:48 [DEBUG   ] spawn_process: at 2018-11-15 21:30:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 21:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 21:30:48 [DEBUG   ] spawn_process: at 2018-11-15 21:30:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 21:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 21:30:48 [DEBUG   ] spawn_process: at 2018-11-15 21:30:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 21:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 21:30:48 [DEBUG   ] spawn_process: at 2018-11-15 21:30:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 21:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 21:30:48 [DEBUG   ] spawn_process: at 2018-11-15 21:30:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 21:30:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 21:30:48 [DEBUG   ] spawn_process: at 2018-11-15 21:30:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 21:31:03 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-15 21:31:12 [DEBUG   ] Got command BAM from MCS: ref #519107
2018-11-15 21:31:12 [INFO    ] Finished processing BAM request
2018-11-15 21:31:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:31:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519107   8 58437 77472033 A  ERROR'
2018-11-15 21:31:12 [DEBUG   ] Got command BAM from MCS: ref #519108
2018-11-15 21:31:12 [INFO    ] Finished processing BAM request
2018-11-15 21:31:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:31:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519108   8 58437 77472037 A  ERROR'
2018-11-15 21:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 21:31:12 [DEBUG   ] spawn_process: at 2018-11-15 21:31:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 21:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 21:31:12 [DEBUG   ] spawn_process: at 2018-11-15 21:31:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 21:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 21:31:12 [DEBUG   ] spawn_process: at 2018-11-15 21:31:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 21:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 21:31:12 [DEBUG   ] spawn_process: at 2018-11-15 21:31:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 21:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 21:31:12 [DEBUG   ] spawn_process: at 2018-11-15 21:31:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 21:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 21:31:12 [DEBUG   ] spawn_process: at 2018-11-15 21:31:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 21:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 21:31:12 [DEBUG   ] spawn_process: at 2018-11-15 21:31:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 21:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 21:31:12 [DEBUG   ] spawn_process: at 2018-11-15 21:31:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 21:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 21:31:12 [DEBUG   ] spawn_process: at 2018-11-15 21:31:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 21:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 21:31:12 [DEBUG   ] spawn_process: at 2018-11-15 21:31:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 21:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 21:31:12 [DEBUG   ] spawn_process: at 2018-11-15 21:31:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 21:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 21:31:12 [DEBUG   ] spawn_process: at 2018-11-15 21:31:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 21:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 21:31:12 [DEBUG   ] spawn_process: at 2018-11-15 21:31:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 21:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 21:31:12 [DEBUG   ] spawn_process: at 2018-11-15 21:31:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 21:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 21:31:12 [DEBUG   ] spawn_process: at 2018-11-15 21:31:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 21:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 21:31:12 [DEBUG   ] spawn_process: at 2018-11-15 21:31:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 21:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 21:31:12 [DEBUG   ] spawn_process: at 2018-11-15 21:31:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 21:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 21:31:12 [DEBUG   ] spawn_process: at 2018-11-15 21:31:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 21:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 21:31:12 [DEBUG   ] spawn_process: at 2018-11-15 21:31:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 21:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 21:31:12 [DEBUG   ] spawn_process: at 2018-11-15 21:31:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 21:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 21:31:12 [DEBUG   ] spawn_process: at 2018-11-15 21:31:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 21:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 21:31:12 [DEBUG   ] spawn_process: at 2018-11-15 21:31:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 21:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 21:31:12 [DEBUG   ] spawn_process: at 2018-11-15 21:31:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 21:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 21:31:12 [DEBUG   ] spawn_process: at 2018-11-15 21:31:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 21:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 21:31:12 [DEBUG   ] spawn_process: at 2018-11-15 21:31:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 21:31:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 21:31:12 [DEBUG   ] spawn_process: at 2018-11-15 21:31:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 21:31:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 21:31:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 21:31:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:31:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 21:31:23 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-11-15 21:31:23 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-15 21:31:23 [WARNING ] (13, 1, 'bot')
2018-11-15 21:31:23 [WARNING ] (13, 1, 'bot')
2018-11-15 21:31:23 [WARNING ] (13, 1, 'bot')
2018-11-15 21:31:23 [WARNING ] (13, 1, 'bot')
2018-11-15 21:31:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:31:23 [DEBUG   ] Finished updating board flags in 1.792 seconds
2018-11-15 21:31:36 [DEBUG   ] Got command BAM from MCS: ref #519110
2018-11-15 21:31:36 [INFO    ] Finished processing BAM request
2018-11-15 21:31:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:31:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519110   8 58437 77496033 A  ERROR'
2018-11-15 21:31:36 [DEBUG   ] Got command BAM from MCS: ref #519109
2018-11-15 21:31:36 [INFO    ] Finished processing BAM request
2018-11-15 21:31:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:31:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519109   8 58437 77496037 A  ERROR'
2018-11-15 21:31:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 21:31:36 [DEBUG   ] spawn_process: at 2018-11-15 21:31:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 21:31:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 21:31:36 [DEBUG   ] spawn_process: at 2018-11-15 21:31:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 21:31:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 21:31:36 [DEBUG   ] spawn_process: at 2018-11-15 21:31:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 21:31:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 21:31:36 [DEBUG   ] spawn_process: at 2018-11-15 21:31:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 21:31:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 21:31:36 [DEBUG   ] spawn_process: at 2018-11-15 21:31:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 21:31:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 21:31:36 [DEBUG   ] spawn_process: at 2018-11-15 21:31:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 21:31:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 21:31:36 [DEBUG   ] spawn_process: at 2018-11-15 21:31:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 21:31:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 21:31:36 [DEBUG   ] spawn_process: at 2018-11-15 21:31:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 21:31:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 21:31:36 [DEBUG   ] spawn_process: at 2018-11-15 21:31:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 21:31:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 21:31:36 [DEBUG   ] spawn_process: at 2018-11-15 21:31:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 21:31:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 21:31:36 [DEBUG   ] spawn_process: at 2018-11-15 21:31:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 21:31:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 21:31:36 [DEBUG   ] spawn_process: at 2018-11-15 21:31:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 21:31:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 21:31:36 [DEBUG   ] spawn_process: at 2018-11-15 21:31:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 21:31:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 21:31:36 [DEBUG   ] spawn_process: at 2018-11-15 21:31:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 21:31:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 21:31:36 [DEBUG   ] spawn_process: at 2018-11-15 21:31:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 21:31:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 21:31:36 [DEBUG   ] spawn_process: at 2018-11-15 21:31:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 21:31:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 21:31:36 [DEBUG   ] spawn_process: at 2018-11-15 21:31:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 21:31:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 21:31:36 [DEBUG   ] spawn_process: at 2018-11-15 21:31:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 21:31:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 21:31:36 [DEBUG   ] spawn_process: at 2018-11-15 21:31:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 21:31:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 21:31:36 [DEBUG   ] spawn_process: at 2018-11-15 21:31:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 21:31:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 21:31:36 [DEBUG   ] spawn_process: at 2018-11-15 21:31:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 21:31:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 21:31:37 [DEBUG   ] spawn_process: at 2018-11-15 21:31:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 21:31:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 21:31:37 [DEBUG   ] spawn_process: at 2018-11-15 21:31:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 21:31:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 21:31:37 [DEBUG   ] spawn_process: at 2018-11-15 21:31:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 21:31:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 21:31:37 [DEBUG   ] spawn_process: at 2018-11-15 21:31:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 21:31:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 21:31:37 [DEBUG   ] spawn_process: at 2018-11-15 21:31:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 21:31:43 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-15 21:32:00 [DEBUG   ] Got command BAM from MCS: ref #519111
2018-11-15 21:32:00 [INFO    ] Finished processing BAM request
2018-11-15 21:32:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:32:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519111   8 58437 77520033 A  ERROR'
2018-11-15 21:32:00 [DEBUG   ] Got command BAM from MCS: ref #519112
2018-11-15 21:32:00 [INFO    ] Finished processing BAM request
2018-11-15 21:32:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:32:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519112   8 58437 77520037 A  ERROR'
2018-11-15 21:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 21:32:00 [DEBUG   ] spawn_process: at 2018-11-15 21:32:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 21:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 21:32:00 [DEBUG   ] spawn_process: at 2018-11-15 21:32:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 21:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 21:32:00 [DEBUG   ] spawn_process: at 2018-11-15 21:32:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 21:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 21:32:00 [DEBUG   ] spawn_process: at 2018-11-15 21:32:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 21:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 21:32:00 [DEBUG   ] spawn_process: at 2018-11-15 21:32:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 21:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 21:32:00 [DEBUG   ] spawn_process: at 2018-11-15 21:32:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 21:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 21:32:00 [DEBUG   ] spawn_process: at 2018-11-15 21:32:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 21:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 21:32:00 [DEBUG   ] spawn_process: at 2018-11-15 21:32:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 21:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 21:32:00 [DEBUG   ] spawn_process: at 2018-11-15 21:32:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 21:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 21:32:00 [DEBUG   ] spawn_process: at 2018-11-15 21:32:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 21:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 21:32:00 [DEBUG   ] spawn_process: at 2018-11-15 21:32:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 21:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 21:32:00 [DEBUG   ] spawn_process: at 2018-11-15 21:32:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 21:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 21:32:00 [DEBUG   ] spawn_process: at 2018-11-15 21:32:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 21:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 21:32:00 [DEBUG   ] spawn_process: at 2018-11-15 21:32:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 21:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 21:32:00 [DEBUG   ] spawn_process: at 2018-11-15 21:32:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 21:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 21:32:00 [DEBUG   ] spawn_process: at 2018-11-15 21:32:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 21:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 21:32:00 [DEBUG   ] spawn_process: at 2018-11-15 21:32:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 21:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 21:32:00 [DEBUG   ] spawn_process: at 2018-11-15 21:32:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 21:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 21:32:00 [DEBUG   ] spawn_process: at 2018-11-15 21:32:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 21:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 21:32:00 [DEBUG   ] spawn_process: at 2018-11-15 21:32:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 21:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 21:32:00 [DEBUG   ] spawn_process: at 2018-11-15 21:32:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 21:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 21:32:00 [DEBUG   ] spawn_process: at 2018-11-15 21:32:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 21:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 21:32:00 [DEBUG   ] spawn_process: at 2018-11-15 21:32:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 21:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 21:32:00 [DEBUG   ] spawn_process: at 2018-11-15 21:32:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 21:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 21:32:00 [DEBUG   ] spawn_process: at 2018-11-15 21:32:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 21:32:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 21:32:00 [DEBUG   ] spawn_process: at 2018-11-15 21:32:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 21:32:03 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 21:32:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:32:22 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-15 21:32:22 [WARNING ] (13, 1, 'bot')
2018-11-15 21:32:22 [WARNING ] (13, 1, 'bot')
2018-11-15 21:32:22 [WARNING ] (13, 1, 'bot')
2018-11-15 21:32:22 [WARNING ] (13, 1, 'bot')
2018-11-15 21:32:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:32:22 [DEBUG   ] Finished updating board flags in 1.075 seconds
2018-11-15 21:32:23 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 21:32:24 [DEBUG   ] Got command BAM from MCS: ref #519114
2018-11-15 21:32:24 [INFO    ] Finished processing BAM request
2018-11-15 21:32:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:32:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519114   8 58437 77544025 A  ERROR'
2018-11-15 21:32:24 [DEBUG   ] Got command BAM from MCS: ref #519113
2018-11-15 21:32:24 [INFO    ] Finished processing BAM request
2018-11-15 21:32:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:32:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519113   8 58437 77544029 A  ERROR'
2018-11-15 21:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 21:32:24 [DEBUG   ] spawn_process: at 2018-11-15 21:32:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 21:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 21:32:24 [DEBUG   ] spawn_process: at 2018-11-15 21:32:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 21:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 21:32:24 [DEBUG   ] spawn_process: at 2018-11-15 21:32:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 21:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 21:32:24 [DEBUG   ] spawn_process: at 2018-11-15 21:32:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 21:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 21:32:24 [DEBUG   ] spawn_process: at 2018-11-15 21:32:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 21:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 21:32:24 [DEBUG   ] spawn_process: at 2018-11-15 21:32:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 21:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 21:32:24 [DEBUG   ] spawn_process: at 2018-11-15 21:32:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 21:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 21:32:24 [DEBUG   ] spawn_process: at 2018-11-15 21:32:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 21:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 21:32:24 [DEBUG   ] spawn_process: at 2018-11-15 21:32:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 21:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 21:32:24 [DEBUG   ] spawn_process: at 2018-11-15 21:32:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 21:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 21:32:24 [DEBUG   ] spawn_process: at 2018-11-15 21:32:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 21:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 21:32:24 [DEBUG   ] spawn_process: at 2018-11-15 21:32:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 21:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 21:32:24 [DEBUG   ] spawn_process: at 2018-11-15 21:32:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 21:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 21:32:24 [DEBUG   ] spawn_process: at 2018-11-15 21:32:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 21:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 21:32:24 [DEBUG   ] spawn_process: at 2018-11-15 21:32:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 21:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 21:32:24 [DEBUG   ] spawn_process: at 2018-11-15 21:32:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 21:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 21:32:24 [DEBUG   ] spawn_process: at 2018-11-15 21:32:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 21:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 21:32:24 [DEBUG   ] spawn_process: at 2018-11-15 21:32:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 21:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 21:32:24 [DEBUG   ] spawn_process: at 2018-11-15 21:32:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 21:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 21:32:24 [DEBUG   ] spawn_process: at 2018-11-15 21:32:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 21:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 21:32:24 [DEBUG   ] spawn_process: at 2018-11-15 21:32:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 21:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 21:32:24 [DEBUG   ] spawn_process: at 2018-11-15 21:32:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 21:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 21:32:24 [DEBUG   ] spawn_process: at 2018-11-15 21:32:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 21:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 21:32:24 [DEBUG   ] spawn_process: at 2018-11-15 21:32:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 21:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 21:32:24 [DEBUG   ] spawn_process: at 2018-11-15 21:32:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 21:32:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 21:32:24 [DEBUG   ] spawn_process: at 2018-11-15 21:32:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 21:32:43 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 21:32:48 [DEBUG   ] Got command BAM from MCS: ref #519120
2018-11-15 21:32:48 [INFO    ] Finished processing BAM request
2018-11-15 21:32:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:32:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519120   8 58437 77568029 A  ERROR'
2018-11-15 21:32:48 [DEBUG   ] Got command BAM from MCS: ref #519119
2018-11-15 21:32:48 [INFO    ] Finished processing BAM request
2018-11-15 21:32:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:32:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519119   8 58437 77568033 A  ERROR'
2018-11-15 21:32:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 21:32:48 [DEBUG   ] spawn_process: at 2018-11-15 21:32:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 21:32:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 21:32:48 [DEBUG   ] spawn_process: at 2018-11-15 21:32:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 21:32:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 21:32:48 [DEBUG   ] spawn_process: at 2018-11-15 21:32:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 21:32:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 21:32:48 [DEBUG   ] spawn_process: at 2018-11-15 21:32:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 21:32:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 21:32:48 [DEBUG   ] spawn_process: at 2018-11-15 21:32:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 21:32:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 21:32:48 [DEBUG   ] spawn_process: at 2018-11-15 21:32:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 21:32:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 21:32:48 [DEBUG   ] spawn_process: at 2018-11-15 21:32:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 21:32:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 21:32:48 [DEBUG   ] spawn_process: at 2018-11-15 21:32:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 21:32:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 21:32:48 [DEBUG   ] spawn_process: at 2018-11-15 21:32:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 21:32:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 21:32:48 [DEBUG   ] spawn_process: at 2018-11-15 21:32:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 21:32:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 21:32:48 [DEBUG   ] spawn_process: at 2018-11-15 21:32:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 21:32:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 21:32:48 [DEBUG   ] spawn_process: at 2018-11-15 21:32:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 21:32:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 21:32:48 [DEBUG   ] spawn_process: at 2018-11-15 21:32:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 21:32:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 21:32:48 [DEBUG   ] spawn_process: at 2018-11-15 21:32:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 21:32:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 21:32:48 [DEBUG   ] spawn_process: at 2018-11-15 21:32:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 21:32:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 21:32:48 [DEBUG   ] spawn_process: at 2018-11-15 21:32:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 21:32:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 21:32:48 [DEBUG   ] spawn_process: at 2018-11-15 21:32:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 21:32:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 21:32:48 [DEBUG   ] spawn_process: at 2018-11-15 21:32:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 21:32:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 21:32:48 [DEBUG   ] spawn_process: at 2018-11-15 21:32:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 21:32:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 21:32:48 [DEBUG   ] spawn_process: at 2018-11-15 21:32:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 21:32:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 21:32:48 [DEBUG   ] spawn_process: at 2018-11-15 21:32:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 21:32:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 21:32:48 [DEBUG   ] spawn_process: at 2018-11-15 21:32:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 21:32:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 21:32:48 [DEBUG   ] spawn_process: at 2018-11-15 21:32:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 21:32:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 21:32:48 [DEBUG   ] spawn_process: at 2018-11-15 21:32:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 21:32:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 21:32:48 [DEBUG   ] spawn_process: at 2018-11-15 21:32:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 21:32:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 21:32:48 [DEBUG   ] spawn_process: at 2018-11-15 21:32:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 21:33:03 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 21:33:12 [DEBUG   ] Got command BAM from MCS: ref #519122
2018-11-15 21:33:12 [INFO    ] Finished processing BAM request
2018-11-15 21:33:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:33:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519122   8 58437 77592025 A  ERROR'
2018-11-15 21:33:12 [DEBUG   ] Got command BAM from MCS: ref #519121
2018-11-15 21:33:12 [INFO    ] Finished processing BAM request
2018-11-15 21:33:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:33:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519121   8 58437 77592029 A  ERROR'
2018-11-15 21:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 21:33:12 [DEBUG   ] spawn_process: at 2018-11-15 21:33:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 21:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 21:33:12 [DEBUG   ] spawn_process: at 2018-11-15 21:33:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 21:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 21:33:12 [DEBUG   ] spawn_process: at 2018-11-15 21:33:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 21:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 21:33:12 [DEBUG   ] spawn_process: at 2018-11-15 21:33:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 21:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 21:33:12 [DEBUG   ] spawn_process: at 2018-11-15 21:33:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 21:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 21:33:12 [DEBUG   ] spawn_process: at 2018-11-15 21:33:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 21:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 21:33:12 [DEBUG   ] spawn_process: at 2018-11-15 21:33:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 21:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 21:33:12 [DEBUG   ] spawn_process: at 2018-11-15 21:33:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 21:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 21:33:12 [DEBUG   ] spawn_process: at 2018-11-15 21:33:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 21:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 21:33:12 [DEBUG   ] spawn_process: at 2018-11-15 21:33:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 21:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 21:33:12 [DEBUG   ] spawn_process: at 2018-11-15 21:33:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 21:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 21:33:12 [DEBUG   ] spawn_process: at 2018-11-15 21:33:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 21:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 21:33:12 [DEBUG   ] spawn_process: at 2018-11-15 21:33:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 21:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 21:33:12 [DEBUG   ] spawn_process: at 2018-11-15 21:33:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 21:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 21:33:12 [DEBUG   ] spawn_process: at 2018-11-15 21:33:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 21:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 21:33:12 [DEBUG   ] spawn_process: at 2018-11-15 21:33:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 21:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 21:33:12 [DEBUG   ] spawn_process: at 2018-11-15 21:33:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 21:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 21:33:12 [DEBUG   ] spawn_process: at 2018-11-15 21:33:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 21:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 21:33:12 [DEBUG   ] spawn_process: at 2018-11-15 21:33:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 21:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 21:33:12 [DEBUG   ] spawn_process: at 2018-11-15 21:33:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 21:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 21:33:12 [DEBUG   ] spawn_process: at 2018-11-15 21:33:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 21:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 21:33:12 [DEBUG   ] spawn_process: at 2018-11-15 21:33:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 21:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 21:33:12 [DEBUG   ] spawn_process: at 2018-11-15 21:33:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 21:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 21:33:12 [DEBUG   ] spawn_process: at 2018-11-15 21:33:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 21:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 21:33:12 [DEBUG   ] spawn_process: at 2018-11-15 21:33:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 21:33:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 21:33:12 [DEBUG   ] spawn_process: at 2018-11-15 21:33:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 21:33:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 21:33:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 21:33:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:33:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-15 21:33:22 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-15 21:33:22 [WARNING ] (13, 1, 'bot')
2018-11-15 21:33:22 [WARNING ] (13, 1, 'bot')
2018-11-15 21:33:22 [WARNING ] (13, 1, 'bot')
2018-11-15 21:33:22 [WARNING ] (13, 1, 'bot')
2018-11-15 21:33:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:33:22 [DEBUG   ] Finished updating board flags in 0.971 seconds
2018-11-15 21:33:23 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-11-15 21:33:24 [DEBUG   ] Got command RPT from MCS: ref #519123
2018-11-15 21:33:24 [DEBUG   ] summary = ERROR
2018-11-15 21:33:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519123  13 58437 77604749 A  ERRORERROR'
2018-11-15 21:33:24 [DEBUG   ] Got command RPT from MCS: ref #519124
2018-11-15 21:33:24 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 21:33:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519124  77 58437 77604953 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 21:33:25 [DEBUG   ] Got command RPT from MCS: ref #519125
2018-11-15 21:33:25 [DEBUG   ] summary = ERROR
2018-11-15 21:33:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519125  13 58437 77605145 A  ERRORERROR'
2018-11-15 21:33:25 [DEBUG   ] Got command RPT from MCS: ref #519126
2018-11-15 21:33:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 21:33:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519126  77 58437 77605349 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 21:33:25 [DEBUG   ] Got command RPT from MCS: ref #519127
2018-11-15 21:33:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 21:33:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519127  12 58437 77605553 A  ERRORB¡ff'
2018-11-15 21:33:36 [DEBUG   ] Got command BAM from MCS: ref #519128
2018-11-15 21:33:36 [INFO    ] Finished processing BAM request
2018-11-15 21:33:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:33:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519128   8 58437 77616033 A  ERROR'
2018-11-15 21:33:36 [DEBUG   ] Got command BAM from MCS: ref #519129
2018-11-15 21:33:36 [INFO    ] Finished processing BAM request
2018-11-15 21:33:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:33:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519129   8 58437 77616037 A  ERROR'
2018-11-15 21:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 21:33:36 [DEBUG   ] spawn_process: at 2018-11-15 21:33:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 21:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 21:33:36 [DEBUG   ] spawn_process: at 2018-11-15 21:33:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 21:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 21:33:36 [DEBUG   ] spawn_process: at 2018-11-15 21:33:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 21:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 21:33:36 [DEBUG   ] spawn_process: at 2018-11-15 21:33:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 21:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 21:33:36 [DEBUG   ] spawn_process: at 2018-11-15 21:33:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 21:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 21:33:36 [DEBUG   ] spawn_process: at 2018-11-15 21:33:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 21:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 21:33:36 [DEBUG   ] spawn_process: at 2018-11-15 21:33:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 21:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 21:33:36 [DEBUG   ] spawn_process: at 2018-11-15 21:33:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 21:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 21:33:36 [DEBUG   ] spawn_process: at 2018-11-15 21:33:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 21:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 21:33:36 [DEBUG   ] spawn_process: at 2018-11-15 21:33:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 21:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 21:33:36 [DEBUG   ] spawn_process: at 2018-11-15 21:33:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 21:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 21:33:36 [DEBUG   ] spawn_process: at 2018-11-15 21:33:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 21:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 21:33:36 [DEBUG   ] spawn_process: at 2018-11-15 21:33:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 21:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 21:33:36 [DEBUG   ] spawn_process: at 2018-11-15 21:33:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 21:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 21:33:36 [DEBUG   ] spawn_process: at 2018-11-15 21:33:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 21:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 21:33:36 [DEBUG   ] spawn_process: at 2018-11-15 21:33:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 21:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 21:33:36 [DEBUG   ] spawn_process: at 2018-11-15 21:33:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 21:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 21:33:36 [DEBUG   ] spawn_process: at 2018-11-15 21:33:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 21:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 21:33:36 [DEBUG   ] spawn_process: at 2018-11-15 21:33:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 21:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 21:33:36 [DEBUG   ] spawn_process: at 2018-11-15 21:33:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 21:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 21:33:36 [DEBUG   ] spawn_process: at 2018-11-15 21:33:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 21:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 21:33:36 [DEBUG   ] spawn_process: at 2018-11-15 21:33:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 21:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 21:33:36 [DEBUG   ] spawn_process: at 2018-11-15 21:33:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 21:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 21:33:36 [DEBUG   ] spawn_process: at 2018-11-15 21:33:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 21:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 21:33:36 [DEBUG   ] spawn_process: at 2018-11-15 21:33:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 21:33:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 21:33:36 [DEBUG   ] spawn_process: at 2018-11-15 21:33:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 21:33:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 21:34:00 [DEBUG   ] Got command BAM from MCS: ref #519131
2018-11-15 21:34:00 [INFO    ] Finished processing BAM request
2018-11-15 21:34:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:34:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519131   8 58437 77640025 A  ERROR'
2018-11-15 21:34:00 [DEBUG   ] Got command BAM from MCS: ref #519130
2018-11-15 21:34:00 [INFO    ] Finished processing BAM request
2018-11-15 21:34:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:34:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519130   8 58437 77640029 A  ERROR'
2018-11-15 21:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 21:34:00 [DEBUG   ] spawn_process: at 2018-11-15 21:34:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 21:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 21:34:00 [DEBUG   ] spawn_process: at 2018-11-15 21:34:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 21:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 21:34:00 [DEBUG   ] spawn_process: at 2018-11-15 21:34:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 21:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 21:34:00 [DEBUG   ] spawn_process: at 2018-11-15 21:34:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 21:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 21:34:00 [DEBUG   ] spawn_process: at 2018-11-15 21:34:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 21:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 21:34:00 [DEBUG   ] spawn_process: at 2018-11-15 21:34:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 21:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 21:34:00 [DEBUG   ] spawn_process: at 2018-11-15 21:34:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 21:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 21:34:00 [DEBUG   ] spawn_process: at 2018-11-15 21:34:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 21:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 21:34:00 [DEBUG   ] spawn_process: at 2018-11-15 21:34:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 21:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 21:34:00 [DEBUG   ] spawn_process: at 2018-11-15 21:34:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 21:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 21:34:00 [DEBUG   ] spawn_process: at 2018-11-15 21:34:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 21:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 21:34:00 [DEBUG   ] spawn_process: at 2018-11-15 21:34:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 21:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 21:34:00 [DEBUG   ] spawn_process: at 2018-11-15 21:34:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 21:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 21:34:00 [DEBUG   ] spawn_process: at 2018-11-15 21:34:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 21:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 21:34:00 [DEBUG   ] spawn_process: at 2018-11-15 21:34:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 21:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 21:34:00 [DEBUG   ] spawn_process: at 2018-11-15 21:34:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 21:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 21:34:00 [DEBUG   ] spawn_process: at 2018-11-15 21:34:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 21:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 21:34:00 [DEBUG   ] spawn_process: at 2018-11-15 21:34:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 21:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 21:34:00 [DEBUG   ] spawn_process: at 2018-11-15 21:34:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 21:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 21:34:00 [DEBUG   ] spawn_process: at 2018-11-15 21:34:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 21:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 21:34:00 [DEBUG   ] spawn_process: at 2018-11-15 21:34:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 21:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 21:34:00 [DEBUG   ] spawn_process: at 2018-11-15 21:34:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 21:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 21:34:00 [DEBUG   ] spawn_process: at 2018-11-15 21:34:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 21:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 21:34:00 [DEBUG   ] spawn_process: at 2018-11-15 21:34:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 21:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 21:34:00 [DEBUG   ] spawn_process: at 2018-11-15 21:34:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 21:34:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 21:34:00 [DEBUG   ] spawn_process: at 2018-11-15 21:34:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 21:34:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 21:34:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 21:34:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:34:23 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 21:34:23 [WARNING ] (13, 1, 'bot')
2018-11-15 21:34:23 [WARNING ] (13, 1, 'bot')
2018-11-15 21:34:23 [WARNING ] (13, 1, 'bot')
2018-11-15 21:34:23 [WARNING ] (13, 1, 'bot')
2018-11-15 21:34:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:34:23 [DEBUG   ] Finished updating board flags in 1.396 seconds
2018-11-15 21:34:24 [DEBUG   ] Got command BAM from MCS: ref #519132
2018-11-15 21:34:24 [INFO    ] Finished processing BAM request
2018-11-15 21:34:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:34:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519132   8 58437 77664029 A  ERROR'
2018-11-15 21:34:24 [DEBUG   ] Got command BAM from MCS: ref #519133
2018-11-15 21:34:24 [INFO    ] Finished processing BAM request
2018-11-15 21:34:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:34:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519133   8 58437 77664033 A  ERROR'
2018-11-15 21:34:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 21:34:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 21:34:24 [DEBUG   ] spawn_process: at 2018-11-15 21:34:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 21:34:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 21:34:24 [DEBUG   ] spawn_process: at 2018-11-15 21:34:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 21:34:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 21:34:24 [DEBUG   ] spawn_process: at 2018-11-15 21:34:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 21:34:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 21:34:24 [DEBUG   ] spawn_process: at 2018-11-15 21:34:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 21:34:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 21:34:24 [DEBUG   ] spawn_process: at 2018-11-15 21:34:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 21:34:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 21:34:24 [DEBUG   ] spawn_process: at 2018-11-15 21:34:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 21:34:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 21:34:24 [DEBUG   ] spawn_process: at 2018-11-15 21:34:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 21:34:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 21:34:24 [DEBUG   ] spawn_process: at 2018-11-15 21:34:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 21:34:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 21:34:24 [DEBUG   ] spawn_process: at 2018-11-15 21:34:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 21:34:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 21:34:24 [DEBUG   ] spawn_process: at 2018-11-15 21:34:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 21:34:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 21:34:24 [DEBUG   ] spawn_process: at 2018-11-15 21:34:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 21:34:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 21:34:24 [DEBUG   ] spawn_process: at 2018-11-15 21:34:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 21:34:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 21:34:24 [DEBUG   ] spawn_process: at 2018-11-15 21:34:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 21:34:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 21:34:24 [DEBUG   ] spawn_process: at 2018-11-15 21:34:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 21:34:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 21:34:24 [DEBUG   ] spawn_process: at 2018-11-15 21:34:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 21:34:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 21:34:24 [DEBUG   ] spawn_process: at 2018-11-15 21:34:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 21:34:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 21:34:24 [DEBUG   ] spawn_process: at 2018-11-15 21:34:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 21:34:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 21:34:24 [DEBUG   ] spawn_process: at 2018-11-15 21:34:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 21:34:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 21:34:24 [DEBUG   ] spawn_process: at 2018-11-15 21:34:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 21:34:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 21:34:24 [DEBUG   ] spawn_process: at 2018-11-15 21:34:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 21:34:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 21:34:24 [DEBUG   ] spawn_process: at 2018-11-15 21:34:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 21:34:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 21:34:24 [DEBUG   ] spawn_process: at 2018-11-15 21:34:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 21:34:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 21:34:24 [DEBUG   ] spawn_process: at 2018-11-15 21:34:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 21:34:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 21:34:24 [DEBUG   ] spawn_process: at 2018-11-15 21:34:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 21:34:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 21:34:24 [DEBUG   ] spawn_process: at 2018-11-15 21:34:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 21:34:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 21:34:24 [DEBUG   ] spawn_process: at 2018-11-15 21:34:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 21:34:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 21:34:48 [DEBUG   ] Got command BAM from MCS: ref #519134
2018-11-15 21:34:48 [INFO    ] Finished processing BAM request
2018-11-15 21:34:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:34:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519134   8 58437 77688033 A  ERROR'
2018-11-15 21:34:48 [DEBUG   ] Got command BAM from MCS: ref #519135
2018-11-15 21:34:48 [INFO    ] Finished processing BAM request
2018-11-15 21:34:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:34:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519135   8 58437 77688037 A  ERROR'
2018-11-15 21:34:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 21:34:48 [DEBUG   ] spawn_process: at 2018-11-15 21:34:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 21:34:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 21:34:48 [DEBUG   ] spawn_process: at 2018-11-15 21:34:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 21:34:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 21:34:48 [DEBUG   ] spawn_process: at 2018-11-15 21:34:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 21:34:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 21:34:48 [DEBUG   ] spawn_process: at 2018-11-15 21:34:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 21:34:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 21:34:48 [DEBUG   ] spawn_process: at 2018-11-15 21:34:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 21:34:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 21:34:48 [DEBUG   ] spawn_process: at 2018-11-15 21:34:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 21:34:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 21:34:48 [DEBUG   ] spawn_process: at 2018-11-15 21:34:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 21:34:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 21:34:48 [DEBUG   ] spawn_process: at 2018-11-15 21:34:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 21:34:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 21:34:48 [DEBUG   ] spawn_process: at 2018-11-15 21:34:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 21:34:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 21:34:48 [DEBUG   ] spawn_process: at 2018-11-15 21:34:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 21:34:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 21:34:48 [DEBUG   ] spawn_process: at 2018-11-15 21:34:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 21:34:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 21:34:48 [DEBUG   ] spawn_process: at 2018-11-15 21:34:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 21:34:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 21:34:48 [DEBUG   ] spawn_process: at 2018-11-15 21:34:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 21:34:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 21:34:48 [DEBUG   ] spawn_process: at 2018-11-15 21:34:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 21:34:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 21:34:48 [DEBUG   ] spawn_process: at 2018-11-15 21:34:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 21:34:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 21:34:48 [DEBUG   ] spawn_process: at 2018-11-15 21:34:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 21:34:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 21:34:48 [DEBUG   ] spawn_process: at 2018-11-15 21:34:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 21:34:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 21:34:48 [DEBUG   ] spawn_process: at 2018-11-15 21:34:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 21:34:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 21:34:48 [DEBUG   ] spawn_process: at 2018-11-15 21:34:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 21:34:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 21:34:48 [DEBUG   ] spawn_process: at 2018-11-15 21:34:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 21:34:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 21:34:48 [DEBUG   ] spawn_process: at 2018-11-15 21:34:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 21:34:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 21:34:48 [DEBUG   ] spawn_process: at 2018-11-15 21:34:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 21:34:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 21:34:48 [DEBUG   ] spawn_process: at 2018-11-15 21:34:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 21:34:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 21:34:48 [DEBUG   ] spawn_process: at 2018-11-15 21:34:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 21:34:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 21:34:48 [DEBUG   ] spawn_process: at 2018-11-15 21:34:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 21:34:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 21:34:48 [DEBUG   ] spawn_process: at 2018-11-15 21:34:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 21:35:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 21:35:12 [DEBUG   ] Got command BAM from MCS: ref #519137
2018-11-15 21:35:12 [INFO    ] Finished processing BAM request
2018-11-15 21:35:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:35:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519137   8 58437 77712029 A  ERROR'
2018-11-15 21:35:12 [DEBUG   ] Got command BAM from MCS: ref #519136
2018-11-15 21:35:12 [INFO    ] Finished processing BAM request
2018-11-15 21:35:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:35:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519136   8 58437 77712033 A  ERROR'
2018-11-15 21:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 21:35:12 [DEBUG   ] spawn_process: at 2018-11-15 21:35:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 21:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 21:35:12 [DEBUG   ] spawn_process: at 2018-11-15 21:35:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 21:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 21:35:12 [DEBUG   ] spawn_process: at 2018-11-15 21:35:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 21:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 21:35:12 [DEBUG   ] spawn_process: at 2018-11-15 21:35:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 21:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 21:35:12 [DEBUG   ] spawn_process: at 2018-11-15 21:35:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 21:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 21:35:12 [DEBUG   ] spawn_process: at 2018-11-15 21:35:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 21:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 21:35:12 [DEBUG   ] spawn_process: at 2018-11-15 21:35:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 21:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 21:35:12 [DEBUG   ] spawn_process: at 2018-11-15 21:35:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 21:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 21:35:12 [DEBUG   ] spawn_process: at 2018-11-15 21:35:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 21:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 21:35:12 [DEBUG   ] spawn_process: at 2018-11-15 21:35:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 21:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 21:35:12 [DEBUG   ] spawn_process: at 2018-11-15 21:35:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 21:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 21:35:12 [DEBUG   ] spawn_process: at 2018-11-15 21:35:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 21:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 21:35:12 [DEBUG   ] spawn_process: at 2018-11-15 21:35:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 21:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 21:35:12 [DEBUG   ] spawn_process: at 2018-11-15 21:35:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 21:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 21:35:12 [DEBUG   ] spawn_process: at 2018-11-15 21:35:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 21:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 21:35:12 [DEBUG   ] spawn_process: at 2018-11-15 21:35:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 21:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 21:35:12 [DEBUG   ] spawn_process: at 2018-11-15 21:35:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 21:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 21:35:12 [DEBUG   ] spawn_process: at 2018-11-15 21:35:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 21:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 21:35:12 [DEBUG   ] spawn_process: at 2018-11-15 21:35:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 21:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 21:35:12 [DEBUG   ] spawn_process: at 2018-11-15 21:35:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 21:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 21:35:12 [DEBUG   ] spawn_process: at 2018-11-15 21:35:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 21:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 21:35:12 [DEBUG   ] spawn_process: at 2018-11-15 21:35:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 21:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 21:35:12 [DEBUG   ] spawn_process: at 2018-11-15 21:35:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 21:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 21:35:12 [DEBUG   ] spawn_process: at 2018-11-15 21:35:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 21:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 21:35:12 [DEBUG   ] spawn_process: at 2018-11-15 21:35:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 21:35:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 21:35:12 [DEBUG   ] spawn_process: at 2018-11-15 21:35:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 21:35:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 21:35:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-15 21:35:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-11-15 21:35:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:35:23 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 21:35:23 [WARNING ] (13, 1, 'bot')
2018-11-15 21:35:23 [WARNING ] (13, 1, 'bot')
2018-11-15 21:35:23 [WARNING ] (13, 1, 'bot')
2018-11-15 21:35:23 [WARNING ] (13, 1, 'bot')
2018-11-15 21:35:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:35:23 [DEBUG   ] Finished updating board flags in 1.187 seconds
2018-11-15 21:35:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 21:35:36 [DEBUG   ] Got command BAM from MCS: ref #519142
2018-11-15 21:35:36 [INFO    ] Finished processing BAM request
2018-11-15 21:35:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:35:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519142   8 58437 77736025 A  ERROR'
2018-11-15 21:35:36 [DEBUG   ] Got command BAM from MCS: ref #519143
2018-11-15 21:35:36 [INFO    ] Finished processing BAM request
2018-11-15 21:35:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:35:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519143   8 58437 77736029 A  ERROR'
2018-11-15 21:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 21:35:36 [DEBUG   ] spawn_process: at 2018-11-15 21:35:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 21:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 21:35:36 [DEBUG   ] spawn_process: at 2018-11-15 21:35:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 21:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 21:35:36 [DEBUG   ] spawn_process: at 2018-11-15 21:35:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 21:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 21:35:36 [DEBUG   ] spawn_process: at 2018-11-15 21:35:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 21:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 21:35:36 [DEBUG   ] spawn_process: at 2018-11-15 21:35:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 21:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 21:35:36 [DEBUG   ] spawn_process: at 2018-11-15 21:35:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 21:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 21:35:36 [DEBUG   ] spawn_process: at 2018-11-15 21:35:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 21:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 21:35:36 [DEBUG   ] spawn_process: at 2018-11-15 21:35:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 21:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 21:35:36 [DEBUG   ] spawn_process: at 2018-11-15 21:35:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 21:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 21:35:36 [DEBUG   ] spawn_process: at 2018-11-15 21:35:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 21:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 21:35:36 [DEBUG   ] spawn_process: at 2018-11-15 21:35:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 21:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 21:35:36 [DEBUG   ] spawn_process: at 2018-11-15 21:35:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 21:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 21:35:36 [DEBUG   ] spawn_process: at 2018-11-15 21:35:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 21:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 21:35:36 [DEBUG   ] spawn_process: at 2018-11-15 21:35:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 21:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 21:35:36 [DEBUG   ] spawn_process: at 2018-11-15 21:35:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 21:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 21:35:36 [DEBUG   ] spawn_process: at 2018-11-15 21:35:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 21:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 21:35:36 [DEBUG   ] spawn_process: at 2018-11-15 21:35:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 21:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 21:35:36 [DEBUG   ] spawn_process: at 2018-11-15 21:35:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 21:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 21:35:36 [DEBUG   ] spawn_process: at 2018-11-15 21:35:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 21:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 21:35:36 [DEBUG   ] spawn_process: at 2018-11-15 21:35:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 21:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 21:35:36 [DEBUG   ] spawn_process: at 2018-11-15 21:35:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 21:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 21:35:36 [DEBUG   ] spawn_process: at 2018-11-15 21:35:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 21:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 21:35:36 [DEBUG   ] spawn_process: at 2018-11-15 21:35:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 21:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 21:35:36 [DEBUG   ] spawn_process: at 2018-11-15 21:35:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 21:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 21:35:36 [DEBUG   ] spawn_process: at 2018-11-15 21:35:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 21:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 21:35:36 [DEBUG   ] spawn_process: at 2018-11-15 21:35:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 21:35:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 21:35:45 [DEBUG   ] Got command RPT from MCS: ref #519144
2018-11-15 21:35:45 [DEBUG   ] summary = ERROR
2018-11-15 21:35:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519144  13 58437 77745205 A  ERRORERROR'
2018-11-15 21:35:45 [DEBUG   ] Got command RPT from MCS: ref #519145
2018-11-15 21:35:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 21:35:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519145  77 58437 77745206 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 21:36:00 [DEBUG   ] Got command BAM from MCS: ref #519161
2018-11-15 21:36:00 [INFO    ] Finished processing BAM request
2018-11-15 21:36:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:36:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519161   8 58437 77760029 A  ERROR'
2018-11-15 21:36:00 [DEBUG   ] Got command BAM from MCS: ref #519162
2018-11-15 21:36:00 [INFO    ] Finished processing BAM request
2018-11-15 21:36:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:36:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519162   8 58437 77760033 A  ERROR'
2018-11-15 21:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 21:36:00 [DEBUG   ] spawn_process: at 2018-11-15 21:36:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 21:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 21:36:00 [DEBUG   ] spawn_process: at 2018-11-15 21:36:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 21:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 21:36:00 [DEBUG   ] spawn_process: at 2018-11-15 21:36:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 21:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 21:36:00 [DEBUG   ] spawn_process: at 2018-11-15 21:36:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 21:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 21:36:00 [DEBUG   ] spawn_process: at 2018-11-15 21:36:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 21:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 21:36:00 [DEBUG   ] spawn_process: at 2018-11-15 21:36:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 21:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 21:36:00 [DEBUG   ] spawn_process: at 2018-11-15 21:36:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 21:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 21:36:00 [DEBUG   ] spawn_process: at 2018-11-15 21:36:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 21:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 21:36:00 [DEBUG   ] spawn_process: at 2018-11-15 21:36:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 21:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 21:36:00 [DEBUG   ] spawn_process: at 2018-11-15 21:36:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 21:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 21:36:00 [DEBUG   ] spawn_process: at 2018-11-15 21:36:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 21:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 21:36:00 [DEBUG   ] spawn_process: at 2018-11-15 21:36:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 21:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 21:36:00 [DEBUG   ] spawn_process: at 2018-11-15 21:36:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 21:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 21:36:00 [DEBUG   ] spawn_process: at 2018-11-15 21:36:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 21:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 21:36:00 [DEBUG   ] spawn_process: at 2018-11-15 21:36:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 21:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 21:36:00 [DEBUG   ] spawn_process: at 2018-11-15 21:36:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 21:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 21:36:00 [DEBUG   ] spawn_process: at 2018-11-15 21:36:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 21:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 21:36:00 [DEBUG   ] spawn_process: at 2018-11-15 21:36:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 21:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 21:36:00 [DEBUG   ] spawn_process: at 2018-11-15 21:36:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 21:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 21:36:00 [DEBUG   ] spawn_process: at 2018-11-15 21:36:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 21:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 21:36:00 [DEBUG   ] spawn_process: at 2018-11-15 21:36:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 21:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 21:36:00 [DEBUG   ] spawn_process: at 2018-11-15 21:36:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 21:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 21:36:00 [DEBUG   ] spawn_process: at 2018-11-15 21:36:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 21:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 21:36:00 [DEBUG   ] spawn_process: at 2018-11-15 21:36:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 21:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 21:36:00 [DEBUG   ] spawn_process: at 2018-11-15 21:36:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 21:36:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 21:36:00 [DEBUG   ] spawn_process: at 2018-11-15 21:36:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 21:36:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 21:36:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 21:36:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:36:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-15 21:36:24 [DEBUG   ] Got command BAM from MCS: ref #519164
2018-11-15 21:36:24 [INFO    ] Finished processing BAM request
2018-11-15 21:36:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:36:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519164   8 58437 77784033 A  ERROR'
2018-11-15 21:36:24 [DEBUG   ] Got command BAM from MCS: ref #519163
2018-11-15 21:36:24 [INFO    ] Finished processing BAM request
2018-11-15 21:36:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:36:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519163   8 58437 77784041 A  ERROR'
2018-11-15 21:36:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 21:36:24 [DEBUG   ] Finished updating ant stats in 1.231 seconds
2018-11-15 21:36:24 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-15 21:36:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 21:36:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 21:36:24 [WARNING ] (13, 1, 'bot')
2018-11-15 21:36:24 [WARNING ] (13, 1, 'bot')
2018-11-15 21:36:24 [WARNING ] (13, 1, 'bot')
2018-11-15 21:36:24 [WARNING ] (13, 1, 'bot')
2018-11-15 21:36:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:36:24 [DEBUG   ] Finished updating board flags in 2.049 seconds
2018-11-15 21:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 21:36:24 [DEBUG   ] spawn_process: at 2018-11-15 21:36:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 21:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 21:36:24 [DEBUG   ] spawn_process: at 2018-11-15 21:36:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 21:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 21:36:24 [DEBUG   ] spawn_process: at 2018-11-15 21:36:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 21:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 21:36:24 [DEBUG   ] spawn_process: at 2018-11-15 21:36:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 21:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 21:36:24 [DEBUG   ] spawn_process: at 2018-11-15 21:36:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 21:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 21:36:24 [DEBUG   ] spawn_process: at 2018-11-15 21:36:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 21:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 21:36:24 [DEBUG   ] spawn_process: at 2018-11-15 21:36:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 21:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 21:36:24 [DEBUG   ] spawn_process: at 2018-11-15 21:36:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 21:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 21:36:24 [DEBUG   ] spawn_process: at 2018-11-15 21:36:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 21:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 21:36:24 [DEBUG   ] spawn_process: at 2018-11-15 21:36:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 21:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 21:36:24 [DEBUG   ] spawn_process: at 2018-11-15 21:36:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 21:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 21:36:24 [DEBUG   ] spawn_process: at 2018-11-15 21:36:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 21:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 21:36:24 [DEBUG   ] spawn_process: at 2018-11-15 21:36:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 21:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 21:36:24 [DEBUG   ] spawn_process: at 2018-11-15 21:36:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 21:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 21:36:24 [DEBUG   ] spawn_process: at 2018-11-15 21:36:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 21:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 21:36:24 [DEBUG   ] spawn_process: at 2018-11-15 21:36:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 21:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 21:36:24 [DEBUG   ] spawn_process: at 2018-11-15 21:36:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 21:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 21:36:24 [DEBUG   ] spawn_process: at 2018-11-15 21:36:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 21:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 21:36:24 [DEBUG   ] spawn_process: at 2018-11-15 21:36:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 21:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 21:36:24 [DEBUG   ] spawn_process: at 2018-11-15 21:36:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 21:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 21:36:24 [DEBUG   ] spawn_process: at 2018-11-15 21:36:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 21:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 21:36:24 [DEBUG   ] spawn_process: at 2018-11-15 21:36:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 21:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 21:36:24 [DEBUG   ] spawn_process: at 2018-11-15 21:36:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 21:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 21:36:24 [DEBUG   ] spawn_process: at 2018-11-15 21:36:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 21:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 21:36:24 [DEBUG   ] spawn_process: at 2018-11-15 21:36:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 21:36:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 21:36:24 [DEBUG   ] spawn_process: at 2018-11-15 21:36:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 21:36:44 [DEBUG   ] Finished updating ant stats in 1.175 seconds
2018-11-15 21:36:48 [DEBUG   ] Got command BAM from MCS: ref #519165
2018-11-15 21:36:48 [INFO    ] Finished processing BAM request
2018-11-15 21:36:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:36:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519165   8 58437 77808033 A  ERROR'
2018-11-15 21:36:48 [DEBUG   ] Got command BAM from MCS: ref #519166
2018-11-15 21:36:48 [INFO    ] Finished processing BAM request
2018-11-15 21:36:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:36:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519166   8 58437 77808037 A  ERROR'
2018-11-15 21:36:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 21:36:48 [DEBUG   ] spawn_process: at 2018-11-15 21:36:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 21:36:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 21:36:48 [DEBUG   ] spawn_process: at 2018-11-15 21:36:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 21:36:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 21:36:48 [DEBUG   ] spawn_process: at 2018-11-15 21:36:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 21:36:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 21:36:48 [DEBUG   ] spawn_process: at 2018-11-15 21:36:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 21:36:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 21:36:48 [DEBUG   ] spawn_process: at 2018-11-15 21:36:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 21:36:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 21:36:48 [DEBUG   ] spawn_process: at 2018-11-15 21:36:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 21:36:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 21:36:48 [DEBUG   ] spawn_process: at 2018-11-15 21:36:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 21:36:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 21:36:48 [DEBUG   ] spawn_process: at 2018-11-15 21:36:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 21:36:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 21:36:48 [DEBUG   ] spawn_process: at 2018-11-15 21:36:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 21:36:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 21:36:48 [DEBUG   ] spawn_process: at 2018-11-15 21:36:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 21:36:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 21:36:48 [DEBUG   ] spawn_process: at 2018-11-15 21:36:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 21:36:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 21:36:48 [DEBUG   ] spawn_process: at 2018-11-15 21:36:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 21:36:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 21:36:48 [DEBUG   ] spawn_process: at 2018-11-15 21:36:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 21:36:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 21:36:48 [DEBUG   ] spawn_process: at 2018-11-15 21:36:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 21:36:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 21:36:48 [DEBUG   ] spawn_process: at 2018-11-15 21:36:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 21:36:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 21:36:48 [DEBUG   ] spawn_process: at 2018-11-15 21:36:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 21:36:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 21:36:48 [DEBUG   ] spawn_process: at 2018-11-15 21:36:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 21:36:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 21:36:48 [DEBUG   ] spawn_process: at 2018-11-15 21:36:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 21:36:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 21:36:48 [DEBUG   ] spawn_process: at 2018-11-15 21:36:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 21:36:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 21:36:48 [DEBUG   ] spawn_process: at 2018-11-15 21:36:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 21:36:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 21:36:48 [DEBUG   ] spawn_process: at 2018-11-15 21:36:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 21:36:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 21:36:48 [DEBUG   ] spawn_process: at 2018-11-15 21:36:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 21:36:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 21:36:48 [DEBUG   ] spawn_process: at 2018-11-15 21:36:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 21:36:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 21:36:48 [DEBUG   ] spawn_process: at 2018-11-15 21:36:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 21:36:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 21:36:48 [DEBUG   ] spawn_process: at 2018-11-15 21:36:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 21:36:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 21:36:48 [DEBUG   ] spawn_process: at 2018-11-15 21:36:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 21:37:04 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 21:37:12 [DEBUG   ] Got command BAM from MCS: ref #519168
2018-11-15 21:37:12 [INFO    ] Finished processing BAM request
2018-11-15 21:37:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:37:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519168   8 58437 77832033 A  ERROR'
2018-11-15 21:37:12 [DEBUG   ] Got command BAM from MCS: ref #519167
2018-11-15 21:37:12 [INFO    ] Finished processing BAM request
2018-11-15 21:37:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:37:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519167   8 58437 77832037 A  ERROR'
2018-11-15 21:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 21:37:12 [DEBUG   ] spawn_process: at 2018-11-15 21:37:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 21:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 21:37:12 [DEBUG   ] spawn_process: at 2018-11-15 21:37:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 21:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 21:37:12 [DEBUG   ] spawn_process: at 2018-11-15 21:37:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 21:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 21:37:12 [DEBUG   ] spawn_process: at 2018-11-15 21:37:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 21:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 21:37:12 [DEBUG   ] spawn_process: at 2018-11-15 21:37:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 21:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 21:37:12 [DEBUG   ] spawn_process: at 2018-11-15 21:37:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 21:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 21:37:12 [DEBUG   ] spawn_process: at 2018-11-15 21:37:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 21:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 21:37:12 [DEBUG   ] spawn_process: at 2018-11-15 21:37:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 21:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 21:37:12 [DEBUG   ] spawn_process: at 2018-11-15 21:37:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 21:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 21:37:12 [DEBUG   ] spawn_process: at 2018-11-15 21:37:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 21:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 21:37:12 [DEBUG   ] spawn_process: at 2018-11-15 21:37:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 21:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 21:37:12 [DEBUG   ] spawn_process: at 2018-11-15 21:37:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 21:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 21:37:12 [DEBUG   ] spawn_process: at 2018-11-15 21:37:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 21:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 21:37:12 [DEBUG   ] spawn_process: at 2018-11-15 21:37:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 21:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 21:37:12 [DEBUG   ] spawn_process: at 2018-11-15 21:37:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 21:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 21:37:12 [DEBUG   ] spawn_process: at 2018-11-15 21:37:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 21:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 21:37:12 [DEBUG   ] spawn_process: at 2018-11-15 21:37:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 21:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 21:37:12 [DEBUG   ] spawn_process: at 2018-11-15 21:37:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 21:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 21:37:12 [DEBUG   ] spawn_process: at 2018-11-15 21:37:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 21:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 21:37:12 [DEBUG   ] spawn_process: at 2018-11-15 21:37:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 21:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 21:37:12 [DEBUG   ] spawn_process: at 2018-11-15 21:37:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 21:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 21:37:12 [DEBUG   ] spawn_process: at 2018-11-15 21:37:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 21:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 21:37:12 [DEBUG   ] spawn_process: at 2018-11-15 21:37:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 21:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 21:37:12 [DEBUG   ] spawn_process: at 2018-11-15 21:37:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 21:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 21:37:12 [DEBUG   ] spawn_process: at 2018-11-15 21:37:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 21:37:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 21:37:12 [DEBUG   ] spawn_process: at 2018-11-15 21:37:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 21:37:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:37:24 [DEBUG   ] Finished updating ant stats in 1.028 seconds
2018-11-15 21:37:24 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 21:37:24 [WARNING ] (13, 1, 'bot')
2018-11-15 21:37:24 [WARNING ] (13, 1, 'bot')
2018-11-15 21:37:24 [WARNING ] (13, 1, 'bot')
2018-11-15 21:37:24 [WARNING ] (13, 1, 'bot')
2018-11-15 21:37:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:37:24 [DEBUG   ] Finished updating board flags in 1.983 seconds
2018-11-15 21:37:36 [DEBUG   ] Got command BAM from MCS: ref #519169
2018-11-15 21:37:36 [INFO    ] Finished processing BAM request
2018-11-15 21:37:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:37:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519169   8 58437 77856033 A  ERROR'
2018-11-15 21:37:36 [DEBUG   ] Got command BAM from MCS: ref #519170
2018-11-15 21:37:36 [INFO    ] Finished processing BAM request
2018-11-15 21:37:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:37:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519170   8 58437 77856037 A  ERROR'
2018-11-15 21:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 21:37:36 [DEBUG   ] spawn_process: at 2018-11-15 21:37:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 21:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 21:37:36 [DEBUG   ] spawn_process: at 2018-11-15 21:37:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 21:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 21:37:36 [DEBUG   ] spawn_process: at 2018-11-15 21:37:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 21:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 21:37:36 [DEBUG   ] spawn_process: at 2018-11-15 21:37:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 21:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 21:37:36 [DEBUG   ] spawn_process: at 2018-11-15 21:37:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 21:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 21:37:36 [DEBUG   ] spawn_process: at 2018-11-15 21:37:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 21:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 21:37:36 [DEBUG   ] spawn_process: at 2018-11-15 21:37:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 21:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 21:37:36 [DEBUG   ] spawn_process: at 2018-11-15 21:37:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 21:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 21:37:36 [DEBUG   ] spawn_process: at 2018-11-15 21:37:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 21:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 21:37:36 [DEBUG   ] spawn_process: at 2018-11-15 21:37:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 21:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 21:37:36 [DEBUG   ] spawn_process: at 2018-11-15 21:37:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 21:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 21:37:36 [DEBUG   ] spawn_process: at 2018-11-15 21:37:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 21:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 21:37:36 [DEBUG   ] spawn_process: at 2018-11-15 21:37:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 21:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 21:37:36 [DEBUG   ] spawn_process: at 2018-11-15 21:37:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 21:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 21:37:36 [DEBUG   ] spawn_process: at 2018-11-15 21:37:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 21:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 21:37:36 [DEBUG   ] spawn_process: at 2018-11-15 21:37:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 21:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 21:37:36 [DEBUG   ] spawn_process: at 2018-11-15 21:37:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 21:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 21:37:36 [DEBUG   ] spawn_process: at 2018-11-15 21:37:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 21:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 21:37:36 [DEBUG   ] spawn_process: at 2018-11-15 21:37:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 21:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 21:37:36 [DEBUG   ] spawn_process: at 2018-11-15 21:37:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 21:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 21:37:36 [DEBUG   ] spawn_process: at 2018-11-15 21:37:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 21:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 21:37:36 [DEBUG   ] spawn_process: at 2018-11-15 21:37:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 21:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 21:37:36 [DEBUG   ] spawn_process: at 2018-11-15 21:37:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 21:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 21:37:36 [DEBUG   ] spawn_process: at 2018-11-15 21:37:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 21:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 21:37:36 [DEBUG   ] spawn_process: at 2018-11-15 21:37:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 21:37:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 21:37:36 [DEBUG   ] spawn_process: at 2018-11-15 21:37:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 21:37:44 [DEBUG   ] Finished updating ant stats in 0.975 seconds
2018-11-15 21:38:00 [DEBUG   ] Got command BAM from MCS: ref #519172
2018-11-15 21:38:00 [INFO    ] Finished processing BAM request
2018-11-15 21:38:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:38:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519172   8 58437 77880033 A  ERROR'
2018-11-15 21:38:00 [DEBUG   ] Got command BAM from MCS: ref #519171
2018-11-15 21:38:00 [INFO    ] Finished processing BAM request
2018-11-15 21:38:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:38:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519171   8 58437 77880037 A  ERROR'
2018-11-15 21:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 21:38:00 [DEBUG   ] spawn_process: at 2018-11-15 21:38:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 21:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 21:38:00 [DEBUG   ] spawn_process: at 2018-11-15 21:38:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 21:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 21:38:00 [DEBUG   ] spawn_process: at 2018-11-15 21:38:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 21:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 21:38:00 [DEBUG   ] spawn_process: at 2018-11-15 21:38:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 21:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 21:38:00 [DEBUG   ] spawn_process: at 2018-11-15 21:38:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 21:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 21:38:00 [DEBUG   ] spawn_process: at 2018-11-15 21:38:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 21:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 21:38:00 [DEBUG   ] spawn_process: at 2018-11-15 21:38:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 21:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 21:38:00 [DEBUG   ] spawn_process: at 2018-11-15 21:38:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 21:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 21:38:00 [DEBUG   ] spawn_process: at 2018-11-15 21:38:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 21:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 21:38:00 [DEBUG   ] spawn_process: at 2018-11-15 21:38:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 21:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 21:38:00 [DEBUG   ] spawn_process: at 2018-11-15 21:38:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 21:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 21:38:00 [DEBUG   ] spawn_process: at 2018-11-15 21:38:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 21:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 21:38:00 [DEBUG   ] spawn_process: at 2018-11-15 21:38:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 21:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 21:38:00 [DEBUG   ] spawn_process: at 2018-11-15 21:38:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 21:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 21:38:00 [DEBUG   ] spawn_process: at 2018-11-15 21:38:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 21:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 21:38:00 [DEBUG   ] spawn_process: at 2018-11-15 21:38:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 21:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 21:38:00 [DEBUG   ] spawn_process: at 2018-11-15 21:38:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 21:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 21:38:00 [DEBUG   ] spawn_process: at 2018-11-15 21:38:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 21:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 21:38:00 [DEBUG   ] spawn_process: at 2018-11-15 21:38:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 21:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 21:38:00 [DEBUG   ] spawn_process: at 2018-11-15 21:38:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 21:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 21:38:00 [DEBUG   ] spawn_process: at 2018-11-15 21:38:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 21:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 21:38:00 [DEBUG   ] spawn_process: at 2018-11-15 21:38:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 21:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 21:38:00 [DEBUG   ] spawn_process: at 2018-11-15 21:38:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 21:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 21:38:00 [DEBUG   ] spawn_process: at 2018-11-15 21:38:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 21:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 21:38:00 [DEBUG   ] spawn_process: at 2018-11-15 21:38:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 21:38:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 21:38:00 [DEBUG   ] spawn_process: at 2018-11-15 21:38:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 21:38:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 21:38:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:38:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-15 21:38:24 [DEBUG   ] Got command BAM from MCS: ref #519176
2018-11-15 21:38:24 [INFO    ] Finished processing BAM request
2018-11-15 21:38:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:38:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519176   8 58437 77904029 A  ERROR'
2018-11-15 21:38:24 [DEBUG   ] Got command BAM from MCS: ref #519175
2018-11-15 21:38:24 [INFO    ] Finished processing BAM request
2018-11-15 21:38:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:38:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519175   8 58437 77904033 A  ERROR'
2018-11-15 21:38:24 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-15 21:38:24 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 21:38:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 21:38:24 [WARNING ] (13, 1, 'bot')
2018-11-15 21:38:24 [WARNING ] (13, 1, 'bot')
2018-11-15 21:38:24 [WARNING ] (13, 1, 'bot')
2018-11-15 21:38:24 [WARNING ] (13, 1, 'bot')
2018-11-15 21:38:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:38:24 [DEBUG   ] Finished updating board flags in 1.976 seconds
2018-11-15 21:38:24 [DEBUG   ] Got command RPT from MCS: ref #519177
2018-11-15 21:38:24 [DEBUG   ] summary = ERROR
2018-11-15 21:38:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519177  13 58437 77904825 A  ERRORERROR'
2018-11-15 21:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 21:38:24 [DEBUG   ] spawn_process: at 2018-11-15 21:38:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 21:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 21:38:24 [DEBUG   ] spawn_process: at 2018-11-15 21:38:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 21:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 21:38:24 [DEBUG   ] spawn_process: at 2018-11-15 21:38:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 21:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 21:38:24 [DEBUG   ] spawn_process: at 2018-11-15 21:38:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 21:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 21:38:24 [DEBUG   ] spawn_process: at 2018-11-15 21:38:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 21:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 21:38:24 [DEBUG   ] spawn_process: at 2018-11-15 21:38:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 21:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 21:38:24 [DEBUG   ] spawn_process: at 2018-11-15 21:38:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 21:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 21:38:24 [DEBUG   ] spawn_process: at 2018-11-15 21:38:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 21:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 21:38:24 [DEBUG   ] spawn_process: at 2018-11-15 21:38:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 21:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 21:38:24 [DEBUG   ] spawn_process: at 2018-11-15 21:38:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 21:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 21:38:24 [DEBUG   ] spawn_process: at 2018-11-15 21:38:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 21:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 21:38:24 [DEBUG   ] spawn_process: at 2018-11-15 21:38:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 21:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 21:38:24 [DEBUG   ] spawn_process: at 2018-11-15 21:38:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 21:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 21:38:24 [DEBUG   ] spawn_process: at 2018-11-15 21:38:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 21:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 21:38:24 [DEBUG   ] spawn_process: at 2018-11-15 21:38:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 21:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 21:38:24 [DEBUG   ] spawn_process: at 2018-11-15 21:38:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 21:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 21:38:24 [DEBUG   ] spawn_process: at 2018-11-15 21:38:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 21:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 21:38:24 [DEBUG   ] spawn_process: at 2018-11-15 21:38:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 21:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 21:38:24 [DEBUG   ] spawn_process: at 2018-11-15 21:38:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 21:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 21:38:24 [DEBUG   ] spawn_process: at 2018-11-15 21:38:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 21:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 21:38:24 [DEBUG   ] spawn_process: at 2018-11-15 21:38:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 21:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 21:38:24 [DEBUG   ] spawn_process: at 2018-11-15 21:38:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 21:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 21:38:24 [DEBUG   ] spawn_process: at 2018-11-15 21:38:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 21:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 21:38:24 [DEBUG   ] spawn_process: at 2018-11-15 21:38:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 21:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 21:38:24 [DEBUG   ] spawn_process: at 2018-11-15 21:38:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 21:38:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 21:38:24 [DEBUG   ] spawn_process: at 2018-11-15 21:38:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 21:38:25 [DEBUG   ] Got command RPT from MCS: ref #519178
2018-11-15 21:38:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 21:38:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519178  77 58437 77905030 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 21:38:25 [DEBUG   ] Got command RPT from MCS: ref #519179
2018-11-15 21:38:25 [DEBUG   ] summary = ERROR
2018-11-15 21:38:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519179  13 58437 77905233 A  ERRORERROR'
2018-11-15 21:38:25 [DEBUG   ] Got command RPT from MCS: ref #519181
2018-11-15 21:38:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 21:38:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519181  77 58437 77905437 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 21:38:25 [DEBUG   ] Got command RPT from MCS: ref #519182
2018-11-15 21:38:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 21:38:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519182  12 58437 77905629 A  ERRORB¢ff'
2018-11-15 21:38:44 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-15 21:38:48 [DEBUG   ] Got command BAM from MCS: ref #519191
2018-11-15 21:38:48 [INFO    ] Finished processing BAM request
2018-11-15 21:38:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:38:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519191   8 58437 77928025 A  ERROR'
2018-11-15 21:38:48 [DEBUG   ] Got command BAM from MCS: ref #519192
2018-11-15 21:38:48 [INFO    ] Finished processing BAM request
2018-11-15 21:38:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:38:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519192   8 58437 77928029 A  ERROR'
2018-11-15 21:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 21:38:48 [DEBUG   ] spawn_process: at 2018-11-15 21:38:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 21:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 21:38:48 [DEBUG   ] spawn_process: at 2018-11-15 21:38:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 21:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 21:38:48 [DEBUG   ] spawn_process: at 2018-11-15 21:38:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 21:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 21:38:48 [DEBUG   ] spawn_process: at 2018-11-15 21:38:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 21:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 21:38:48 [DEBUG   ] spawn_process: at 2018-11-15 21:38:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 21:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 21:38:48 [DEBUG   ] spawn_process: at 2018-11-15 21:38:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 21:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 21:38:48 [DEBUG   ] spawn_process: at 2018-11-15 21:38:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 21:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 21:38:48 [DEBUG   ] spawn_process: at 2018-11-15 21:38:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 21:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 21:38:48 [DEBUG   ] spawn_process: at 2018-11-15 21:38:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 21:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 21:38:48 [DEBUG   ] spawn_process: at 2018-11-15 21:38:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 21:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 21:38:48 [DEBUG   ] spawn_process: at 2018-11-15 21:38:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 21:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 21:38:48 [DEBUG   ] spawn_process: at 2018-11-15 21:38:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 21:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 21:38:48 [DEBUG   ] spawn_process: at 2018-11-15 21:38:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 21:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 21:38:48 [DEBUG   ] spawn_process: at 2018-11-15 21:38:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 21:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 21:38:48 [DEBUG   ] spawn_process: at 2018-11-15 21:38:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 21:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 21:38:48 [DEBUG   ] spawn_process: at 2018-11-15 21:38:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 21:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 21:38:48 [DEBUG   ] spawn_process: at 2018-11-15 21:38:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 21:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 21:38:48 [DEBUG   ] spawn_process: at 2018-11-15 21:38:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 21:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 21:38:48 [DEBUG   ] spawn_process: at 2018-11-15 21:38:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 21:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 21:38:48 [DEBUG   ] spawn_process: at 2018-11-15 21:38:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 21:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 21:38:48 [DEBUG   ] spawn_process: at 2018-11-15 21:38:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 21:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 21:38:48 [DEBUG   ] spawn_process: at 2018-11-15 21:38:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 21:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 21:38:48 [DEBUG   ] spawn_process: at 2018-11-15 21:38:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 21:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 21:38:48 [DEBUG   ] spawn_process: at 2018-11-15 21:38:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 21:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 21:38:48 [DEBUG   ] spawn_process: at 2018-11-15 21:38:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 21:38:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 21:38:48 [DEBUG   ] spawn_process: at 2018-11-15 21:38:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 21:39:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 21:39:12 [DEBUG   ] Got command BAM from MCS: ref #519193
2018-11-15 21:39:12 [INFO    ] Finished processing BAM request
2018-11-15 21:39:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:39:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519193   8 58437 77952033 A  ERROR'
2018-11-15 21:39:12 [DEBUG   ] Got command BAM from MCS: ref #519194
2018-11-15 21:39:12 [INFO    ] Finished processing BAM request
2018-11-15 21:39:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:39:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519194   8 58437 77952037 A  ERROR'
2018-11-15 21:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 21:39:12 [DEBUG   ] spawn_process: at 2018-11-15 21:39:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 21:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 21:39:12 [DEBUG   ] spawn_process: at 2018-11-15 21:39:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 21:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 21:39:12 [DEBUG   ] spawn_process: at 2018-11-15 21:39:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 21:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 21:39:12 [DEBUG   ] spawn_process: at 2018-11-15 21:39:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 21:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 21:39:12 [DEBUG   ] spawn_process: at 2018-11-15 21:39:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 21:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 21:39:12 [DEBUG   ] spawn_process: at 2018-11-15 21:39:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 21:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 21:39:12 [DEBUG   ] spawn_process: at 2018-11-15 21:39:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 21:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 21:39:12 [DEBUG   ] spawn_process: at 2018-11-15 21:39:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 21:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 21:39:12 [DEBUG   ] spawn_process: at 2018-11-15 21:39:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 21:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 21:39:12 [DEBUG   ] spawn_process: at 2018-11-15 21:39:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 21:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 21:39:12 [DEBUG   ] spawn_process: at 2018-11-15 21:39:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 21:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 21:39:12 [DEBUG   ] spawn_process: at 2018-11-15 21:39:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 21:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 21:39:12 [DEBUG   ] spawn_process: at 2018-11-15 21:39:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 21:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 21:39:12 [DEBUG   ] spawn_process: at 2018-11-15 21:39:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 21:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 21:39:12 [DEBUG   ] spawn_process: at 2018-11-15 21:39:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 21:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 21:39:12 [DEBUG   ] spawn_process: at 2018-11-15 21:39:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 21:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 21:39:12 [DEBUG   ] spawn_process: at 2018-11-15 21:39:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 21:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 21:39:12 [DEBUG   ] spawn_process: at 2018-11-15 21:39:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 21:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 21:39:12 [DEBUG   ] spawn_process: at 2018-11-15 21:39:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 21:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 21:39:12 [DEBUG   ] spawn_process: at 2018-11-15 21:39:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 21:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 21:39:12 [DEBUG   ] spawn_process: at 2018-11-15 21:39:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 21:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 21:39:12 [DEBUG   ] spawn_process: at 2018-11-15 21:39:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 21:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 21:39:12 [DEBUG   ] spawn_process: at 2018-11-15 21:39:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 21:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 21:39:12 [DEBUG   ] spawn_process: at 2018-11-15 21:39:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 21:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 21:39:12 [DEBUG   ] spawn_process: at 2018-11-15 21:39:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 21:39:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 21:39:12 [DEBUG   ] spawn_process: at 2018-11-15 21:39:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 21:39:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 21:39:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-15 21:39:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:39:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 1
2018-11-15 21:39:24 [DEBUG   ] Finished updating ant stats in 0.628 seconds
2018-11-15 21:39:24 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 21:39:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 21:39:24 [WARNING ] (13, 1, 'bot')
2018-11-15 21:39:24 [WARNING ] (13, 1, 'bot')
2018-11-15 21:39:24 [WARNING ] (13, 1, 'bot')
2018-11-15 21:39:24 [WARNING ] (13, 1, 'bot')
2018-11-15 21:39:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:39:24 [DEBUG   ] Finished updating board flags in 1.630 seconds
2018-11-15 21:39:36 [DEBUG   ] Got command BAM from MCS: ref #519195
2018-11-15 21:39:36 [INFO    ] Finished processing BAM request
2018-11-15 21:39:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:39:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519195   8 58437 77976025 A  ERROR'
2018-11-15 21:39:36 [DEBUG   ] Got command BAM from MCS: ref #519196
2018-11-15 21:39:36 [INFO    ] Finished processing BAM request
2018-11-15 21:39:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:39:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519196   8 58437 77976029 A  ERROR'
2018-11-15 21:39:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 21:39:36 [DEBUG   ] spawn_process: at 2018-11-15 21:39:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 21:39:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 21:39:36 [DEBUG   ] spawn_process: at 2018-11-15 21:39:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 21:39:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 21:39:36 [DEBUG   ] spawn_process: at 2018-11-15 21:39:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 21:39:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 21:39:36 [DEBUG   ] spawn_process: at 2018-11-15 21:39:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 21:39:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 21:39:36 [DEBUG   ] spawn_process: at 2018-11-15 21:39:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 21:39:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 21:39:36 [DEBUG   ] spawn_process: at 2018-11-15 21:39:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 21:39:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 21:39:36 [DEBUG   ] spawn_process: at 2018-11-15 21:39:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 21:39:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 21:39:36 [DEBUG   ] spawn_process: at 2018-11-15 21:39:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 21:39:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 21:39:36 [DEBUG   ] spawn_process: at 2018-11-15 21:39:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 21:39:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 21:39:36 [DEBUG   ] spawn_process: at 2018-11-15 21:39:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 21:39:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 21:39:36 [DEBUG   ] spawn_process: at 2018-11-15 21:39:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 21:39:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 21:39:36 [DEBUG   ] spawn_process: at 2018-11-15 21:39:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 21:39:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 21:39:36 [DEBUG   ] spawn_process: at 2018-11-15 21:39:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 21:39:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 21:39:36 [DEBUG   ] spawn_process: at 2018-11-15 21:39:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 21:39:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 21:39:36 [DEBUG   ] spawn_process: at 2018-11-15 21:39:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 21:39:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 21:39:36 [DEBUG   ] spawn_process: at 2018-11-15 21:39:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 21:39:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 21:39:36 [DEBUG   ] spawn_process: at 2018-11-15 21:39:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 21:39:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 21:39:36 [DEBUG   ] spawn_process: at 2018-11-15 21:39:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 21:39:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 21:39:36 [DEBUG   ] spawn_process: at 2018-11-15 21:39:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 21:39:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 21:39:36 [DEBUG   ] spawn_process: at 2018-11-15 21:39:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 21:39:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 21:39:36 [DEBUG   ] spawn_process: at 2018-11-15 21:39:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 21:39:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 21:39:36 [DEBUG   ] spawn_process: at 2018-11-15 21:39:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 21:39:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 21:39:36 [DEBUG   ] spawn_process: at 2018-11-15 21:39:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 21:39:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 21:39:36 [DEBUG   ] spawn_process: at 2018-11-15 21:39:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 21:39:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 21:39:36 [DEBUG   ] spawn_process: at 2018-11-15 21:39:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 21:39:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 21:39:36 [DEBUG   ] spawn_process: at 2018-11-15 21:39:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 21:39:44 [DEBUG   ] Finished updating ant stats in 0.574 seconds
2018-11-15 21:40:00 [DEBUG   ] Got command BAM from MCS: ref #519198
2018-11-15 21:40:00 [INFO    ] Finished processing BAM request
2018-11-15 21:40:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:40:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519198   8 58437 78000029 A  ERROR'
2018-11-15 21:40:00 [DEBUG   ] Got command BAM from MCS: ref #519197
2018-11-15 21:40:00 [INFO    ] Finished processing BAM request
2018-11-15 21:40:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:40:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519197   8 58437 78000033 A  ERROR'
2018-11-15 21:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 21:40:00 [DEBUG   ] spawn_process: at 2018-11-15 21:40:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 21:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 21:40:00 [DEBUG   ] spawn_process: at 2018-11-15 21:40:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 21:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 21:40:00 [DEBUG   ] spawn_process: at 2018-11-15 21:40:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 21:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 21:40:00 [DEBUG   ] spawn_process: at 2018-11-15 21:40:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 21:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 21:40:00 [DEBUG   ] spawn_process: at 2018-11-15 21:40:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 21:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 21:40:00 [DEBUG   ] spawn_process: at 2018-11-15 21:40:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 21:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 21:40:00 [DEBUG   ] spawn_process: at 2018-11-15 21:40:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 21:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 21:40:00 [DEBUG   ] spawn_process: at 2018-11-15 21:40:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 21:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 21:40:00 [DEBUG   ] spawn_process: at 2018-11-15 21:40:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 21:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 21:40:00 [DEBUG   ] spawn_process: at 2018-11-15 21:40:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 21:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 21:40:00 [DEBUG   ] spawn_process: at 2018-11-15 21:40:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 21:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 21:40:00 [DEBUG   ] spawn_process: at 2018-11-15 21:40:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 21:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 21:40:00 [DEBUG   ] spawn_process: at 2018-11-15 21:40:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 21:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 21:40:00 [DEBUG   ] spawn_process: at 2018-11-15 21:40:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 21:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 21:40:00 [DEBUG   ] spawn_process: at 2018-11-15 21:40:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 21:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 21:40:00 [DEBUG   ] spawn_process: at 2018-11-15 21:40:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 21:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 21:40:00 [DEBUG   ] spawn_process: at 2018-11-15 21:40:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 21:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 21:40:00 [DEBUG   ] spawn_process: at 2018-11-15 21:40:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 21:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 21:40:00 [DEBUG   ] spawn_process: at 2018-11-15 21:40:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 21:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 21:40:00 [DEBUG   ] spawn_process: at 2018-11-15 21:40:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 21:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 21:40:00 [DEBUG   ] spawn_process: at 2018-11-15 21:40:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 21:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 21:40:00 [DEBUG   ] spawn_process: at 2018-11-15 21:40:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 21:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 21:40:00 [DEBUG   ] spawn_process: at 2018-11-15 21:40:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 21:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 21:40:00 [DEBUG   ] spawn_process: at 2018-11-15 21:40:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 21:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 21:40:00 [DEBUG   ] spawn_process: at 2018-11-15 21:40:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 21:40:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 21:40:00 [DEBUG   ] spawn_process: at 2018-11-15 21:40:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 21:40:04 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 21:40:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 21:40:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 21:40:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:40:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-15 21:40:23 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 21:40:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 21:40:23 [WARNING ] (13, 1, 'bot')
2018-11-15 21:40:23 [WARNING ] (13, 1, 'bot')
2018-11-15 21:40:23 [WARNING ] (13, 1, 'bot')
2018-11-15 21:40:23 [WARNING ] (13, 1, 'bot')
2018-11-15 21:40:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:40:23 [DEBUG   ] Finished updating board flags in 1.021 seconds
2018-11-15 21:40:24 [DEBUG   ] Got command BAM from MCS: ref #519200
2018-11-15 21:40:24 [INFO    ] Finished processing BAM request
2018-11-15 21:40:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:40:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519200   8 58437 78024025 A  ERROR'
2018-11-15 21:40:24 [DEBUG   ] Got command BAM from MCS: ref #519199
2018-11-15 21:40:24 [INFO    ] Finished processing BAM request
2018-11-15 21:40:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:40:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519199   8 58437 78024029 A  ERROR'
2018-11-15 21:40:24 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 21:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 21:40:24 [DEBUG   ] spawn_process: at 2018-11-15 21:40:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 21:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 21:40:24 [DEBUG   ] spawn_process: at 2018-11-15 21:40:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 21:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 21:40:24 [DEBUG   ] spawn_process: at 2018-11-15 21:40:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 21:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 21:40:24 [DEBUG   ] spawn_process: at 2018-11-15 21:40:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 21:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 21:40:24 [DEBUG   ] spawn_process: at 2018-11-15 21:40:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 21:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 21:40:24 [DEBUG   ] spawn_process: at 2018-11-15 21:40:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 21:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 21:40:24 [DEBUG   ] spawn_process: at 2018-11-15 21:40:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 21:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 21:40:24 [DEBUG   ] spawn_process: at 2018-11-15 21:40:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 21:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 21:40:24 [DEBUG   ] spawn_process: at 2018-11-15 21:40:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 21:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 21:40:24 [DEBUG   ] spawn_process: at 2018-11-15 21:40:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 21:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 21:40:24 [DEBUG   ] spawn_process: at 2018-11-15 21:40:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 21:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 21:40:24 [DEBUG   ] spawn_process: at 2018-11-15 21:40:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 21:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 21:40:24 [DEBUG   ] spawn_process: at 2018-11-15 21:40:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 21:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 21:40:24 [DEBUG   ] spawn_process: at 2018-11-15 21:40:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 21:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 21:40:24 [DEBUG   ] spawn_process: at 2018-11-15 21:40:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 21:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 21:40:24 [DEBUG   ] spawn_process: at 2018-11-15 21:40:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 21:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 21:40:24 [DEBUG   ] spawn_process: at 2018-11-15 21:40:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 21:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 21:40:24 [DEBUG   ] spawn_process: at 2018-11-15 21:40:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 21:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 21:40:24 [DEBUG   ] spawn_process: at 2018-11-15 21:40:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 21:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 21:40:24 [DEBUG   ] spawn_process: at 2018-11-15 21:40:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 21:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 21:40:24 [DEBUG   ] spawn_process: at 2018-11-15 21:40:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 21:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 21:40:24 [DEBUG   ] spawn_process: at 2018-11-15 21:40:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 21:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 21:40:24 [DEBUG   ] spawn_process: at 2018-11-15 21:40:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 21:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 21:40:24 [DEBUG   ] spawn_process: at 2018-11-15 21:40:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 21:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 21:40:24 [DEBUG   ] spawn_process: at 2018-11-15 21:40:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 21:40:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 21:40:24 [DEBUG   ] spawn_process: at 2018-11-15 21:40:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 21:40:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 21:40:45 [DEBUG   ] Got command RPT from MCS: ref #519201
2018-11-15 21:40:45 [DEBUG   ] summary = ERROR
2018-11-15 21:40:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519201  13 58437 78045205 A  ERRORERROR'
2018-11-15 21:40:45 [DEBUG   ] Got command RPT from MCS: ref #519202
2018-11-15 21:40:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 21:40:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519202  77 58437 78045206 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 21:40:48 [DEBUG   ] Got command BAM from MCS: ref #519219
2018-11-15 21:40:48 [INFO    ] Finished processing BAM request
2018-11-15 21:40:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:40:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519219   8 58437 78048029 A  ERROR'
2018-11-15 21:40:48 [DEBUG   ] Got command BAM from MCS: ref #519218
2018-11-15 21:40:48 [INFO    ] Finished processing BAM request
2018-11-15 21:40:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:40:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519218   8 58437 78048033 A  ERROR'
2018-11-15 21:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 21:40:48 [DEBUG   ] spawn_process: at 2018-11-15 21:40:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 21:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 21:40:48 [DEBUG   ] spawn_process: at 2018-11-15 21:40:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 21:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 21:40:48 [DEBUG   ] spawn_process: at 2018-11-15 21:40:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 21:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 21:40:48 [DEBUG   ] spawn_process: at 2018-11-15 21:40:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 21:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 21:40:48 [DEBUG   ] spawn_process: at 2018-11-15 21:40:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 21:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 21:40:48 [DEBUG   ] spawn_process: at 2018-11-15 21:40:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 21:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 21:40:48 [DEBUG   ] spawn_process: at 2018-11-15 21:40:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 21:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 21:40:48 [DEBUG   ] spawn_process: at 2018-11-15 21:40:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 21:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 21:40:48 [DEBUG   ] spawn_process: at 2018-11-15 21:40:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 21:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 21:40:48 [DEBUG   ] spawn_process: at 2018-11-15 21:40:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 21:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 21:40:48 [DEBUG   ] spawn_process: at 2018-11-15 21:40:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 21:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 21:40:48 [DEBUG   ] spawn_process: at 2018-11-15 21:40:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 21:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 21:40:48 [DEBUG   ] spawn_process: at 2018-11-15 21:40:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 21:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 21:40:48 [DEBUG   ] spawn_process: at 2018-11-15 21:40:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 21:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 21:40:48 [DEBUG   ] spawn_process: at 2018-11-15 21:40:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 21:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 21:40:48 [DEBUG   ] spawn_process: at 2018-11-15 21:40:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 21:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 21:40:48 [DEBUG   ] spawn_process: at 2018-11-15 21:40:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 21:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 21:40:48 [DEBUG   ] spawn_process: at 2018-11-15 21:40:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 21:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 21:40:48 [DEBUG   ] spawn_process: at 2018-11-15 21:40:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 21:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 21:40:48 [DEBUG   ] spawn_process: at 2018-11-15 21:40:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 21:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 21:40:48 [DEBUG   ] spawn_process: at 2018-11-15 21:40:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 21:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 21:40:48 [DEBUG   ] spawn_process: at 2018-11-15 21:40:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 21:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 21:40:48 [DEBUG   ] spawn_process: at 2018-11-15 21:40:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 21:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 21:40:48 [DEBUG   ] spawn_process: at 2018-11-15 21:40:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 21:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 21:40:48 [DEBUG   ] spawn_process: at 2018-11-15 21:40:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 21:40:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 21:40:48 [DEBUG   ] spawn_process: at 2018-11-15 21:40:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 21:41:04 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 21:41:12 [DEBUG   ] Got command BAM from MCS: ref #519221
2018-11-15 21:41:12 [INFO    ] Finished processing BAM request
2018-11-15 21:41:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:41:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519221   8 58437 78072033 A  ERROR'
2018-11-15 21:41:12 [DEBUG   ] Got command BAM from MCS: ref #519220
2018-11-15 21:41:12 [INFO    ] Finished processing BAM request
2018-11-15 21:41:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:41:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519220   8 58437 78072037 A  ERROR'
2018-11-15 21:41:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 21:41:12 [DEBUG   ] spawn_process: at 2018-11-15 21:41:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 21:41:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 21:41:12 [DEBUG   ] spawn_process: at 2018-11-15 21:41:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 21:41:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 21:41:12 [DEBUG   ] spawn_process: at 2018-11-15 21:41:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 21:41:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 21:41:12 [DEBUG   ] spawn_process: at 2018-11-15 21:41:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 21:41:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 21:41:12 [DEBUG   ] spawn_process: at 2018-11-15 21:41:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 21:41:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 21:41:12 [DEBUG   ] spawn_process: at 2018-11-15 21:41:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 21:41:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 21:41:12 [DEBUG   ] spawn_process: at 2018-11-15 21:41:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 21:41:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 21:41:12 [DEBUG   ] spawn_process: at 2018-11-15 21:41:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 21:41:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 21:41:12 [DEBUG   ] spawn_process: at 2018-11-15 21:41:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 21:41:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 21:41:12 [DEBUG   ] spawn_process: at 2018-11-15 21:41:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 21:41:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 21:41:12 [DEBUG   ] spawn_process: at 2018-11-15 21:41:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 21:41:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 21:41:12 [DEBUG   ] spawn_process: at 2018-11-15 21:41:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 21:41:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 21:41:12 [DEBUG   ] spawn_process: at 2018-11-15 21:41:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 21:41:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 21:41:12 [DEBUG   ] spawn_process: at 2018-11-15 21:41:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 21:41:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 21:41:12 [DEBUG   ] spawn_process: at 2018-11-15 21:41:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 21:41:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 21:41:12 [DEBUG   ] spawn_process: at 2018-11-15 21:41:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 21:41:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 21:41:12 [DEBUG   ] spawn_process: at 2018-11-15 21:41:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 21:41:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 21:41:12 [DEBUG   ] spawn_process: at 2018-11-15 21:41:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 21:41:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 21:41:12 [DEBUG   ] spawn_process: at 2018-11-15 21:41:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 21:41:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 21:41:12 [DEBUG   ] spawn_process: at 2018-11-15 21:41:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 21:41:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 21:41:12 [DEBUG   ] spawn_process: at 2018-11-15 21:41:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 21:41:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 21:41:12 [DEBUG   ] spawn_process: at 2018-11-15 21:41:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 21:41:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 21:41:12 [DEBUG   ] spawn_process: at 2018-11-15 21:41:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 21:41:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 21:41:12 [DEBUG   ] spawn_process: at 2018-11-15 21:41:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 21:41:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 21:41:12 [DEBUG   ] spawn_process: at 2018-11-15 21:41:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 21:41:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 21:41:12 [DEBUG   ] spawn_process: at 2018-11-15 21:41:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 21:41:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-15 21:41:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:41:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-15 21:41:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-11-15 21:41:23 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 21:41:23 [WARNING ] (13, 1, 'bot')
2018-11-15 21:41:23 [WARNING ] (13, 1, 'bot')
2018-11-15 21:41:23 [WARNING ] (13, 1, 'bot')
2018-11-15 21:41:23 [WARNING ] (13, 1, 'bot')
2018-11-15 21:41:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:41:23 [DEBUG   ] Finished updating board flags in 1.016 seconds
2018-11-15 21:41:24 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-11-15 21:41:36 [DEBUG   ] Got command BAM from MCS: ref #519226
2018-11-15 21:41:36 [INFO    ] Finished processing BAM request
2018-11-15 21:41:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:41:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519226   8 58437 78096025 A  ERROR'
2018-11-15 21:41:36 [DEBUG   ] Got command BAM from MCS: ref #519227
2018-11-15 21:41:36 [INFO    ] Finished processing BAM request
2018-11-15 21:41:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:41:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519227   8 58437 78096029 A  ERROR'
2018-11-15 21:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 21:41:36 [DEBUG   ] spawn_process: at 2018-11-15 21:41:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 21:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 21:41:36 [DEBUG   ] spawn_process: at 2018-11-15 21:41:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 21:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 21:41:36 [DEBUG   ] spawn_process: at 2018-11-15 21:41:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 21:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 21:41:36 [DEBUG   ] spawn_process: at 2018-11-15 21:41:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 21:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 21:41:36 [DEBUG   ] spawn_process: at 2018-11-15 21:41:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 21:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 21:41:36 [DEBUG   ] spawn_process: at 2018-11-15 21:41:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 21:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 21:41:36 [DEBUG   ] spawn_process: at 2018-11-15 21:41:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 21:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 21:41:36 [DEBUG   ] spawn_process: at 2018-11-15 21:41:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 21:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 21:41:36 [DEBUG   ] spawn_process: at 2018-11-15 21:41:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 21:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 21:41:36 [DEBUG   ] spawn_process: at 2018-11-15 21:41:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 21:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 21:41:36 [DEBUG   ] spawn_process: at 2018-11-15 21:41:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 21:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 21:41:36 [DEBUG   ] spawn_process: at 2018-11-15 21:41:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 21:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 21:41:36 [DEBUG   ] spawn_process: at 2018-11-15 21:41:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 21:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 21:41:36 [DEBUG   ] spawn_process: at 2018-11-15 21:41:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 21:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 21:41:36 [DEBUG   ] spawn_process: at 2018-11-15 21:41:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 21:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 21:41:36 [DEBUG   ] spawn_process: at 2018-11-15 21:41:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 21:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 21:41:36 [DEBUG   ] spawn_process: at 2018-11-15 21:41:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 21:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 21:41:36 [DEBUG   ] spawn_process: at 2018-11-15 21:41:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 21:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 21:41:36 [DEBUG   ] spawn_process: at 2018-11-15 21:41:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 21:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 21:41:36 [DEBUG   ] spawn_process: at 2018-11-15 21:41:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 21:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 21:41:36 [DEBUG   ] spawn_process: at 2018-11-15 21:41:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 21:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 21:41:36 [DEBUG   ] spawn_process: at 2018-11-15 21:41:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 21:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 21:41:36 [DEBUG   ] spawn_process: at 2018-11-15 21:41:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 21:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 21:41:36 [DEBUG   ] spawn_process: at 2018-11-15 21:41:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 21:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 21:41:36 [DEBUG   ] spawn_process: at 2018-11-15 21:41:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 21:41:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 21:41:36 [DEBUG   ] spawn_process: at 2018-11-15 21:41:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 21:41:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 21:41:59 [DEBUG   ] Got command BAM from MCS: ref #519228
2018-11-15 21:41:59 [INFO    ] Finished processing BAM request
2018-11-15 21:41:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:41:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519228   8 58437 78119029 A  ERROR'
2018-11-15 21:41:59 [DEBUG   ] Got command BAM from MCS: ref #519229
2018-11-15 21:41:59 [INFO    ] Finished processing BAM request
2018-11-15 21:41:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:41:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519229   8 58437 78119033 A  ERROR'
2018-11-15 21:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 21:41:59 [DEBUG   ] spawn_process: at 2018-11-15 21:41:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 21:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 21:41:59 [DEBUG   ] spawn_process: at 2018-11-15 21:41:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 21:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 21:41:59 [DEBUG   ] spawn_process: at 2018-11-15 21:41:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 21:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 21:41:59 [DEBUG   ] spawn_process: at 2018-11-15 21:41:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 21:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 21:41:59 [DEBUG   ] spawn_process: at 2018-11-15 21:41:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 21:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 21:41:59 [DEBUG   ] spawn_process: at 2018-11-15 21:41:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 21:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 21:41:59 [DEBUG   ] spawn_process: at 2018-11-15 21:41:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 21:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 21:41:59 [DEBUG   ] spawn_process: at 2018-11-15 21:41:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 21:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 21:41:59 [DEBUG   ] spawn_process: at 2018-11-15 21:41:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 21:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 21:41:59 [DEBUG   ] spawn_process: at 2018-11-15 21:41:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 21:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 21:41:59 [DEBUG   ] spawn_process: at 2018-11-15 21:41:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 21:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 21:41:59 [DEBUG   ] spawn_process: at 2018-11-15 21:41:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 21:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 21:41:59 [DEBUG   ] spawn_process: at 2018-11-15 21:41:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 21:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 21:41:59 [DEBUG   ] spawn_process: at 2018-11-15 21:41:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 21:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 21:41:59 [DEBUG   ] spawn_process: at 2018-11-15 21:41:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 21:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 21:41:59 [DEBUG   ] spawn_process: at 2018-11-15 21:41:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 21:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 21:41:59 [DEBUG   ] spawn_process: at 2018-11-15 21:41:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 21:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 21:41:59 [DEBUG   ] spawn_process: at 2018-11-15 21:41:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 21:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 21:41:59 [DEBUG   ] spawn_process: at 2018-11-15 21:41:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 21:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 21:41:59 [DEBUG   ] spawn_process: at 2018-11-15 21:41:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 21:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 21:41:59 [DEBUG   ] spawn_process: at 2018-11-15 21:41:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 21:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 21:41:59 [DEBUG   ] spawn_process: at 2018-11-15 21:41:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 21:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 21:41:59 [DEBUG   ] spawn_process: at 2018-11-15 21:41:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 21:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 21:41:59 [DEBUG   ] spawn_process: at 2018-11-15 21:41:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 21:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 21:41:59 [DEBUG   ] spawn_process: at 2018-11-15 21:41:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 21:41:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 21:41:59 [DEBUG   ] spawn_process: at 2018-11-15 21:41:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 21:42:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 21:42:22 [DEBUG   ] Got command BAM from MCS: ref #519231
2018-11-15 21:42:22 [INFO    ] Finished processing BAM request
2018-11-15 21:42:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:42:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519231   8 58437 78142029 A  ERROR'
2018-11-15 21:42:22 [DEBUG   ] Got command BAM from MCS: ref #519230
2018-11-15 21:42:22 [INFO    ] Finished processing BAM request
2018-11-15 21:42:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:42:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519230   8 58437 78142033 A  ERROR'
2018-11-15 21:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 21:42:22 [DEBUG   ] spawn_process: at 2018-11-15 21:42:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 21:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 21:42:22 [DEBUG   ] spawn_process: at 2018-11-15 21:42:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 21:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 21:42:22 [DEBUG   ] spawn_process: at 2018-11-15 21:42:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 21:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 21:42:22 [DEBUG   ] spawn_process: at 2018-11-15 21:42:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 21:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 21:42:22 [DEBUG   ] spawn_process: at 2018-11-15 21:42:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 21:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 21:42:22 [DEBUG   ] spawn_process: at 2018-11-15 21:42:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 21:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 21:42:22 [DEBUG   ] spawn_process: at 2018-11-15 21:42:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 21:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 21:42:22 [DEBUG   ] spawn_process: at 2018-11-15 21:42:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 21:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 21:42:22 [DEBUG   ] spawn_process: at 2018-11-15 21:42:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 21:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 21:42:22 [DEBUG   ] spawn_process: at 2018-11-15 21:42:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 21:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 21:42:22 [DEBUG   ] spawn_process: at 2018-11-15 21:42:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 21:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 21:42:22 [DEBUG   ] spawn_process: at 2018-11-15 21:42:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 21:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 21:42:22 [DEBUG   ] spawn_process: at 2018-11-15 21:42:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 21:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 21:42:22 [DEBUG   ] spawn_process: at 2018-11-15 21:42:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 21:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 21:42:22 [DEBUG   ] spawn_process: at 2018-11-15 21:42:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 21:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 21:42:22 [DEBUG   ] spawn_process: at 2018-11-15 21:42:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 21:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 21:42:22 [DEBUG   ] spawn_process: at 2018-11-15 21:42:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 21:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 21:42:22 [DEBUG   ] spawn_process: at 2018-11-15 21:42:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 21:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 21:42:22 [DEBUG   ] spawn_process: at 2018-11-15 21:42:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 21:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 21:42:22 [DEBUG   ] spawn_process: at 2018-11-15 21:42:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 21:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 21:42:22 [DEBUG   ] spawn_process: at 2018-11-15 21:42:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 21:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 21:42:22 [DEBUG   ] spawn_process: at 2018-11-15 21:42:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 21:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 21:42:22 [DEBUG   ] spawn_process: at 2018-11-15 21:42:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 21:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 21:42:22 [DEBUG   ] spawn_process: at 2018-11-15 21:42:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 21:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 21:42:22 [DEBUG   ] spawn_process: at 2018-11-15 21:42:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 21:42:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 21:42:22 [DEBUG   ] spawn_process: at 2018-11-15 21:42:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 21:42:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 21:42:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-11-15 21:42:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:42:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 21:42:23 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 21:42:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 21:42:23 [WARNING ] (13, 1, 'bot')
2018-11-15 21:42:23 [WARNING ] (13, 1, 'bot')
2018-11-15 21:42:23 [WARNING ] (13, 1, 'bot')
2018-11-15 21:42:23 [WARNING ] (13, 1, 'bot')
2018-11-15 21:42:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:42:23 [DEBUG   ] Finished updating board flags in 0.946 seconds
2018-11-15 21:42:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 21:42:45 [DEBUG   ] Got command BAM from MCS: ref #519232
2018-11-15 21:42:45 [INFO    ] Finished processing BAM request
2018-11-15 21:42:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:42:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519232   8 58437 78165025 A  ERROR'
2018-11-15 21:42:45 [DEBUG   ] Got command BAM from MCS: ref #519233
2018-11-15 21:42:45 [INFO    ] Finished processing BAM request
2018-11-15 21:42:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:42:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519233   8 58437 78165029 A  ERROR'
2018-11-15 21:42:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 21:42:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 21:42:45 [DEBUG   ] spawn_process: at 2018-11-15 21:42:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 21:42:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 21:42:45 [DEBUG   ] spawn_process: at 2018-11-15 21:42:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 21:42:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 21:42:45 [DEBUG   ] spawn_process: at 2018-11-15 21:42:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 21:42:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 21:42:45 [DEBUG   ] spawn_process: at 2018-11-15 21:42:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 21:42:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 21:42:45 [DEBUG   ] spawn_process: at 2018-11-15 21:42:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 21:42:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 21:42:45 [DEBUG   ] spawn_process: at 2018-11-15 21:42:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 21:42:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 21:42:45 [DEBUG   ] spawn_process: at 2018-11-15 21:42:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 21:42:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 21:42:45 [DEBUG   ] spawn_process: at 2018-11-15 21:42:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 21:42:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 21:42:45 [DEBUG   ] spawn_process: at 2018-11-15 21:42:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 21:42:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 21:42:45 [DEBUG   ] spawn_process: at 2018-11-15 21:42:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 21:42:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 21:42:45 [DEBUG   ] spawn_process: at 2018-11-15 21:42:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 21:42:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 21:42:45 [DEBUG   ] spawn_process: at 2018-11-15 21:42:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 21:42:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 21:42:45 [DEBUG   ] spawn_process: at 2018-11-15 21:42:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 21:42:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 21:42:45 [DEBUG   ] spawn_process: at 2018-11-15 21:42:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 21:42:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 21:42:45 [DEBUG   ] spawn_process: at 2018-11-15 21:42:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 21:42:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 21:42:45 [DEBUG   ] spawn_process: at 2018-11-15 21:42:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 21:42:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 21:42:45 [DEBUG   ] spawn_process: at 2018-11-15 21:42:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 21:42:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 21:42:45 [DEBUG   ] spawn_process: at 2018-11-15 21:42:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 21:42:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 21:42:45 [DEBUG   ] spawn_process: at 2018-11-15 21:42:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 21:42:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 21:42:45 [DEBUG   ] spawn_process: at 2018-11-15 21:42:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 21:42:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 21:42:45 [DEBUG   ] spawn_process: at 2018-11-15 21:42:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 21:42:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 21:42:45 [DEBUG   ] spawn_process: at 2018-11-15 21:42:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 21:42:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 21:42:45 [DEBUG   ] spawn_process: at 2018-11-15 21:42:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 21:42:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 21:42:45 [DEBUG   ] spawn_process: at 2018-11-15 21:42:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 21:42:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 21:42:45 [DEBUG   ] spawn_process: at 2018-11-15 21:42:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 21:42:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 21:42:45 [DEBUG   ] spawn_process: at 2018-11-15 21:42:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 21:43:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 21:43:08 [DEBUG   ] Got command BAM from MCS: ref #519235
2018-11-15 21:43:08 [INFO    ] Finished processing BAM request
2018-11-15 21:43:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:43:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519235   8 58437 78188025 A  ERROR'
2018-11-15 21:43:08 [DEBUG   ] Got command BAM from MCS: ref #519234
2018-11-15 21:43:08 [INFO    ] Finished processing BAM request
2018-11-15 21:43:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:43:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519234   8 58437 78188029 A  ERROR'
2018-11-15 21:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 21:43:08 [DEBUG   ] spawn_process: at 2018-11-15 21:43:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 21:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 21:43:08 [DEBUG   ] spawn_process: at 2018-11-15 21:43:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 21:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 21:43:08 [DEBUG   ] spawn_process: at 2018-11-15 21:43:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 21:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 21:43:08 [DEBUG   ] spawn_process: at 2018-11-15 21:43:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 21:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 21:43:08 [DEBUG   ] spawn_process: at 2018-11-15 21:43:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 21:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 21:43:08 [DEBUG   ] spawn_process: at 2018-11-15 21:43:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 21:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 21:43:08 [DEBUG   ] spawn_process: at 2018-11-15 21:43:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 21:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 21:43:08 [DEBUG   ] spawn_process: at 2018-11-15 21:43:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 21:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 21:43:08 [DEBUG   ] spawn_process: at 2018-11-15 21:43:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 21:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 21:43:08 [DEBUG   ] spawn_process: at 2018-11-15 21:43:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 21:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 21:43:08 [DEBUG   ] spawn_process: at 2018-11-15 21:43:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 21:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 21:43:08 [DEBUG   ] spawn_process: at 2018-11-15 21:43:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 21:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 21:43:08 [DEBUG   ] spawn_process: at 2018-11-15 21:43:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 21:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 21:43:08 [DEBUG   ] spawn_process: at 2018-11-15 21:43:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 21:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 21:43:08 [DEBUG   ] spawn_process: at 2018-11-15 21:43:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 21:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 21:43:08 [DEBUG   ] spawn_process: at 2018-11-15 21:43:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 21:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 21:43:08 [DEBUG   ] spawn_process: at 2018-11-15 21:43:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 21:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 21:43:08 [DEBUG   ] spawn_process: at 2018-11-15 21:43:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 21:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 21:43:08 [DEBUG   ] spawn_process: at 2018-11-15 21:43:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 21:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 21:43:08 [DEBUG   ] spawn_process: at 2018-11-15 21:43:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 21:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 21:43:08 [DEBUG   ] spawn_process: at 2018-11-15 21:43:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 21:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 21:43:08 [DEBUG   ] spawn_process: at 2018-11-15 21:43:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 21:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 21:43:08 [DEBUG   ] spawn_process: at 2018-11-15 21:43:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 21:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 21:43:08 [DEBUG   ] spawn_process: at 2018-11-15 21:43:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 21:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 21:43:08 [DEBUG   ] spawn_process: at 2018-11-15 21:43:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 21:43:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 21:43:08 [DEBUG   ] spawn_process: at 2018-11-15 21:43:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 21:43:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 21:43:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 21:43:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-11-15 21:43:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:43:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-15 21:43:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-11-15 21:43:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-15 21:43:24 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 21:43:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 21:43:24 [WARNING ] (13, 1, 'bot')
2018-11-15 21:43:24 [WARNING ] (13, 1, 'bot')
2018-11-15 21:43:24 [WARNING ] (13, 1, 'bot')
2018-11-15 21:43:24 [WARNING ] (13, 1, 'bot')
2018-11-15 21:43:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:43:24 [DEBUG   ] Finished updating board flags in 1.427 seconds
2018-11-15 21:43:24 [DEBUG   ] Got command RPT from MCS: ref #519236
2018-11-15 21:43:24 [DEBUG   ] summary = ERROR
2018-11-15 21:43:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519236  13 58437 78204913 A  ERRORERROR'
2018-11-15 21:43:25 [DEBUG   ] Got command RPT from MCS: ref #519237
2018-11-15 21:43:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 21:43:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519237  77 58437 78205117 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 21:43:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 21:43:25 [DEBUG   ] Got command RPT from MCS: ref #519238
2018-11-15 21:43:25 [DEBUG   ] summary = ERROR
2018-11-15 21:43:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519238  13 58437 78205321 A  ERRORERROR'
2018-11-15 21:43:25 [DEBUG   ] Got command RPT from MCS: ref #519239
2018-11-15 21:43:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 21:43:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519239  77 58437 78205525 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 21:43:25 [DEBUG   ] Got command RPT from MCS: ref #519240
2018-11-15 21:43:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 21:43:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519240  12 58437 78205717 A  ERRORB¢ff'
2018-11-15 21:43:31 [DEBUG   ] Got command BAM from MCS: ref #519241
2018-11-15 21:43:31 [INFO    ] Finished processing BAM request
2018-11-15 21:43:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:43:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519241   8 58437 78211025 A  ERROR'
2018-11-15 21:43:31 [DEBUG   ] Got command BAM from MCS: ref #519242
2018-11-15 21:43:31 [INFO    ] Finished processing BAM request
2018-11-15 21:43:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:43:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519242   8 58437 78211029 A  ERROR'
2018-11-15 21:43:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 21:43:31 [DEBUG   ] spawn_process: at 2018-11-15 21:43:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 21:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 21:43:32 [DEBUG   ] spawn_process: at 2018-11-15 21:43:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 21:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 21:43:32 [DEBUG   ] spawn_process: at 2018-11-15 21:43:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 21:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 21:43:32 [DEBUG   ] spawn_process: at 2018-11-15 21:43:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 21:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 21:43:32 [DEBUG   ] spawn_process: at 2018-11-15 21:43:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 21:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 21:43:32 [DEBUG   ] spawn_process: at 2018-11-15 21:43:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 21:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 21:43:32 [DEBUG   ] spawn_process: at 2018-11-15 21:43:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 21:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 21:43:32 [DEBUG   ] spawn_process: at 2018-11-15 21:43:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 21:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 21:43:32 [DEBUG   ] spawn_process: at 2018-11-15 21:43:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 21:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 21:43:32 [DEBUG   ] spawn_process: at 2018-11-15 21:43:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 21:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 21:43:32 [DEBUG   ] spawn_process: at 2018-11-15 21:43:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 21:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 21:43:32 [DEBUG   ] spawn_process: at 2018-11-15 21:43:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 21:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 21:43:32 [DEBUG   ] spawn_process: at 2018-11-15 21:43:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 21:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 21:43:32 [DEBUG   ] spawn_process: at 2018-11-15 21:43:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 21:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 21:43:32 [DEBUG   ] spawn_process: at 2018-11-15 21:43:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 21:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 21:43:32 [DEBUG   ] spawn_process: at 2018-11-15 21:43:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 21:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 21:43:32 [DEBUG   ] spawn_process: at 2018-11-15 21:43:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 21:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 21:43:32 [DEBUG   ] spawn_process: at 2018-11-15 21:43:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 21:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 21:43:32 [DEBUG   ] spawn_process: at 2018-11-15 21:43:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 21:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 21:43:32 [DEBUG   ] spawn_process: at 2018-11-15 21:43:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 21:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 21:43:32 [DEBUG   ] spawn_process: at 2018-11-15 21:43:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 21:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 21:43:32 [DEBUG   ] spawn_process: at 2018-11-15 21:43:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 21:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 21:43:32 [DEBUG   ] spawn_process: at 2018-11-15 21:43:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 21:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 21:43:32 [DEBUG   ] spawn_process: at 2018-11-15 21:43:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 21:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 21:43:32 [DEBUG   ] spawn_process: at 2018-11-15 21:43:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 21:43:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 21:43:32 [DEBUG   ] spawn_process: at 2018-11-15 21:43:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 21:43:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 21:43:54 [DEBUG   ] Got command BAM from MCS: ref #519244
2018-11-15 21:43:54 [INFO    ] Finished processing BAM request
2018-11-15 21:43:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:43:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519244   8 58437 78234029 A  ERROR'
2018-11-15 21:43:54 [DEBUG   ] Got command BAM from MCS: ref #519243
2018-11-15 21:43:54 [INFO    ] Finished processing BAM request
2018-11-15 21:43:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:43:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519243   8 58437 78234033 A  ERROR'
2018-11-15 21:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 21:43:54 [DEBUG   ] spawn_process: at 2018-11-15 21:43:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 21:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 21:43:54 [DEBUG   ] spawn_process: at 2018-11-15 21:43:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 21:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 21:43:54 [DEBUG   ] spawn_process: at 2018-11-15 21:43:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 21:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 21:43:54 [DEBUG   ] spawn_process: at 2018-11-15 21:43:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 21:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 21:43:54 [DEBUG   ] spawn_process: at 2018-11-15 21:43:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 21:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 21:43:54 [DEBUG   ] spawn_process: at 2018-11-15 21:43:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 21:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 21:43:54 [DEBUG   ] spawn_process: at 2018-11-15 21:43:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 21:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 21:43:54 [DEBUG   ] spawn_process: at 2018-11-15 21:43:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 21:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 21:43:54 [DEBUG   ] spawn_process: at 2018-11-15 21:43:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 21:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 21:43:54 [DEBUG   ] spawn_process: at 2018-11-15 21:43:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 21:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 21:43:54 [DEBUG   ] spawn_process: at 2018-11-15 21:43:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 21:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 21:43:54 [DEBUG   ] spawn_process: at 2018-11-15 21:43:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 21:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 21:43:54 [DEBUG   ] spawn_process: at 2018-11-15 21:43:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 21:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 21:43:54 [DEBUG   ] spawn_process: at 2018-11-15 21:43:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 21:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 21:43:54 [DEBUG   ] spawn_process: at 2018-11-15 21:43:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 21:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 21:43:54 [DEBUG   ] spawn_process: at 2018-11-15 21:43:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 21:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 21:43:54 [DEBUG   ] spawn_process: at 2018-11-15 21:43:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 21:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 21:43:54 [DEBUG   ] spawn_process: at 2018-11-15 21:43:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 21:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 21:43:54 [DEBUG   ] spawn_process: at 2018-11-15 21:43:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 21:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 21:43:54 [DEBUG   ] spawn_process: at 2018-11-15 21:43:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 21:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 21:43:54 [DEBUG   ] spawn_process: at 2018-11-15 21:43:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 21:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 21:43:54 [DEBUG   ] spawn_process: at 2018-11-15 21:43:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 21:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 21:43:54 [DEBUG   ] spawn_process: at 2018-11-15 21:43:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 21:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 21:43:54 [DEBUG   ] spawn_process: at 2018-11-15 21:43:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 21:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 21:43:54 [DEBUG   ] spawn_process: at 2018-11-15 21:43:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 21:43:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 21:43:54 [DEBUG   ] spawn_process: at 2018-11-15 21:43:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 21:44:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 21:44:17 [DEBUG   ] Got command BAM from MCS: ref #519246
2018-11-15 21:44:17 [INFO    ] Finished processing BAM request
2018-11-15 21:44:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:44:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519246   8 58437 78257029 A  ERROR'
2018-11-15 21:44:17 [DEBUG   ] Got command BAM from MCS: ref #519245
2018-11-15 21:44:17 [INFO    ] Finished processing BAM request
2018-11-15 21:44:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:44:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519245   8 58437 78257033 A  ERROR'
2018-11-15 21:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 21:44:17 [DEBUG   ] spawn_process: at 2018-11-15 21:44:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 21:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 21:44:17 [DEBUG   ] spawn_process: at 2018-11-15 21:44:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 21:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 21:44:17 [DEBUG   ] spawn_process: at 2018-11-15 21:44:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 21:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 21:44:17 [DEBUG   ] spawn_process: at 2018-11-15 21:44:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 21:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 21:44:17 [DEBUG   ] spawn_process: at 2018-11-15 21:44:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 21:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 21:44:17 [DEBUG   ] spawn_process: at 2018-11-15 21:44:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 21:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 21:44:17 [DEBUG   ] spawn_process: at 2018-11-15 21:44:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 21:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 21:44:17 [DEBUG   ] spawn_process: at 2018-11-15 21:44:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 21:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 21:44:17 [DEBUG   ] spawn_process: at 2018-11-15 21:44:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 21:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 21:44:17 [DEBUG   ] spawn_process: at 2018-11-15 21:44:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 21:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 21:44:17 [DEBUG   ] spawn_process: at 2018-11-15 21:44:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 21:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 21:44:17 [DEBUG   ] spawn_process: at 2018-11-15 21:44:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 21:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 21:44:17 [DEBUG   ] spawn_process: at 2018-11-15 21:44:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 21:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 21:44:17 [DEBUG   ] spawn_process: at 2018-11-15 21:44:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 21:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 21:44:17 [DEBUG   ] spawn_process: at 2018-11-15 21:44:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 21:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 21:44:17 [DEBUG   ] spawn_process: at 2018-11-15 21:44:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 21:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 21:44:17 [DEBUG   ] spawn_process: at 2018-11-15 21:44:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 21:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 21:44:17 [DEBUG   ] spawn_process: at 2018-11-15 21:44:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 21:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 21:44:17 [DEBUG   ] spawn_process: at 2018-11-15 21:44:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 21:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 21:44:17 [DEBUG   ] spawn_process: at 2018-11-15 21:44:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 21:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 21:44:17 [DEBUG   ] spawn_process: at 2018-11-15 21:44:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 21:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 21:44:17 [DEBUG   ] spawn_process: at 2018-11-15 21:44:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 21:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 21:44:17 [DEBUG   ] spawn_process: at 2018-11-15 21:44:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 21:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 21:44:17 [DEBUG   ] spawn_process: at 2018-11-15 21:44:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 21:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 21:44:17 [DEBUG   ] spawn_process: at 2018-11-15 21:44:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 21:44:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 21:44:17 [DEBUG   ] spawn_process: at 2018-11-15 21:44:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 21:44:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 21:44:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 21:44:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:44:24 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 21:44:24 [WARNING ] (13, 1, 'bot')
2018-11-15 21:44:24 [WARNING ] (13, 1, 'bot')
2018-11-15 21:44:24 [WARNING ] (13, 1, 'bot')
2018-11-15 21:44:24 [WARNING ] (13, 1, 'bot')
2018-11-15 21:44:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:44:24 [DEBUG   ] Finished updating board flags in 1.441 seconds
2018-11-15 21:44:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 21:44:40 [DEBUG   ] Got command BAM from MCS: ref #519251
2018-11-15 21:44:40 [INFO    ] Finished processing BAM request
2018-11-15 21:44:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:44:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519251   8 58437 78280025 A  ERROR'
2018-11-15 21:44:40 [DEBUG   ] Got command BAM from MCS: ref #519252
2018-11-15 21:44:40 [INFO    ] Finished processing BAM request
2018-11-15 21:44:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:44:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519252   8 58437 78280029 A  ERROR'
2018-11-15 21:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 21:44:40 [DEBUG   ] spawn_process: at 2018-11-15 21:44:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 21:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 21:44:40 [DEBUG   ] spawn_process: at 2018-11-15 21:44:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 21:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 21:44:40 [DEBUG   ] spawn_process: at 2018-11-15 21:44:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 21:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 21:44:40 [DEBUG   ] spawn_process: at 2018-11-15 21:44:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 21:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 21:44:40 [DEBUG   ] spawn_process: at 2018-11-15 21:44:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 21:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 21:44:40 [DEBUG   ] spawn_process: at 2018-11-15 21:44:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 21:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 21:44:40 [DEBUG   ] spawn_process: at 2018-11-15 21:44:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 21:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 21:44:40 [DEBUG   ] spawn_process: at 2018-11-15 21:44:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 21:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 21:44:40 [DEBUG   ] spawn_process: at 2018-11-15 21:44:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 21:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 21:44:40 [DEBUG   ] spawn_process: at 2018-11-15 21:44:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 21:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 21:44:40 [DEBUG   ] spawn_process: at 2018-11-15 21:44:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 21:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 21:44:40 [DEBUG   ] spawn_process: at 2018-11-15 21:44:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 21:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 21:44:40 [DEBUG   ] spawn_process: at 2018-11-15 21:44:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 21:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 21:44:40 [DEBUG   ] spawn_process: at 2018-11-15 21:44:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 21:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 21:44:40 [DEBUG   ] spawn_process: at 2018-11-15 21:44:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 21:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 21:44:40 [DEBUG   ] spawn_process: at 2018-11-15 21:44:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 21:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 21:44:40 [DEBUG   ] spawn_process: at 2018-11-15 21:44:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 21:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 21:44:40 [DEBUG   ] spawn_process: at 2018-11-15 21:44:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 21:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 21:44:40 [DEBUG   ] spawn_process: at 2018-11-15 21:44:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 21:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 21:44:40 [DEBUG   ] spawn_process: at 2018-11-15 21:44:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 21:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 21:44:40 [DEBUG   ] spawn_process: at 2018-11-15 21:44:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 21:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 21:44:40 [DEBUG   ] spawn_process: at 2018-11-15 21:44:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 21:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 21:44:40 [DEBUG   ] spawn_process: at 2018-11-15 21:44:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 21:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 21:44:40 [DEBUG   ] spawn_process: at 2018-11-15 21:44:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 21:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 21:44:40 [DEBUG   ] spawn_process: at 2018-11-15 21:44:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 21:44:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 21:44:40 [DEBUG   ] spawn_process: at 2018-11-15 21:44:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 21:44:45 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-15 21:45:03 [DEBUG   ] Got command BAM from MCS: ref #519254
2018-11-15 21:45:03 [INFO    ] Finished processing BAM request
2018-11-15 21:45:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:45:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519254   8 58437 78303029 A  ERROR'
2018-11-15 21:45:03 [DEBUG   ] Got command BAM from MCS: ref #519253
2018-11-15 21:45:03 [INFO    ] Finished processing BAM request
2018-11-15 21:45:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:45:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519253   8 58437 78303033 A  ERROR'
2018-11-15 21:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 21:45:03 [DEBUG   ] spawn_process: at 2018-11-15 21:45:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 21:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 21:45:03 [DEBUG   ] spawn_process: at 2018-11-15 21:45:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 21:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 21:45:03 [DEBUG   ] spawn_process: at 2018-11-15 21:45:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 21:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 21:45:03 [DEBUG   ] spawn_process: at 2018-11-15 21:45:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 21:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 21:45:03 [DEBUG   ] spawn_process: at 2018-11-15 21:45:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 21:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 21:45:03 [DEBUG   ] spawn_process: at 2018-11-15 21:45:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 21:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 21:45:03 [DEBUG   ] spawn_process: at 2018-11-15 21:45:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 21:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 21:45:03 [DEBUG   ] spawn_process: at 2018-11-15 21:45:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 21:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 21:45:03 [DEBUG   ] spawn_process: at 2018-11-15 21:45:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 21:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 21:45:03 [DEBUG   ] spawn_process: at 2018-11-15 21:45:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 21:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 21:45:03 [DEBUG   ] spawn_process: at 2018-11-15 21:45:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 21:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 21:45:03 [DEBUG   ] spawn_process: at 2018-11-15 21:45:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 21:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 21:45:03 [DEBUG   ] spawn_process: at 2018-11-15 21:45:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 21:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 21:45:03 [DEBUG   ] spawn_process: at 2018-11-15 21:45:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 21:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 21:45:03 [DEBUG   ] spawn_process: at 2018-11-15 21:45:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 21:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 21:45:03 [DEBUG   ] spawn_process: at 2018-11-15 21:45:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 21:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 21:45:03 [DEBUG   ] spawn_process: at 2018-11-15 21:45:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 21:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 21:45:03 [DEBUG   ] spawn_process: at 2018-11-15 21:45:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 21:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 21:45:03 [DEBUG   ] spawn_process: at 2018-11-15 21:45:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 21:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 21:45:03 [DEBUG   ] spawn_process: at 2018-11-15 21:45:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 21:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 21:45:03 [DEBUG   ] spawn_process: at 2018-11-15 21:45:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 21:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 21:45:03 [DEBUG   ] spawn_process: at 2018-11-15 21:45:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 21:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 21:45:03 [DEBUG   ] spawn_process: at 2018-11-15 21:45:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 21:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 21:45:03 [DEBUG   ] spawn_process: at 2018-11-15 21:45:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 21:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 21:45:03 [DEBUG   ] spawn_process: at 2018-11-15 21:45:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 21:45:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 21:45:03 [DEBUG   ] spawn_process: at 2018-11-15 21:45:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 21:45:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 21:45:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:45:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-15 21:45:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-15 21:45:24 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 21:45:24 [WARNING ] (13, 1, 'bot')
2018-11-15 21:45:24 [WARNING ] (13, 1, 'bot')
2018-11-15 21:45:24 [WARNING ] (13, 1, 'bot')
2018-11-15 21:45:24 [WARNING ] (13, 1, 'bot')
2018-11-15 21:45:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:45:24 [DEBUG   ] Finished updating board flags in 1.337 seconds
2018-11-15 21:45:25 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-15 21:45:26 [DEBUG   ] Got command BAM from MCS: ref #519256
2018-11-15 21:45:26 [INFO    ] Finished processing BAM request
2018-11-15 21:45:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:45:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519256   8 58437 78326033 A  ERROR'
2018-11-15 21:45:26 [DEBUG   ] Got command BAM from MCS: ref #519255
2018-11-15 21:45:26 [INFO    ] Finished processing BAM request
2018-11-15 21:45:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:45:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519255   8 58437 78326037 A  ERROR'
2018-11-15 21:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 21:45:26 [DEBUG   ] spawn_process: at 2018-11-15 21:45:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 21:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 21:45:26 [DEBUG   ] spawn_process: at 2018-11-15 21:45:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 21:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 21:45:26 [DEBUG   ] spawn_process: at 2018-11-15 21:45:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 21:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 21:45:26 [DEBUG   ] spawn_process: at 2018-11-15 21:45:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 21:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 21:45:26 [DEBUG   ] spawn_process: at 2018-11-15 21:45:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 21:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 21:45:26 [DEBUG   ] spawn_process: at 2018-11-15 21:45:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 21:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 21:45:26 [DEBUG   ] spawn_process: at 2018-11-15 21:45:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 21:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 21:45:26 [DEBUG   ] spawn_process: at 2018-11-15 21:45:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 21:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 21:45:26 [DEBUG   ] spawn_process: at 2018-11-15 21:45:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 21:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 21:45:26 [DEBUG   ] spawn_process: at 2018-11-15 21:45:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 21:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 21:45:26 [DEBUG   ] spawn_process: at 2018-11-15 21:45:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 21:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 21:45:26 [DEBUG   ] spawn_process: at 2018-11-15 21:45:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 21:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 21:45:26 [DEBUG   ] spawn_process: at 2018-11-15 21:45:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 21:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 21:45:26 [DEBUG   ] spawn_process: at 2018-11-15 21:45:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 21:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 21:45:26 [DEBUG   ] spawn_process: at 2018-11-15 21:45:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 21:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 21:45:26 [DEBUG   ] spawn_process: at 2018-11-15 21:45:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 21:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 21:45:26 [DEBUG   ] spawn_process: at 2018-11-15 21:45:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 21:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 21:45:26 [DEBUG   ] spawn_process: at 2018-11-15 21:45:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 21:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 21:45:26 [DEBUG   ] spawn_process: at 2018-11-15 21:45:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 21:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 21:45:26 [DEBUG   ] spawn_process: at 2018-11-15 21:45:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 21:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 21:45:26 [DEBUG   ] spawn_process: at 2018-11-15 21:45:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 21:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 21:45:26 [DEBUG   ] spawn_process: at 2018-11-15 21:45:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 21:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 21:45:26 [DEBUG   ] spawn_process: at 2018-11-15 21:45:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 21:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 21:45:26 [DEBUG   ] spawn_process: at 2018-11-15 21:45:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 21:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 21:45:26 [DEBUG   ] spawn_process: at 2018-11-15 21:45:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 21:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 21:45:26 [DEBUG   ] spawn_process: at 2018-11-15 21:45:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 21:45:45 [DEBUG   ] Got command RPT from MCS: ref #519257
2018-11-15 21:45:45 [DEBUG   ] summary = ERROR
2018-11-15 21:45:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519257  13 58437 78345205 A  ERRORERROR'
2018-11-15 21:45:45 [DEBUG   ] Got command RPT from MCS: ref #519258
2018-11-15 21:45:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 21:45:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519258  77 58437 78345206 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 21:45:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 21:45:49 [DEBUG   ] Got command BAM from MCS: ref #519274
2018-11-15 21:45:49 [INFO    ] Finished processing BAM request
2018-11-15 21:45:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:45:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519274   8 58437 78349025 A  ERROR'
2018-11-15 21:45:49 [DEBUG   ] Got command BAM from MCS: ref #519275
2018-11-15 21:45:49 [INFO    ] Finished processing BAM request
2018-11-15 21:45:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:45:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519275   8 58437 78349029 A  ERROR'
2018-11-15 21:45:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 21:45:49 [DEBUG   ] spawn_process: at 2018-11-15 21:45:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 21:45:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 21:45:49 [DEBUG   ] spawn_process: at 2018-11-15 21:45:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 21:45:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 21:45:49 [DEBUG   ] spawn_process: at 2018-11-15 21:45:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 21:45:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 21:45:49 [DEBUG   ] spawn_process: at 2018-11-15 21:45:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 21:45:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 21:45:49 [DEBUG   ] spawn_process: at 2018-11-15 21:45:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 21:45:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 21:45:49 [DEBUG   ] spawn_process: at 2018-11-15 21:45:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 21:45:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 21:45:49 [DEBUG   ] spawn_process: at 2018-11-15 21:45:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 21:45:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 21:45:49 [DEBUG   ] spawn_process: at 2018-11-15 21:45:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 21:45:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 21:45:49 [DEBUG   ] spawn_process: at 2018-11-15 21:45:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 21:45:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 21:45:49 [DEBUG   ] spawn_process: at 2018-11-15 21:45:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 21:45:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 21:45:49 [DEBUG   ] spawn_process: at 2018-11-15 21:45:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 21:45:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 21:45:49 [DEBUG   ] spawn_process: at 2018-11-15 21:45:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 21:45:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 21:45:49 [DEBUG   ] spawn_process: at 2018-11-15 21:45:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 21:45:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 21:45:49 [DEBUG   ] spawn_process: at 2018-11-15 21:45:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 21:45:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 21:45:49 [DEBUG   ] spawn_process: at 2018-11-15 21:45:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 21:45:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 21:45:49 [DEBUG   ] spawn_process: at 2018-11-15 21:45:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 21:45:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 21:45:49 [DEBUG   ] spawn_process: at 2018-11-15 21:45:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 21:45:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 21:45:49 [DEBUG   ] spawn_process: at 2018-11-15 21:45:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 21:45:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 21:45:49 [DEBUG   ] spawn_process: at 2018-11-15 21:45:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 21:45:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 21:45:49 [DEBUG   ] spawn_process: at 2018-11-15 21:45:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 21:45:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 21:45:49 [DEBUG   ] spawn_process: at 2018-11-15 21:45:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 21:45:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 21:45:49 [DEBUG   ] spawn_process: at 2018-11-15 21:45:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 21:45:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 21:45:49 [DEBUG   ] spawn_process: at 2018-11-15 21:45:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 21:45:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 21:45:49 [DEBUG   ] spawn_process: at 2018-11-15 21:45:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 21:45:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 21:45:49 [DEBUG   ] spawn_process: at 2018-11-15 21:45:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 21:45:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 21:45:49 [DEBUG   ] spawn_process: at 2018-11-15 21:45:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 21:46:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 21:46:12 [DEBUG   ] Got command BAM from MCS: ref #519276
2018-11-15 21:46:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:46:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519276   8 58437 78372033 A  ERROR'
2018-11-15 21:46:12 [DEBUG   ] Got command BAM from MCS: ref #519277
2018-11-15 21:46:12 [INFO    ] Finished processing BAM request
2018-11-15 21:46:12 [INFO    ] Finished processing BAM request
2018-11-15 21:46:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:46:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519277   8 58437 78372369 A  ERROR'
2018-11-15 21:46:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 21:46:12 [DEBUG   ] spawn_process: at 2018-11-15 21:46:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 21:46:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 21:46:12 [DEBUG   ] spawn_process: at 2018-11-15 21:46:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 21:46:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 21:46:12 [DEBUG   ] spawn_process: at 2018-11-15 21:46:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 21:46:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 21:46:12 [DEBUG   ] spawn_process: at 2018-11-15 21:46:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 21:46:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 21:46:12 [DEBUG   ] spawn_process: at 2018-11-15 21:46:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 21:46:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 21:46:12 [DEBUG   ] spawn_process: at 2018-11-15 21:46:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 21:46:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 21:46:12 [DEBUG   ] spawn_process: at 2018-11-15 21:46:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 21:46:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 21:46:12 [DEBUG   ] spawn_process: at 2018-11-15 21:46:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 21:46:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 21:46:12 [DEBUG   ] spawn_process: at 2018-11-15 21:46:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 21:46:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 21:46:12 [DEBUG   ] spawn_process: at 2018-11-15 21:46:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 21:46:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 21:46:12 [DEBUG   ] spawn_process: at 2018-11-15 21:46:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 21:46:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 21:46:12 [DEBUG   ] spawn_process: at 2018-11-15 21:46:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 21:46:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 21:46:12 [DEBUG   ] spawn_process: at 2018-11-15 21:46:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 21:46:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 21:46:12 [DEBUG   ] spawn_process: at 2018-11-15 21:46:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 21:46:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 21:46:12 [DEBUG   ] spawn_process: at 2018-11-15 21:46:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 21:46:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 21:46:12 [DEBUG   ] spawn_process: at 2018-11-15 21:46:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 21:46:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 21:46:12 [DEBUG   ] spawn_process: at 2018-11-15 21:46:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 21:46:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 21:46:12 [DEBUG   ] spawn_process: at 2018-11-15 21:46:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 21:46:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 21:46:12 [DEBUG   ] spawn_process: at 2018-11-15 21:46:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 21:46:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 21:46:12 [DEBUG   ] spawn_process: at 2018-11-15 21:46:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 21:46:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 21:46:12 [DEBUG   ] spawn_process: at 2018-11-15 21:46:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 21:46:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 21:46:12 [DEBUG   ] spawn_process: at 2018-11-15 21:46:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 21:46:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 21:46:12 [DEBUG   ] spawn_process: at 2018-11-15 21:46:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 21:46:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 21:46:12 [DEBUG   ] spawn_process: at 2018-11-15 21:46:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 21:46:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 21:46:12 [DEBUG   ] spawn_process: at 2018-11-15 21:46:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 21:46:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 21:46:12 [DEBUG   ] spawn_process: at 2018-11-15 21:46:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 21:46:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 21:46:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:46:24 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 21:46:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 21:46:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 21:46:24 [WARNING ] (13, 1, 'bot')
2018-11-15 21:46:24 [WARNING ] (13, 1, 'bot')
2018-11-15 21:46:24 [WARNING ] (13, 1, 'bot')
2018-11-15 21:46:24 [WARNING ] (13, 1, 'bot')
2018-11-15 21:46:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:46:24 [DEBUG   ] Finished updating board flags in 1.172 seconds
2018-11-15 21:46:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 21:46:35 [DEBUG   ] Got command BAM from MCS: ref #519279
2018-11-15 21:46:35 [INFO    ] Finished processing BAM request
2018-11-15 21:46:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:46:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519279   8 58437 78395045 A  ERROR'
2018-11-15 21:46:35 [DEBUG   ] Got command BAM from MCS: ref #519278
2018-11-15 21:46:35 [INFO    ] Finished processing BAM request
2018-11-15 21:46:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:46:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519278   8 58437 78395053 A  ERROR'
2018-11-15 21:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 21:46:35 [DEBUG   ] spawn_process: at 2018-11-15 21:46:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 21:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 21:46:35 [DEBUG   ] spawn_process: at 2018-11-15 21:46:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 21:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 21:46:35 [DEBUG   ] spawn_process: at 2018-11-15 21:46:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 21:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 21:46:35 [DEBUG   ] spawn_process: at 2018-11-15 21:46:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 21:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 21:46:35 [DEBUG   ] spawn_process: at 2018-11-15 21:46:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 21:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 21:46:35 [DEBUG   ] spawn_process: at 2018-11-15 21:46:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 21:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 21:46:35 [DEBUG   ] spawn_process: at 2018-11-15 21:46:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 21:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 21:46:35 [DEBUG   ] spawn_process: at 2018-11-15 21:46:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 21:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 21:46:35 [DEBUG   ] spawn_process: at 2018-11-15 21:46:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 21:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 21:46:35 [DEBUG   ] spawn_process: at 2018-11-15 21:46:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 21:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 21:46:35 [DEBUG   ] spawn_process: at 2018-11-15 21:46:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 21:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 21:46:35 [DEBUG   ] spawn_process: at 2018-11-15 21:46:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 21:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 21:46:35 [DEBUG   ] spawn_process: at 2018-11-15 21:46:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 21:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 21:46:35 [DEBUG   ] spawn_process: at 2018-11-15 21:46:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 21:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 21:46:35 [DEBUG   ] spawn_process: at 2018-11-15 21:46:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 21:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 21:46:35 [DEBUG   ] spawn_process: at 2018-11-15 21:46:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 21:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 21:46:35 [DEBUG   ] spawn_process: at 2018-11-15 21:46:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 21:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 21:46:35 [DEBUG   ] spawn_process: at 2018-11-15 21:46:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 21:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 21:46:35 [DEBUG   ] spawn_process: at 2018-11-15 21:46:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 21:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 21:46:35 [DEBUG   ] spawn_process: at 2018-11-15 21:46:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 21:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 21:46:35 [DEBUG   ] spawn_process: at 2018-11-15 21:46:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 21:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 21:46:35 [DEBUG   ] spawn_process: at 2018-11-15 21:46:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 21:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 21:46:35 [DEBUG   ] spawn_process: at 2018-11-15 21:46:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 21:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 21:46:35 [DEBUG   ] spawn_process: at 2018-11-15 21:46:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 21:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 21:46:35 [DEBUG   ] spawn_process: at 2018-11-15 21:46:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 21:46:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 21:46:35 [DEBUG   ] spawn_process: at 2018-11-15 21:46:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 21:46:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 21:46:58 [DEBUG   ] Got command BAM from MCS: ref #519280
2018-11-15 21:46:58 [INFO    ] Finished processing BAM request
2018-11-15 21:46:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:46:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519280   8 58437 78418025 A  ERROR'
2018-11-15 21:46:58 [DEBUG   ] Got command BAM from MCS: ref #519281
2018-11-15 21:46:58 [INFO    ] Finished processing BAM request
2018-11-15 21:46:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:46:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519281   8 58437 78418029 A  ERROR'
2018-11-15 21:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 21:46:58 [DEBUG   ] spawn_process: at 2018-11-15 21:46:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 21:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 21:46:58 [DEBUG   ] spawn_process: at 2018-11-15 21:46:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 21:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 21:46:58 [DEBUG   ] spawn_process: at 2018-11-15 21:46:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 21:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 21:46:58 [DEBUG   ] spawn_process: at 2018-11-15 21:46:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 21:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 21:46:58 [DEBUG   ] spawn_process: at 2018-11-15 21:46:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 21:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 21:46:58 [DEBUG   ] spawn_process: at 2018-11-15 21:46:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 21:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 21:46:58 [DEBUG   ] spawn_process: at 2018-11-15 21:46:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 21:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 21:46:58 [DEBUG   ] spawn_process: at 2018-11-15 21:46:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 21:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 21:46:58 [DEBUG   ] spawn_process: at 2018-11-15 21:46:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 21:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 21:46:58 [DEBUG   ] spawn_process: at 2018-11-15 21:46:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 21:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 21:46:58 [DEBUG   ] spawn_process: at 2018-11-15 21:46:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 21:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 21:46:58 [DEBUG   ] spawn_process: at 2018-11-15 21:46:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 21:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 21:46:58 [DEBUG   ] spawn_process: at 2018-11-15 21:46:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 21:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 21:46:58 [DEBUG   ] spawn_process: at 2018-11-15 21:46:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 21:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 21:46:58 [DEBUG   ] spawn_process: at 2018-11-15 21:46:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 21:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 21:46:58 [DEBUG   ] spawn_process: at 2018-11-15 21:46:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 21:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 21:46:58 [DEBUG   ] spawn_process: at 2018-11-15 21:46:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 21:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 21:46:58 [DEBUG   ] spawn_process: at 2018-11-15 21:46:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 21:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 21:46:58 [DEBUG   ] spawn_process: at 2018-11-15 21:46:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 21:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 21:46:58 [DEBUG   ] spawn_process: at 2018-11-15 21:46:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 21:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 21:46:58 [DEBUG   ] spawn_process: at 2018-11-15 21:46:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 21:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 21:46:58 [DEBUG   ] spawn_process: at 2018-11-15 21:46:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 21:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 21:46:58 [DEBUG   ] spawn_process: at 2018-11-15 21:46:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 21:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 21:46:58 [DEBUG   ] spawn_process: at 2018-11-15 21:46:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 21:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 21:46:58 [DEBUG   ] spawn_process: at 2018-11-15 21:46:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 21:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 21:46:58 [DEBUG   ] spawn_process: at 2018-11-15 21:46:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 21:47:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 21:47:21 [DEBUG   ] Got command BAM from MCS: ref #519283
2018-11-15 21:47:21 [INFO    ] Finished processing BAM request
2018-11-15 21:47:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:47:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519283   8 58437 78441025 A  ERROR'
2018-11-15 21:47:21 [DEBUG   ] Got command BAM from MCS: ref #519282
2018-11-15 21:47:21 [INFO    ] Finished processing BAM request
2018-11-15 21:47:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:47:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519282   8 58437 78441029 A  ERROR'
2018-11-15 21:47:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 21:47:21 [DEBUG   ] spawn_process: at 2018-11-15 21:47:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 21:47:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 21:47:21 [DEBUG   ] spawn_process: at 2018-11-15 21:47:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 21:47:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 21:47:21 [DEBUG   ] spawn_process: at 2018-11-15 21:47:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 21:47:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 21:47:21 [DEBUG   ] spawn_process: at 2018-11-15 21:47:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 21:47:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 21:47:21 [DEBUG   ] spawn_process: at 2018-11-15 21:47:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 21:47:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 21:47:21 [DEBUG   ] spawn_process: at 2018-11-15 21:47:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 21:47:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 21:47:21 [DEBUG   ] spawn_process: at 2018-11-15 21:47:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 21:47:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 21:47:21 [DEBUG   ] spawn_process: at 2018-11-15 21:47:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 21:47:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 21:47:21 [DEBUG   ] spawn_process: at 2018-11-15 21:47:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 21:47:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 21:47:21 [DEBUG   ] spawn_process: at 2018-11-15 21:47:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 21:47:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 21:47:21 [DEBUG   ] spawn_process: at 2018-11-15 21:47:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 21:47:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 21:47:21 [DEBUG   ] spawn_process: at 2018-11-15 21:47:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 21:47:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 21:47:21 [DEBUG   ] spawn_process: at 2018-11-15 21:47:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 21:47:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 21:47:21 [DEBUG   ] spawn_process: at 2018-11-15 21:47:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 21:47:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 21:47:21 [DEBUG   ] spawn_process: at 2018-11-15 21:47:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 21:47:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 21:47:21 [DEBUG   ] spawn_process: at 2018-11-15 21:47:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 21:47:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 21:47:21 [DEBUG   ] spawn_process: at 2018-11-15 21:47:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 21:47:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 21:47:21 [DEBUG   ] spawn_process: at 2018-11-15 21:47:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 21:47:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 21:47:21 [DEBUG   ] spawn_process: at 2018-11-15 21:47:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 21:47:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 21:47:21 [DEBUG   ] spawn_process: at 2018-11-15 21:47:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 21:47:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 21:47:21 [DEBUG   ] spawn_process: at 2018-11-15 21:47:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 21:47:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 21:47:21 [DEBUG   ] spawn_process: at 2018-11-15 21:47:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 21:47:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 21:47:21 [DEBUG   ] spawn_process: at 2018-11-15 21:47:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 21:47:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 21:47:21 [DEBUG   ] spawn_process: at 2018-11-15 21:47:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 21:47:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 21:47:21 [DEBUG   ] spawn_process: at 2018-11-15 21:47:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 21:47:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 21:47:21 [DEBUG   ] spawn_process: at 2018-11-15 21:47:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 21:47:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 21:47:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-15 21:47:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:47:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 21:47:24 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 21:47:24 [WARNING ] (13, 1, 'bot')
2018-11-15 21:47:24 [WARNING ] (13, 1, 'bot')
2018-11-15 21:47:24 [WARNING ] (13, 1, 'bot')
2018-11-15 21:47:24 [WARNING ] (13, 1, 'bot')
2018-11-15 21:47:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:47:24 [DEBUG   ] Finished updating board flags in 1.006 seconds
2018-11-15 21:47:25 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-15 21:47:44 [DEBUG   ] Got command BAM from MCS: ref #519289
2018-11-15 21:47:44 [INFO    ] Finished processing BAM request
2018-11-15 21:47:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:47:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519289   8 58437 78464029 A  ERROR'
2018-11-15 21:47:44 [DEBUG   ] Got command BAM from MCS: ref #519288
2018-11-15 21:47:44 [INFO    ] Finished processing BAM request
2018-11-15 21:47:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:47:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519288   8 58437 78464033 A  ERROR'
2018-11-15 21:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 21:47:44 [DEBUG   ] spawn_process: at 2018-11-15 21:47:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 21:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 21:47:44 [DEBUG   ] spawn_process: at 2018-11-15 21:47:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 21:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 21:47:44 [DEBUG   ] spawn_process: at 2018-11-15 21:47:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 21:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 21:47:44 [DEBUG   ] spawn_process: at 2018-11-15 21:47:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 21:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 21:47:44 [DEBUG   ] spawn_process: at 2018-11-15 21:47:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 21:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 21:47:44 [DEBUG   ] spawn_process: at 2018-11-15 21:47:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 21:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 21:47:44 [DEBUG   ] spawn_process: at 2018-11-15 21:47:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 21:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 21:47:44 [DEBUG   ] spawn_process: at 2018-11-15 21:47:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 21:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 21:47:44 [DEBUG   ] spawn_process: at 2018-11-15 21:47:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 21:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 21:47:44 [DEBUG   ] spawn_process: at 2018-11-15 21:47:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 21:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 21:47:44 [DEBUG   ] spawn_process: at 2018-11-15 21:47:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 21:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 21:47:44 [DEBUG   ] spawn_process: at 2018-11-15 21:47:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 21:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 21:47:44 [DEBUG   ] spawn_process: at 2018-11-15 21:47:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 21:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 21:47:44 [DEBUG   ] spawn_process: at 2018-11-15 21:47:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 21:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 21:47:44 [DEBUG   ] spawn_process: at 2018-11-15 21:47:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 21:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 21:47:44 [DEBUG   ] spawn_process: at 2018-11-15 21:47:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 21:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 21:47:44 [DEBUG   ] spawn_process: at 2018-11-15 21:47:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 21:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 21:47:44 [DEBUG   ] spawn_process: at 2018-11-15 21:47:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 21:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 21:47:44 [DEBUG   ] spawn_process: at 2018-11-15 21:47:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 21:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 21:47:44 [DEBUG   ] spawn_process: at 2018-11-15 21:47:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 21:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 21:47:44 [DEBUG   ] spawn_process: at 2018-11-15 21:47:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 21:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 21:47:44 [DEBUG   ] spawn_process: at 2018-11-15 21:47:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 21:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 21:47:44 [DEBUG   ] spawn_process: at 2018-11-15 21:47:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 21:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 21:47:44 [DEBUG   ] spawn_process: at 2018-11-15 21:47:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 21:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 21:47:44 [DEBUG   ] spawn_process: at 2018-11-15 21:47:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 21:47:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 21:47:44 [DEBUG   ] spawn_process: at 2018-11-15 21:47:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 21:47:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 21:48:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 21:48:07 [DEBUG   ] Got command BAM from MCS: ref #519290
2018-11-15 21:48:07 [INFO    ] Finished processing BAM request
2018-11-15 21:48:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:48:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519290   8 58437 78487033 A  ERROR'
2018-11-15 21:48:07 [DEBUG   ] Got command BAM from MCS: ref #519291
2018-11-15 21:48:07 [INFO    ] Finished processing BAM request
2018-11-15 21:48:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:48:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519291   8 58437 78487037 A  ERROR'
2018-11-15 21:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 21:48:07 [DEBUG   ] spawn_process: at 2018-11-15 21:48:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 21:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 21:48:07 [DEBUG   ] spawn_process: at 2018-11-15 21:48:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 21:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 21:48:07 [DEBUG   ] spawn_process: at 2018-11-15 21:48:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 21:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 21:48:07 [DEBUG   ] spawn_process: at 2018-11-15 21:48:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 21:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 21:48:07 [DEBUG   ] spawn_process: at 2018-11-15 21:48:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 21:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 21:48:07 [DEBUG   ] spawn_process: at 2018-11-15 21:48:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 21:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 21:48:07 [DEBUG   ] spawn_process: at 2018-11-15 21:48:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 21:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 21:48:07 [DEBUG   ] spawn_process: at 2018-11-15 21:48:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 21:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 21:48:07 [DEBUG   ] spawn_process: at 2018-11-15 21:48:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 21:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 21:48:07 [DEBUG   ] spawn_process: at 2018-11-15 21:48:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 21:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 21:48:07 [DEBUG   ] spawn_process: at 2018-11-15 21:48:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 21:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 21:48:07 [DEBUG   ] spawn_process: at 2018-11-15 21:48:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 21:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 21:48:07 [DEBUG   ] spawn_process: at 2018-11-15 21:48:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 21:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 21:48:07 [DEBUG   ] spawn_process: at 2018-11-15 21:48:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 21:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 21:48:07 [DEBUG   ] spawn_process: at 2018-11-15 21:48:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 21:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 21:48:07 [DEBUG   ] spawn_process: at 2018-11-15 21:48:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 21:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 21:48:07 [DEBUG   ] spawn_process: at 2018-11-15 21:48:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 21:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 21:48:07 [DEBUG   ] spawn_process: at 2018-11-15 21:48:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 21:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 21:48:07 [DEBUG   ] spawn_process: at 2018-11-15 21:48:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 21:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 21:48:07 [DEBUG   ] spawn_process: at 2018-11-15 21:48:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 21:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 21:48:07 [DEBUG   ] spawn_process: at 2018-11-15 21:48:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 21:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 21:48:07 [DEBUG   ] spawn_process: at 2018-11-15 21:48:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 21:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 21:48:07 [DEBUG   ] spawn_process: at 2018-11-15 21:48:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 21:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 21:48:07 [DEBUG   ] spawn_process: at 2018-11-15 21:48:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 21:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 21:48:07 [DEBUG   ] spawn_process: at 2018-11-15 21:48:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 21:48:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 21:48:07 [DEBUG   ] spawn_process: at 2018-11-15 21:48:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 21:48:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 21:48:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:48:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-15 21:48:24 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 21:48:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 21:48:24 [WARNING ] (13, 1, 'bot')
2018-11-15 21:48:24 [WARNING ] (13, 1, 'bot')
2018-11-15 21:48:24 [WARNING ] (13, 1, 'bot')
2018-11-15 21:48:24 [WARNING ] (13, 1, 'bot')
2018-11-15 21:48:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:48:24 [DEBUG   ] Finished updating board flags in 1.006 seconds
2018-11-15 21:48:25 [DEBUG   ] Got command RPT from MCS: ref #519294
2018-11-15 21:48:25 [DEBUG   ] summary = ERROR
2018-11-15 21:48:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519294  13 58437 78505001 A  ERRORERROR'
2018-11-15 21:48:25 [DEBUG   ] Got command RPT from MCS: ref #519295
2018-11-15 21:48:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 21:48:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519295  77 58437 78505205 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 21:48:25 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-15 21:48:25 [DEBUG   ] Got command RPT from MCS: ref #519296
2018-11-15 21:48:25 [DEBUG   ] summary = ERROR
2018-11-15 21:48:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519296  13 58437 78505409 A  ERRORERROR'
2018-11-15 21:48:25 [DEBUG   ] Got command RPT from MCS: ref #519298
2018-11-15 21:48:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 21:48:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519298  77 58437 78505601 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 21:48:25 [DEBUG   ] Got command RPT from MCS: ref #519299
2018-11-15 21:48:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 21:48:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519299  12 58437 78505805 A  ERRORB£ff'
2018-11-15 21:48:30 [DEBUG   ] Got command BAM from MCS: ref #519305
2018-11-15 21:48:30 [INFO    ] Finished processing BAM request
2018-11-15 21:48:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:48:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519305   8 58437 78510033 A  ERROR'
2018-11-15 21:48:30 [DEBUG   ] Got command BAM from MCS: ref #519304
2018-11-15 21:48:30 [INFO    ] Finished processing BAM request
2018-11-15 21:48:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:48:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519304   8 58437 78510037 A  ERROR'
2018-11-15 21:48:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 21:48:30 [DEBUG   ] spawn_process: at 2018-11-15 21:48:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 21:48:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 21:48:30 [DEBUG   ] spawn_process: at 2018-11-15 21:48:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 21:48:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 21:48:30 [DEBUG   ] spawn_process: at 2018-11-15 21:48:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 21:48:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 21:48:30 [DEBUG   ] spawn_process: at 2018-11-15 21:48:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 21:48:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 21:48:30 [DEBUG   ] spawn_process: at 2018-11-15 21:48:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 21:48:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 21:48:30 [DEBUG   ] spawn_process: at 2018-11-15 21:48:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 21:48:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 21:48:30 [DEBUG   ] spawn_process: at 2018-11-15 21:48:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 21:48:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 21:48:30 [DEBUG   ] spawn_process: at 2018-11-15 21:48:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 21:48:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 21:48:30 [DEBUG   ] spawn_process: at 2018-11-15 21:48:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 21:48:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 21:48:30 [DEBUG   ] spawn_process: at 2018-11-15 21:48:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 21:48:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 21:48:30 [DEBUG   ] spawn_process: at 2018-11-15 21:48:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 21:48:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 21:48:30 [DEBUG   ] spawn_process: at 2018-11-15 21:48:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 21:48:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 21:48:30 [DEBUG   ] spawn_process: at 2018-11-15 21:48:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 21:48:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 21:48:30 [DEBUG   ] spawn_process: at 2018-11-15 21:48:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 21:48:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 21:48:30 [DEBUG   ] spawn_process: at 2018-11-15 21:48:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 21:48:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 21:48:30 [DEBUG   ] spawn_process: at 2018-11-15 21:48:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 21:48:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 21:48:30 [DEBUG   ] spawn_process: at 2018-11-15 21:48:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 21:48:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 21:48:30 [DEBUG   ] spawn_process: at 2018-11-15 21:48:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 21:48:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 21:48:30 [DEBUG   ] spawn_process: at 2018-11-15 21:48:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 21:48:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 21:48:30 [DEBUG   ] spawn_process: at 2018-11-15 21:48:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 21:48:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 21:48:30 [DEBUG   ] spawn_process: at 2018-11-15 21:48:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 21:48:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 21:48:30 [DEBUG   ] spawn_process: at 2018-11-15 21:48:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 21:48:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 21:48:30 [DEBUG   ] spawn_process: at 2018-11-15 21:48:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 21:48:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 21:48:30 [DEBUG   ] spawn_process: at 2018-11-15 21:48:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 21:48:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 21:48:30 [DEBUG   ] spawn_process: at 2018-11-15 21:48:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 21:48:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 21:48:30 [DEBUG   ] spawn_process: at 2018-11-15 21:48:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 21:48:45 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 21:48:53 [DEBUG   ] Got command BAM from MCS: ref #519307
2018-11-15 21:48:53 [INFO    ] Finished processing BAM request
2018-11-15 21:48:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:48:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519307   8 58437 78533025 A  ERROR'
2018-11-15 21:48:53 [DEBUG   ] Got command BAM from MCS: ref #519306
2018-11-15 21:48:53 [INFO    ] Finished processing BAM request
2018-11-15 21:48:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:48:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519306   8 58437 78533029 A  ERROR'
2018-11-15 21:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 21:48:53 [DEBUG   ] spawn_process: at 2018-11-15 21:48:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 21:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 21:48:53 [DEBUG   ] spawn_process: at 2018-11-15 21:48:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 21:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 21:48:53 [DEBUG   ] spawn_process: at 2018-11-15 21:48:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 21:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 21:48:53 [DEBUG   ] spawn_process: at 2018-11-15 21:48:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 21:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 21:48:53 [DEBUG   ] spawn_process: at 2018-11-15 21:48:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 21:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 21:48:53 [DEBUG   ] spawn_process: at 2018-11-15 21:48:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 21:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 21:48:53 [DEBUG   ] spawn_process: at 2018-11-15 21:48:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 21:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 21:48:53 [DEBUG   ] spawn_process: at 2018-11-15 21:48:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 21:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 21:48:53 [DEBUG   ] spawn_process: at 2018-11-15 21:48:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 21:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 21:48:53 [DEBUG   ] spawn_process: at 2018-11-15 21:48:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 21:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 21:48:53 [DEBUG   ] spawn_process: at 2018-11-15 21:48:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 21:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 21:48:53 [DEBUG   ] spawn_process: at 2018-11-15 21:48:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 21:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 21:48:53 [DEBUG   ] spawn_process: at 2018-11-15 21:48:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 21:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 21:48:53 [DEBUG   ] spawn_process: at 2018-11-15 21:48:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 21:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 21:48:53 [DEBUG   ] spawn_process: at 2018-11-15 21:48:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 21:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 21:48:53 [DEBUG   ] spawn_process: at 2018-11-15 21:48:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 21:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 21:48:53 [DEBUG   ] spawn_process: at 2018-11-15 21:48:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 21:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 21:48:53 [DEBUG   ] spawn_process: at 2018-11-15 21:48:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 21:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 21:48:53 [DEBUG   ] spawn_process: at 2018-11-15 21:48:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 21:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 21:48:53 [DEBUG   ] spawn_process: at 2018-11-15 21:48:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 21:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 21:48:53 [DEBUG   ] spawn_process: at 2018-11-15 21:48:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 21:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 21:48:53 [DEBUG   ] spawn_process: at 2018-11-15 21:48:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 21:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 21:48:53 [DEBUG   ] spawn_process: at 2018-11-15 21:48:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 21:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 21:48:53 [DEBUG   ] spawn_process: at 2018-11-15 21:48:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 21:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 21:48:53 [DEBUG   ] spawn_process: at 2018-11-15 21:48:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 21:48:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 21:48:53 [DEBUG   ] spawn_process: at 2018-11-15 21:48:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 21:49:05 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-11-15 21:49:16 [DEBUG   ] Got command BAM from MCS: ref #519309
2018-11-15 21:49:16 [INFO    ] Finished processing BAM request
2018-11-15 21:49:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:49:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519309   8 58437 78556029 A  ERROR'
2018-11-15 21:49:16 [DEBUG   ] Got command BAM from MCS: ref #519308
2018-11-15 21:49:16 [INFO    ] Finished processing BAM request
2018-11-15 21:49:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:49:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519308   8 58437 78556033 A  ERROR'
2018-11-15 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 21:49:16 [DEBUG   ] spawn_process: at 2018-11-15 21:49:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 21:49:16 [DEBUG   ] spawn_process: at 2018-11-15 21:49:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 21:49:16 [DEBUG   ] spawn_process: at 2018-11-15 21:49:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 21:49:16 [DEBUG   ] spawn_process: at 2018-11-15 21:49:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 21:49:16 [DEBUG   ] spawn_process: at 2018-11-15 21:49:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 21:49:16 [DEBUG   ] spawn_process: at 2018-11-15 21:49:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 21:49:16 [DEBUG   ] spawn_process: at 2018-11-15 21:49:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 21:49:16 [DEBUG   ] spawn_process: at 2018-11-15 21:49:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 21:49:16 [DEBUG   ] spawn_process: at 2018-11-15 21:49:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 21:49:16 [DEBUG   ] spawn_process: at 2018-11-15 21:49:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 21:49:16 [DEBUG   ] spawn_process: at 2018-11-15 21:49:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 21:49:16 [DEBUG   ] spawn_process: at 2018-11-15 21:49:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 21:49:16 [DEBUG   ] spawn_process: at 2018-11-15 21:49:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 21:49:16 [DEBUG   ] spawn_process: at 2018-11-15 21:49:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 21:49:16 [DEBUG   ] spawn_process: at 2018-11-15 21:49:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 21:49:16 [DEBUG   ] spawn_process: at 2018-11-15 21:49:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 21:49:16 [DEBUG   ] spawn_process: at 2018-11-15 21:49:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 21:49:16 [DEBUG   ] spawn_process: at 2018-11-15 21:49:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 21:49:16 [DEBUG   ] spawn_process: at 2018-11-15 21:49:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 21:49:16 [DEBUG   ] spawn_process: at 2018-11-15 21:49:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 21:49:16 [DEBUG   ] spawn_process: at 2018-11-15 21:49:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 21:49:16 [DEBUG   ] spawn_process: at 2018-11-15 21:49:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 21:49:16 [DEBUG   ] spawn_process: at 2018-11-15 21:49:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 21:49:16 [DEBUG   ] spawn_process: at 2018-11-15 21:49:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 21:49:16 [DEBUG   ] spawn_process: at 2018-11-15 21:49:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 21:49:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 21:49:16 [DEBUG   ] spawn_process: at 2018-11-15 21:49:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 21:49:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 21:49:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 21:49:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 21:49:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:49:24 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 21:49:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 21:49:24 [WARNING ] (13, 1, 'bot')
2018-11-15 21:49:24 [WARNING ] (13, 1, 'bot')
2018-11-15 21:49:24 [WARNING ] (13, 1, 'bot')
2018-11-15 21:49:24 [WARNING ] (13, 1, 'bot')
2018-11-15 21:49:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:49:24 [DEBUG   ] Finished updating board flags in 0.985 seconds
2018-11-15 21:49:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 21:49:39 [DEBUG   ] Got command BAM from MCS: ref #519310
2018-11-15 21:49:39 [INFO    ] Finished processing BAM request
2018-11-15 21:49:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:49:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519310   8 58437 78579029 A  ERROR'
2018-11-15 21:49:39 [DEBUG   ] Got command BAM from MCS: ref #519311
2018-11-15 21:49:39 [INFO    ] Finished processing BAM request
2018-11-15 21:49:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:49:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519311   8 58437 78579033 A  ERROR'
2018-11-15 21:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 21:49:39 [DEBUG   ] spawn_process: at 2018-11-15 21:49:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 21:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 21:49:39 [DEBUG   ] spawn_process: at 2018-11-15 21:49:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 21:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 21:49:39 [DEBUG   ] spawn_process: at 2018-11-15 21:49:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 21:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 21:49:39 [DEBUG   ] spawn_process: at 2018-11-15 21:49:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 21:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 21:49:39 [DEBUG   ] spawn_process: at 2018-11-15 21:49:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 21:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 21:49:39 [DEBUG   ] spawn_process: at 2018-11-15 21:49:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 21:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 21:49:39 [DEBUG   ] spawn_process: at 2018-11-15 21:49:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 21:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 21:49:39 [DEBUG   ] spawn_process: at 2018-11-15 21:49:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 21:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 21:49:39 [DEBUG   ] spawn_process: at 2018-11-15 21:49:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 21:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 21:49:39 [DEBUG   ] spawn_process: at 2018-11-15 21:49:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 21:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 21:49:39 [DEBUG   ] spawn_process: at 2018-11-15 21:49:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 21:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 21:49:39 [DEBUG   ] spawn_process: at 2018-11-15 21:49:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 21:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 21:49:39 [DEBUG   ] spawn_process: at 2018-11-15 21:49:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 21:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 21:49:39 [DEBUG   ] spawn_process: at 2018-11-15 21:49:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 21:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 21:49:39 [DEBUG   ] spawn_process: at 2018-11-15 21:49:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 21:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 21:49:39 [DEBUG   ] spawn_process: at 2018-11-15 21:49:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 21:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 21:49:39 [DEBUG   ] spawn_process: at 2018-11-15 21:49:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 21:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 21:49:39 [DEBUG   ] spawn_process: at 2018-11-15 21:49:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 21:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 21:49:39 [DEBUG   ] spawn_process: at 2018-11-15 21:49:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 21:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 21:49:39 [DEBUG   ] spawn_process: at 2018-11-15 21:49:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 21:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 21:49:39 [DEBUG   ] spawn_process: at 2018-11-15 21:49:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 21:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 21:49:39 [DEBUG   ] spawn_process: at 2018-11-15 21:49:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 21:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 21:49:39 [DEBUG   ] spawn_process: at 2018-11-15 21:49:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 21:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 21:49:39 [DEBUG   ] spawn_process: at 2018-11-15 21:49:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 21:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 21:49:39 [DEBUG   ] spawn_process: at 2018-11-15 21:49:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 21:49:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 21:49:39 [DEBUG   ] spawn_process: at 2018-11-15 21:49:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 21:49:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 21:50:02 [DEBUG   ] Got command BAM from MCS: ref #519313
2018-11-15 21:50:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:50:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519313   8 58437 78602029 A  ERROR'
2018-11-15 21:50:02 [DEBUG   ] Got command BAM from MCS: ref #519312
2018-11-15 21:50:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:50:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519312   8 58437 78602033 A  ERROR'
2018-11-15 21:50:02 [INFO    ] Finished processing BAM request
2018-11-15 21:50:02 [INFO    ] Finished processing BAM request
2018-11-15 21:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 21:50:02 [DEBUG   ] spawn_process: at 2018-11-15 21:50:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 21:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 21:50:02 [DEBUG   ] spawn_process: at 2018-11-15 21:50:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 21:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 21:50:02 [DEBUG   ] spawn_process: at 2018-11-15 21:50:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 21:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 21:50:02 [DEBUG   ] spawn_process: at 2018-11-15 21:50:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 21:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 21:50:02 [DEBUG   ] spawn_process: at 2018-11-15 21:50:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 21:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 21:50:02 [DEBUG   ] spawn_process: at 2018-11-15 21:50:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 21:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 21:50:02 [DEBUG   ] spawn_process: at 2018-11-15 21:50:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 21:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 21:50:02 [DEBUG   ] spawn_process: at 2018-11-15 21:50:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 21:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 21:50:02 [DEBUG   ] spawn_process: at 2018-11-15 21:50:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 21:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 21:50:02 [DEBUG   ] spawn_process: at 2018-11-15 21:50:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 21:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 21:50:02 [DEBUG   ] spawn_process: at 2018-11-15 21:50:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 21:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 21:50:02 [DEBUG   ] spawn_process: at 2018-11-15 21:50:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 21:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 21:50:02 [DEBUG   ] spawn_process: at 2018-11-15 21:50:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 21:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 21:50:02 [DEBUG   ] spawn_process: at 2018-11-15 21:50:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 21:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 21:50:02 [DEBUG   ] spawn_process: at 2018-11-15 21:50:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 21:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 21:50:02 [DEBUG   ] spawn_process: at 2018-11-15 21:50:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 21:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 21:50:02 [DEBUG   ] spawn_process: at 2018-11-15 21:50:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 21:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 21:50:02 [DEBUG   ] spawn_process: at 2018-11-15 21:50:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 21:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 21:50:02 [DEBUG   ] spawn_process: at 2018-11-15 21:50:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 21:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 21:50:02 [DEBUG   ] spawn_process: at 2018-11-15 21:50:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 21:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 21:50:02 [DEBUG   ] spawn_process: at 2018-11-15 21:50:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 21:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 21:50:02 [DEBUG   ] spawn_process: at 2018-11-15 21:50:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 21:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 21:50:02 [DEBUG   ] spawn_process: at 2018-11-15 21:50:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 21:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 21:50:02 [DEBUG   ] spawn_process: at 2018-11-15 21:50:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 21:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 21:50:02 [DEBUG   ] spawn_process: at 2018-11-15 21:50:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 21:50:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 21:50:02 [DEBUG   ] spawn_process: at 2018-11-15 21:50:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 21:50:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 21:50:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 21:50:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:50:25 [DEBUG   ] Got command BAM from MCS: ref #519314
2018-11-15 21:50:25 [INFO    ] Finished processing BAM request
2018-11-15 21:50:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:50:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519314   8 58437 78625033 A  ERROR'
2018-11-15 21:50:25 [DEBUG   ] Got command BAM from MCS: ref #519315
2018-11-15 21:50:25 [INFO    ] Finished processing BAM request
2018-11-15 21:50:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:50:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519315   8 58437 78625037 A  ERROR'
2018-11-15 21:50:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-15 21:50:25 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 21:50:25 [WARNING ] (13, 1, 'bot')
2018-11-15 21:50:25 [WARNING ] (13, 1, 'bot')
2018-11-15 21:50:25 [WARNING ] (13, 1, 'bot')
2018-11-15 21:50:25 [WARNING ] (13, 1, 'bot')
2018-11-15 21:50:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:50:25 [DEBUG   ] Finished updating board flags in 1.847 seconds
2018-11-15 21:50:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 21:50:25 [DEBUG   ] spawn_process: at 2018-11-15 21:50:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 21:50:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 21:50:25 [DEBUG   ] spawn_process: at 2018-11-15 21:50:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 21:50:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 21:50:25 [DEBUG   ] spawn_process: at 2018-11-15 21:50:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 21:50:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 21:50:25 [DEBUG   ] spawn_process: at 2018-11-15 21:50:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 21:50:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 21:50:25 [DEBUG   ] spawn_process: at 2018-11-15 21:50:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 21:50:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 21:50:25 [DEBUG   ] spawn_process: at 2018-11-15 21:50:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 21:50:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 21:50:25 [DEBUG   ] spawn_process: at 2018-11-15 21:50:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 21:50:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 21:50:25 [DEBUG   ] spawn_process: at 2018-11-15 21:50:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 21:50:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 21:50:25 [DEBUG   ] spawn_process: at 2018-11-15 21:50:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 21:50:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 21:50:25 [DEBUG   ] spawn_process: at 2018-11-15 21:50:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 21:50:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 21:50:25 [DEBUG   ] spawn_process: at 2018-11-15 21:50:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 21:50:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 21:50:25 [DEBUG   ] spawn_process: at 2018-11-15 21:50:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 21:50:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 21:50:25 [DEBUG   ] spawn_process: at 2018-11-15 21:50:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 21:50:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 21:50:25 [DEBUG   ] spawn_process: at 2018-11-15 21:50:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 21:50:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 21:50:25 [DEBUG   ] spawn_process: at 2018-11-15 21:50:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 21:50:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 21:50:25 [DEBUG   ] spawn_process: at 2018-11-15 21:50:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 21:50:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 21:50:25 [DEBUG   ] spawn_process: at 2018-11-15 21:50:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 21:50:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 21:50:25 [DEBUG   ] spawn_process: at 2018-11-15 21:50:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 21:50:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 21:50:25 [DEBUG   ] spawn_process: at 2018-11-15 21:50:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 21:50:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 21:50:25 [DEBUG   ] spawn_process: at 2018-11-15 21:50:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 21:50:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 21:50:25 [DEBUG   ] spawn_process: at 2018-11-15 21:50:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 21:50:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 21:50:25 [DEBUG   ] spawn_process: at 2018-11-15 21:50:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 21:50:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 21:50:25 [DEBUG   ] spawn_process: at 2018-11-15 21:50:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 21:50:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 21:50:25 [DEBUG   ] spawn_process: at 2018-11-15 21:50:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 21:50:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 21:50:25 [DEBUG   ] spawn_process: at 2018-11-15 21:50:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 21:50:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 21:50:25 [DEBUG   ] spawn_process: at 2018-11-15 21:50:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 21:50:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 21:50:45 [DEBUG   ] Got command RPT from MCS: ref #519320
2018-11-15 21:50:45 [DEBUG   ] summary = ERROR
2018-11-15 21:50:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519320  13 58437 78645213 A  ERRORERROR'
2018-11-15 21:50:45 [DEBUG   ] Got command RPT from MCS: ref #519321
2018-11-15 21:50:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 21:50:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519321  77 58437 78645214 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 21:50:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 21:50:48 [DEBUG   ] Got command BAM from MCS: ref #519337
2018-11-15 21:50:48 [INFO    ] Finished processing BAM request
2018-11-15 21:50:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:50:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519337   8 58437 78648029 A  ERROR'
2018-11-15 21:50:48 [DEBUG   ] Got command BAM from MCS: ref #519338
2018-11-15 21:50:48 [INFO    ] Finished processing BAM request
2018-11-15 21:50:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:50:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519338   8 58437 78648033 A  ERROR'
2018-11-15 21:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 21:50:48 [DEBUG   ] spawn_process: at 2018-11-15 21:50:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 21:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 21:50:48 [DEBUG   ] spawn_process: at 2018-11-15 21:50:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 21:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 21:50:48 [DEBUG   ] spawn_process: at 2018-11-15 21:50:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 21:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 21:50:48 [DEBUG   ] spawn_process: at 2018-11-15 21:50:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 21:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 21:50:48 [DEBUG   ] spawn_process: at 2018-11-15 21:50:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 21:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 21:50:48 [DEBUG   ] spawn_process: at 2018-11-15 21:50:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 21:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 21:50:48 [DEBUG   ] spawn_process: at 2018-11-15 21:50:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 21:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 21:50:48 [DEBUG   ] spawn_process: at 2018-11-15 21:50:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 21:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 21:50:48 [DEBUG   ] spawn_process: at 2018-11-15 21:50:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 21:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 21:50:48 [DEBUG   ] spawn_process: at 2018-11-15 21:50:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 21:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 21:50:48 [DEBUG   ] spawn_process: at 2018-11-15 21:50:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 21:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 21:50:48 [DEBUG   ] spawn_process: at 2018-11-15 21:50:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 21:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 21:50:48 [DEBUG   ] spawn_process: at 2018-11-15 21:50:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 21:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 21:50:48 [DEBUG   ] spawn_process: at 2018-11-15 21:50:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 21:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 21:50:48 [DEBUG   ] spawn_process: at 2018-11-15 21:50:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 21:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 21:50:48 [DEBUG   ] spawn_process: at 2018-11-15 21:50:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 21:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 21:50:48 [DEBUG   ] spawn_process: at 2018-11-15 21:50:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 21:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 21:50:48 [DEBUG   ] spawn_process: at 2018-11-15 21:50:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 21:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 21:50:48 [DEBUG   ] spawn_process: at 2018-11-15 21:50:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 21:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 21:50:48 [DEBUG   ] spawn_process: at 2018-11-15 21:50:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 21:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 21:50:48 [DEBUG   ] spawn_process: at 2018-11-15 21:50:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 21:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 21:50:48 [DEBUG   ] spawn_process: at 2018-11-15 21:50:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 21:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 21:50:48 [DEBUG   ] spawn_process: at 2018-11-15 21:50:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 21:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 21:50:48 [DEBUG   ] spawn_process: at 2018-11-15 21:50:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 21:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 21:50:48 [DEBUG   ] spawn_process: at 2018-11-15 21:50:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 21:50:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 21:50:48 [DEBUG   ] spawn_process: at 2018-11-15 21:50:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 21:51:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 21:51:11 [DEBUG   ] Got command BAM from MCS: ref #519340
2018-11-15 21:51:11 [INFO    ] Finished processing BAM request
2018-11-15 21:51:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:51:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519340   8 58437 78671033 A  ERROR'
2018-11-15 21:51:11 [DEBUG   ] Got command BAM from MCS: ref #519339
2018-11-15 21:51:11 [INFO    ] Finished processing BAM request
2018-11-15 21:51:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:51:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519339   8 58437 78671037 A  ERROR'
2018-11-15 21:51:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 21:51:12 [DEBUG   ] spawn_process: at 2018-11-15 21:51:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 21:51:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 21:51:12 [DEBUG   ] spawn_process: at 2018-11-15 21:51:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 21:51:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 21:51:12 [DEBUG   ] spawn_process: at 2018-11-15 21:51:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 21:51:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 21:51:12 [DEBUG   ] spawn_process: at 2018-11-15 21:51:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 21:51:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 21:51:12 [DEBUG   ] spawn_process: at 2018-11-15 21:51:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 21:51:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 21:51:12 [DEBUG   ] spawn_process: at 2018-11-15 21:51:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 21:51:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 21:51:12 [DEBUG   ] spawn_process: at 2018-11-15 21:51:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 21:51:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 21:51:12 [DEBUG   ] spawn_process: at 2018-11-15 21:51:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 21:51:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 21:51:12 [DEBUG   ] spawn_process: at 2018-11-15 21:51:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 21:51:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 21:51:12 [DEBUG   ] spawn_process: at 2018-11-15 21:51:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 21:51:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 21:51:12 [DEBUG   ] spawn_process: at 2018-11-15 21:51:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 21:51:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 21:51:12 [DEBUG   ] spawn_process: at 2018-11-15 21:51:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 21:51:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 21:51:12 [DEBUG   ] spawn_process: at 2018-11-15 21:51:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 21:51:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 21:51:12 [DEBUG   ] spawn_process: at 2018-11-15 21:51:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 21:51:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 21:51:12 [DEBUG   ] spawn_process: at 2018-11-15 21:51:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 21:51:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 21:51:12 [DEBUG   ] spawn_process: at 2018-11-15 21:51:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 21:51:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 21:51:12 [DEBUG   ] spawn_process: at 2018-11-15 21:51:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 21:51:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 21:51:12 [DEBUG   ] spawn_process: at 2018-11-15 21:51:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 21:51:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 21:51:12 [DEBUG   ] spawn_process: at 2018-11-15 21:51:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 21:51:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 21:51:12 [DEBUG   ] spawn_process: at 2018-11-15 21:51:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 21:51:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 21:51:12 [DEBUG   ] spawn_process: at 2018-11-15 21:51:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 21:51:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 21:51:12 [DEBUG   ] spawn_process: at 2018-11-15 21:51:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 21:51:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 21:51:12 [DEBUG   ] spawn_process: at 2018-11-15 21:51:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 21:51:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 21:51:12 [DEBUG   ] spawn_process: at 2018-11-15 21:51:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 21:51:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 21:51:12 [DEBUG   ] spawn_process: at 2018-11-15 21:51:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 21:51:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 21:51:12 [DEBUG   ] spawn_process: at 2018-11-15 21:51:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 21:51:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:51:25 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 21:51:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 21:51:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 21:51:25 [WARNING ] (13, 1, 'bot')
2018-11-15 21:51:25 [WARNING ] (13, 1, 'bot')
2018-11-15 21:51:25 [WARNING ] (13, 1, 'bot')
2018-11-15 21:51:25 [WARNING ] (13, 1, 'bot')
2018-11-15 21:51:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:51:25 [DEBUG   ] Finished updating board flags in 1.840 seconds
2018-11-15 21:51:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 21:51:34 [DEBUG   ] Got command BAM from MCS: ref #519342
2018-11-15 21:51:34 [INFO    ] Finished processing BAM request
2018-11-15 21:51:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:51:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519342   8 58437 78694029 A  ERROR'
2018-11-15 21:51:34 [DEBUG   ] Got command BAM from MCS: ref #519341
2018-11-15 21:51:34 [INFO    ] Finished processing BAM request
2018-11-15 21:51:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:51:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519341   8 58437 78694033 A  ERROR'
2018-11-15 21:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 21:51:34 [DEBUG   ] spawn_process: at 2018-11-15 21:51:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 21:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 21:51:34 [DEBUG   ] spawn_process: at 2018-11-15 21:51:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 21:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 21:51:34 [DEBUG   ] spawn_process: at 2018-11-15 21:51:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 21:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 21:51:34 [DEBUG   ] spawn_process: at 2018-11-15 21:51:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 21:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 21:51:34 [DEBUG   ] spawn_process: at 2018-11-15 21:51:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 21:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 21:51:34 [DEBUG   ] spawn_process: at 2018-11-15 21:51:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 21:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 21:51:34 [DEBUG   ] spawn_process: at 2018-11-15 21:51:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 21:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 21:51:34 [DEBUG   ] spawn_process: at 2018-11-15 21:51:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 21:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 21:51:34 [DEBUG   ] spawn_process: at 2018-11-15 21:51:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 21:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 21:51:34 [DEBUG   ] spawn_process: at 2018-11-15 21:51:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 21:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 21:51:34 [DEBUG   ] spawn_process: at 2018-11-15 21:51:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 21:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 21:51:34 [DEBUG   ] spawn_process: at 2018-11-15 21:51:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 21:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 21:51:34 [DEBUG   ] spawn_process: at 2018-11-15 21:51:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 21:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 21:51:34 [DEBUG   ] spawn_process: at 2018-11-15 21:51:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 21:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 21:51:34 [DEBUG   ] spawn_process: at 2018-11-15 21:51:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 21:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 21:51:34 [DEBUG   ] spawn_process: at 2018-11-15 21:51:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 21:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 21:51:34 [DEBUG   ] spawn_process: at 2018-11-15 21:51:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 21:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 21:51:34 [DEBUG   ] spawn_process: at 2018-11-15 21:51:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 21:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 21:51:34 [DEBUG   ] spawn_process: at 2018-11-15 21:51:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 21:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 21:51:34 [DEBUG   ] spawn_process: at 2018-11-15 21:51:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 21:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 21:51:34 [DEBUG   ] spawn_process: at 2018-11-15 21:51:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 21:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 21:51:34 [DEBUG   ] spawn_process: at 2018-11-15 21:51:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 21:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 21:51:34 [DEBUG   ] spawn_process: at 2018-11-15 21:51:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 21:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 21:51:34 [DEBUG   ] spawn_process: at 2018-11-15 21:51:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 21:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 21:51:34 [DEBUG   ] spawn_process: at 2018-11-15 21:51:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 21:51:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 21:51:34 [DEBUG   ] spawn_process: at 2018-11-15 21:51:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 21:51:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 21:51:57 [DEBUG   ] Got command BAM from MCS: ref #519344
2018-11-15 21:51:57 [INFO    ] Finished processing BAM request
2018-11-15 21:51:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:51:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519344   8 58437 78717033 A  ERROR'
2018-11-15 21:51:57 [DEBUG   ] Got command BAM from MCS: ref #519343
2018-11-15 21:51:57 [INFO    ] Finished processing BAM request
2018-11-15 21:51:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:51:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519343   8 58437 78717037 A  ERROR'
2018-11-15 21:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 21:51:57 [DEBUG   ] spawn_process: at 2018-11-15 21:51:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 21:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 21:51:57 [DEBUG   ] spawn_process: at 2018-11-15 21:51:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 21:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 21:51:57 [DEBUG   ] spawn_process: at 2018-11-15 21:51:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 21:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 21:51:57 [DEBUG   ] spawn_process: at 2018-11-15 21:51:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 21:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 21:51:57 [DEBUG   ] spawn_process: at 2018-11-15 21:51:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 21:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 21:51:57 [DEBUG   ] spawn_process: at 2018-11-15 21:51:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 21:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 21:51:57 [DEBUG   ] spawn_process: at 2018-11-15 21:51:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 21:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 21:51:57 [DEBUG   ] spawn_process: at 2018-11-15 21:51:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 21:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 21:51:57 [DEBUG   ] spawn_process: at 2018-11-15 21:51:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 21:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 21:51:57 [DEBUG   ] spawn_process: at 2018-11-15 21:51:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 21:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 21:51:57 [DEBUG   ] spawn_process: at 2018-11-15 21:51:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 21:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 21:51:57 [DEBUG   ] spawn_process: at 2018-11-15 21:51:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 21:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 21:51:57 [DEBUG   ] spawn_process: at 2018-11-15 21:51:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 21:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 21:51:57 [DEBUG   ] spawn_process: at 2018-11-15 21:51:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 21:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 21:51:57 [DEBUG   ] spawn_process: at 2018-11-15 21:51:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 21:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 21:51:57 [DEBUG   ] spawn_process: at 2018-11-15 21:51:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 21:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 21:51:57 [DEBUG   ] spawn_process: at 2018-11-15 21:51:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 21:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 21:51:57 [DEBUG   ] spawn_process: at 2018-11-15 21:51:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 21:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 21:51:57 [DEBUG   ] spawn_process: at 2018-11-15 21:51:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 21:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 21:51:57 [DEBUG   ] spawn_process: at 2018-11-15 21:51:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 21:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 21:51:57 [DEBUG   ] spawn_process: at 2018-11-15 21:51:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 21:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 21:51:57 [DEBUG   ] spawn_process: at 2018-11-15 21:51:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 21:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 21:51:57 [DEBUG   ] spawn_process: at 2018-11-15 21:51:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 21:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 21:51:57 [DEBUG   ] spawn_process: at 2018-11-15 21:51:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 21:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 21:51:57 [DEBUG   ] spawn_process: at 2018-11-15 21:51:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 21:51:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 21:51:57 [DEBUG   ] spawn_process: at 2018-11-15 21:51:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 21:52:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 21:52:20 [DEBUG   ] Got command BAM from MCS: ref #519346
2018-11-15 21:52:20 [INFO    ] Finished processing BAM request
2018-11-15 21:52:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:52:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519346   8 58437 78740033 A  ERROR'
2018-11-15 21:52:20 [DEBUG   ] Got command BAM from MCS: ref #519345
2018-11-15 21:52:20 [INFO    ] Finished processing BAM request
2018-11-15 21:52:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:52:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519345   8 58437 78740037 A  ERROR'
2018-11-15 21:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 21:52:20 [DEBUG   ] spawn_process: at 2018-11-15 21:52:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 21:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 21:52:20 [DEBUG   ] spawn_process: at 2018-11-15 21:52:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 21:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 21:52:20 [DEBUG   ] spawn_process: at 2018-11-15 21:52:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 21:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 21:52:20 [DEBUG   ] spawn_process: at 2018-11-15 21:52:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 21:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 21:52:20 [DEBUG   ] spawn_process: at 2018-11-15 21:52:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 21:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 21:52:20 [DEBUG   ] spawn_process: at 2018-11-15 21:52:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 21:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 21:52:20 [DEBUG   ] spawn_process: at 2018-11-15 21:52:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 21:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 21:52:20 [DEBUG   ] spawn_process: at 2018-11-15 21:52:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 21:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 21:52:20 [DEBUG   ] spawn_process: at 2018-11-15 21:52:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 21:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 21:52:20 [DEBUG   ] spawn_process: at 2018-11-15 21:52:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 21:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 21:52:20 [DEBUG   ] spawn_process: at 2018-11-15 21:52:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 21:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 21:52:20 [DEBUG   ] spawn_process: at 2018-11-15 21:52:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 21:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 21:52:20 [DEBUG   ] spawn_process: at 2018-11-15 21:52:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 21:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 21:52:20 [DEBUG   ] spawn_process: at 2018-11-15 21:52:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 21:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 21:52:20 [DEBUG   ] spawn_process: at 2018-11-15 21:52:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 21:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 21:52:20 [DEBUG   ] spawn_process: at 2018-11-15 21:52:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 21:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 21:52:20 [DEBUG   ] spawn_process: at 2018-11-15 21:52:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 21:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 21:52:20 [DEBUG   ] spawn_process: at 2018-11-15 21:52:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 21:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 21:52:20 [DEBUG   ] spawn_process: at 2018-11-15 21:52:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 21:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 21:52:20 [DEBUG   ] spawn_process: at 2018-11-15 21:52:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 21:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 21:52:20 [DEBUG   ] spawn_process: at 2018-11-15 21:52:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 21:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 21:52:20 [DEBUG   ] spawn_process: at 2018-11-15 21:52:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 21:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 21:52:20 [DEBUG   ] spawn_process: at 2018-11-15 21:52:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 21:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 21:52:20 [DEBUG   ] spawn_process: at 2018-11-15 21:52:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 21:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 21:52:20 [DEBUG   ] spawn_process: at 2018-11-15 21:52:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 21:52:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 21:52:20 [DEBUG   ] spawn_process: at 2018-11-15 21:52:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 21:52:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-15 21:52:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:52:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 21:52:24 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 21:52:24 [WARNING ] (13, 1, 'bot')
2018-11-15 21:52:24 [WARNING ] (13, 1, 'bot')
2018-11-15 21:52:24 [WARNING ] (13, 1, 'bot')
2018-11-15 21:52:24 [WARNING ] (13, 1, 'bot')
2018-11-15 21:52:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:52:24 [DEBUG   ] Finished updating board flags in 1.163 seconds
2018-11-15 21:52:26 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-15 21:52:43 [DEBUG   ] Got command BAM from MCS: ref #519348
2018-11-15 21:52:43 [INFO    ] Finished processing BAM request
2018-11-15 21:52:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:52:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519348   8 58437 78763033 A  ERROR'
2018-11-15 21:52:43 [DEBUG   ] Got command BAM from MCS: ref #519347
2018-11-15 21:52:43 [INFO    ] Finished processing BAM request
2018-11-15 21:52:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:52:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519347   8 58437 78763037 A  ERROR'
2018-11-15 21:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 21:52:43 [DEBUG   ] spawn_process: at 2018-11-15 21:52:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 21:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 21:52:43 [DEBUG   ] spawn_process: at 2018-11-15 21:52:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 21:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 21:52:43 [DEBUG   ] spawn_process: at 2018-11-15 21:52:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 21:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 21:52:43 [DEBUG   ] spawn_process: at 2018-11-15 21:52:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 21:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 21:52:43 [DEBUG   ] spawn_process: at 2018-11-15 21:52:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 21:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 21:52:43 [DEBUG   ] spawn_process: at 2018-11-15 21:52:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 21:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 21:52:43 [DEBUG   ] spawn_process: at 2018-11-15 21:52:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 21:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 21:52:43 [DEBUG   ] spawn_process: at 2018-11-15 21:52:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 21:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 21:52:43 [DEBUG   ] spawn_process: at 2018-11-15 21:52:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 21:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 21:52:43 [DEBUG   ] spawn_process: at 2018-11-15 21:52:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 21:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 21:52:43 [DEBUG   ] spawn_process: at 2018-11-15 21:52:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 21:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 21:52:43 [DEBUG   ] spawn_process: at 2018-11-15 21:52:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 21:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 21:52:43 [DEBUG   ] spawn_process: at 2018-11-15 21:52:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 21:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 21:52:43 [DEBUG   ] spawn_process: at 2018-11-15 21:52:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 21:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 21:52:43 [DEBUG   ] spawn_process: at 2018-11-15 21:52:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 21:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 21:52:43 [DEBUG   ] spawn_process: at 2018-11-15 21:52:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 21:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 21:52:43 [DEBUG   ] spawn_process: at 2018-11-15 21:52:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 21:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 21:52:43 [DEBUG   ] spawn_process: at 2018-11-15 21:52:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 21:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 21:52:43 [DEBUG   ] spawn_process: at 2018-11-15 21:52:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 21:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 21:52:43 [DEBUG   ] spawn_process: at 2018-11-15 21:52:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 21:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 21:52:43 [DEBUG   ] spawn_process: at 2018-11-15 21:52:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 21:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 21:52:43 [DEBUG   ] spawn_process: at 2018-11-15 21:52:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 21:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 21:52:43 [DEBUG   ] spawn_process: at 2018-11-15 21:52:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 21:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 21:52:43 [DEBUG   ] spawn_process: at 2018-11-15 21:52:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 21:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 21:52:43 [DEBUG   ] spawn_process: at 2018-11-15 21:52:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 21:52:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 21:52:43 [DEBUG   ] spawn_process: at 2018-11-15 21:52:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 21:52:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 21:53:06 [DEBUG   ] Got command BAM from MCS: ref #519350
2018-11-15 21:53:06 [INFO    ] Finished processing BAM request
2018-11-15 21:53:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:53:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519350   8 58437 78786033 A  ERROR'
2018-11-15 21:53:06 [DEBUG   ] Got command BAM from MCS: ref #519349
2018-11-15 21:53:06 [INFO    ] Finished processing BAM request
2018-11-15 21:53:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:53:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519349   8 58437 78786037 A  ERROR'
2018-11-15 21:53:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 21:53:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 21:53:06 [DEBUG   ] spawn_process: at 2018-11-15 21:53:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 21:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 21:53:07 [DEBUG   ] spawn_process: at 2018-11-15 21:53:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 21:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 21:53:07 [DEBUG   ] spawn_process: at 2018-11-15 21:53:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 21:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 21:53:07 [DEBUG   ] spawn_process: at 2018-11-15 21:53:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 21:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 21:53:07 [DEBUG   ] spawn_process: at 2018-11-15 21:53:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 21:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 21:53:07 [DEBUG   ] spawn_process: at 2018-11-15 21:53:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 21:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 21:53:07 [DEBUG   ] spawn_process: at 2018-11-15 21:53:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 21:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 21:53:07 [DEBUG   ] spawn_process: at 2018-11-15 21:53:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 21:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 21:53:07 [DEBUG   ] spawn_process: at 2018-11-15 21:53:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 21:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 21:53:07 [DEBUG   ] spawn_process: at 2018-11-15 21:53:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 21:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 21:53:07 [DEBUG   ] spawn_process: at 2018-11-15 21:53:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 21:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 21:53:07 [DEBUG   ] spawn_process: at 2018-11-15 21:53:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 21:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 21:53:07 [DEBUG   ] spawn_process: at 2018-11-15 21:53:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 21:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 21:53:07 [DEBUG   ] spawn_process: at 2018-11-15 21:53:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 21:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 21:53:07 [DEBUG   ] spawn_process: at 2018-11-15 21:53:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 21:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 21:53:07 [DEBUG   ] spawn_process: at 2018-11-15 21:53:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 21:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 21:53:07 [DEBUG   ] spawn_process: at 2018-11-15 21:53:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 21:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 21:53:07 [DEBUG   ] spawn_process: at 2018-11-15 21:53:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 21:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 21:53:07 [DEBUG   ] spawn_process: at 2018-11-15 21:53:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 21:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 21:53:07 [DEBUG   ] spawn_process: at 2018-11-15 21:53:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 21:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 21:53:07 [DEBUG   ] spawn_process: at 2018-11-15 21:53:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 21:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 21:53:07 [DEBUG   ] spawn_process: at 2018-11-15 21:53:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 21:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 21:53:07 [DEBUG   ] spawn_process: at 2018-11-15 21:53:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 21:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 21:53:07 [DEBUG   ] spawn_process: at 2018-11-15 21:53:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 21:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 21:53:07 [DEBUG   ] spawn_process: at 2018-11-15 21:53:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 21:53:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 21:53:07 [DEBUG   ] spawn_process: at 2018-11-15 21:53:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 21:53:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:53:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-15 21:53:24 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 21:53:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 21:53:24 [WARNING ] (13, 1, 'bot')
2018-11-15 21:53:24 [WARNING ] (13, 1, 'bot')
2018-11-15 21:53:24 [WARNING ] (13, 1, 'bot')
2018-11-15 21:53:24 [WARNING ] (13, 1, 'bot')
2018-11-15 21:53:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:53:24 [DEBUG   ] Finished updating board flags in 1.047 seconds
2018-11-15 21:53:25 [DEBUG   ] Got command RPT from MCS: ref #519351
2018-11-15 21:53:25 [DEBUG   ] summary = ERROR
2018-11-15 21:53:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519351  13 58437 78805093 A  ERRORERROR'
2018-11-15 21:53:25 [DEBUG   ] Got command RPT from MCS: ref #519352
2018-11-15 21:53:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 21:53:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519352  77 58437 78805297 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 21:53:25 [DEBUG   ] Got command RPT from MCS: ref #519353
2018-11-15 21:53:25 [DEBUG   ] summary = ERROR
2018-11-15 21:53:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519353  13 58437 78805501 A  ERRORERROR'
2018-11-15 21:53:25 [DEBUG   ] Got command RPT from MCS: ref #519354
2018-11-15 21:53:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 21:53:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519354  77 58437 78805693 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 21:53:25 [DEBUG   ] Got command RPT from MCS: ref #519355
2018-11-15 21:53:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 21:53:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519355  12 58437 78805897 A  ERRORB£ff'
2018-11-15 21:53:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 21:53:29 [DEBUG   ] Got command BAM from MCS: ref #519356
2018-11-15 21:53:29 [INFO    ] Finished processing BAM request
2018-11-15 21:53:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:53:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519356   8 58437 78809029 A  ERROR'
2018-11-15 21:53:29 [DEBUG   ] Got command BAM from MCS: ref #519357
2018-11-15 21:53:29 [INFO    ] Finished processing BAM request
2018-11-15 21:53:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:53:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519357   8 58437 78809033 A  ERROR'
2018-11-15 21:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 21:53:29 [DEBUG   ] spawn_process: at 2018-11-15 21:53:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 21:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 21:53:29 [DEBUG   ] spawn_process: at 2018-11-15 21:53:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 21:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 21:53:29 [DEBUG   ] spawn_process: at 2018-11-15 21:53:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 21:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 21:53:29 [DEBUG   ] spawn_process: at 2018-11-15 21:53:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 21:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 21:53:29 [DEBUG   ] spawn_process: at 2018-11-15 21:53:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 21:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 21:53:29 [DEBUG   ] spawn_process: at 2018-11-15 21:53:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 21:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 21:53:29 [DEBUG   ] spawn_process: at 2018-11-15 21:53:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 21:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 21:53:29 [DEBUG   ] spawn_process: at 2018-11-15 21:53:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 21:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 21:53:29 [DEBUG   ] spawn_process: at 2018-11-15 21:53:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 21:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 21:53:29 [DEBUG   ] spawn_process: at 2018-11-15 21:53:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 21:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 21:53:29 [DEBUG   ] spawn_process: at 2018-11-15 21:53:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 21:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 21:53:29 [DEBUG   ] spawn_process: at 2018-11-15 21:53:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 21:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 21:53:29 [DEBUG   ] spawn_process: at 2018-11-15 21:53:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 21:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 21:53:29 [DEBUG   ] spawn_process: at 2018-11-15 21:53:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 21:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 21:53:29 [DEBUG   ] spawn_process: at 2018-11-15 21:53:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 21:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 21:53:29 [DEBUG   ] spawn_process: at 2018-11-15 21:53:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 21:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 21:53:29 [DEBUG   ] spawn_process: at 2018-11-15 21:53:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 21:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 21:53:29 [DEBUG   ] spawn_process: at 2018-11-15 21:53:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 21:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 21:53:29 [DEBUG   ] spawn_process: at 2018-11-15 21:53:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 21:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 21:53:29 [DEBUG   ] spawn_process: at 2018-11-15 21:53:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 21:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 21:53:29 [DEBUG   ] spawn_process: at 2018-11-15 21:53:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 21:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 21:53:29 [DEBUG   ] spawn_process: at 2018-11-15 21:53:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 21:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 21:53:29 [DEBUG   ] spawn_process: at 2018-11-15 21:53:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 21:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 21:53:29 [DEBUG   ] spawn_process: at 2018-11-15 21:53:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 21:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 21:53:29 [DEBUG   ] spawn_process: at 2018-11-15 21:53:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 21:53:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 21:53:29 [DEBUG   ] spawn_process: at 2018-11-15 21:53:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 21:53:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 21:53:52 [DEBUG   ] Got command BAM from MCS: ref #519363
2018-11-15 21:53:52 [INFO    ] Finished processing BAM request
2018-11-15 21:53:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:53:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519363   8 58437 78832033 A  ERROR'
2018-11-15 21:53:52 [DEBUG   ] Got command BAM from MCS: ref #519362
2018-11-15 21:53:52 [INFO    ] Finished processing BAM request
2018-11-15 21:53:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:53:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519362   8 58437 78832037 A  ERROR'
2018-11-15 21:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 21:53:52 [DEBUG   ] spawn_process: at 2018-11-15 21:53:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 21:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 21:53:52 [DEBUG   ] spawn_process: at 2018-11-15 21:53:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 21:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 21:53:52 [DEBUG   ] spawn_process: at 2018-11-15 21:53:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 21:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 21:53:52 [DEBUG   ] spawn_process: at 2018-11-15 21:53:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 21:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 21:53:52 [DEBUG   ] spawn_process: at 2018-11-15 21:53:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 21:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 21:53:52 [DEBUG   ] spawn_process: at 2018-11-15 21:53:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 21:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 21:53:52 [DEBUG   ] spawn_process: at 2018-11-15 21:53:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 21:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 21:53:52 [DEBUG   ] spawn_process: at 2018-11-15 21:53:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 21:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 21:53:52 [DEBUG   ] spawn_process: at 2018-11-15 21:53:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 21:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 21:53:52 [DEBUG   ] spawn_process: at 2018-11-15 21:53:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 21:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 21:53:52 [DEBUG   ] spawn_process: at 2018-11-15 21:53:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 21:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 21:53:52 [DEBUG   ] spawn_process: at 2018-11-15 21:53:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 21:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 21:53:52 [DEBUG   ] spawn_process: at 2018-11-15 21:53:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 21:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 21:53:52 [DEBUG   ] spawn_process: at 2018-11-15 21:53:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 21:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 21:53:52 [DEBUG   ] spawn_process: at 2018-11-15 21:53:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 21:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 21:53:52 [DEBUG   ] spawn_process: at 2018-11-15 21:53:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 21:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 21:53:52 [DEBUG   ] spawn_process: at 2018-11-15 21:53:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 21:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 21:53:52 [DEBUG   ] spawn_process: at 2018-11-15 21:53:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 21:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 21:53:52 [DEBUG   ] spawn_process: at 2018-11-15 21:53:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 21:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 21:53:52 [DEBUG   ] spawn_process: at 2018-11-15 21:53:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 21:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 21:53:52 [DEBUG   ] spawn_process: at 2018-11-15 21:53:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 21:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 21:53:52 [DEBUG   ] spawn_process: at 2018-11-15 21:53:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 21:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 21:53:52 [DEBUG   ] spawn_process: at 2018-11-15 21:53:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 21:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 21:53:52 [DEBUG   ] spawn_process: at 2018-11-15 21:53:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 21:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 21:53:52 [DEBUG   ] spawn_process: at 2018-11-15 21:53:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 21:53:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 21:53:52 [DEBUG   ] spawn_process: at 2018-11-15 21:53:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 21:54:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 21:54:15 [DEBUG   ] Got command BAM from MCS: ref #519364
2018-11-15 21:54:15 [INFO    ] Finished processing BAM request
2018-11-15 21:54:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:54:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519364   8 58437 78855033 A  ERROR'
2018-11-15 21:54:15 [DEBUG   ] Got command BAM from MCS: ref #519365
2018-11-15 21:54:15 [INFO    ] Finished processing BAM request
2018-11-15 21:54:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:54:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519365   8 58437 78855037 A  ERROR'
2018-11-15 21:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 21:54:15 [DEBUG   ] spawn_process: at 2018-11-15 21:54:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 21:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 21:54:15 [DEBUG   ] spawn_process: at 2018-11-15 21:54:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 21:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 21:54:15 [DEBUG   ] spawn_process: at 2018-11-15 21:54:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 21:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 21:54:15 [DEBUG   ] spawn_process: at 2018-11-15 21:54:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 21:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 21:54:15 [DEBUG   ] spawn_process: at 2018-11-15 21:54:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 21:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 21:54:15 [DEBUG   ] spawn_process: at 2018-11-15 21:54:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 21:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 21:54:15 [DEBUG   ] spawn_process: at 2018-11-15 21:54:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 21:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 21:54:15 [DEBUG   ] spawn_process: at 2018-11-15 21:54:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 21:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 21:54:15 [DEBUG   ] spawn_process: at 2018-11-15 21:54:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 21:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 21:54:15 [DEBUG   ] spawn_process: at 2018-11-15 21:54:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 21:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 21:54:15 [DEBUG   ] spawn_process: at 2018-11-15 21:54:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 21:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 21:54:15 [DEBUG   ] spawn_process: at 2018-11-15 21:54:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 21:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 21:54:15 [DEBUG   ] spawn_process: at 2018-11-15 21:54:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 21:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 21:54:15 [DEBUG   ] spawn_process: at 2018-11-15 21:54:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 21:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 21:54:15 [DEBUG   ] spawn_process: at 2018-11-15 21:54:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 21:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 21:54:15 [DEBUG   ] spawn_process: at 2018-11-15 21:54:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 21:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 21:54:15 [DEBUG   ] spawn_process: at 2018-11-15 21:54:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 21:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 21:54:15 [DEBUG   ] spawn_process: at 2018-11-15 21:54:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 21:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 21:54:15 [DEBUG   ] spawn_process: at 2018-11-15 21:54:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 21:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 21:54:15 [DEBUG   ] spawn_process: at 2018-11-15 21:54:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 21:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 21:54:15 [DEBUG   ] spawn_process: at 2018-11-15 21:54:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 21:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 21:54:15 [DEBUG   ] spawn_process: at 2018-11-15 21:54:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 21:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 21:54:15 [DEBUG   ] spawn_process: at 2018-11-15 21:54:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 21:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 21:54:15 [DEBUG   ] spawn_process: at 2018-11-15 21:54:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 21:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 21:54:15 [DEBUG   ] spawn_process: at 2018-11-15 21:54:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 21:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 21:54:15 [DEBUG   ] spawn_process: at 2018-11-15 21:54:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 21:54:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 21:54:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:54:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-15 21:54:25 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 21:54:25 [WARNING ] (13, 1, 'bot')
2018-11-15 21:54:25 [WARNING ] (13, 1, 'bot')
2018-11-15 21:54:25 [WARNING ] (13, 1, 'bot')
2018-11-15 21:54:25 [WARNING ] (13, 1, 'bot')
2018-11-15 21:54:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:54:25 [DEBUG   ] Finished updating board flags in 1.546 seconds
2018-11-15 21:54:26 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-15 21:54:38 [DEBUG   ] Got command BAM from MCS: ref #519367
2018-11-15 21:54:38 [INFO    ] Finished processing BAM request
2018-11-15 21:54:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:54:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519367   8 58437 78878033 A  ERROR'
2018-11-15 21:54:38 [DEBUG   ] Got command BAM from MCS: ref #519366
2018-11-15 21:54:38 [INFO    ] Finished processing BAM request
2018-11-15 21:54:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:54:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519366   8 58437 78878037 A  ERROR'
2018-11-15 21:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 21:54:38 [DEBUG   ] spawn_process: at 2018-11-15 21:54:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 21:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 21:54:38 [DEBUG   ] spawn_process: at 2018-11-15 21:54:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 21:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 21:54:38 [DEBUG   ] spawn_process: at 2018-11-15 21:54:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 21:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 21:54:38 [DEBUG   ] spawn_process: at 2018-11-15 21:54:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 21:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 21:54:38 [DEBUG   ] spawn_process: at 2018-11-15 21:54:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 21:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 21:54:38 [DEBUG   ] spawn_process: at 2018-11-15 21:54:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 21:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 21:54:38 [DEBUG   ] spawn_process: at 2018-11-15 21:54:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 21:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 21:54:38 [DEBUG   ] spawn_process: at 2018-11-15 21:54:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 21:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 21:54:38 [DEBUG   ] spawn_process: at 2018-11-15 21:54:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 21:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 21:54:38 [DEBUG   ] spawn_process: at 2018-11-15 21:54:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 21:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 21:54:38 [DEBUG   ] spawn_process: at 2018-11-15 21:54:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 21:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 21:54:38 [DEBUG   ] spawn_process: at 2018-11-15 21:54:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 21:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 21:54:38 [DEBUG   ] spawn_process: at 2018-11-15 21:54:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 21:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 21:54:38 [DEBUG   ] spawn_process: at 2018-11-15 21:54:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 21:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 21:54:38 [DEBUG   ] spawn_process: at 2018-11-15 21:54:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 21:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 21:54:38 [DEBUG   ] spawn_process: at 2018-11-15 21:54:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 21:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 21:54:38 [DEBUG   ] spawn_process: at 2018-11-15 21:54:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 21:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 21:54:38 [DEBUG   ] spawn_process: at 2018-11-15 21:54:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 21:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 21:54:38 [DEBUG   ] spawn_process: at 2018-11-15 21:54:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 21:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 21:54:38 [DEBUG   ] spawn_process: at 2018-11-15 21:54:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 21:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 21:54:38 [DEBUG   ] spawn_process: at 2018-11-15 21:54:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 21:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 21:54:38 [DEBUG   ] spawn_process: at 2018-11-15 21:54:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 21:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 21:54:38 [DEBUG   ] spawn_process: at 2018-11-15 21:54:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 21:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 21:54:38 [DEBUG   ] spawn_process: at 2018-11-15 21:54:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 21:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 21:54:38 [DEBUG   ] spawn_process: at 2018-11-15 21:54:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 21:54:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 21:54:38 [DEBUG   ] spawn_process: at 2018-11-15 21:54:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 21:54:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 21:55:01 [DEBUG   ] Got command BAM from MCS: ref #519368
2018-11-15 21:55:01 [INFO    ] Finished processing BAM request
2018-11-15 21:55:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:55:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519368   8 58437 78901033 A  ERROR'
2018-11-15 21:55:01 [DEBUG   ] Got command BAM from MCS: ref #519369
2018-11-15 21:55:01 [INFO    ] Finished processing BAM request
2018-11-15 21:55:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:55:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519369   8 58437 78901037 A  ERROR'
2018-11-15 21:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 21:55:01 [DEBUG   ] spawn_process: at 2018-11-15 21:55:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 21:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 21:55:01 [DEBUG   ] spawn_process: at 2018-11-15 21:55:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 21:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 21:55:01 [DEBUG   ] spawn_process: at 2018-11-15 21:55:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 21:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 21:55:01 [DEBUG   ] spawn_process: at 2018-11-15 21:55:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 21:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 21:55:01 [DEBUG   ] spawn_process: at 2018-11-15 21:55:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 21:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 21:55:01 [DEBUG   ] spawn_process: at 2018-11-15 21:55:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 21:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 21:55:01 [DEBUG   ] spawn_process: at 2018-11-15 21:55:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 21:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 21:55:01 [DEBUG   ] spawn_process: at 2018-11-15 21:55:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 21:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 21:55:01 [DEBUG   ] spawn_process: at 2018-11-15 21:55:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 21:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 21:55:01 [DEBUG   ] spawn_process: at 2018-11-15 21:55:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 21:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 21:55:01 [DEBUG   ] spawn_process: at 2018-11-15 21:55:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 21:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 21:55:01 [DEBUG   ] spawn_process: at 2018-11-15 21:55:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 21:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 21:55:01 [DEBUG   ] spawn_process: at 2018-11-15 21:55:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 21:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 21:55:01 [DEBUG   ] spawn_process: at 2018-11-15 21:55:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 21:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 21:55:01 [DEBUG   ] spawn_process: at 2018-11-15 21:55:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 21:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 21:55:01 [DEBUG   ] spawn_process: at 2018-11-15 21:55:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 21:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 21:55:01 [DEBUG   ] spawn_process: at 2018-11-15 21:55:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 21:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 21:55:01 [DEBUG   ] spawn_process: at 2018-11-15 21:55:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 21:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 21:55:01 [DEBUG   ] spawn_process: at 2018-11-15 21:55:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 21:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 21:55:01 [DEBUG   ] spawn_process: at 2018-11-15 21:55:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 21:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 21:55:01 [DEBUG   ] spawn_process: at 2018-11-15 21:55:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 21:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 21:55:01 [DEBUG   ] spawn_process: at 2018-11-15 21:55:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 21:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 21:55:01 [DEBUG   ] spawn_process: at 2018-11-15 21:55:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 21:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 21:55:01 [DEBUG   ] spawn_process: at 2018-11-15 21:55:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 21:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 21:55:01 [DEBUG   ] spawn_process: at 2018-11-15 21:55:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 21:55:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 21:55:01 [DEBUG   ] spawn_process: at 2018-11-15 21:55:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 21:55:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 21:55:24 [DEBUG   ] Got command BAM from MCS: ref #519370
2018-11-15 21:55:24 [INFO    ] Finished processing BAM request
2018-11-15 21:55:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:55:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519370   8 58437 78924033 A  ERROR'
2018-11-15 21:55:24 [DEBUG   ] Got command BAM from MCS: ref #519371
2018-11-15 21:55:24 [INFO    ] Finished processing BAM request
2018-11-15 21:55:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:55:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519371   8 58437 78924037 A  ERROR'
2018-11-15 21:55:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 21:55:24 [DEBUG   ] spawn_process: at 2018-11-15 21:55:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 21:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 21:55:24 [DEBUG   ] spawn_process: at 2018-11-15 21:55:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 21:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 21:55:24 [DEBUG   ] spawn_process: at 2018-11-15 21:55:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 21:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 21:55:24 [DEBUG   ] spawn_process: at 2018-11-15 21:55:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 21:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 21:55:24 [DEBUG   ] spawn_process: at 2018-11-15 21:55:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 21:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 21:55:24 [DEBUG   ] spawn_process: at 2018-11-15 21:55:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 21:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 21:55:24 [DEBUG   ] spawn_process: at 2018-11-15 21:55:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 21:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 21:55:24 [DEBUG   ] spawn_process: at 2018-11-15 21:55:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 21:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 21:55:24 [DEBUG   ] spawn_process: at 2018-11-15 21:55:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 21:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 21:55:24 [DEBUG   ] spawn_process: at 2018-11-15 21:55:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 21:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 21:55:24 [DEBUG   ] spawn_process: at 2018-11-15 21:55:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 21:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 21:55:24 [DEBUG   ] spawn_process: at 2018-11-15 21:55:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 21:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 21:55:24 [DEBUG   ] spawn_process: at 2018-11-15 21:55:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 21:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 21:55:24 [DEBUG   ] spawn_process: at 2018-11-15 21:55:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 21:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 21:55:24 [DEBUG   ] spawn_process: at 2018-11-15 21:55:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 21:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 21:55:24 [DEBUG   ] spawn_process: at 2018-11-15 21:55:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 21:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 21:55:24 [DEBUG   ] spawn_process: at 2018-11-15 21:55:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 21:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 21:55:24 [DEBUG   ] spawn_process: at 2018-11-15 21:55:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 21:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 21:55:24 [DEBUG   ] spawn_process: at 2018-11-15 21:55:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 21:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 21:55:24 [DEBUG   ] spawn_process: at 2018-11-15 21:55:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 21:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 21:55:24 [DEBUG   ] spawn_process: at 2018-11-15 21:55:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 21:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 21:55:24 [DEBUG   ] spawn_process: at 2018-11-15 21:55:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 21:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 21:55:24 [DEBUG   ] spawn_process: at 2018-11-15 21:55:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 21:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 21:55:24 [DEBUG   ] spawn_process: at 2018-11-15 21:55:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 21:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 21:55:24 [DEBUG   ] spawn_process: at 2018-11-15 21:55:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 21:55:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 21:55:24 [DEBUG   ] spawn_process: at 2018-11-15 21:55:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 21:55:25 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 21:55:25 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 21:55:25 [WARNING ] (13, 1, 'bot')
2018-11-15 21:55:25 [WARNING ] (13, 1, 'bot')
2018-11-15 21:55:25 [WARNING ] (13, 1, 'bot')
2018-11-15 21:55:25 [WARNING ] (13, 1, 'bot')
2018-11-15 21:55:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:55:25 [DEBUG   ] Finished updating board flags in 1.390 seconds
2018-11-15 21:55:26 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-15 21:55:45 [DEBUG   ] Got command RPT from MCS: ref #519372
2018-11-15 21:55:45 [DEBUG   ] summary = ERROR
2018-11-15 21:55:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519372  13 58437 78945217 A  ERRORERROR'
2018-11-15 21:55:45 [DEBUG   ] Got command RPT from MCS: ref #519373
2018-11-15 21:55:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 21:55:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519373  77 58437 78945218 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 21:55:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 21:55:47 [DEBUG   ] Got command BAM from MCS: ref #519389
2018-11-15 21:55:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:55:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519389   8 58437 78947025 A  ERROR'
2018-11-15 21:55:47 [DEBUG   ] Got command BAM from MCS: ref #519390
2018-11-15 21:55:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:55:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519390   8 58437 78947029 A  ERROR'
2018-11-15 21:55:47 [INFO    ] Finished processing BAM request
2018-11-15 21:55:47 [INFO    ] Finished processing BAM request
2018-11-15 21:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 21:55:47 [DEBUG   ] spawn_process: at 2018-11-15 21:55:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 21:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 21:55:47 [DEBUG   ] spawn_process: at 2018-11-15 21:55:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 21:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 21:55:47 [DEBUG   ] spawn_process: at 2018-11-15 21:55:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 21:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 21:55:47 [DEBUG   ] spawn_process: at 2018-11-15 21:55:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 21:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 21:55:47 [DEBUG   ] spawn_process: at 2018-11-15 21:55:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 21:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 21:55:47 [DEBUG   ] spawn_process: at 2018-11-15 21:55:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 21:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 21:55:47 [DEBUG   ] spawn_process: at 2018-11-15 21:55:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 21:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 21:55:47 [DEBUG   ] spawn_process: at 2018-11-15 21:55:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 21:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 21:55:47 [DEBUG   ] spawn_process: at 2018-11-15 21:55:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 21:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 21:55:47 [DEBUG   ] spawn_process: at 2018-11-15 21:55:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 21:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 21:55:47 [DEBUG   ] spawn_process: at 2018-11-15 21:55:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 21:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 21:55:47 [DEBUG   ] spawn_process: at 2018-11-15 21:55:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 21:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 21:55:47 [DEBUG   ] spawn_process: at 2018-11-15 21:55:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 21:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 21:55:47 [DEBUG   ] spawn_process: at 2018-11-15 21:55:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 21:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 21:55:47 [DEBUG   ] spawn_process: at 2018-11-15 21:55:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 21:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 21:55:47 [DEBUG   ] spawn_process: at 2018-11-15 21:55:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 21:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 21:55:47 [DEBUG   ] spawn_process: at 2018-11-15 21:55:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 21:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 21:55:47 [DEBUG   ] spawn_process: at 2018-11-15 21:55:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 21:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 21:55:47 [DEBUG   ] spawn_process: at 2018-11-15 21:55:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 21:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 21:55:47 [DEBUG   ] spawn_process: at 2018-11-15 21:55:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 21:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 21:55:47 [DEBUG   ] spawn_process: at 2018-11-15 21:55:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 21:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 21:55:47 [DEBUG   ] spawn_process: at 2018-11-15 21:55:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 21:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 21:55:47 [DEBUG   ] spawn_process: at 2018-11-15 21:55:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 21:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 21:55:47 [DEBUG   ] spawn_process: at 2018-11-15 21:55:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 21:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 21:55:47 [DEBUG   ] spawn_process: at 2018-11-15 21:55:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 21:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 21:55:47 [DEBUG   ] spawn_process: at 2018-11-15 21:55:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 21:56:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 21:56:10 [DEBUG   ] Got command BAM from MCS: ref #519391
2018-11-15 21:56:10 [INFO    ] Finished processing BAM request
2018-11-15 21:56:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:56:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519391   8 58437 78970029 A  ERROR'
2018-11-15 21:56:10 [DEBUG   ] Got command BAM from MCS: ref #519392
2018-11-15 21:56:10 [INFO    ] Finished processing BAM request
2018-11-15 21:56:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:56:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519392   8 58437 78970033 A  ERROR'
2018-11-15 21:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 21:56:10 [DEBUG   ] spawn_process: at 2018-11-15 21:56:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 21:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 21:56:10 [DEBUG   ] spawn_process: at 2018-11-15 21:56:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 21:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 21:56:10 [DEBUG   ] spawn_process: at 2018-11-15 21:56:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 21:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 21:56:10 [DEBUG   ] spawn_process: at 2018-11-15 21:56:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 21:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 21:56:10 [DEBUG   ] spawn_process: at 2018-11-15 21:56:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 21:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 21:56:10 [DEBUG   ] spawn_process: at 2018-11-15 21:56:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 21:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 21:56:10 [DEBUG   ] spawn_process: at 2018-11-15 21:56:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 21:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 21:56:10 [DEBUG   ] spawn_process: at 2018-11-15 21:56:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 21:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 21:56:10 [DEBUG   ] spawn_process: at 2018-11-15 21:56:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 21:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 21:56:10 [DEBUG   ] spawn_process: at 2018-11-15 21:56:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 21:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 21:56:10 [DEBUG   ] spawn_process: at 2018-11-15 21:56:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 21:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 21:56:10 [DEBUG   ] spawn_process: at 2018-11-15 21:56:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 21:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 21:56:10 [DEBUG   ] spawn_process: at 2018-11-15 21:56:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 21:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 21:56:10 [DEBUG   ] spawn_process: at 2018-11-15 21:56:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 21:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 21:56:10 [DEBUG   ] spawn_process: at 2018-11-15 21:56:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 21:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 21:56:10 [DEBUG   ] spawn_process: at 2018-11-15 21:56:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 21:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 21:56:10 [DEBUG   ] spawn_process: at 2018-11-15 21:56:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 21:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 21:56:10 [DEBUG   ] spawn_process: at 2018-11-15 21:56:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 21:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 21:56:10 [DEBUG   ] spawn_process: at 2018-11-15 21:56:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 21:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 21:56:10 [DEBUG   ] spawn_process: at 2018-11-15 21:56:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 21:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 21:56:10 [DEBUG   ] spawn_process: at 2018-11-15 21:56:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 21:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 21:56:10 [DEBUG   ] spawn_process: at 2018-11-15 21:56:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 21:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 21:56:10 [DEBUG   ] spawn_process: at 2018-11-15 21:56:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 21:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 21:56:10 [DEBUG   ] spawn_process: at 2018-11-15 21:56:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 21:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 21:56:10 [DEBUG   ] spawn_process: at 2018-11-15 21:56:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 21:56:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 21:56:10 [DEBUG   ] spawn_process: at 2018-11-15 21:56:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 21:56:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-11-15 21:56:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:56:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 21:56:25 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 21:56:25 [WARNING ] (13, 1, 'bot')
2018-11-15 21:56:25 [WARNING ] (13, 1, 'bot')
2018-11-15 21:56:25 [WARNING ] (13, 1, 'bot')
2018-11-15 21:56:25 [WARNING ] (13, 1, 'bot')
2018-11-15 21:56:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:56:25 [DEBUG   ] Finished updating board flags in 1.256 seconds
2018-11-15 21:56:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 21:56:33 [DEBUG   ] Got command BAM from MCS: ref #519397
2018-11-15 21:56:33 [INFO    ] Finished processing BAM request
2018-11-15 21:56:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:56:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519397   8 58437 78993029 A  ERROR'
2018-11-15 21:56:33 [DEBUG   ] Got command BAM from MCS: ref #519398
2018-11-15 21:56:33 [INFO    ] Finished processing BAM request
2018-11-15 21:56:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:56:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519398   8 58437 78993033 A  ERROR'
2018-11-15 21:56:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 21:56:33 [DEBUG   ] spawn_process: at 2018-11-15 21:56:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 21:56:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 21:56:33 [DEBUG   ] spawn_process: at 2018-11-15 21:56:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 21:56:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 21:56:33 [DEBUG   ] spawn_process: at 2018-11-15 21:56:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 21:56:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 21:56:33 [DEBUG   ] spawn_process: at 2018-11-15 21:56:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 21:56:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 21:56:33 [DEBUG   ] spawn_process: at 2018-11-15 21:56:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 21:56:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 21:56:33 [DEBUG   ] spawn_process: at 2018-11-15 21:56:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 21:56:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 21:56:33 [DEBUG   ] spawn_process: at 2018-11-15 21:56:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 21:56:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 21:56:33 [DEBUG   ] spawn_process: at 2018-11-15 21:56:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 21:56:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 21:56:33 [DEBUG   ] spawn_process: at 2018-11-15 21:56:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 21:56:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 21:56:33 [DEBUG   ] spawn_process: at 2018-11-15 21:56:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 21:56:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 21:56:33 [DEBUG   ] spawn_process: at 2018-11-15 21:56:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 21:56:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 21:56:33 [DEBUG   ] spawn_process: at 2018-11-15 21:56:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 21:56:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 21:56:33 [DEBUG   ] spawn_process: at 2018-11-15 21:56:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 21:56:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 21:56:33 [DEBUG   ] spawn_process: at 2018-11-15 21:56:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 21:56:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 21:56:33 [DEBUG   ] spawn_process: at 2018-11-15 21:56:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 21:56:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 21:56:33 [DEBUG   ] spawn_process: at 2018-11-15 21:56:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 21:56:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 21:56:33 [DEBUG   ] spawn_process: at 2018-11-15 21:56:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 21:56:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 21:56:33 [DEBUG   ] spawn_process: at 2018-11-15 21:56:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 21:56:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 21:56:33 [DEBUG   ] spawn_process: at 2018-11-15 21:56:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 21:56:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 21:56:33 [DEBUG   ] spawn_process: at 2018-11-15 21:56:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 21:56:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 21:56:33 [DEBUG   ] spawn_process: at 2018-11-15 21:56:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 21:56:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 21:56:33 [DEBUG   ] spawn_process: at 2018-11-15 21:56:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 21:56:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 21:56:33 [DEBUG   ] spawn_process: at 2018-11-15 21:56:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 21:56:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 21:56:33 [DEBUG   ] spawn_process: at 2018-11-15 21:56:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 21:56:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 21:56:33 [DEBUG   ] spawn_process: at 2018-11-15 21:56:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 21:56:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 21:56:33 [DEBUG   ] spawn_process: at 2018-11-15 21:56:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 21:56:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 21:56:56 [DEBUG   ] Got command BAM from MCS: ref #519399
2018-11-15 21:56:56 [INFO    ] Finished processing BAM request
2018-11-15 21:56:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:56:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519399   8 58437 79016025 A  ERROR'
2018-11-15 21:56:56 [DEBUG   ] Got command BAM from MCS: ref #519400
2018-11-15 21:56:56 [INFO    ] Finished processing BAM request
2018-11-15 21:56:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:56:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519400   8 58437 79016029 A  ERROR'
2018-11-15 21:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 21:56:56 [DEBUG   ] spawn_process: at 2018-11-15 21:56:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 21:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 21:56:56 [DEBUG   ] spawn_process: at 2018-11-15 21:56:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 21:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 21:56:56 [DEBUG   ] spawn_process: at 2018-11-15 21:56:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 21:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 21:56:56 [DEBUG   ] spawn_process: at 2018-11-15 21:56:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 21:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 21:56:56 [DEBUG   ] spawn_process: at 2018-11-15 21:56:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 21:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 21:56:56 [DEBUG   ] spawn_process: at 2018-11-15 21:56:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 21:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 21:56:56 [DEBUG   ] spawn_process: at 2018-11-15 21:56:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 21:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 21:56:56 [DEBUG   ] spawn_process: at 2018-11-15 21:56:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 21:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 21:56:56 [DEBUG   ] spawn_process: at 2018-11-15 21:56:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 21:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 21:56:56 [DEBUG   ] spawn_process: at 2018-11-15 21:56:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 21:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 21:56:56 [DEBUG   ] spawn_process: at 2018-11-15 21:56:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 21:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 21:56:56 [DEBUG   ] spawn_process: at 2018-11-15 21:56:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 21:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 21:56:56 [DEBUG   ] spawn_process: at 2018-11-15 21:56:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 21:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 21:56:56 [DEBUG   ] spawn_process: at 2018-11-15 21:56:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 21:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 21:56:56 [DEBUG   ] spawn_process: at 2018-11-15 21:56:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 21:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 21:56:56 [DEBUG   ] spawn_process: at 2018-11-15 21:56:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 21:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 21:56:56 [DEBUG   ] spawn_process: at 2018-11-15 21:56:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 21:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 21:56:56 [DEBUG   ] spawn_process: at 2018-11-15 21:56:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 21:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 21:56:56 [DEBUG   ] spawn_process: at 2018-11-15 21:56:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 21:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 21:56:56 [DEBUG   ] spawn_process: at 2018-11-15 21:56:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 21:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 21:56:56 [DEBUG   ] spawn_process: at 2018-11-15 21:56:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 21:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 21:56:56 [DEBUG   ] spawn_process: at 2018-11-15 21:56:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 21:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 21:56:56 [DEBUG   ] spawn_process: at 2018-11-15 21:56:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 21:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 21:56:56 [DEBUG   ] spawn_process: at 2018-11-15 21:56:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 21:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 21:56:56 [DEBUG   ] spawn_process: at 2018-11-15 21:56:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 21:56:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 21:56:56 [DEBUG   ] spawn_process: at 2018-11-15 21:56:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 21:57:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 21:57:19 [DEBUG   ] Got command BAM from MCS: ref #519402
2018-11-15 21:57:19 [INFO    ] Finished processing BAM request
2018-11-15 21:57:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:57:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519402   8 58437 79039025 A  ERROR'
2018-11-15 21:57:19 [DEBUG   ] Got command BAM from MCS: ref #519401
2018-11-15 21:57:19 [INFO    ] Finished processing BAM request
2018-11-15 21:57:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:57:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519401   8 58437 79039029 A  ERROR'
2018-11-15 21:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 21:57:19 [DEBUG   ] spawn_process: at 2018-11-15 21:57:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 21:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 21:57:19 [DEBUG   ] spawn_process: at 2018-11-15 21:57:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 21:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 21:57:19 [DEBUG   ] spawn_process: at 2018-11-15 21:57:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 21:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 21:57:19 [DEBUG   ] spawn_process: at 2018-11-15 21:57:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 21:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 21:57:19 [DEBUG   ] spawn_process: at 2018-11-15 21:57:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 21:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 21:57:19 [DEBUG   ] spawn_process: at 2018-11-15 21:57:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 21:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 21:57:19 [DEBUG   ] spawn_process: at 2018-11-15 21:57:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 21:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 21:57:19 [DEBUG   ] spawn_process: at 2018-11-15 21:57:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 21:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 21:57:19 [DEBUG   ] spawn_process: at 2018-11-15 21:57:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 21:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 21:57:19 [DEBUG   ] spawn_process: at 2018-11-15 21:57:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 21:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 21:57:19 [DEBUG   ] spawn_process: at 2018-11-15 21:57:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 21:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 21:57:19 [DEBUG   ] spawn_process: at 2018-11-15 21:57:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 21:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 21:57:19 [DEBUG   ] spawn_process: at 2018-11-15 21:57:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 21:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 21:57:19 [DEBUG   ] spawn_process: at 2018-11-15 21:57:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 21:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 21:57:19 [DEBUG   ] spawn_process: at 2018-11-15 21:57:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 21:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 21:57:19 [DEBUG   ] spawn_process: at 2018-11-15 21:57:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 21:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 21:57:19 [DEBUG   ] spawn_process: at 2018-11-15 21:57:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 21:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 21:57:19 [DEBUG   ] spawn_process: at 2018-11-15 21:57:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 21:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 21:57:19 [DEBUG   ] spawn_process: at 2018-11-15 21:57:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 21:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 21:57:19 [DEBUG   ] spawn_process: at 2018-11-15 21:57:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 21:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 21:57:19 [DEBUG   ] spawn_process: at 2018-11-15 21:57:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 21:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 21:57:19 [DEBUG   ] spawn_process: at 2018-11-15 21:57:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 21:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 21:57:19 [DEBUG   ] spawn_process: at 2018-11-15 21:57:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 21:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 21:57:19 [DEBUG   ] spawn_process: at 2018-11-15 21:57:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 21:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 21:57:19 [DEBUG   ] spawn_process: at 2018-11-15 21:57:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 21:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 21:57:19 [DEBUG   ] spawn_process: at 2018-11-15 21:57:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 21:57:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:57:25 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 21:57:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 21:57:25 [WARNING ] (13, 1, 'bot')
2018-11-15 21:57:25 [WARNING ] (13, 1, 'bot')
2018-11-15 21:57:25 [WARNING ] (13, 1, 'bot')
2018-11-15 21:57:25 [WARNING ] (13, 1, 'bot')
2018-11-15 21:57:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:57:25 [DEBUG   ] Finished updating board flags in 1.141 seconds
2018-11-15 21:57:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 21:57:42 [DEBUG   ] Got command BAM from MCS: ref #519404
2018-11-15 21:57:42 [INFO    ] Finished processing BAM request
2018-11-15 21:57:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:57:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519404   8 58437 79062029 A  ERROR'
2018-11-15 21:57:42 [DEBUG   ] Got command BAM from MCS: ref #519403
2018-11-15 21:57:42 [INFO    ] Finished processing BAM request
2018-11-15 21:57:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:57:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519403   8 58437 79062033 A  ERROR'
2018-11-15 21:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 21:57:42 [DEBUG   ] spawn_process: at 2018-11-15 21:57:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 21:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 21:57:42 [DEBUG   ] spawn_process: at 2018-11-15 21:57:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 21:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 21:57:42 [DEBUG   ] spawn_process: at 2018-11-15 21:57:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 21:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 21:57:42 [DEBUG   ] spawn_process: at 2018-11-15 21:57:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 21:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 21:57:42 [DEBUG   ] spawn_process: at 2018-11-15 21:57:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 21:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 21:57:42 [DEBUG   ] spawn_process: at 2018-11-15 21:57:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 21:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 21:57:42 [DEBUG   ] spawn_process: at 2018-11-15 21:57:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 21:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 21:57:42 [DEBUG   ] spawn_process: at 2018-11-15 21:57:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 21:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 21:57:42 [DEBUG   ] spawn_process: at 2018-11-15 21:57:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 21:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 21:57:42 [DEBUG   ] spawn_process: at 2018-11-15 21:57:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 21:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 21:57:42 [DEBUG   ] spawn_process: at 2018-11-15 21:57:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 21:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 21:57:42 [DEBUG   ] spawn_process: at 2018-11-15 21:57:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 21:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 21:57:42 [DEBUG   ] spawn_process: at 2018-11-15 21:57:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 21:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 21:57:42 [DEBUG   ] spawn_process: at 2018-11-15 21:57:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 21:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 21:57:42 [DEBUG   ] spawn_process: at 2018-11-15 21:57:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 21:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 21:57:42 [DEBUG   ] spawn_process: at 2018-11-15 21:57:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 21:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 21:57:42 [DEBUG   ] spawn_process: at 2018-11-15 21:57:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 21:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 21:57:42 [DEBUG   ] spawn_process: at 2018-11-15 21:57:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 21:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 21:57:42 [DEBUG   ] spawn_process: at 2018-11-15 21:57:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 21:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 21:57:42 [DEBUG   ] spawn_process: at 2018-11-15 21:57:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 21:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 21:57:42 [DEBUG   ] spawn_process: at 2018-11-15 21:57:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 21:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 21:57:42 [DEBUG   ] spawn_process: at 2018-11-15 21:57:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 21:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 21:57:42 [DEBUG   ] spawn_process: at 2018-11-15 21:57:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 21:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 21:57:42 [DEBUG   ] spawn_process: at 2018-11-15 21:57:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 21:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 21:57:42 [DEBUG   ] spawn_process: at 2018-11-15 21:57:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 21:57:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 21:57:42 [DEBUG   ] spawn_process: at 2018-11-15 21:57:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 21:57:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 21:58:05 [DEBUG   ] Got command BAM from MCS: ref #519405
2018-11-15 21:58:05 [INFO    ] Finished processing BAM request
2018-11-15 21:58:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:58:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519405   8 58437 79085025 A  ERROR'
2018-11-15 21:58:05 [DEBUG   ] Got command BAM from MCS: ref #519406
2018-11-15 21:58:05 [INFO    ] Finished processing BAM request
2018-11-15 21:58:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:58:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519406   8 58437 79085029 A  ERROR'
2018-11-15 21:58:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 21:58:05 [DEBUG   ] spawn_process: at 2018-11-15 21:58:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 21:58:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 21:58:05 [DEBUG   ] spawn_process: at 2018-11-15 21:58:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 21:58:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 21:58:05 [DEBUG   ] spawn_process: at 2018-11-15 21:58:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 21:58:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 21:58:05 [DEBUG   ] spawn_process: at 2018-11-15 21:58:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 21:58:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 21:58:05 [DEBUG   ] spawn_process: at 2018-11-15 21:58:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 21:58:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 21:58:05 [DEBUG   ] spawn_process: at 2018-11-15 21:58:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 21:58:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 21:58:05 [DEBUG   ] spawn_process: at 2018-11-15 21:58:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 21:58:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 21:58:05 [DEBUG   ] spawn_process: at 2018-11-15 21:58:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 21:58:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 21:58:05 [DEBUG   ] spawn_process: at 2018-11-15 21:58:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 21:58:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 21:58:05 [DEBUG   ] spawn_process: at 2018-11-15 21:58:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 21:58:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 21:58:05 [DEBUG   ] spawn_process: at 2018-11-15 21:58:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 21:58:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 21:58:05 [DEBUG   ] spawn_process: at 2018-11-15 21:58:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 21:58:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 21:58:05 [DEBUG   ] spawn_process: at 2018-11-15 21:58:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 21:58:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 21:58:05 [DEBUG   ] spawn_process: at 2018-11-15 21:58:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 21:58:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 21:58:05 [DEBUG   ] spawn_process: at 2018-11-15 21:58:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 21:58:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 21:58:05 [DEBUG   ] spawn_process: at 2018-11-15 21:58:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 21:58:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 21:58:05 [DEBUG   ] spawn_process: at 2018-11-15 21:58:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 21:58:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 21:58:05 [DEBUG   ] spawn_process: at 2018-11-15 21:58:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 21:58:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 21:58:05 [DEBUG   ] spawn_process: at 2018-11-15 21:58:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 21:58:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 21:58:05 [DEBUG   ] spawn_process: at 2018-11-15 21:58:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 21:58:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 21:58:05 [DEBUG   ] spawn_process: at 2018-11-15 21:58:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 21:58:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 21:58:05 [DEBUG   ] spawn_process: at 2018-11-15 21:58:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 21:58:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 21:58:05 [DEBUG   ] spawn_process: at 2018-11-15 21:58:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 21:58:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 21:58:05 [DEBUG   ] spawn_process: at 2018-11-15 21:58:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 21:58:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 21:58:05 [DEBUG   ] spawn_process: at 2018-11-15 21:58:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 21:58:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 21:58:05 [DEBUG   ] spawn_process: at 2018-11-15 21:58:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 21:58:06 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 21:58:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-11-15 21:58:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 21:58:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:58:25 [DEBUG   ] Got command RPT from MCS: ref #519409
2018-11-15 21:58:25 [DEBUG   ] summary = ERROR
2018-11-15 21:58:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519409  13 58437 79105189 A  ERRORERROR'
2018-11-15 21:58:25 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 21:58:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 21:58:25 [DEBUG   ] Got command RPT from MCS: ref #519410
2018-11-15 21:58:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 21:58:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519410  77 58437 79105377 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 21:58:25 [WARNING ] (13, 1, 'bot')
2018-11-15 21:58:25 [WARNING ] (13, 1, 'bot')
2018-11-15 21:58:25 [WARNING ] (13, 1, 'bot')
2018-11-15 21:58:25 [WARNING ] (13, 1, 'bot')
2018-11-15 21:58:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:58:25 [DEBUG   ] Finished updating board flags in 1.003 seconds
2018-11-15 21:58:25 [DEBUG   ] Got command RPT from MCS: ref #519411
2018-11-15 21:58:25 [DEBUG   ] summary = ERROR
2018-11-15 21:58:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519411  13 58437 79105581 A  ERRORERROR'
2018-11-15 21:58:25 [DEBUG   ] Got command RPT from MCS: ref #519413
2018-11-15 21:58:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 21:58:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519413  77 58437 79105785 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 21:58:25 [DEBUG   ] Got command RPT from MCS: ref #519415
2018-11-15 21:58:25 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 21:58:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519415  12 58437 79105985 A  ERRORB£ff'
2018-11-15 21:58:26 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-15 21:58:28 [DEBUG   ] Got command BAM from MCS: ref #519419
2018-11-15 21:58:28 [INFO    ] Finished processing BAM request
2018-11-15 21:58:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519419   8 58437 79108029 A  ERROR'
2018-11-15 21:58:28 [DEBUG   ] Got command BAM from MCS: ref #519420
2018-11-15 21:58:28 [INFO    ] Finished processing BAM request
2018-11-15 21:58:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519420   8 58437 79108033 A  ERROR'
2018-11-15 21:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 21:58:28 [DEBUG   ] spawn_process: at 2018-11-15 21:58:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 21:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 21:58:28 [DEBUG   ] spawn_process: at 2018-11-15 21:58:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 21:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 21:58:28 [DEBUG   ] spawn_process: at 2018-11-15 21:58:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 21:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 21:58:28 [DEBUG   ] spawn_process: at 2018-11-15 21:58:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 21:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 21:58:28 [DEBUG   ] spawn_process: at 2018-11-15 21:58:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 21:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 21:58:28 [DEBUG   ] spawn_process: at 2018-11-15 21:58:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 21:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 21:58:28 [DEBUG   ] spawn_process: at 2018-11-15 21:58:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 21:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 21:58:28 [DEBUG   ] spawn_process: at 2018-11-15 21:58:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 21:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 21:58:28 [DEBUG   ] spawn_process: at 2018-11-15 21:58:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 21:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 21:58:28 [DEBUG   ] spawn_process: at 2018-11-15 21:58:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 21:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 21:58:28 [DEBUG   ] spawn_process: at 2018-11-15 21:58:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 21:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 21:58:28 [DEBUG   ] spawn_process: at 2018-11-15 21:58:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 21:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 21:58:28 [DEBUG   ] spawn_process: at 2018-11-15 21:58:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 21:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 21:58:28 [DEBUG   ] spawn_process: at 2018-11-15 21:58:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 21:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 21:58:28 [DEBUG   ] spawn_process: at 2018-11-15 21:58:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 21:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 21:58:28 [DEBUG   ] spawn_process: at 2018-11-15 21:58:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 21:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 21:58:28 [DEBUG   ] spawn_process: at 2018-11-15 21:58:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 21:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 21:58:28 [DEBUG   ] spawn_process: at 2018-11-15 21:58:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 21:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 21:58:28 [DEBUG   ] spawn_process: at 2018-11-15 21:58:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 21:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 21:58:28 [DEBUG   ] spawn_process: at 2018-11-15 21:58:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 21:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 21:58:28 [DEBUG   ] spawn_process: at 2018-11-15 21:58:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 21:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 21:58:28 [DEBUG   ] spawn_process: at 2018-11-15 21:58:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 21:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 21:58:28 [DEBUG   ] spawn_process: at 2018-11-15 21:58:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 21:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 21:58:28 [DEBUG   ] spawn_process: at 2018-11-15 21:58:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 21:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 21:58:28 [DEBUG   ] spawn_process: at 2018-11-15 21:58:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 21:58:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 21:58:28 [DEBUG   ] spawn_process: at 2018-11-15 21:58:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 21:58:46 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 21:58:51 [DEBUG   ] Got command BAM from MCS: ref #519422
2018-11-15 21:58:51 [INFO    ] Finished processing BAM request
2018-11-15 21:58:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:58:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519422   8 58437 79131029 A  ERROR'
2018-11-15 21:58:51 [DEBUG   ] Got command BAM from MCS: ref #519421
2018-11-15 21:58:51 [INFO    ] Finished processing BAM request
2018-11-15 21:58:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:58:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519421   8 58437 79131033 A  ERROR'
2018-11-15 21:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 21:58:51 [DEBUG   ] spawn_process: at 2018-11-15 21:58:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 21:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 21:58:51 [DEBUG   ] spawn_process: at 2018-11-15 21:58:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 21:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 21:58:51 [DEBUG   ] spawn_process: at 2018-11-15 21:58:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 21:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 21:58:51 [DEBUG   ] spawn_process: at 2018-11-15 21:58:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 21:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 21:58:51 [DEBUG   ] spawn_process: at 2018-11-15 21:58:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 21:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 21:58:51 [DEBUG   ] spawn_process: at 2018-11-15 21:58:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 21:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 21:58:51 [DEBUG   ] spawn_process: at 2018-11-15 21:58:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 21:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 21:58:51 [DEBUG   ] spawn_process: at 2018-11-15 21:58:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 21:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 21:58:51 [DEBUG   ] spawn_process: at 2018-11-15 21:58:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 21:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 21:58:51 [DEBUG   ] spawn_process: at 2018-11-15 21:58:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 21:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 21:58:51 [DEBUG   ] spawn_process: at 2018-11-15 21:58:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 21:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 21:58:51 [DEBUG   ] spawn_process: at 2018-11-15 21:58:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 21:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 21:58:51 [DEBUG   ] spawn_process: at 2018-11-15 21:58:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 21:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 21:58:51 [DEBUG   ] spawn_process: at 2018-11-15 21:58:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 21:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 21:58:51 [DEBUG   ] spawn_process: at 2018-11-15 21:58:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 21:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 21:58:51 [DEBUG   ] spawn_process: at 2018-11-15 21:58:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 21:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 21:58:51 [DEBUG   ] spawn_process: at 2018-11-15 21:58:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 21:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 21:58:51 [DEBUG   ] spawn_process: at 2018-11-15 21:58:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 21:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 21:58:51 [DEBUG   ] spawn_process: at 2018-11-15 21:58:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 21:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 21:58:51 [DEBUG   ] spawn_process: at 2018-11-15 21:58:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 21:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 21:58:51 [DEBUG   ] spawn_process: at 2018-11-15 21:58:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 21:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 21:58:51 [DEBUG   ] spawn_process: at 2018-11-15 21:58:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 21:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 21:58:51 [DEBUG   ] spawn_process: at 2018-11-15 21:58:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 21:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 21:58:51 [DEBUG   ] spawn_process: at 2018-11-15 21:58:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 21:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 21:58:51 [DEBUG   ] spawn_process: at 2018-11-15 21:58:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 21:58:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 21:58:51 [DEBUG   ] spawn_process: at 2018-11-15 21:58:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 21:59:06 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 21:59:14 [DEBUG   ] Got command BAM from MCS: ref #519423
2018-11-15 21:59:14 [INFO    ] Finished processing BAM request
2018-11-15 21:59:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:59:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519423   8 58437 79154025 A  ERROR'
2018-11-15 21:59:14 [DEBUG   ] Got command BAM from MCS: ref #519424
2018-11-15 21:59:14 [INFO    ] Finished processing BAM request
2018-11-15 21:59:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:59:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519424   8 58437 79154029 A  ERROR'
2018-11-15 21:59:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 21:59:14 [DEBUG   ] spawn_process: at 2018-11-15 21:59:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 21:59:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 21:59:14 [DEBUG   ] spawn_process: at 2018-11-15 21:59:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 21:59:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 21:59:14 [DEBUG   ] spawn_process: at 2018-11-15 21:59:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 21:59:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 21:59:14 [DEBUG   ] spawn_process: at 2018-11-15 21:59:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 21:59:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 21:59:14 [DEBUG   ] spawn_process: at 2018-11-15 21:59:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 21:59:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 21:59:14 [DEBUG   ] spawn_process: at 2018-11-15 21:59:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 21:59:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 21:59:14 [DEBUG   ] spawn_process: at 2018-11-15 21:59:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 21:59:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 21:59:14 [DEBUG   ] spawn_process: at 2018-11-15 21:59:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 21:59:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 21:59:14 [DEBUG   ] spawn_process: at 2018-11-15 21:59:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 21:59:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 21:59:14 [DEBUG   ] spawn_process: at 2018-11-15 21:59:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 21:59:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 21:59:14 [DEBUG   ] spawn_process: at 2018-11-15 21:59:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 21:59:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 21:59:14 [DEBUG   ] spawn_process: at 2018-11-15 21:59:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 21:59:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 21:59:14 [DEBUG   ] spawn_process: at 2018-11-15 21:59:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 21:59:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 21:59:14 [DEBUG   ] spawn_process: at 2018-11-15 21:59:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 21:59:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 21:59:14 [DEBUG   ] spawn_process: at 2018-11-15 21:59:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 21:59:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 21:59:14 [DEBUG   ] spawn_process: at 2018-11-15 21:59:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 21:59:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 21:59:14 [DEBUG   ] spawn_process: at 2018-11-15 21:59:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 21:59:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 21:59:14 [DEBUG   ] spawn_process: at 2018-11-15 21:59:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 21:59:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 21:59:14 [DEBUG   ] spawn_process: at 2018-11-15 21:59:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 21:59:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 21:59:14 [DEBUG   ] spawn_process: at 2018-11-15 21:59:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 21:59:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 21:59:14 [DEBUG   ] spawn_process: at 2018-11-15 21:59:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 21:59:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 21:59:14 [DEBUG   ] spawn_process: at 2018-11-15 21:59:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 21:59:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 21:59:14 [DEBUG   ] spawn_process: at 2018-11-15 21:59:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 21:59:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 21:59:14 [DEBUG   ] spawn_process: at 2018-11-15 21:59:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 21:59:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 21:59:14 [DEBUG   ] spawn_process: at 2018-11-15 21:59:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 21:59:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 21:59:14 [DEBUG   ] spawn_process: at 2018-11-15 21:59:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 21:59:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 21:59:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 21:59:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 21:59:25 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 21:59:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 21:59:25 [WARNING ] (13, 1, 'bot')
2018-11-15 21:59:25 [WARNING ] (13, 1, 'bot')
2018-11-15 21:59:25 [WARNING ] (13, 1, 'bot')
2018-11-15 21:59:25 [WARNING ] (13, 1, 'bot')
2018-11-15 21:59:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 21:59:25 [DEBUG   ] Finished updating board flags in 0.994 seconds
2018-11-15 21:59:26 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-11-15 21:59:37 [DEBUG   ] Got command BAM from MCS: ref #519429
2018-11-15 21:59:37 [INFO    ] Finished processing BAM request
2018-11-15 21:59:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:59:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519429   8 58437 79177025 A  ERROR'
2018-11-15 21:59:37 [DEBUG   ] Got command BAM from MCS: ref #519430
2018-11-15 21:59:37 [INFO    ] Finished processing BAM request
2018-11-15 21:59:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 21:59:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519430   8 58437 79177033 A  ERROR'
2018-11-15 21:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 21:59:37 [DEBUG   ] spawn_process: at 2018-11-15 21:59:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 21:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 21:59:37 [DEBUG   ] spawn_process: at 2018-11-15 21:59:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 21:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 21:59:37 [DEBUG   ] spawn_process: at 2018-11-15 21:59:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 21:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 21:59:37 [DEBUG   ] spawn_process: at 2018-11-15 21:59:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 21:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 21:59:37 [DEBUG   ] spawn_process: at 2018-11-15 21:59:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 21:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 21:59:37 [DEBUG   ] spawn_process: at 2018-11-15 21:59:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 21:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 21:59:37 [DEBUG   ] spawn_process: at 2018-11-15 21:59:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 21:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 21:59:37 [DEBUG   ] spawn_process: at 2018-11-15 21:59:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 21:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 21:59:37 [DEBUG   ] spawn_process: at 2018-11-15 21:59:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 21:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 21:59:37 [DEBUG   ] spawn_process: at 2018-11-15 21:59:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 21:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 21:59:37 [DEBUG   ] spawn_process: at 2018-11-15 21:59:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 21:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 21:59:37 [DEBUG   ] spawn_process: at 2018-11-15 21:59:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 21:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 21:59:37 [DEBUG   ] spawn_process: at 2018-11-15 21:59:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 21:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 21:59:37 [DEBUG   ] spawn_process: at 2018-11-15 21:59:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 21:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 21:59:37 [DEBUG   ] spawn_process: at 2018-11-15 21:59:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 21:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 21:59:37 [DEBUG   ] spawn_process: at 2018-11-15 21:59:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 21:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 21:59:37 [DEBUG   ] spawn_process: at 2018-11-15 21:59:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 21:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 21:59:37 [DEBUG   ] spawn_process: at 2018-11-15 21:59:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 21:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 21:59:37 [DEBUG   ] spawn_process: at 2018-11-15 21:59:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 21:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 21:59:37 [DEBUG   ] spawn_process: at 2018-11-15 21:59:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 21:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 21:59:37 [DEBUG   ] spawn_process: at 2018-11-15 21:59:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 21:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 21:59:37 [DEBUG   ] spawn_process: at 2018-11-15 21:59:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 21:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 21:59:37 [DEBUG   ] spawn_process: at 2018-11-15 21:59:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 21:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 21:59:37 [DEBUG   ] spawn_process: at 2018-11-15 21:59:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 21:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 21:59:37 [DEBUG   ] spawn_process: at 2018-11-15 21:59:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 21:59:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 21:59:37 [DEBUG   ] spawn_process: at 2018-11-15 21:59:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 21:59:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 22:00:00 [DEBUG   ] Got command BAM from MCS: ref #519431
2018-11-15 22:00:00 [INFO    ] Finished processing BAM request
2018-11-15 22:00:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:00:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519431   8 58437 79200025 A  ERROR'
2018-11-15 22:00:00 [DEBUG   ] Got command BAM from MCS: ref #519432
2018-11-15 22:00:00 [INFO    ] Finished processing BAM request
2018-11-15 22:00:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:00:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519432   8 58437 79200029 A  ERROR'
2018-11-15 22:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 22:00:00 [DEBUG   ] spawn_process: at 2018-11-15 22:00:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 22:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 22:00:00 [DEBUG   ] spawn_process: at 2018-11-15 22:00:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 22:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 22:00:00 [DEBUG   ] spawn_process: at 2018-11-15 22:00:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 22:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 22:00:00 [DEBUG   ] spawn_process: at 2018-11-15 22:00:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 22:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 22:00:00 [DEBUG   ] spawn_process: at 2018-11-15 22:00:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 22:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 22:00:00 [DEBUG   ] spawn_process: at 2018-11-15 22:00:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 22:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 22:00:00 [DEBUG   ] spawn_process: at 2018-11-15 22:00:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 22:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 22:00:00 [DEBUG   ] spawn_process: at 2018-11-15 22:00:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 22:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 22:00:00 [DEBUG   ] spawn_process: at 2018-11-15 22:00:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 22:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 22:00:00 [DEBUG   ] spawn_process: at 2018-11-15 22:00:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 22:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 22:00:00 [DEBUG   ] spawn_process: at 2018-11-15 22:00:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 22:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 22:00:00 [DEBUG   ] spawn_process: at 2018-11-15 22:00:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 22:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 22:00:00 [DEBUG   ] spawn_process: at 2018-11-15 22:00:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 22:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 22:00:00 [DEBUG   ] spawn_process: at 2018-11-15 22:00:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 22:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 22:00:00 [DEBUG   ] spawn_process: at 2018-11-15 22:00:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 22:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 22:00:00 [DEBUG   ] spawn_process: at 2018-11-15 22:00:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 22:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 22:00:00 [DEBUG   ] spawn_process: at 2018-11-15 22:00:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 22:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 22:00:00 [DEBUG   ] spawn_process: at 2018-11-15 22:00:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 22:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 22:00:00 [DEBUG   ] spawn_process: at 2018-11-15 22:00:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 22:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 22:00:00 [DEBUG   ] spawn_process: at 2018-11-15 22:00:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 22:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 22:00:00 [DEBUG   ] spawn_process: at 2018-11-15 22:00:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 22:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 22:00:00 [DEBUG   ] spawn_process: at 2018-11-15 22:00:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 22:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 22:00:00 [DEBUG   ] spawn_process: at 2018-11-15 22:00:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 22:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 22:00:00 [DEBUG   ] spawn_process: at 2018-11-15 22:00:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 22:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 22:00:00 [DEBUG   ] spawn_process: at 2018-11-15 22:00:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 22:00:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 22:00:00 [DEBUG   ] spawn_process: at 2018-11-15 22:00:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 22:00:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 22:00:23 [DEBUG   ] Got command BAM from MCS: ref #519434
2018-11-15 22:00:23 [INFO    ] Finished processing BAM request
2018-11-15 22:00:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:00:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519434   8 58437 79223033 A  ERROR'
2018-11-15 22:00:23 [DEBUG   ] Got command BAM from MCS: ref #519433
2018-11-15 22:00:23 [INFO    ] Finished processing BAM request
2018-11-15 22:00:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:00:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519433   8 58437 79223037 A  ERROR'
2018-11-15 22:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 22:00:23 [DEBUG   ] spawn_process: at 2018-11-15 22:00:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 22:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 22:00:23 [DEBUG   ] spawn_process: at 2018-11-15 22:00:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 22:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 22:00:23 [DEBUG   ] spawn_process: at 2018-11-15 22:00:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 22:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 22:00:23 [DEBUG   ] spawn_process: at 2018-11-15 22:00:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 22:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 22:00:23 [DEBUG   ] spawn_process: at 2018-11-15 22:00:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 22:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 22:00:23 [DEBUG   ] spawn_process: at 2018-11-15 22:00:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 22:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 22:00:23 [DEBUG   ] spawn_process: at 2018-11-15 22:00:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 22:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 22:00:23 [DEBUG   ] spawn_process: at 2018-11-15 22:00:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 22:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 22:00:23 [DEBUG   ] spawn_process: at 2018-11-15 22:00:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 22:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 22:00:23 [DEBUG   ] spawn_process: at 2018-11-15 22:00:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 22:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 22:00:23 [DEBUG   ] spawn_process: at 2018-11-15 22:00:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 22:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 22:00:23 [DEBUG   ] spawn_process: at 2018-11-15 22:00:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 22:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 22:00:23 [DEBUG   ] spawn_process: at 2018-11-15 22:00:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 22:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 22:00:23 [DEBUG   ] spawn_process: at 2018-11-15 22:00:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 22:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 22:00:23 [DEBUG   ] spawn_process: at 2018-11-15 22:00:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 22:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 22:00:23 [DEBUG   ] spawn_process: at 2018-11-15 22:00:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 22:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 22:00:23 [DEBUG   ] spawn_process: at 2018-11-15 22:00:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 22:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 22:00:23 [DEBUG   ] spawn_process: at 2018-11-15 22:00:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 22:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 22:00:23 [DEBUG   ] spawn_process: at 2018-11-15 22:00:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 22:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 22:00:23 [DEBUG   ] spawn_process: at 2018-11-15 22:00:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 22:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 22:00:23 [DEBUG   ] spawn_process: at 2018-11-15 22:00:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 22:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 22:00:23 [DEBUG   ] spawn_process: at 2018-11-15 22:00:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 22:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 22:00:23 [DEBUG   ] spawn_process: at 2018-11-15 22:00:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 22:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 22:00:23 [DEBUG   ] spawn_process: at 2018-11-15 22:00:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 22:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 22:00:23 [DEBUG   ] spawn_process: at 2018-11-15 22:00:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 22:00:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 22:00:23 [DEBUG   ] spawn_process: at 2018-11-15 22:00:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 22:00:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-11-15 22:00:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 22:00:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:00:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-15 22:00:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-11-15 22:00:25 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 22:00:25 [WARNING ] (13, 1, 'bot')
2018-11-15 22:00:25 [WARNING ] (13, 1, 'bot')
2018-11-15 22:00:25 [WARNING ] (13, 1, 'bot')
2018-11-15 22:00:25 [WARNING ] (13, 1, 'bot')
2018-11-15 22:00:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 22:00:25 [DEBUG   ] Finished updating board flags in 1.265 seconds
2018-11-15 22:00:27 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 22:00:45 [DEBUG   ] Got command RPT from MCS: ref #519437
2018-11-15 22:00:45 [DEBUG   ] summary = ERROR
2018-11-15 22:00:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519437  13 58437 79245209 A  ERRORERROR'
2018-11-15 22:00:45 [DEBUG   ] Got command RPT from MCS: ref #519438
2018-11-15 22:00:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 22:00:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519438  77 58437 79245210 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 22:00:46 [DEBUG   ] Got command BAM from MCS: ref #519435
2018-11-15 22:00:46 [INFO    ] Finished processing BAM request
2018-11-15 22:00:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:00:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519435   8 58437 79246029 A  ERROR'
2018-11-15 22:00:46 [DEBUG   ] Got command BAM from MCS: ref #519436
2018-11-15 22:00:46 [INFO    ] Finished processing BAM request
2018-11-15 22:00:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:00:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519436   8 58437 79246033 A  ERROR'
2018-11-15 22:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 22:00:46 [DEBUG   ] spawn_process: at 2018-11-15 22:00:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 22:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 22:00:46 [DEBUG   ] spawn_process: at 2018-11-15 22:00:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 22:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 22:00:46 [DEBUG   ] spawn_process: at 2018-11-15 22:00:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 22:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 22:00:46 [DEBUG   ] spawn_process: at 2018-11-15 22:00:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 22:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 22:00:46 [DEBUG   ] spawn_process: at 2018-11-15 22:00:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 22:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 22:00:46 [DEBUG   ] spawn_process: at 2018-11-15 22:00:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 22:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 22:00:46 [DEBUG   ] spawn_process: at 2018-11-15 22:00:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 22:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 22:00:46 [DEBUG   ] spawn_process: at 2018-11-15 22:00:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 22:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 22:00:46 [DEBUG   ] spawn_process: at 2018-11-15 22:00:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 22:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 22:00:46 [DEBUG   ] spawn_process: at 2018-11-15 22:00:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 22:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 22:00:46 [DEBUG   ] spawn_process: at 2018-11-15 22:00:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 22:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 22:00:46 [DEBUG   ] spawn_process: at 2018-11-15 22:00:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 22:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 22:00:46 [DEBUG   ] spawn_process: at 2018-11-15 22:00:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 22:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 22:00:46 [DEBUG   ] spawn_process: at 2018-11-15 22:00:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 22:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 22:00:46 [DEBUG   ] spawn_process: at 2018-11-15 22:00:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 22:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 22:00:46 [DEBUG   ] spawn_process: at 2018-11-15 22:00:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 22:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 22:00:46 [DEBUG   ] spawn_process: at 2018-11-15 22:00:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 22:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 22:00:46 [DEBUG   ] spawn_process: at 2018-11-15 22:00:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 22:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 22:00:46 [DEBUG   ] spawn_process: at 2018-11-15 22:00:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 22:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 22:00:46 [DEBUG   ] spawn_process: at 2018-11-15 22:00:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 22:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 22:00:46 [DEBUG   ] spawn_process: at 2018-11-15 22:00:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 22:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 22:00:46 [DEBUG   ] spawn_process: at 2018-11-15 22:00:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 22:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 22:00:46 [DEBUG   ] spawn_process: at 2018-11-15 22:00:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 22:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 22:00:46 [DEBUG   ] spawn_process: at 2018-11-15 22:00:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 22:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 22:00:46 [DEBUG   ] spawn_process: at 2018-11-15 22:00:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 22:00:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 22:00:46 [DEBUG   ] spawn_process: at 2018-11-15 22:00:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 22:00:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 22:01:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 22:01:09 [DEBUG   ] Got command BAM from MCS: ref #519455
2018-11-15 22:01:09 [INFO    ] Finished processing BAM request
2018-11-15 22:01:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:01:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519455   8 58437 79269033 A  ERROR'
2018-11-15 22:01:09 [DEBUG   ] Got command BAM from MCS: ref #519454
2018-11-15 22:01:09 [INFO    ] Finished processing BAM request
2018-11-15 22:01:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:01:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519454   8 58437 79269037 A  ERROR'
2018-11-15 22:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 22:01:09 [DEBUG   ] spawn_process: at 2018-11-15 22:01:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 22:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 22:01:09 [DEBUG   ] spawn_process: at 2018-11-15 22:01:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 22:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 22:01:09 [DEBUG   ] spawn_process: at 2018-11-15 22:01:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 22:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 22:01:09 [DEBUG   ] spawn_process: at 2018-11-15 22:01:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 22:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 22:01:09 [DEBUG   ] spawn_process: at 2018-11-15 22:01:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 22:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 22:01:09 [DEBUG   ] spawn_process: at 2018-11-15 22:01:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 22:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 22:01:09 [DEBUG   ] spawn_process: at 2018-11-15 22:01:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 22:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 22:01:09 [DEBUG   ] spawn_process: at 2018-11-15 22:01:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 22:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 22:01:09 [DEBUG   ] spawn_process: at 2018-11-15 22:01:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 22:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 22:01:09 [DEBUG   ] spawn_process: at 2018-11-15 22:01:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 22:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 22:01:09 [DEBUG   ] spawn_process: at 2018-11-15 22:01:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 22:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 22:01:09 [DEBUG   ] spawn_process: at 2018-11-15 22:01:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 22:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 22:01:09 [DEBUG   ] spawn_process: at 2018-11-15 22:01:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 22:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 22:01:09 [DEBUG   ] spawn_process: at 2018-11-15 22:01:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 22:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 22:01:09 [DEBUG   ] spawn_process: at 2018-11-15 22:01:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 22:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 22:01:09 [DEBUG   ] spawn_process: at 2018-11-15 22:01:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 22:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 22:01:09 [DEBUG   ] spawn_process: at 2018-11-15 22:01:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 22:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 22:01:09 [DEBUG   ] spawn_process: at 2018-11-15 22:01:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 22:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 22:01:09 [DEBUG   ] spawn_process: at 2018-11-15 22:01:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 22:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 22:01:09 [DEBUG   ] spawn_process: at 2018-11-15 22:01:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 22:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 22:01:09 [DEBUG   ] spawn_process: at 2018-11-15 22:01:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 22:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 22:01:09 [DEBUG   ] spawn_process: at 2018-11-15 22:01:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 22:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 22:01:09 [DEBUG   ] spawn_process: at 2018-11-15 22:01:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 22:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 22:01:09 [DEBUG   ] spawn_process: at 2018-11-15 22:01:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 22:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 22:01:09 [DEBUG   ] spawn_process: at 2018-11-15 22:01:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 22:01:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 22:01:09 [DEBUG   ] spawn_process: at 2018-11-15 22:01:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 22:01:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:01:25 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 22:01:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 22:01:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 22:01:25 [WARNING ] (13, 1, 'bot')
2018-11-15 22:01:25 [WARNING ] (13, 1, 'bot')
2018-11-15 22:01:25 [WARNING ] (13, 1, 'bot')
2018-11-15 22:01:25 [WARNING ] (13, 1, 'bot')
2018-11-15 22:01:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 22:01:25 [DEBUG   ] Finished updating board flags in 1.183 seconds
2018-11-15 22:01:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 22:01:32 [DEBUG   ] Got command BAM from MCS: ref #519457
2018-11-15 22:01:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:01:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519457   8 58437 79292029 A  ERROR'
2018-11-15 22:01:32 [DEBUG   ] Got command BAM from MCS: ref #519456
2018-11-15 22:01:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:01:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519456   8 58437 79292033 A  ERROR'
2018-11-15 22:01:32 [INFO    ] Finished processing BAM request
2018-11-15 22:01:32 [INFO    ] Finished processing BAM request
2018-11-15 22:01:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 22:01:32 [DEBUG   ] spawn_process: at 2018-11-15 22:01:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 22:01:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 22:01:32 [DEBUG   ] spawn_process: at 2018-11-15 22:01:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 22:01:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 22:01:32 [DEBUG   ] spawn_process: at 2018-11-15 22:01:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 22:01:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 22:01:32 [DEBUG   ] spawn_process: at 2018-11-15 22:01:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 22:01:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 22:01:32 [DEBUG   ] spawn_process: at 2018-11-15 22:01:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 22:01:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 22:01:32 [DEBUG   ] spawn_process: at 2018-11-15 22:01:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 22:01:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 22:01:32 [DEBUG   ] spawn_process: at 2018-11-15 22:01:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 22:01:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 22:01:32 [DEBUG   ] spawn_process: at 2018-11-15 22:01:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 22:01:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 22:01:32 [DEBUG   ] spawn_process: at 2018-11-15 22:01:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 22:01:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 22:01:32 [DEBUG   ] spawn_process: at 2018-11-15 22:01:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 22:01:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 22:01:32 [DEBUG   ] spawn_process: at 2018-11-15 22:01:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 22:01:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 22:01:32 [DEBUG   ] spawn_process: at 2018-11-15 22:01:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 22:01:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 22:01:32 [DEBUG   ] spawn_process: at 2018-11-15 22:01:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 22:01:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 22:01:32 [DEBUG   ] spawn_process: at 2018-11-15 22:01:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 22:01:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 22:01:32 [DEBUG   ] spawn_process: at 2018-11-15 22:01:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 22:01:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 22:01:32 [DEBUG   ] spawn_process: at 2018-11-15 22:01:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 22:01:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 22:01:32 [DEBUG   ] spawn_process: at 2018-11-15 22:01:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 22:01:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 22:01:32 [DEBUG   ] spawn_process: at 2018-11-15 22:01:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 22:01:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 22:01:32 [DEBUG   ] spawn_process: at 2018-11-15 22:01:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 22:01:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 22:01:32 [DEBUG   ] spawn_process: at 2018-11-15 22:01:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 22:01:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 22:01:32 [DEBUG   ] spawn_process: at 2018-11-15 22:01:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 22:01:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 22:01:32 [DEBUG   ] spawn_process: at 2018-11-15 22:01:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 22:01:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 22:01:32 [DEBUG   ] spawn_process: at 2018-11-15 22:01:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 22:01:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 22:01:32 [DEBUG   ] spawn_process: at 2018-11-15 22:01:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 22:01:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 22:01:32 [DEBUG   ] spawn_process: at 2018-11-15 22:01:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 22:01:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 22:01:32 [DEBUG   ] spawn_process: at 2018-11-15 22:01:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 22:01:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 22:01:55 [DEBUG   ] Got command BAM from MCS: ref #519458
2018-11-15 22:01:55 [INFO    ] Finished processing BAM request
2018-11-15 22:01:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:01:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519458   8 58437 79315025 A  ERROR'
2018-11-15 22:01:55 [DEBUG   ] Got command BAM from MCS: ref #519459
2018-11-15 22:01:55 [INFO    ] Finished processing BAM request
2018-11-15 22:01:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:01:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519459   8 58437 79315029 A  ERROR'
2018-11-15 22:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 22:01:55 [DEBUG   ] spawn_process: at 2018-11-15 22:01:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 22:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 22:01:55 [DEBUG   ] spawn_process: at 2018-11-15 22:01:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 22:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 22:01:55 [DEBUG   ] spawn_process: at 2018-11-15 22:01:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 22:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 22:01:55 [DEBUG   ] spawn_process: at 2018-11-15 22:01:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 22:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 22:01:55 [DEBUG   ] spawn_process: at 2018-11-15 22:01:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 22:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 22:01:55 [DEBUG   ] spawn_process: at 2018-11-15 22:01:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 22:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 22:01:55 [DEBUG   ] spawn_process: at 2018-11-15 22:01:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 22:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 22:01:55 [DEBUG   ] spawn_process: at 2018-11-15 22:01:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 22:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 22:01:55 [DEBUG   ] spawn_process: at 2018-11-15 22:01:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 22:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 22:01:55 [DEBUG   ] spawn_process: at 2018-11-15 22:01:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 22:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 22:01:55 [DEBUG   ] spawn_process: at 2018-11-15 22:01:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 22:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 22:01:55 [DEBUG   ] spawn_process: at 2018-11-15 22:01:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 22:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 22:01:55 [DEBUG   ] spawn_process: at 2018-11-15 22:01:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 22:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 22:01:55 [DEBUG   ] spawn_process: at 2018-11-15 22:01:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 22:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 22:01:55 [DEBUG   ] spawn_process: at 2018-11-15 22:01:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 22:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 22:01:55 [DEBUG   ] spawn_process: at 2018-11-15 22:01:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 22:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 22:01:55 [DEBUG   ] spawn_process: at 2018-11-15 22:01:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 22:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 22:01:55 [DEBUG   ] spawn_process: at 2018-11-15 22:01:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 22:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 22:01:55 [DEBUG   ] spawn_process: at 2018-11-15 22:01:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 22:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 22:01:55 [DEBUG   ] spawn_process: at 2018-11-15 22:01:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 22:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 22:01:55 [DEBUG   ] spawn_process: at 2018-11-15 22:01:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 22:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 22:01:55 [DEBUG   ] spawn_process: at 2018-11-15 22:01:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 22:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 22:01:55 [DEBUG   ] spawn_process: at 2018-11-15 22:01:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 22:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 22:01:55 [DEBUG   ] spawn_process: at 2018-11-15 22:01:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 22:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 22:01:55 [DEBUG   ] spawn_process: at 2018-11-15 22:01:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 22:01:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 22:01:55 [DEBUG   ] spawn_process: at 2018-11-15 22:01:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 22:02:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 22:02:18 [DEBUG   ] Got command BAM from MCS: ref #519460
2018-11-15 22:02:18 [INFO    ] Finished processing BAM request
2018-11-15 22:02:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:02:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519460   8 58437 79338029 A  ERROR'
2018-11-15 22:02:18 [DEBUG   ] Got command BAM from MCS: ref #519461
2018-11-15 22:02:18 [INFO    ] Finished processing BAM request
2018-11-15 22:02:18 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:02:18 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519461   8 58437 79338033 A  ERROR'
2018-11-15 22:02:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 22:02:18 [DEBUG   ] spawn_process: at 2018-11-15 22:02:18 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 22:02:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 22:02:18 [DEBUG   ] spawn_process: at 2018-11-15 22:02:18 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 22:02:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 22:02:18 [DEBUG   ] spawn_process: at 2018-11-15 22:02:18 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 22:02:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 22:02:18 [DEBUG   ] spawn_process: at 2018-11-15 22:02:18 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 22:02:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 22:02:18 [DEBUG   ] spawn_process: at 2018-11-15 22:02:18 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 22:02:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 22:02:18 [DEBUG   ] spawn_process: at 2018-11-15 22:02:18 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 22:02:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 22:02:18 [DEBUG   ] spawn_process: at 2018-11-15 22:02:18 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 22:02:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 22:02:18 [DEBUG   ] spawn_process: at 2018-11-15 22:02:18 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 22:02:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 22:02:18 [DEBUG   ] spawn_process: at 2018-11-15 22:02:18 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 22:02:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 22:02:18 [DEBUG   ] spawn_process: at 2018-11-15 22:02:18 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 22:02:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 22:02:18 [DEBUG   ] spawn_process: at 2018-11-15 22:02:18 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 22:02:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 22:02:18 [DEBUG   ] spawn_process: at 2018-11-15 22:02:18 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 22:02:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 22:02:18 [DEBUG   ] spawn_process: at 2018-11-15 22:02:18 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 22:02:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 22:02:18 [DEBUG   ] spawn_process: at 2018-11-15 22:02:18 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 22:02:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 22:02:18 [DEBUG   ] spawn_process: at 2018-11-15 22:02:18 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 22:02:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 22:02:18 [DEBUG   ] spawn_process: at 2018-11-15 22:02:18 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 22:02:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 22:02:18 [DEBUG   ] spawn_process: at 2018-11-15 22:02:18 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 22:02:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 22:02:18 [DEBUG   ] spawn_process: at 2018-11-15 22:02:18 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 22:02:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 22:02:18 [DEBUG   ] spawn_process: at 2018-11-15 22:02:18 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 22:02:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 22:02:18 [DEBUG   ] spawn_process: at 2018-11-15 22:02:18 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 22:02:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 22:02:18 [DEBUG   ] spawn_process: at 2018-11-15 22:02:18 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 22:02:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 22:02:18 [DEBUG   ] spawn_process: at 2018-11-15 22:02:18 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 22:02:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 22:02:18 [DEBUG   ] spawn_process: at 2018-11-15 22:02:18 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 22:02:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 22:02:18 [DEBUG   ] spawn_process: at 2018-11-15 22:02:18 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 22:02:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 22:02:18 [DEBUG   ] spawn_process: at 2018-11-15 22:02:18 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 22:02:18 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 22:02:18 [DEBUG   ] spawn_process: at 2018-11-15 22:02:18 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 22:02:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-11-15 22:02:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:02:25 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-15 22:02:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 22:02:25 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 22:02:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 22:02:25 [WARNING ] (13, 1, 'bot')
2018-11-15 22:02:25 [WARNING ] (13, 1, 'bot')
2018-11-15 22:02:25 [WARNING ] (13, 1, 'bot')
2018-11-15 22:02:25 [WARNING ] (13, 1, 'bot')
2018-11-15 22:02:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 22:02:25 [DEBUG   ] Finished updating board flags in 1.024 seconds
2018-11-15 22:02:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 22:02:41 [DEBUG   ] Got command BAM from MCS: ref #519467
2018-11-15 22:02:41 [INFO    ] Finished processing BAM request
2018-11-15 22:02:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:02:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519467   8 58437 79361033 A  ERROR'
2018-11-15 22:02:41 [DEBUG   ] Got command BAM from MCS: ref #519466
2018-11-15 22:02:41 [INFO    ] Finished processing BAM request
2018-11-15 22:02:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:02:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519466   8 58437 79361037 A  ERROR'
2018-11-15 22:02:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 22:02:41 [DEBUG   ] spawn_process: at 2018-11-15 22:02:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 22:02:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 22:02:41 [DEBUG   ] spawn_process: at 2018-11-15 22:02:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 22:02:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 22:02:41 [DEBUG   ] spawn_process: at 2018-11-15 22:02:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 22:02:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 22:02:41 [DEBUG   ] spawn_process: at 2018-11-15 22:02:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 22:02:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 22:02:41 [DEBUG   ] spawn_process: at 2018-11-15 22:02:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 22:02:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 22:02:41 [DEBUG   ] spawn_process: at 2018-11-15 22:02:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 22:02:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 22:02:41 [DEBUG   ] spawn_process: at 2018-11-15 22:02:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 22:02:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 22:02:41 [DEBUG   ] spawn_process: at 2018-11-15 22:02:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 22:02:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 22:02:41 [DEBUG   ] spawn_process: at 2018-11-15 22:02:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 22:02:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 22:02:41 [DEBUG   ] spawn_process: at 2018-11-15 22:02:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 22:02:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 22:02:41 [DEBUG   ] spawn_process: at 2018-11-15 22:02:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 22:02:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 22:02:41 [DEBUG   ] spawn_process: at 2018-11-15 22:02:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 22:02:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 22:02:41 [DEBUG   ] spawn_process: at 2018-11-15 22:02:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 22:02:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 22:02:41 [DEBUG   ] spawn_process: at 2018-11-15 22:02:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 22:02:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 22:02:41 [DEBUG   ] spawn_process: at 2018-11-15 22:02:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 22:02:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 22:02:41 [DEBUG   ] spawn_process: at 2018-11-15 22:02:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 22:02:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 22:02:41 [DEBUG   ] spawn_process: at 2018-11-15 22:02:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 22:02:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 22:02:41 [DEBUG   ] spawn_process: at 2018-11-15 22:02:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 22:02:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 22:02:41 [DEBUG   ] spawn_process: at 2018-11-15 22:02:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 22:02:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 22:02:41 [DEBUG   ] spawn_process: at 2018-11-15 22:02:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 22:02:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 22:02:41 [DEBUG   ] spawn_process: at 2018-11-15 22:02:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 22:02:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 22:02:41 [DEBUG   ] spawn_process: at 2018-11-15 22:02:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 22:02:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 22:02:41 [DEBUG   ] spawn_process: at 2018-11-15 22:02:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 22:02:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 22:02:41 [DEBUG   ] spawn_process: at 2018-11-15 22:02:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 22:02:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 22:02:41 [DEBUG   ] spawn_process: at 2018-11-15 22:02:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 22:02:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 22:02:41 [DEBUG   ] spawn_process: at 2018-11-15 22:02:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 22:02:47 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-15 22:03:04 [DEBUG   ] Got command BAM from MCS: ref #519469
2018-11-15 22:03:04 [INFO    ] Finished processing BAM request
2018-11-15 22:03:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:03:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519469   8 58437 79384025 A  ERROR'
2018-11-15 22:03:04 [DEBUG   ] Got command BAM from MCS: ref #519468
2018-11-15 22:03:04 [INFO    ] Finished processing BAM request
2018-11-15 22:03:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:03:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519468   8 58437 79384029 A  ERROR'
2018-11-15 22:03:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 22:03:04 [DEBUG   ] spawn_process: at 2018-11-15 22:03:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 22:03:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 22:03:04 [DEBUG   ] spawn_process: at 2018-11-15 22:03:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 22:03:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 22:03:04 [DEBUG   ] spawn_process: at 2018-11-15 22:03:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 22:03:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 22:03:04 [DEBUG   ] spawn_process: at 2018-11-15 22:03:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 22:03:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 22:03:04 [DEBUG   ] spawn_process: at 2018-11-15 22:03:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 22:03:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 22:03:04 [DEBUG   ] spawn_process: at 2018-11-15 22:03:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 22:03:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 22:03:04 [DEBUG   ] spawn_process: at 2018-11-15 22:03:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 22:03:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 22:03:04 [DEBUG   ] spawn_process: at 2018-11-15 22:03:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 22:03:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 22:03:04 [DEBUG   ] spawn_process: at 2018-11-15 22:03:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 22:03:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 22:03:04 [DEBUG   ] spawn_process: at 2018-11-15 22:03:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 22:03:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 22:03:04 [DEBUG   ] spawn_process: at 2018-11-15 22:03:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 22:03:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 22:03:04 [DEBUG   ] spawn_process: at 2018-11-15 22:03:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 22:03:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 22:03:04 [DEBUG   ] spawn_process: at 2018-11-15 22:03:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 22:03:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 22:03:04 [DEBUG   ] spawn_process: at 2018-11-15 22:03:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 22:03:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 22:03:04 [DEBUG   ] spawn_process: at 2018-11-15 22:03:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 22:03:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 22:03:04 [DEBUG   ] spawn_process: at 2018-11-15 22:03:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 22:03:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 22:03:04 [DEBUG   ] spawn_process: at 2018-11-15 22:03:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 22:03:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 22:03:04 [DEBUG   ] spawn_process: at 2018-11-15 22:03:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 22:03:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 22:03:04 [DEBUG   ] spawn_process: at 2018-11-15 22:03:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 22:03:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 22:03:04 [DEBUG   ] spawn_process: at 2018-11-15 22:03:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 22:03:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 22:03:04 [DEBUG   ] spawn_process: at 2018-11-15 22:03:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 22:03:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 22:03:04 [DEBUG   ] spawn_process: at 2018-11-15 22:03:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 22:03:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 22:03:04 [DEBUG   ] spawn_process: at 2018-11-15 22:03:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 22:03:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 22:03:04 [DEBUG   ] spawn_process: at 2018-11-15 22:03:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 22:03:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 22:03:04 [DEBUG   ] spawn_process: at 2018-11-15 22:03:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 22:03:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 22:03:04 [DEBUG   ] spawn_process: at 2018-11-15 22:03:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 22:03:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 22:03:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-11-15 22:03:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 22:03:25 [DEBUG   ] Got command RPT from MCS: ref #519470
2018-11-15 22:03:25 [DEBUG   ] summary = ERROR
2018-11-15 22:03:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519470  13 58437 79405269 A  ERRORERROR'
2018-11-15 22:03:25 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 22:03:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:03:25 [DEBUG   ] Got command RPT from MCS: ref #519471
2018-11-15 22:03:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 22:03:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519471  77 58437 79405470 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 22:03:25 [DEBUG   ] Got command RPT from MCS: ref #519472
2018-11-15 22:03:25 [DEBUG   ] summary = ERROR
2018-11-15 22:03:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519472  13 58437 79405665 A  ERRORERROR'
2018-11-15 22:03:25 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 22:03:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 22:03:25 [DEBUG   ] Got command RPT from MCS: ref #519473
2018-11-15 22:03:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 22:03:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519473  77 58437 79405874 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 22:03:25 [WARNING ] (13, 1, 'bot')
2018-11-15 22:03:25 [WARNING ] (13, 1, 'bot')
2018-11-15 22:03:25 [WARNING ] (13, 1, 'bot')
2018-11-15 22:03:25 [WARNING ] (13, 1, 'bot')
2018-11-15 22:03:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 22:03:25 [DEBUG   ] Finished updating board flags in 1.007 seconds
2018-11-15 22:03:26 [DEBUG   ] Got command RPT from MCS: ref #519476
2018-11-15 22:03:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 22:03:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519476  12 58437 79406065 A  ERRORB£ff'
2018-11-15 22:03:27 [DEBUG   ] Got command BAM from MCS: ref #519474
2018-11-15 22:03:27 [INFO    ] Finished processing BAM request
2018-11-15 22:03:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:03:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519474   8 58437 79407029 A  ERROR'
2018-11-15 22:03:27 [DEBUG   ] Got command BAM from MCS: ref #519475
2018-11-15 22:03:27 [INFO    ] Finished processing BAM request
2018-11-15 22:03:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:03:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519475   8 58437 79407033 A  ERROR'
2018-11-15 22:03:27 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-15 22:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 22:03:27 [DEBUG   ] spawn_process: at 2018-11-15 22:03:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 22:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 22:03:27 [DEBUG   ] spawn_process: at 2018-11-15 22:03:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 22:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 22:03:27 [DEBUG   ] spawn_process: at 2018-11-15 22:03:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 22:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 22:03:27 [DEBUG   ] spawn_process: at 2018-11-15 22:03:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 22:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 22:03:27 [DEBUG   ] spawn_process: at 2018-11-15 22:03:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 22:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 22:03:27 [DEBUG   ] spawn_process: at 2018-11-15 22:03:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 22:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 22:03:27 [DEBUG   ] spawn_process: at 2018-11-15 22:03:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 22:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 22:03:27 [DEBUG   ] spawn_process: at 2018-11-15 22:03:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 22:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 22:03:27 [DEBUG   ] spawn_process: at 2018-11-15 22:03:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 22:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 22:03:27 [DEBUG   ] spawn_process: at 2018-11-15 22:03:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 22:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 22:03:27 [DEBUG   ] spawn_process: at 2018-11-15 22:03:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 22:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 22:03:27 [DEBUG   ] spawn_process: at 2018-11-15 22:03:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 22:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 22:03:27 [DEBUG   ] spawn_process: at 2018-11-15 22:03:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 22:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 22:03:27 [DEBUG   ] spawn_process: at 2018-11-15 22:03:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 22:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 22:03:27 [DEBUG   ] spawn_process: at 2018-11-15 22:03:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 22:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 22:03:27 [DEBUG   ] spawn_process: at 2018-11-15 22:03:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 22:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 22:03:27 [DEBUG   ] spawn_process: at 2018-11-15 22:03:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 22:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 22:03:27 [DEBUG   ] spawn_process: at 2018-11-15 22:03:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 22:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 22:03:27 [DEBUG   ] spawn_process: at 2018-11-15 22:03:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 22:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 22:03:27 [DEBUG   ] spawn_process: at 2018-11-15 22:03:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 22:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 22:03:27 [DEBUG   ] spawn_process: at 2018-11-15 22:03:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 22:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 22:03:27 [DEBUG   ] spawn_process: at 2018-11-15 22:03:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 22:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 22:03:27 [DEBUG   ] spawn_process: at 2018-11-15 22:03:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 22:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 22:03:27 [DEBUG   ] spawn_process: at 2018-11-15 22:03:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 22:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 22:03:27 [DEBUG   ] spawn_process: at 2018-11-15 22:03:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 22:03:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 22:03:27 [DEBUG   ] spawn_process: at 2018-11-15 22:03:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 22:03:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 22:03:50 [DEBUG   ] Got command BAM from MCS: ref #519478
2018-11-15 22:03:50 [INFO    ] Finished processing BAM request
2018-11-15 22:03:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:03:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519478   8 58437 79430029 A  ERROR'
2018-11-15 22:03:50 [DEBUG   ] Got command BAM from MCS: ref #519477
2018-11-15 22:03:50 [INFO    ] Finished processing BAM request
2018-11-15 22:03:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:03:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519477   8 58437 79430033 A  ERROR'
2018-11-15 22:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 22:03:50 [DEBUG   ] spawn_process: at 2018-11-15 22:03:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 22:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 22:03:50 [DEBUG   ] spawn_process: at 2018-11-15 22:03:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 22:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 22:03:50 [DEBUG   ] spawn_process: at 2018-11-15 22:03:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 22:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 22:03:50 [DEBUG   ] spawn_process: at 2018-11-15 22:03:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 22:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 22:03:50 [DEBUG   ] spawn_process: at 2018-11-15 22:03:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 22:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 22:03:50 [DEBUG   ] spawn_process: at 2018-11-15 22:03:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 22:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 22:03:50 [DEBUG   ] spawn_process: at 2018-11-15 22:03:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 22:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 22:03:50 [DEBUG   ] spawn_process: at 2018-11-15 22:03:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 22:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 22:03:50 [DEBUG   ] spawn_process: at 2018-11-15 22:03:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 22:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 22:03:50 [DEBUG   ] spawn_process: at 2018-11-15 22:03:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 22:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 22:03:50 [DEBUG   ] spawn_process: at 2018-11-15 22:03:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 22:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 22:03:50 [DEBUG   ] spawn_process: at 2018-11-15 22:03:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 22:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 22:03:50 [DEBUG   ] spawn_process: at 2018-11-15 22:03:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 22:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 22:03:50 [DEBUG   ] spawn_process: at 2018-11-15 22:03:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 22:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 22:03:50 [DEBUG   ] spawn_process: at 2018-11-15 22:03:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 22:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 22:03:50 [DEBUG   ] spawn_process: at 2018-11-15 22:03:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 22:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 22:03:50 [DEBUG   ] spawn_process: at 2018-11-15 22:03:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 22:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 22:03:50 [DEBUG   ] spawn_process: at 2018-11-15 22:03:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 22:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 22:03:50 [DEBUG   ] spawn_process: at 2018-11-15 22:03:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 22:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 22:03:50 [DEBUG   ] spawn_process: at 2018-11-15 22:03:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 22:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 22:03:50 [DEBUG   ] spawn_process: at 2018-11-15 22:03:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 22:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 22:03:50 [DEBUG   ] spawn_process: at 2018-11-15 22:03:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 22:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 22:03:50 [DEBUG   ] spawn_process: at 2018-11-15 22:03:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 22:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 22:03:50 [DEBUG   ] spawn_process: at 2018-11-15 22:03:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 22:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 22:03:50 [DEBUG   ] spawn_process: at 2018-11-15 22:03:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 22:03:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 22:03:50 [DEBUG   ] spawn_process: at 2018-11-15 22:03:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 22:04:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 22:04:13 [DEBUG   ] Got command BAM from MCS: ref #519480
2018-11-15 22:04:13 [INFO    ] Finished processing BAM request
2018-11-15 22:04:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:04:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519480   8 58437 79453029 A  ERROR'
2018-11-15 22:04:13 [DEBUG   ] Got command BAM from MCS: ref #519479
2018-11-15 22:04:13 [INFO    ] Finished processing BAM request
2018-11-15 22:04:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:04:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519479   8 58437 79453033 A  ERROR'
2018-11-15 22:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 22:04:13 [DEBUG   ] spawn_process: at 2018-11-15 22:04:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 22:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 22:04:13 [DEBUG   ] spawn_process: at 2018-11-15 22:04:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 22:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 22:04:13 [DEBUG   ] spawn_process: at 2018-11-15 22:04:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 22:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 22:04:13 [DEBUG   ] spawn_process: at 2018-11-15 22:04:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 22:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 22:04:13 [DEBUG   ] spawn_process: at 2018-11-15 22:04:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 22:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 22:04:13 [DEBUG   ] spawn_process: at 2018-11-15 22:04:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 22:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 22:04:13 [DEBUG   ] spawn_process: at 2018-11-15 22:04:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 22:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 22:04:13 [DEBUG   ] spawn_process: at 2018-11-15 22:04:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 22:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 22:04:13 [DEBUG   ] spawn_process: at 2018-11-15 22:04:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 22:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 22:04:13 [DEBUG   ] spawn_process: at 2018-11-15 22:04:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 22:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 22:04:13 [DEBUG   ] spawn_process: at 2018-11-15 22:04:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 22:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 22:04:13 [DEBUG   ] spawn_process: at 2018-11-15 22:04:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 22:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 22:04:13 [DEBUG   ] spawn_process: at 2018-11-15 22:04:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 22:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 22:04:13 [DEBUG   ] spawn_process: at 2018-11-15 22:04:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 22:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 22:04:13 [DEBUG   ] spawn_process: at 2018-11-15 22:04:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 22:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 22:04:13 [DEBUG   ] spawn_process: at 2018-11-15 22:04:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 22:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 22:04:13 [DEBUG   ] spawn_process: at 2018-11-15 22:04:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 22:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 22:04:13 [DEBUG   ] spawn_process: at 2018-11-15 22:04:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 22:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 22:04:13 [DEBUG   ] spawn_process: at 2018-11-15 22:04:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 22:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 22:04:13 [DEBUG   ] spawn_process: at 2018-11-15 22:04:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 22:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 22:04:13 [DEBUG   ] spawn_process: at 2018-11-15 22:04:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 22:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 22:04:13 [DEBUG   ] spawn_process: at 2018-11-15 22:04:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 22:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 22:04:13 [DEBUG   ] spawn_process: at 2018-11-15 22:04:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 22:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 22:04:13 [DEBUG   ] spawn_process: at 2018-11-15 22:04:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 22:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 22:04:13 [DEBUG   ] spawn_process: at 2018-11-15 22:04:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 22:04:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 22:04:13 [DEBUG   ] spawn_process: at 2018-11-15 22:04:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 22:04:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 22:04:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:04:25 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 22:04:25 [WARNING ] (13, 1, 'bot')
2018-11-15 22:04:25 [WARNING ] (13, 1, 'bot')
2018-11-15 22:04:25 [WARNING ] (13, 1, 'bot')
2018-11-15 22:04:25 [WARNING ] (13, 1, 'bot')
2018-11-15 22:04:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 22:04:25 [DEBUG   ] Finished updating board flags in 1.019 seconds
2018-11-15 22:04:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 22:04:36 [DEBUG   ] Got command BAM from MCS: ref #519482
2018-11-15 22:04:36 [INFO    ] Finished processing BAM request
2018-11-15 22:04:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:04:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519482   8 58437 79476033 A  ERROR'
2018-11-15 22:04:36 [DEBUG   ] Got command BAM from MCS: ref #519481
2018-11-15 22:04:36 [INFO    ] Finished processing BAM request
2018-11-15 22:04:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:04:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519481   8 58437 79476037 A  ERROR'
2018-11-15 22:04:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 22:04:36 [DEBUG   ] spawn_process: at 2018-11-15 22:04:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 22:04:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 22:04:37 [DEBUG   ] spawn_process: at 2018-11-15 22:04:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 22:04:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 22:04:37 [DEBUG   ] spawn_process: at 2018-11-15 22:04:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 22:04:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 22:04:37 [DEBUG   ] spawn_process: at 2018-11-15 22:04:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 22:04:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 22:04:37 [DEBUG   ] spawn_process: at 2018-11-15 22:04:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 22:04:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 22:04:37 [DEBUG   ] spawn_process: at 2018-11-15 22:04:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 22:04:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 22:04:37 [DEBUG   ] spawn_process: at 2018-11-15 22:04:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 22:04:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 22:04:37 [DEBUG   ] spawn_process: at 2018-11-15 22:04:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 22:04:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 22:04:37 [DEBUG   ] spawn_process: at 2018-11-15 22:04:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 22:04:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 22:04:37 [DEBUG   ] spawn_process: at 2018-11-15 22:04:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 22:04:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 22:04:37 [DEBUG   ] spawn_process: at 2018-11-15 22:04:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 22:04:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 22:04:37 [DEBUG   ] spawn_process: at 2018-11-15 22:04:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 22:04:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 22:04:37 [DEBUG   ] spawn_process: at 2018-11-15 22:04:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 22:04:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 22:04:37 [DEBUG   ] spawn_process: at 2018-11-15 22:04:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 22:04:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 22:04:37 [DEBUG   ] spawn_process: at 2018-11-15 22:04:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 22:04:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 22:04:37 [DEBUG   ] spawn_process: at 2018-11-15 22:04:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 22:04:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 22:04:37 [DEBUG   ] spawn_process: at 2018-11-15 22:04:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 22:04:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 22:04:37 [DEBUG   ] spawn_process: at 2018-11-15 22:04:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 22:04:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 22:04:37 [DEBUG   ] spawn_process: at 2018-11-15 22:04:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 22:04:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 22:04:37 [DEBUG   ] spawn_process: at 2018-11-15 22:04:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 22:04:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 22:04:37 [DEBUG   ] spawn_process: at 2018-11-15 22:04:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 22:04:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 22:04:37 [DEBUG   ] spawn_process: at 2018-11-15 22:04:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 22:04:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 22:04:37 [DEBUG   ] spawn_process: at 2018-11-15 22:04:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 22:04:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 22:04:37 [DEBUG   ] spawn_process: at 2018-11-15 22:04:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 22:04:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 22:04:37 [DEBUG   ] spawn_process: at 2018-11-15 22:04:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 22:04:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 22:04:37 [DEBUG   ] spawn_process: at 2018-11-15 22:04:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 22:04:47 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 22:04:59 [DEBUG   ] Got command BAM from MCS: ref #519484
2018-11-15 22:04:59 [INFO    ] Finished processing BAM request
2018-11-15 22:04:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:04:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519484   8 58437 79499026 A  ERROR'
2018-11-15 22:04:59 [DEBUG   ] Got command BAM from MCS: ref #519483
2018-11-15 22:04:59 [INFO    ] Finished processing BAM request
2018-11-15 22:04:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:04:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519483   8 58437 79499030 A  ERROR'
2018-11-15 22:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 22:04:59 [DEBUG   ] spawn_process: at 2018-11-15 22:04:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 22:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 22:04:59 [DEBUG   ] spawn_process: at 2018-11-15 22:04:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 22:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 22:04:59 [DEBUG   ] spawn_process: at 2018-11-15 22:04:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 22:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 22:04:59 [DEBUG   ] spawn_process: at 2018-11-15 22:04:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 22:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 22:04:59 [DEBUG   ] spawn_process: at 2018-11-15 22:04:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 22:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 22:04:59 [DEBUG   ] spawn_process: at 2018-11-15 22:04:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 22:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 22:04:59 [DEBUG   ] spawn_process: at 2018-11-15 22:04:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 22:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 22:04:59 [DEBUG   ] spawn_process: at 2018-11-15 22:04:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 22:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 22:04:59 [DEBUG   ] spawn_process: at 2018-11-15 22:04:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 22:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 22:04:59 [DEBUG   ] spawn_process: at 2018-11-15 22:04:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 22:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 22:04:59 [DEBUG   ] spawn_process: at 2018-11-15 22:04:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 22:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 22:04:59 [DEBUG   ] spawn_process: at 2018-11-15 22:04:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 22:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 22:04:59 [DEBUG   ] spawn_process: at 2018-11-15 22:04:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 22:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 22:04:59 [DEBUG   ] spawn_process: at 2018-11-15 22:04:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 22:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 22:04:59 [DEBUG   ] spawn_process: at 2018-11-15 22:04:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 22:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 22:04:59 [DEBUG   ] spawn_process: at 2018-11-15 22:04:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 22:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 22:04:59 [DEBUG   ] spawn_process: at 2018-11-15 22:04:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 22:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 22:04:59 [DEBUG   ] spawn_process: at 2018-11-15 22:04:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 22:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 22:04:59 [DEBUG   ] spawn_process: at 2018-11-15 22:04:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 22:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 22:04:59 [DEBUG   ] spawn_process: at 2018-11-15 22:04:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 22:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 22:04:59 [DEBUG   ] spawn_process: at 2018-11-15 22:04:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 22:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 22:04:59 [DEBUG   ] spawn_process: at 2018-11-15 22:04:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 22:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 22:04:59 [DEBUG   ] spawn_process: at 2018-11-15 22:04:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 22:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 22:04:59 [DEBUG   ] spawn_process: at 2018-11-15 22:04:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 22:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 22:04:59 [DEBUG   ] spawn_process: at 2018-11-15 22:04:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 22:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 22:04:59 [DEBUG   ] spawn_process: at 2018-11-15 22:04:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 22:05:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 22:05:22 [DEBUG   ] Got command BAM from MCS: ref #519485
2018-11-15 22:05:22 [INFO    ] Finished processing BAM request
2018-11-15 22:05:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:05:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519485   8 58437 79522025 A  ERROR'
2018-11-15 22:05:22 [DEBUG   ] Got command BAM from MCS: ref #519486
2018-11-15 22:05:22 [INFO    ] Finished processing BAM request
2018-11-15 22:05:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:05:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519486   8 58437 79522029 A  ERROR'
2018-11-15 22:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 22:05:22 [DEBUG   ] spawn_process: at 2018-11-15 22:05:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 22:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 22:05:22 [DEBUG   ] spawn_process: at 2018-11-15 22:05:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 22:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 22:05:22 [DEBUG   ] spawn_process: at 2018-11-15 22:05:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 22:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 22:05:22 [DEBUG   ] spawn_process: at 2018-11-15 22:05:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 22:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 22:05:22 [DEBUG   ] spawn_process: at 2018-11-15 22:05:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 22:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 22:05:22 [DEBUG   ] spawn_process: at 2018-11-15 22:05:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 22:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 22:05:22 [DEBUG   ] spawn_process: at 2018-11-15 22:05:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 22:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 22:05:22 [DEBUG   ] spawn_process: at 2018-11-15 22:05:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 22:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 22:05:22 [DEBUG   ] spawn_process: at 2018-11-15 22:05:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 22:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 22:05:22 [DEBUG   ] spawn_process: at 2018-11-15 22:05:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 22:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 22:05:22 [DEBUG   ] spawn_process: at 2018-11-15 22:05:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 22:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 22:05:22 [DEBUG   ] spawn_process: at 2018-11-15 22:05:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 22:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 22:05:22 [DEBUG   ] spawn_process: at 2018-11-15 22:05:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 22:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 22:05:22 [DEBUG   ] spawn_process: at 2018-11-15 22:05:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 22:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 22:05:22 [DEBUG   ] spawn_process: at 2018-11-15 22:05:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 22:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 22:05:22 [DEBUG   ] spawn_process: at 2018-11-15 22:05:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 22:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 22:05:22 [DEBUG   ] spawn_process: at 2018-11-15 22:05:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 22:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 22:05:22 [DEBUG   ] spawn_process: at 2018-11-15 22:05:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 22:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 22:05:22 [DEBUG   ] spawn_process: at 2018-11-15 22:05:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 22:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 22:05:22 [DEBUG   ] spawn_process: at 2018-11-15 22:05:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 22:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 22:05:22 [DEBUG   ] spawn_process: at 2018-11-15 22:05:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 22:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 22:05:22 [DEBUG   ] spawn_process: at 2018-11-15 22:05:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 22:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 22:05:22 [DEBUG   ] spawn_process: at 2018-11-15 22:05:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 22:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 22:05:22 [DEBUG   ] spawn_process: at 2018-11-15 22:05:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 22:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 22:05:22 [DEBUG   ] spawn_process: at 2018-11-15 22:05:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 22:05:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 22:05:22 [DEBUG   ] spawn_process: at 2018-11-15 22:05:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 22:05:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:05:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-15 22:05:25 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 22:05:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 22:05:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 22:05:25 [WARNING ] (13, 1, 'bot')
2018-11-15 22:05:25 [WARNING ] (13, 1, 'bot')
2018-11-15 22:05:25 [WARNING ] (13, 1, 'bot')
2018-11-15 22:05:25 [WARNING ] (13, 1, 'bot')
2018-11-15 22:05:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 22:05:25 [DEBUG   ] Finished updating board flags in 0.967 seconds
2018-11-15 22:05:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 22:05:45 [DEBUG   ] Got command BAM from MCS: ref #519492
2018-11-15 22:05:45 [INFO    ] Finished processing BAM request
2018-11-15 22:05:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:05:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519492   8 58437 79545025 A  ERROR'
2018-11-15 22:05:45 [DEBUG   ] Got command BAM from MCS: ref #519491
2018-11-15 22:05:45 [INFO    ] Finished processing BAM request
2018-11-15 22:05:45 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:05:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519491   8 58437 79545029 A  ERROR'
2018-11-15 22:05:45 [DEBUG   ] Got command RPT from MCS: ref #519493
2018-11-15 22:05:45 [DEBUG   ] summary = ERROR
2018-11-15 22:05:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519493  13 58437 79545209 A  ERRORERROR'
2018-11-15 22:05:45 [DEBUG   ] Got command RPT from MCS: ref #519494
2018-11-15 22:05:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 22:05:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519494  77 58437 79545210 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 22:05:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 22:05:45 [DEBUG   ] spawn_process: at 2018-11-15 22:05:45 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 22:05:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 22:05:45 [DEBUG   ] spawn_process: at 2018-11-15 22:05:45 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 22:05:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 22:05:45 [DEBUG   ] spawn_process: at 2018-11-15 22:05:45 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 22:05:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 22:05:45 [DEBUG   ] spawn_process: at 2018-11-15 22:05:45 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 22:05:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 22:05:45 [DEBUG   ] spawn_process: at 2018-11-15 22:05:45 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 22:05:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 22:05:45 [DEBUG   ] spawn_process: at 2018-11-15 22:05:45 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 22:05:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 22:05:45 [DEBUG   ] spawn_process: at 2018-11-15 22:05:45 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 22:05:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 22:05:45 [DEBUG   ] spawn_process: at 2018-11-15 22:05:45 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 22:05:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 22:05:45 [DEBUG   ] spawn_process: at 2018-11-15 22:05:45 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 22:05:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 22:05:45 [DEBUG   ] spawn_process: at 2018-11-15 22:05:45 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 22:05:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 22:05:45 [DEBUG   ] spawn_process: at 2018-11-15 22:05:45 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 22:05:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 22:05:45 [DEBUG   ] spawn_process: at 2018-11-15 22:05:45 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 22:05:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 22:05:45 [DEBUG   ] spawn_process: at 2018-11-15 22:05:45 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 22:05:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 22:05:45 [DEBUG   ] spawn_process: at 2018-11-15 22:05:45 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 22:05:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 22:05:45 [DEBUG   ] spawn_process: at 2018-11-15 22:05:45 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 22:05:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 22:05:45 [DEBUG   ] spawn_process: at 2018-11-15 22:05:45 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 22:05:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 22:05:45 [DEBUG   ] spawn_process: at 2018-11-15 22:05:45 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 22:05:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 22:05:45 [DEBUG   ] spawn_process: at 2018-11-15 22:05:45 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 22:05:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 22:05:45 [DEBUG   ] spawn_process: at 2018-11-15 22:05:45 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 22:05:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 22:05:45 [DEBUG   ] spawn_process: at 2018-11-15 22:05:45 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 22:05:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 22:05:45 [DEBUG   ] spawn_process: at 2018-11-15 22:05:45 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 22:05:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 22:05:45 [DEBUG   ] spawn_process: at 2018-11-15 22:05:45 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 22:05:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 22:05:45 [DEBUG   ] spawn_process: at 2018-11-15 22:05:45 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 22:05:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 22:05:45 [DEBUG   ] spawn_process: at 2018-11-15 22:05:45 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 22:05:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 22:05:45 [DEBUG   ] spawn_process: at 2018-11-15 22:05:45 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 22:05:45 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 22:05:45 [DEBUG   ] spawn_process: at 2018-11-15 22:05:45 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 22:05:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 22:06:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 22:06:08 [DEBUG   ] Got command BAM from MCS: ref #519510
2018-11-15 22:06:08 [INFO    ] Finished processing BAM request
2018-11-15 22:06:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:06:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519510   8 58437 79568025 A  ERROR'
2018-11-15 22:06:08 [DEBUG   ] Got command BAM from MCS: ref #519511
2018-11-15 22:06:08 [INFO    ] Finished processing BAM request
2018-11-15 22:06:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:06:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519511   8 58437 79568029 A  ERROR'
2018-11-15 22:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 22:06:08 [DEBUG   ] spawn_process: at 2018-11-15 22:06:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 22:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 22:06:08 [DEBUG   ] spawn_process: at 2018-11-15 22:06:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 22:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 22:06:08 [DEBUG   ] spawn_process: at 2018-11-15 22:06:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 22:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 22:06:08 [DEBUG   ] spawn_process: at 2018-11-15 22:06:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 22:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 22:06:08 [DEBUG   ] spawn_process: at 2018-11-15 22:06:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 22:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 22:06:08 [DEBUG   ] spawn_process: at 2018-11-15 22:06:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 22:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 22:06:08 [DEBUG   ] spawn_process: at 2018-11-15 22:06:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 22:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 22:06:08 [DEBUG   ] spawn_process: at 2018-11-15 22:06:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 22:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 22:06:08 [DEBUG   ] spawn_process: at 2018-11-15 22:06:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 22:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 22:06:08 [DEBUG   ] spawn_process: at 2018-11-15 22:06:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 22:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 22:06:08 [DEBUG   ] spawn_process: at 2018-11-15 22:06:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 22:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 22:06:08 [DEBUG   ] spawn_process: at 2018-11-15 22:06:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 22:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 22:06:08 [DEBUG   ] spawn_process: at 2018-11-15 22:06:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 22:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 22:06:08 [DEBUG   ] spawn_process: at 2018-11-15 22:06:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 22:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 22:06:08 [DEBUG   ] spawn_process: at 2018-11-15 22:06:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 22:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 22:06:08 [DEBUG   ] spawn_process: at 2018-11-15 22:06:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 22:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 22:06:08 [DEBUG   ] spawn_process: at 2018-11-15 22:06:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 22:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 22:06:08 [DEBUG   ] spawn_process: at 2018-11-15 22:06:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 22:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 22:06:08 [DEBUG   ] spawn_process: at 2018-11-15 22:06:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 22:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 22:06:08 [DEBUG   ] spawn_process: at 2018-11-15 22:06:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 22:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 22:06:08 [DEBUG   ] spawn_process: at 2018-11-15 22:06:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 22:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 22:06:08 [DEBUG   ] spawn_process: at 2018-11-15 22:06:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 22:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 22:06:08 [DEBUG   ] spawn_process: at 2018-11-15 22:06:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 22:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 22:06:08 [DEBUG   ] spawn_process: at 2018-11-15 22:06:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 22:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 22:06:08 [DEBUG   ] spawn_process: at 2018-11-15 22:06:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 22:06:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 22:06:08 [DEBUG   ] spawn_process: at 2018-11-15 22:06:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 22:06:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-11-15 22:06:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 22:06:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:06:26 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 22:06:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 5
2018-11-15 22:06:26 [WARNING ] (13, 1, 'bot')
2018-11-15 22:06:26 [WARNING ] (13, 1, 'bot')
2018-11-15 22:06:26 [WARNING ] (13, 1, 'bot')
2018-11-15 22:06:26 [WARNING ] (13, 1, 'bot')
2018-11-15 22:06:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 22:06:26 [DEBUG   ] Finished updating board flags in 1.361 seconds
2018-11-15 22:06:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 22:06:31 [DEBUG   ] Got command BAM from MCS: ref #519512
2018-11-15 22:06:31 [INFO    ] Finished processing BAM request
2018-11-15 22:06:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:06:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519512   8 58437 79591029 A  ERROR'
2018-11-15 22:06:31 [DEBUG   ] Got command BAM from MCS: ref #519513
2018-11-15 22:06:31 [INFO    ] Finished processing BAM request
2018-11-15 22:06:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:06:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519513   8 58437 79591033 A  ERROR'
2018-11-15 22:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 22:06:31 [DEBUG   ] spawn_process: at 2018-11-15 22:06:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 22:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 22:06:31 [DEBUG   ] spawn_process: at 2018-11-15 22:06:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 22:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 22:06:31 [DEBUG   ] spawn_process: at 2018-11-15 22:06:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 22:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 22:06:31 [DEBUG   ] spawn_process: at 2018-11-15 22:06:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 22:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 22:06:31 [DEBUG   ] spawn_process: at 2018-11-15 22:06:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 22:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 22:06:31 [DEBUG   ] spawn_process: at 2018-11-15 22:06:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 22:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 22:06:31 [DEBUG   ] spawn_process: at 2018-11-15 22:06:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 22:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 22:06:31 [DEBUG   ] spawn_process: at 2018-11-15 22:06:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 22:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 22:06:31 [DEBUG   ] spawn_process: at 2018-11-15 22:06:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 22:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 22:06:31 [DEBUG   ] spawn_process: at 2018-11-15 22:06:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 22:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 22:06:31 [DEBUG   ] spawn_process: at 2018-11-15 22:06:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 22:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 22:06:31 [DEBUG   ] spawn_process: at 2018-11-15 22:06:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 22:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 22:06:31 [DEBUG   ] spawn_process: at 2018-11-15 22:06:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 22:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 22:06:31 [DEBUG   ] spawn_process: at 2018-11-15 22:06:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 22:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 22:06:31 [DEBUG   ] spawn_process: at 2018-11-15 22:06:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 22:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 22:06:31 [DEBUG   ] spawn_process: at 2018-11-15 22:06:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 22:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 22:06:31 [DEBUG   ] spawn_process: at 2018-11-15 22:06:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 22:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 22:06:31 [DEBUG   ] spawn_process: at 2018-11-15 22:06:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 22:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 22:06:31 [DEBUG   ] spawn_process: at 2018-11-15 22:06:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 22:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 22:06:31 [DEBUG   ] spawn_process: at 2018-11-15 22:06:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 22:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 22:06:31 [DEBUG   ] spawn_process: at 2018-11-15 22:06:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 22:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 22:06:31 [DEBUG   ] spawn_process: at 2018-11-15 22:06:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 22:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 22:06:31 [DEBUG   ] spawn_process: at 2018-11-15 22:06:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 22:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 22:06:31 [DEBUG   ] spawn_process: at 2018-11-15 22:06:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 22:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 22:06:31 [DEBUG   ] spawn_process: at 2018-11-15 22:06:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 22:06:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 22:06:31 [DEBUG   ] spawn_process: at 2018-11-15 22:06:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 22:06:47 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 22:06:54 [DEBUG   ] Got command BAM from MCS: ref #519514
2018-11-15 22:06:54 [INFO    ] Finished processing BAM request
2018-11-15 22:06:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:06:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519514   8 58437 79614025 A  ERROR'
2018-11-15 22:06:54 [DEBUG   ] Got command BAM from MCS: ref #519515
2018-11-15 22:06:54 [INFO    ] Finished processing BAM request
2018-11-15 22:06:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:06:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519515   8 58437 79614029 A  ERROR'
2018-11-15 22:06:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 22:06:54 [DEBUG   ] spawn_process: at 2018-11-15 22:06:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 22:06:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 22:06:54 [DEBUG   ] spawn_process: at 2018-11-15 22:06:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 22:06:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 22:06:54 [DEBUG   ] spawn_process: at 2018-11-15 22:06:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 22:06:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 22:06:54 [DEBUG   ] spawn_process: at 2018-11-15 22:06:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 22:06:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 22:06:54 [DEBUG   ] spawn_process: at 2018-11-15 22:06:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 22:06:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 22:06:54 [DEBUG   ] spawn_process: at 2018-11-15 22:06:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 22:06:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 22:06:54 [DEBUG   ] spawn_process: at 2018-11-15 22:06:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 22:06:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 22:06:54 [DEBUG   ] spawn_process: at 2018-11-15 22:06:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 22:06:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 22:06:54 [DEBUG   ] spawn_process: at 2018-11-15 22:06:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 22:06:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 22:06:54 [DEBUG   ] spawn_process: at 2018-11-15 22:06:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 22:06:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 22:06:54 [DEBUG   ] spawn_process: at 2018-11-15 22:06:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 22:06:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 22:06:54 [DEBUG   ] spawn_process: at 2018-11-15 22:06:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 22:06:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 22:06:54 [DEBUG   ] spawn_process: at 2018-11-15 22:06:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 22:06:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 22:06:54 [DEBUG   ] spawn_process: at 2018-11-15 22:06:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 22:06:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 22:06:54 [DEBUG   ] spawn_process: at 2018-11-15 22:06:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 22:06:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 22:06:54 [DEBUG   ] spawn_process: at 2018-11-15 22:06:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 22:06:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 22:06:54 [DEBUG   ] spawn_process: at 2018-11-15 22:06:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 22:06:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 22:06:54 [DEBUG   ] spawn_process: at 2018-11-15 22:06:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 22:06:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 22:06:54 [DEBUG   ] spawn_process: at 2018-11-15 22:06:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 22:06:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 22:06:54 [DEBUG   ] spawn_process: at 2018-11-15 22:06:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 22:06:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 22:06:54 [DEBUG   ] spawn_process: at 2018-11-15 22:06:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 22:06:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 22:06:54 [DEBUG   ] spawn_process: at 2018-11-15 22:06:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 22:06:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 22:06:54 [DEBUG   ] spawn_process: at 2018-11-15 22:06:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 22:06:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 22:06:54 [DEBUG   ] spawn_process: at 2018-11-15 22:06:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 22:06:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 22:06:54 [DEBUG   ] spawn_process: at 2018-11-15 22:06:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 22:06:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 22:06:54 [DEBUG   ] spawn_process: at 2018-11-15 22:06:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 22:07:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 22:07:17 [DEBUG   ] Got command BAM from MCS: ref #519517
2018-11-15 22:07:17 [INFO    ] Finished processing BAM request
2018-11-15 22:07:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:07:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519517   8 58437 79637033 A  ERROR'
2018-11-15 22:07:17 [DEBUG   ] Got command BAM from MCS: ref #519516
2018-11-15 22:07:17 [INFO    ] Finished processing BAM request
2018-11-15 22:07:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:07:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519516   8 58437 79637037 A  ERROR'
2018-11-15 22:07:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 22:07:17 [DEBUG   ] spawn_process: at 2018-11-15 22:07:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 22:07:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 22:07:17 [DEBUG   ] spawn_process: at 2018-11-15 22:07:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 22:07:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 22:07:17 [DEBUG   ] spawn_process: at 2018-11-15 22:07:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 22:07:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 22:07:17 [DEBUG   ] spawn_process: at 2018-11-15 22:07:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 22:07:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 22:07:17 [DEBUG   ] spawn_process: at 2018-11-15 22:07:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 22:07:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 22:07:17 [DEBUG   ] spawn_process: at 2018-11-15 22:07:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 22:07:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 22:07:17 [DEBUG   ] spawn_process: at 2018-11-15 22:07:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 22:07:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 22:07:17 [DEBUG   ] spawn_process: at 2018-11-15 22:07:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 22:07:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 22:07:17 [DEBUG   ] spawn_process: at 2018-11-15 22:07:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 22:07:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 22:07:17 [DEBUG   ] spawn_process: at 2018-11-15 22:07:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 22:07:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 22:07:17 [DEBUG   ] spawn_process: at 2018-11-15 22:07:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 22:07:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 22:07:17 [DEBUG   ] spawn_process: at 2018-11-15 22:07:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 22:07:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 22:07:17 [DEBUG   ] spawn_process: at 2018-11-15 22:07:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 22:07:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 22:07:17 [DEBUG   ] spawn_process: at 2018-11-15 22:07:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 22:07:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 22:07:17 [DEBUG   ] spawn_process: at 2018-11-15 22:07:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 22:07:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 22:07:17 [DEBUG   ] spawn_process: at 2018-11-15 22:07:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 22:07:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 22:07:17 [DEBUG   ] spawn_process: at 2018-11-15 22:07:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 22:07:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 22:07:17 [DEBUG   ] spawn_process: at 2018-11-15 22:07:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 22:07:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 22:07:17 [DEBUG   ] spawn_process: at 2018-11-15 22:07:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 22:07:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 22:07:17 [DEBUG   ] spawn_process: at 2018-11-15 22:07:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 22:07:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 22:07:17 [DEBUG   ] spawn_process: at 2018-11-15 22:07:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 22:07:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 22:07:17 [DEBUG   ] spawn_process: at 2018-11-15 22:07:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 22:07:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 22:07:17 [DEBUG   ] spawn_process: at 2018-11-15 22:07:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 22:07:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 22:07:17 [DEBUG   ] spawn_process: at 2018-11-15 22:07:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 22:07:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 22:07:17 [DEBUG   ] spawn_process: at 2018-11-15 22:07:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 22:07:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 22:07:17 [DEBUG   ] spawn_process: at 2018-11-15 22:07:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 22:07:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-15 22:07:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:07:26 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 22:07:26 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-15 22:07:26 [WARNING ] (13, 1, 'bot')
2018-11-15 22:07:26 [WARNING ] (13, 1, 'bot')
2018-11-15 22:07:26 [WARNING ] (13, 1, 'bot')
2018-11-15 22:07:26 [WARNING ] (13, 1, 'bot')
2018-11-15 22:07:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 22:07:26 [DEBUG   ] Finished updating board flags in 1.186 seconds
2018-11-15 22:07:27 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-15 22:07:40 [DEBUG   ] Got command BAM from MCS: ref #519518
2018-11-15 22:07:40 [INFO    ] Finished processing BAM request
2018-11-15 22:07:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519518   8 58437 79660025 A  ERROR'
2018-11-15 22:07:40 [DEBUG   ] Got command BAM from MCS: ref #519519
2018-11-15 22:07:40 [INFO    ] Finished processing BAM request
2018-11-15 22:07:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519519   8 58437 79660029 A  ERROR'
2018-11-15 22:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 22:07:40 [DEBUG   ] spawn_process: at 2018-11-15 22:07:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 22:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 22:07:40 [DEBUG   ] spawn_process: at 2018-11-15 22:07:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 22:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 22:07:40 [DEBUG   ] spawn_process: at 2018-11-15 22:07:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 22:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 22:07:40 [DEBUG   ] spawn_process: at 2018-11-15 22:07:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 22:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 22:07:40 [DEBUG   ] spawn_process: at 2018-11-15 22:07:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 22:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 22:07:40 [DEBUG   ] spawn_process: at 2018-11-15 22:07:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 22:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 22:07:40 [DEBUG   ] spawn_process: at 2018-11-15 22:07:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 22:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 22:07:40 [DEBUG   ] spawn_process: at 2018-11-15 22:07:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 22:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 22:07:40 [DEBUG   ] spawn_process: at 2018-11-15 22:07:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 22:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 22:07:40 [DEBUG   ] spawn_process: at 2018-11-15 22:07:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 22:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 22:07:40 [DEBUG   ] spawn_process: at 2018-11-15 22:07:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 22:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 22:07:40 [DEBUG   ] spawn_process: at 2018-11-15 22:07:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 22:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 22:07:40 [DEBUG   ] spawn_process: at 2018-11-15 22:07:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 22:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 22:07:40 [DEBUG   ] spawn_process: at 2018-11-15 22:07:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 22:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 22:07:40 [DEBUG   ] spawn_process: at 2018-11-15 22:07:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 22:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 22:07:40 [DEBUG   ] spawn_process: at 2018-11-15 22:07:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 22:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 22:07:40 [DEBUG   ] spawn_process: at 2018-11-15 22:07:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 22:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 22:07:40 [DEBUG   ] spawn_process: at 2018-11-15 22:07:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 22:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 22:07:40 [DEBUG   ] spawn_process: at 2018-11-15 22:07:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 22:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 22:07:40 [DEBUG   ] spawn_process: at 2018-11-15 22:07:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 22:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 22:07:40 [DEBUG   ] spawn_process: at 2018-11-15 22:07:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 22:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 22:07:40 [DEBUG   ] spawn_process: at 2018-11-15 22:07:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 22:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 22:07:40 [DEBUG   ] spawn_process: at 2018-11-15 22:07:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 22:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 22:07:40 [DEBUG   ] spawn_process: at 2018-11-15 22:07:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 22:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 22:07:40 [DEBUG   ] spawn_process: at 2018-11-15 22:07:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 22:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 22:07:40 [DEBUG   ] spawn_process: at 2018-11-15 22:07:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 22:07:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 22:08:03 [DEBUG   ] Got command BAM from MCS: ref #519520
2018-11-15 22:08:03 [INFO    ] Finished processing BAM request
2018-11-15 22:08:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:08:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519520   8 58437 79683033 A  ERROR'
2018-11-15 22:08:03 [DEBUG   ] Got command BAM from MCS: ref #519521
2018-11-15 22:08:03 [INFO    ] Finished processing BAM request
2018-11-15 22:08:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:08:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519521   8 58437 79683037 A  ERROR'
2018-11-15 22:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 22:08:03 [DEBUG   ] spawn_process: at 2018-11-15 22:08:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 22:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 22:08:03 [DEBUG   ] spawn_process: at 2018-11-15 22:08:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 22:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 22:08:03 [DEBUG   ] spawn_process: at 2018-11-15 22:08:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 22:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 22:08:03 [DEBUG   ] spawn_process: at 2018-11-15 22:08:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 22:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 22:08:03 [DEBUG   ] spawn_process: at 2018-11-15 22:08:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 22:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 22:08:03 [DEBUG   ] spawn_process: at 2018-11-15 22:08:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 22:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 22:08:03 [DEBUG   ] spawn_process: at 2018-11-15 22:08:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 22:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 22:08:03 [DEBUG   ] spawn_process: at 2018-11-15 22:08:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 22:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 22:08:03 [DEBUG   ] spawn_process: at 2018-11-15 22:08:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 22:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 22:08:03 [DEBUG   ] spawn_process: at 2018-11-15 22:08:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 22:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 22:08:03 [DEBUG   ] spawn_process: at 2018-11-15 22:08:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 22:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 22:08:03 [DEBUG   ] spawn_process: at 2018-11-15 22:08:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 22:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 22:08:03 [DEBUG   ] spawn_process: at 2018-11-15 22:08:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 22:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 22:08:03 [DEBUG   ] spawn_process: at 2018-11-15 22:08:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 22:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 22:08:03 [DEBUG   ] spawn_process: at 2018-11-15 22:08:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 22:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 22:08:03 [DEBUG   ] spawn_process: at 2018-11-15 22:08:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 22:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 22:08:03 [DEBUG   ] spawn_process: at 2018-11-15 22:08:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 22:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 22:08:03 [DEBUG   ] spawn_process: at 2018-11-15 22:08:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 22:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 22:08:03 [DEBUG   ] spawn_process: at 2018-11-15 22:08:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 22:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 22:08:03 [DEBUG   ] spawn_process: at 2018-11-15 22:08:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 22:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 22:08:03 [DEBUG   ] spawn_process: at 2018-11-15 22:08:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 22:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 22:08:03 [DEBUG   ] spawn_process: at 2018-11-15 22:08:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 22:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 22:08:03 [DEBUG   ] spawn_process: at 2018-11-15 22:08:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 22:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 22:08:03 [DEBUG   ] spawn_process: at 2018-11-15 22:08:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 22:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 22:08:03 [DEBUG   ] spawn_process: at 2018-11-15 22:08:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 22:08:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 22:08:03 [DEBUG   ] spawn_process: at 2018-11-15 22:08:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 22:08:07 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 22:08:25 [DEBUG   ] Got command RPT from MCS: ref #519526
2018-11-15 22:08:25 [DEBUG   ] summary = ERROR
2018-11-15 22:08:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519526  13 58437 79705349 A  ERRORERROR'
2018-11-15 22:08:25 [DEBUG   ] Got command RPT from MCS: ref #519527
2018-11-15 22:08:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 22:08:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519527  77 58437 79705553 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 22:08:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 22:08:25 [DEBUG   ] Got command RPT from MCS: ref #519528
2018-11-15 22:08:25 [DEBUG   ] summary = ERROR
2018-11-15 22:08:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519528  13 58437 79705745 A  ERRORERROR'
2018-11-15 22:08:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:08:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-15 22:08:25 [DEBUG   ] Got command RPT from MCS: ref #519530
2018-11-15 22:08:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 22:08:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519530  77 58437 79705954 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 22:08:26 [DEBUG   ] Got command BAM from MCS: ref #519524
2018-11-15 22:08:26 [INFO    ] Finished processing BAM request
2018-11-15 22:08:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:08:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519524   8 58437 79706029 A  ERROR'
2018-11-15 22:08:26 [DEBUG   ] Got command BAM from MCS: ref #519525
2018-11-15 22:08:26 [INFO    ] Finished processing BAM request
2018-11-15 22:08:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:08:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519525   8 58437 79706033 A  ERROR'
2018-11-15 22:08:26 [DEBUG   ] Got command RPT from MCS: ref #519532
2018-11-15 22:08:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 22:08:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519532  12 58437 79706153 A  ERRORB›™š'
2018-11-15 22:08:26 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 22:08:26 [WARNING ] (13, 1, 'bot')
2018-11-15 22:08:26 [WARNING ] (13, 1, 'bot')
2018-11-15 22:08:26 [WARNING ] (13, 1, 'bot')
2018-11-15 22:08:26 [WARNING ] (13, 1, 'bot')
2018-11-15 22:08:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 22:08:26 [DEBUG   ] Finished updating board flags in 1.047 seconds
2018-11-15 22:08:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 22:08:26 [DEBUG   ] spawn_process: at 2018-11-15 22:08:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 22:08:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 22:08:26 [DEBUG   ] spawn_process: at 2018-11-15 22:08:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 22:08:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 22:08:26 [DEBUG   ] spawn_process: at 2018-11-15 22:08:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 22:08:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 22:08:26 [DEBUG   ] spawn_process: at 2018-11-15 22:08:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 22:08:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 22:08:26 [DEBUG   ] spawn_process: at 2018-11-15 22:08:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 22:08:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 22:08:26 [DEBUG   ] spawn_process: at 2018-11-15 22:08:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 22:08:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 22:08:26 [DEBUG   ] spawn_process: at 2018-11-15 22:08:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 22:08:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 22:08:26 [DEBUG   ] spawn_process: at 2018-11-15 22:08:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 22:08:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 22:08:26 [DEBUG   ] spawn_process: at 2018-11-15 22:08:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 22:08:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 22:08:26 [DEBUG   ] spawn_process: at 2018-11-15 22:08:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 22:08:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 22:08:26 [DEBUG   ] spawn_process: at 2018-11-15 22:08:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 22:08:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 22:08:26 [DEBUG   ] spawn_process: at 2018-11-15 22:08:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 22:08:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 22:08:26 [DEBUG   ] spawn_process: at 2018-11-15 22:08:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 22:08:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 22:08:26 [DEBUG   ] spawn_process: at 2018-11-15 22:08:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 22:08:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 22:08:26 [DEBUG   ] spawn_process: at 2018-11-15 22:08:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 22:08:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 22:08:26 [DEBUG   ] spawn_process: at 2018-11-15 22:08:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 22:08:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 22:08:26 [DEBUG   ] spawn_process: at 2018-11-15 22:08:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 22:08:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 22:08:26 [DEBUG   ] spawn_process: at 2018-11-15 22:08:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 22:08:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 22:08:26 [DEBUG   ] spawn_process: at 2018-11-15 22:08:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 22:08:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 22:08:26 [DEBUG   ] spawn_process: at 2018-11-15 22:08:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 22:08:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 22:08:26 [DEBUG   ] spawn_process: at 2018-11-15 22:08:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 22:08:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 22:08:26 [DEBUG   ] spawn_process: at 2018-11-15 22:08:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 22:08:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 22:08:26 [DEBUG   ] spawn_process: at 2018-11-15 22:08:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 22:08:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 22:08:26 [DEBUG   ] spawn_process: at 2018-11-15 22:08:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 22:08:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 22:08:26 [DEBUG   ] spawn_process: at 2018-11-15 22:08:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 22:08:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 22:08:26 [DEBUG   ] spawn_process: at 2018-11-15 22:08:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 22:08:27 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-15 22:08:47 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 22:08:49 [DEBUG   ] Got command BAM from MCS: ref #519540
2018-11-15 22:08:49 [INFO    ] Finished processing BAM request
2018-11-15 22:08:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:08:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519540   8 58437 79729025 A  ERROR'
2018-11-15 22:08:49 [DEBUG   ] Got command BAM from MCS: ref #519541
2018-11-15 22:08:49 [INFO    ] Finished processing BAM request
2018-11-15 22:08:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:08:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519541   8 58437 79729029 A  ERROR'
2018-11-15 22:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 22:08:49 [DEBUG   ] spawn_process: at 2018-11-15 22:08:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 22:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 22:08:49 [DEBUG   ] spawn_process: at 2018-11-15 22:08:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 22:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 22:08:49 [DEBUG   ] spawn_process: at 2018-11-15 22:08:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 22:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 22:08:49 [DEBUG   ] spawn_process: at 2018-11-15 22:08:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 22:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 22:08:49 [DEBUG   ] spawn_process: at 2018-11-15 22:08:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 22:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 22:08:49 [DEBUG   ] spawn_process: at 2018-11-15 22:08:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 22:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 22:08:49 [DEBUG   ] spawn_process: at 2018-11-15 22:08:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 22:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 22:08:49 [DEBUG   ] spawn_process: at 2018-11-15 22:08:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 22:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 22:08:49 [DEBUG   ] spawn_process: at 2018-11-15 22:08:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 22:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 22:08:49 [DEBUG   ] spawn_process: at 2018-11-15 22:08:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 22:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 22:08:49 [DEBUG   ] spawn_process: at 2018-11-15 22:08:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 22:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 22:08:49 [DEBUG   ] spawn_process: at 2018-11-15 22:08:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 22:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 22:08:49 [DEBUG   ] spawn_process: at 2018-11-15 22:08:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 22:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 22:08:49 [DEBUG   ] spawn_process: at 2018-11-15 22:08:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 22:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 22:08:49 [DEBUG   ] spawn_process: at 2018-11-15 22:08:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 22:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 22:08:49 [DEBUG   ] spawn_process: at 2018-11-15 22:08:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 22:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 22:08:49 [DEBUG   ] spawn_process: at 2018-11-15 22:08:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 22:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 22:08:49 [DEBUG   ] spawn_process: at 2018-11-15 22:08:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 22:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 22:08:49 [DEBUG   ] spawn_process: at 2018-11-15 22:08:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 22:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 22:08:49 [DEBUG   ] spawn_process: at 2018-11-15 22:08:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 22:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 22:08:49 [DEBUG   ] spawn_process: at 2018-11-15 22:08:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 22:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 22:08:49 [DEBUG   ] spawn_process: at 2018-11-15 22:08:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 22:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 22:08:49 [DEBUG   ] spawn_process: at 2018-11-15 22:08:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 22:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 22:08:49 [DEBUG   ] spawn_process: at 2018-11-15 22:08:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 22:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 22:08:49 [DEBUG   ] spawn_process: at 2018-11-15 22:08:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 22:08:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 22:08:49 [DEBUG   ] spawn_process: at 2018-11-15 22:08:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 22:09:07 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-15 22:09:13 [DEBUG   ] Got command BAM from MCS: ref #519542
2018-11-15 22:09:13 [INFO    ] Finished processing BAM request
2018-11-15 22:09:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:09:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519542   8 58437 79753029 A  ERROR'
2018-11-15 22:09:13 [DEBUG   ] Got command BAM from MCS: ref #519543
2018-11-15 22:09:13 [INFO    ] Finished processing BAM request
2018-11-15 22:09:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:09:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519543   8 58437 79753033 A  ERROR'
2018-11-15 22:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 22:09:13 [DEBUG   ] spawn_process: at 2018-11-15 22:09:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 22:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 22:09:13 [DEBUG   ] spawn_process: at 2018-11-15 22:09:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 22:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 22:09:13 [DEBUG   ] spawn_process: at 2018-11-15 22:09:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 22:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 22:09:13 [DEBUG   ] spawn_process: at 2018-11-15 22:09:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 22:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 22:09:13 [DEBUG   ] spawn_process: at 2018-11-15 22:09:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 22:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 22:09:13 [DEBUG   ] spawn_process: at 2018-11-15 22:09:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 22:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 22:09:13 [DEBUG   ] spawn_process: at 2018-11-15 22:09:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 22:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 22:09:13 [DEBUG   ] spawn_process: at 2018-11-15 22:09:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 22:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 22:09:13 [DEBUG   ] spawn_process: at 2018-11-15 22:09:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 22:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 22:09:13 [DEBUG   ] spawn_process: at 2018-11-15 22:09:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 22:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 22:09:13 [DEBUG   ] spawn_process: at 2018-11-15 22:09:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 22:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 22:09:13 [DEBUG   ] spawn_process: at 2018-11-15 22:09:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 22:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 22:09:13 [DEBUG   ] spawn_process: at 2018-11-15 22:09:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 22:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 22:09:13 [DEBUG   ] spawn_process: at 2018-11-15 22:09:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 22:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 22:09:13 [DEBUG   ] spawn_process: at 2018-11-15 22:09:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 22:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 22:09:13 [DEBUG   ] spawn_process: at 2018-11-15 22:09:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 22:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 22:09:13 [DEBUG   ] spawn_process: at 2018-11-15 22:09:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 22:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 22:09:13 [DEBUG   ] spawn_process: at 2018-11-15 22:09:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 22:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 22:09:13 [DEBUG   ] spawn_process: at 2018-11-15 22:09:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 22:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 22:09:13 [DEBUG   ] spawn_process: at 2018-11-15 22:09:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 22:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 22:09:13 [DEBUG   ] spawn_process: at 2018-11-15 22:09:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 22:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 22:09:13 [DEBUG   ] spawn_process: at 2018-11-15 22:09:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 22:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 22:09:13 [DEBUG   ] spawn_process: at 2018-11-15 22:09:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 22:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 22:09:13 [DEBUG   ] spawn_process: at 2018-11-15 22:09:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 22:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 22:09:13 [DEBUG   ] spawn_process: at 2018-11-15 22:09:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 22:09:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 22:09:13 [DEBUG   ] spawn_process: at 2018-11-15 22:09:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 22:09:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 22:09:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 22:09:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-15 22:09:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:09:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-15 22:09:27 [DEBUG   ] Finished updating ant stats in 0.430 seconds
2018-11-15 22:09:27 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 22:09:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 22:09:27 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 22:09:27 [WARNING ] (13, 1, 'bot')
2018-11-15 22:09:27 [WARNING ] (13, 1, 'bot')
2018-11-15 22:09:27 [WARNING ] (13, 1, 'bot')
2018-11-15 22:09:27 [WARNING ] (13, 1, 'bot')
2018-11-15 22:09:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 22:09:27 [DEBUG   ] Finished updating board flags in 2.029 seconds
2018-11-15 22:09:37 [DEBUG   ] Got command BAM from MCS: ref #519545
2018-11-15 22:09:37 [INFO    ] Finished processing BAM request
2018-11-15 22:09:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:09:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519545   8 58437 79777033 A  ERROR'
2018-11-15 22:09:37 [DEBUG   ] Got command BAM from MCS: ref #519544
2018-11-15 22:09:37 [INFO    ] Finished processing BAM request
2018-11-15 22:09:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:09:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519544   8 58437 79777037 A  ERROR'
2018-11-15 22:09:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 22:09:37 [DEBUG   ] spawn_process: at 2018-11-15 22:09:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 22:09:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 22:09:37 [DEBUG   ] spawn_process: at 2018-11-15 22:09:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 22:09:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 22:09:37 [DEBUG   ] spawn_process: at 2018-11-15 22:09:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 22:09:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 22:09:37 [DEBUG   ] spawn_process: at 2018-11-15 22:09:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 22:09:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 22:09:37 [DEBUG   ] spawn_process: at 2018-11-15 22:09:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 22:09:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 22:09:37 [DEBUG   ] spawn_process: at 2018-11-15 22:09:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 22:09:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 22:09:37 [DEBUG   ] spawn_process: at 2018-11-15 22:09:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 22:09:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 22:09:37 [DEBUG   ] spawn_process: at 2018-11-15 22:09:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 22:09:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 22:09:37 [DEBUG   ] spawn_process: at 2018-11-15 22:09:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 22:09:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 22:09:37 [DEBUG   ] spawn_process: at 2018-11-15 22:09:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 22:09:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 22:09:37 [DEBUG   ] spawn_process: at 2018-11-15 22:09:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 22:09:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 22:09:37 [DEBUG   ] spawn_process: at 2018-11-15 22:09:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 22:09:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 22:09:37 [DEBUG   ] spawn_process: at 2018-11-15 22:09:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 22:09:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 22:09:37 [DEBUG   ] spawn_process: at 2018-11-15 22:09:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 22:09:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 22:09:37 [DEBUG   ] spawn_process: at 2018-11-15 22:09:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 22:09:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 22:09:37 [DEBUG   ] spawn_process: at 2018-11-15 22:09:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 22:09:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 22:09:37 [DEBUG   ] spawn_process: at 2018-11-15 22:09:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 22:09:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 22:09:37 [DEBUG   ] spawn_process: at 2018-11-15 22:09:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 22:09:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 22:09:37 [DEBUG   ] spawn_process: at 2018-11-15 22:09:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 22:09:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 22:09:37 [DEBUG   ] spawn_process: at 2018-11-15 22:09:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 22:09:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 22:09:37 [DEBUG   ] spawn_process: at 2018-11-15 22:09:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 22:09:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 22:09:37 [DEBUG   ] spawn_process: at 2018-11-15 22:09:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 22:09:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 22:09:37 [DEBUG   ] spawn_process: at 2018-11-15 22:09:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 22:09:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 22:09:37 [DEBUG   ] spawn_process: at 2018-11-15 22:09:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 22:09:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 22:09:37 [DEBUG   ] spawn_process: at 2018-11-15 22:09:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 22:09:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 22:09:37 [DEBUG   ] spawn_process: at 2018-11-15 22:09:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 22:09:47 [DEBUG   ] Finished updating ant stats in 0.375 seconds
2018-11-15 22:10:01 [DEBUG   ] Got command BAM from MCS: ref #519546
2018-11-15 22:10:01 [INFO    ] Finished processing BAM request
2018-11-15 22:10:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:10:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519546   8 58437 79801029 A  ERROR'
2018-11-15 22:10:01 [DEBUG   ] Got command BAM from MCS: ref #519547
2018-11-15 22:10:01 [INFO    ] Finished processing BAM request
2018-11-15 22:10:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:10:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519547   8 58437 79801033 A  ERROR'
2018-11-15 22:10:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 22:10:01 [DEBUG   ] spawn_process: at 2018-11-15 22:10:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 22:10:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 22:10:01 [DEBUG   ] spawn_process: at 2018-11-15 22:10:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 22:10:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 22:10:01 [DEBUG   ] spawn_process: at 2018-11-15 22:10:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 22:10:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 22:10:01 [DEBUG   ] spawn_process: at 2018-11-15 22:10:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 22:10:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 22:10:01 [DEBUG   ] spawn_process: at 2018-11-15 22:10:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 22:10:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 22:10:01 [DEBUG   ] spawn_process: at 2018-11-15 22:10:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 22:10:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 22:10:01 [DEBUG   ] spawn_process: at 2018-11-15 22:10:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 22:10:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 22:10:01 [DEBUG   ] spawn_process: at 2018-11-15 22:10:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 22:10:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 22:10:01 [DEBUG   ] spawn_process: at 2018-11-15 22:10:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 22:10:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 22:10:01 [DEBUG   ] spawn_process: at 2018-11-15 22:10:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 22:10:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 22:10:01 [DEBUG   ] spawn_process: at 2018-11-15 22:10:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 22:10:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 22:10:01 [DEBUG   ] spawn_process: at 2018-11-15 22:10:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 22:10:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 22:10:01 [DEBUG   ] spawn_process: at 2018-11-15 22:10:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 22:10:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 22:10:01 [DEBUG   ] spawn_process: at 2018-11-15 22:10:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 22:10:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 22:10:01 [DEBUG   ] spawn_process: at 2018-11-15 22:10:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 22:10:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 22:10:01 [DEBUG   ] spawn_process: at 2018-11-15 22:10:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 22:10:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 22:10:01 [DEBUG   ] spawn_process: at 2018-11-15 22:10:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 22:10:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 22:10:01 [DEBUG   ] spawn_process: at 2018-11-15 22:10:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 22:10:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 22:10:01 [DEBUG   ] spawn_process: at 2018-11-15 22:10:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 22:10:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 22:10:01 [DEBUG   ] spawn_process: at 2018-11-15 22:10:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 22:10:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 22:10:01 [DEBUG   ] spawn_process: at 2018-11-15 22:10:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 22:10:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 22:10:01 [DEBUG   ] spawn_process: at 2018-11-15 22:10:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 22:10:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 22:10:01 [DEBUG   ] spawn_process: at 2018-11-15 22:10:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 22:10:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 22:10:01 [DEBUG   ] spawn_process: at 2018-11-15 22:10:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 22:10:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 22:10:01 [DEBUG   ] spawn_process: at 2018-11-15 22:10:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 22:10:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 22:10:01 [DEBUG   ] spawn_process: at 2018-11-15 22:10:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 22:10:08 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-15 22:10:25 [DEBUG   ] Got command BAM from MCS: ref #519549
2018-11-15 22:10:25 [INFO    ] Finished processing BAM request
2018-11-15 22:10:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:10:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519549   8 58437 79825025 A  ERROR'
2018-11-15 22:10:25 [DEBUG   ] Got command BAM from MCS: ref #519548
2018-11-15 22:10:25 [INFO    ] Finished processing BAM request
2018-11-15 22:10:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:10:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519548   8 58437 79825029 A  ERROR'
2018-11-15 22:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 22:10:25 [DEBUG   ] spawn_process: at 2018-11-15 22:10:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 22:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 22:10:25 [DEBUG   ] spawn_process: at 2018-11-15 22:10:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 22:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 22:10:25 [DEBUG   ] spawn_process: at 2018-11-15 22:10:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 22:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 22:10:25 [DEBUG   ] spawn_process: at 2018-11-15 22:10:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 22:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 22:10:25 [DEBUG   ] spawn_process: at 2018-11-15 22:10:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 22:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 22:10:25 [DEBUG   ] spawn_process: at 2018-11-15 22:10:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 22:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 22:10:25 [DEBUG   ] spawn_process: at 2018-11-15 22:10:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 22:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 22:10:25 [DEBUG   ] spawn_process: at 2018-11-15 22:10:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 22:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 22:10:25 [DEBUG   ] spawn_process: at 2018-11-15 22:10:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 22:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 22:10:25 [DEBUG   ] spawn_process: at 2018-11-15 22:10:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 22:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 22:10:25 [DEBUG   ] spawn_process: at 2018-11-15 22:10:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 22:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 22:10:25 [DEBUG   ] spawn_process: at 2018-11-15 22:10:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 22:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 22:10:25 [DEBUG   ] spawn_process: at 2018-11-15 22:10:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 22:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 22:10:25 [DEBUG   ] spawn_process: at 2018-11-15 22:10:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 22:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 22:10:25 [DEBUG   ] spawn_process: at 2018-11-15 22:10:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 22:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 22:10:25 [DEBUG   ] spawn_process: at 2018-11-15 22:10:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 22:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 22:10:25 [DEBUG   ] spawn_process: at 2018-11-15 22:10:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 22:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 22:10:25 [DEBUG   ] spawn_process: at 2018-11-15 22:10:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 22:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 22:10:25 [DEBUG   ] spawn_process: at 2018-11-15 22:10:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 22:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 22:10:25 [DEBUG   ] spawn_process: at 2018-11-15 22:10:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 22:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 22:10:25 [DEBUG   ] spawn_process: at 2018-11-15 22:10:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 22:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 22:10:25 [DEBUG   ] spawn_process: at 2018-11-15 22:10:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 22:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 22:10:25 [DEBUG   ] spawn_process: at 2018-11-15 22:10:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 22:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 22:10:25 [DEBUG   ] spawn_process: at 2018-11-15 22:10:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 22:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 22:10:25 [DEBUG   ] spawn_process: at 2018-11-15 22:10:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 22:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 22:10:25 [DEBUG   ] spawn_process: at 2018-11-15 22:10:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 22:10:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 22:10:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:10:26 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 22:10:26 [WARNING ] (13, 1, 'bot')
2018-11-15 22:10:26 [WARNING ] (13, 1, 'bot')
2018-11-15 22:10:26 [WARNING ] (13, 1, 'bot')
2018-11-15 22:10:26 [WARNING ] (13, 1, 'bot')
2018-11-15 22:10:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 22:10:26 [DEBUG   ] Finished updating board flags in 1.368 seconds
2018-11-15 22:10:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 22:10:45 [DEBUG   ] Got command RPT from MCS: ref #519550
2018-11-15 22:10:45 [DEBUG   ] summary = ERROR
2018-11-15 22:10:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519550  13 58437 79845209 A  ERRORERROR'
2018-11-15 22:10:45 [DEBUG   ] Got command RPT from MCS: ref #519551
2018-11-15 22:10:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 22:10:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519551  77 58437 79845210 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 22:10:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 22:10:49 [DEBUG   ] Got command BAM from MCS: ref #519568
2018-11-15 22:10:49 [INFO    ] Finished processing BAM request
2018-11-15 22:10:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:10:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519568   8 58437 79849033 A  ERROR'
2018-11-15 22:10:49 [DEBUG   ] Got command BAM from MCS: ref #519567
2018-11-15 22:10:49 [INFO    ] Finished processing BAM request
2018-11-15 22:10:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:10:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519567   8 58437 79849037 A  ERROR'
2018-11-15 22:10:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 22:10:49 [DEBUG   ] spawn_process: at 2018-11-15 22:10:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 22:10:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 22:10:49 [DEBUG   ] spawn_process: at 2018-11-15 22:10:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 22:10:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 22:10:49 [DEBUG   ] spawn_process: at 2018-11-15 22:10:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 22:10:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 22:10:49 [DEBUG   ] spawn_process: at 2018-11-15 22:10:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 22:10:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 22:10:49 [DEBUG   ] spawn_process: at 2018-11-15 22:10:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 22:10:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 22:10:49 [DEBUG   ] spawn_process: at 2018-11-15 22:10:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 22:10:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 22:10:49 [DEBUG   ] spawn_process: at 2018-11-15 22:10:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 22:10:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 22:10:49 [DEBUG   ] spawn_process: at 2018-11-15 22:10:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 22:10:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 22:10:49 [DEBUG   ] spawn_process: at 2018-11-15 22:10:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 22:10:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 22:10:49 [DEBUG   ] spawn_process: at 2018-11-15 22:10:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 22:10:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 22:10:49 [DEBUG   ] spawn_process: at 2018-11-15 22:10:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 22:10:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 22:10:49 [DEBUG   ] spawn_process: at 2018-11-15 22:10:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 22:10:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 22:10:49 [DEBUG   ] spawn_process: at 2018-11-15 22:10:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 22:10:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 22:10:49 [DEBUG   ] spawn_process: at 2018-11-15 22:10:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 22:10:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 22:10:49 [DEBUG   ] spawn_process: at 2018-11-15 22:10:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 22:10:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 22:10:49 [DEBUG   ] spawn_process: at 2018-11-15 22:10:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 22:10:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 22:10:49 [DEBUG   ] spawn_process: at 2018-11-15 22:10:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 22:10:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 22:10:49 [DEBUG   ] spawn_process: at 2018-11-15 22:10:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 22:10:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 22:10:49 [DEBUG   ] spawn_process: at 2018-11-15 22:10:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 22:10:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 22:10:49 [DEBUG   ] spawn_process: at 2018-11-15 22:10:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 22:10:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 22:10:49 [DEBUG   ] spawn_process: at 2018-11-15 22:10:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 22:10:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 22:10:49 [DEBUG   ] spawn_process: at 2018-11-15 22:10:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 22:10:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 22:10:49 [DEBUG   ] spawn_process: at 2018-11-15 22:10:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 22:10:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 22:10:49 [DEBUG   ] spawn_process: at 2018-11-15 22:10:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 22:10:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 22:10:49 [DEBUG   ] spawn_process: at 2018-11-15 22:10:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 22:10:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 22:10:49 [DEBUG   ] spawn_process: at 2018-11-15 22:10:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 22:11:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 22:11:13 [DEBUG   ] Got command BAM from MCS: ref #519570
2018-11-15 22:11:13 [INFO    ] Finished processing BAM request
2018-11-15 22:11:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:11:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519570   8 58437 79873033 A  ERROR'
2018-11-15 22:11:13 [DEBUG   ] Got command BAM from MCS: ref #519569
2018-11-15 22:11:13 [INFO    ] Finished processing BAM request
2018-11-15 22:11:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:11:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519569   8 58437 79873037 A  ERROR'
2018-11-15 22:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 22:11:13 [DEBUG   ] spawn_process: at 2018-11-15 22:11:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 22:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 22:11:13 [DEBUG   ] spawn_process: at 2018-11-15 22:11:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 22:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 22:11:13 [DEBUG   ] spawn_process: at 2018-11-15 22:11:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 22:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 22:11:13 [DEBUG   ] spawn_process: at 2018-11-15 22:11:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 22:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 22:11:13 [DEBUG   ] spawn_process: at 2018-11-15 22:11:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 22:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 22:11:13 [DEBUG   ] spawn_process: at 2018-11-15 22:11:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 22:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 22:11:13 [DEBUG   ] spawn_process: at 2018-11-15 22:11:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 22:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 22:11:13 [DEBUG   ] spawn_process: at 2018-11-15 22:11:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 22:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 22:11:13 [DEBUG   ] spawn_process: at 2018-11-15 22:11:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 22:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 22:11:13 [DEBUG   ] spawn_process: at 2018-11-15 22:11:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 22:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 22:11:13 [DEBUG   ] spawn_process: at 2018-11-15 22:11:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 22:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 22:11:13 [DEBUG   ] spawn_process: at 2018-11-15 22:11:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 22:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 22:11:13 [DEBUG   ] spawn_process: at 2018-11-15 22:11:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 22:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 22:11:13 [DEBUG   ] spawn_process: at 2018-11-15 22:11:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 22:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 22:11:13 [DEBUG   ] spawn_process: at 2018-11-15 22:11:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 22:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 22:11:13 [DEBUG   ] spawn_process: at 2018-11-15 22:11:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 22:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 22:11:13 [DEBUG   ] spawn_process: at 2018-11-15 22:11:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 22:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 22:11:13 [DEBUG   ] spawn_process: at 2018-11-15 22:11:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 22:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 22:11:13 [DEBUG   ] spawn_process: at 2018-11-15 22:11:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 22:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 22:11:13 [DEBUG   ] spawn_process: at 2018-11-15 22:11:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 22:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 22:11:13 [DEBUG   ] spawn_process: at 2018-11-15 22:11:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 22:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 22:11:13 [DEBUG   ] spawn_process: at 2018-11-15 22:11:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 22:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 22:11:13 [DEBUG   ] spawn_process: at 2018-11-15 22:11:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 22:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 22:11:13 [DEBUG   ] spawn_process: at 2018-11-15 22:11:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 22:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 22:11:13 [DEBUG   ] spawn_process: at 2018-11-15 22:11:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 22:11:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 22:11:13 [DEBUG   ] spawn_process: at 2018-11-15 22:11:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 22:11:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 22:11:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2018-11-15 22:11:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:11:26 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 22:11:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 22:11:26 [WARNING ] (13, 1, 'bot')
2018-11-15 22:11:26 [WARNING ] (13, 1, 'bot')
2018-11-15 22:11:26 [WARNING ] (13, 1, 'bot')
2018-11-15 22:11:26 [WARNING ] (13, 1, 'bot')
2018-11-15 22:11:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 22:11:26 [DEBUG   ] Finished updating board flags in 1.235 seconds
2018-11-15 22:11:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 22:11:37 [DEBUG   ] Got command BAM from MCS: ref #519575
2018-11-15 22:11:37 [INFO    ] Finished processing BAM request
2018-11-15 22:11:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:11:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519575   8 58437 79897029 A  ERROR'
2018-11-15 22:11:37 [DEBUG   ] Got command BAM from MCS: ref #519576
2018-11-15 22:11:37 [INFO    ] Finished processing BAM request
2018-11-15 22:11:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:11:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519576   8 58437 79897033 A  ERROR'
2018-11-15 22:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 22:11:37 [DEBUG   ] spawn_process: at 2018-11-15 22:11:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 22:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 22:11:37 [DEBUG   ] spawn_process: at 2018-11-15 22:11:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 22:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 22:11:37 [DEBUG   ] spawn_process: at 2018-11-15 22:11:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 22:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 22:11:37 [DEBUG   ] spawn_process: at 2018-11-15 22:11:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 22:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 22:11:37 [DEBUG   ] spawn_process: at 2018-11-15 22:11:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 22:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 22:11:37 [DEBUG   ] spawn_process: at 2018-11-15 22:11:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 22:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 22:11:37 [DEBUG   ] spawn_process: at 2018-11-15 22:11:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 22:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 22:11:37 [DEBUG   ] spawn_process: at 2018-11-15 22:11:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 22:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 22:11:37 [DEBUG   ] spawn_process: at 2018-11-15 22:11:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 22:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 22:11:37 [DEBUG   ] spawn_process: at 2018-11-15 22:11:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 22:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 22:11:37 [DEBUG   ] spawn_process: at 2018-11-15 22:11:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 22:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 22:11:37 [DEBUG   ] spawn_process: at 2018-11-15 22:11:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 22:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 22:11:37 [DEBUG   ] spawn_process: at 2018-11-15 22:11:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 22:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 22:11:37 [DEBUG   ] spawn_process: at 2018-11-15 22:11:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 22:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 22:11:37 [DEBUG   ] spawn_process: at 2018-11-15 22:11:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 22:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 22:11:37 [DEBUG   ] spawn_process: at 2018-11-15 22:11:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 22:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 22:11:37 [DEBUG   ] spawn_process: at 2018-11-15 22:11:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 22:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 22:11:37 [DEBUG   ] spawn_process: at 2018-11-15 22:11:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 22:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 22:11:37 [DEBUG   ] spawn_process: at 2018-11-15 22:11:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 22:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 22:11:37 [DEBUG   ] spawn_process: at 2018-11-15 22:11:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 22:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 22:11:37 [DEBUG   ] spawn_process: at 2018-11-15 22:11:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 22:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 22:11:37 [DEBUG   ] spawn_process: at 2018-11-15 22:11:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 22:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 22:11:37 [DEBUG   ] spawn_process: at 2018-11-15 22:11:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 22:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 22:11:37 [DEBUG   ] spawn_process: at 2018-11-15 22:11:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 22:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 22:11:37 [DEBUG   ] spawn_process: at 2018-11-15 22:11:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 22:11:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 22:11:37 [DEBUG   ] spawn_process: at 2018-11-15 22:11:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 22:11:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 22:12:01 [DEBUG   ] Got command BAM from MCS: ref #519578
2018-11-15 22:12:01 [INFO    ] Finished processing BAM request
2018-11-15 22:12:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:12:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519578   8 58437 79921033 A  ERROR'
2018-11-15 22:12:01 [DEBUG   ] Got command BAM from MCS: ref #519577
2018-11-15 22:12:01 [INFO    ] Finished processing BAM request
2018-11-15 22:12:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:12:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519577   8 58437 79921037 A  ERROR'
2018-11-15 22:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 22:12:01 [DEBUG   ] spawn_process: at 2018-11-15 22:12:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 22:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 22:12:01 [DEBUG   ] spawn_process: at 2018-11-15 22:12:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 22:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 22:12:01 [DEBUG   ] spawn_process: at 2018-11-15 22:12:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 22:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 22:12:01 [DEBUG   ] spawn_process: at 2018-11-15 22:12:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 22:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 22:12:01 [DEBUG   ] spawn_process: at 2018-11-15 22:12:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 22:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 22:12:01 [DEBUG   ] spawn_process: at 2018-11-15 22:12:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 22:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 22:12:01 [DEBUG   ] spawn_process: at 2018-11-15 22:12:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 22:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 22:12:01 [DEBUG   ] spawn_process: at 2018-11-15 22:12:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 22:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 22:12:01 [DEBUG   ] spawn_process: at 2018-11-15 22:12:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 22:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 22:12:01 [DEBUG   ] spawn_process: at 2018-11-15 22:12:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 22:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 22:12:01 [DEBUG   ] spawn_process: at 2018-11-15 22:12:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 22:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 22:12:01 [DEBUG   ] spawn_process: at 2018-11-15 22:12:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 22:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 22:12:01 [DEBUG   ] spawn_process: at 2018-11-15 22:12:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 22:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 22:12:01 [DEBUG   ] spawn_process: at 2018-11-15 22:12:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 22:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 22:12:01 [DEBUG   ] spawn_process: at 2018-11-15 22:12:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 22:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 22:12:01 [DEBUG   ] spawn_process: at 2018-11-15 22:12:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 22:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 22:12:01 [DEBUG   ] spawn_process: at 2018-11-15 22:12:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 22:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 22:12:01 [DEBUG   ] spawn_process: at 2018-11-15 22:12:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 22:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 22:12:01 [DEBUG   ] spawn_process: at 2018-11-15 22:12:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 22:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 22:12:01 [DEBUG   ] spawn_process: at 2018-11-15 22:12:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 22:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 22:12:01 [DEBUG   ] spawn_process: at 2018-11-15 22:12:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 22:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 22:12:01 [DEBUG   ] spawn_process: at 2018-11-15 22:12:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 22:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 22:12:01 [DEBUG   ] spawn_process: at 2018-11-15 22:12:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 22:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 22:12:01 [DEBUG   ] spawn_process: at 2018-11-15 22:12:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 22:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 22:12:01 [DEBUG   ] spawn_process: at 2018-11-15 22:12:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 22:12:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 22:12:01 [DEBUG   ] spawn_process: at 2018-11-15 22:12:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 22:12:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 22:12:25 [DEBUG   ] Got command BAM from MCS: ref #519580
2018-11-15 22:12:25 [INFO    ] Finished processing BAM request
2018-11-15 22:12:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:12:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519580   8 58437 79945029 A  ERROR'
2018-11-15 22:12:25 [DEBUG   ] Got command BAM from MCS: ref #519579
2018-11-15 22:12:25 [INFO    ] Finished processing BAM request
2018-11-15 22:12:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:12:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519579   8 58437 79945033 A  ERROR'
2018-11-15 22:12:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 22:12:25 [DEBUG   ] spawn_process: at 2018-11-15 22:12:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 22:12:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 22:12:25 [DEBUG   ] spawn_process: at 2018-11-15 22:12:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 22:12:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 22:12:25 [DEBUG   ] spawn_process: at 2018-11-15 22:12:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 22:12:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 22:12:25 [DEBUG   ] spawn_process: at 2018-11-15 22:12:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 22:12:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 22:12:25 [DEBUG   ] spawn_process: at 2018-11-15 22:12:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 22:12:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 22:12:25 [DEBUG   ] spawn_process: at 2018-11-15 22:12:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 22:12:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 22:12:25 [DEBUG   ] spawn_process: at 2018-11-15 22:12:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 22:12:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 22:12:25 [DEBUG   ] spawn_process: at 2018-11-15 22:12:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 22:12:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 22:12:25 [DEBUG   ] spawn_process: at 2018-11-15 22:12:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 22:12:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 22:12:25 [DEBUG   ] spawn_process: at 2018-11-15 22:12:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 22:12:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 22:12:25 [DEBUG   ] spawn_process: at 2018-11-15 22:12:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 22:12:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 22:12:25 [DEBUG   ] spawn_process: at 2018-11-15 22:12:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 22:12:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 22:12:25 [DEBUG   ] spawn_process: at 2018-11-15 22:12:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 22:12:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 22:12:25 [DEBUG   ] spawn_process: at 2018-11-15 22:12:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 22:12:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 22:12:25 [DEBUG   ] spawn_process: at 2018-11-15 22:12:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 22:12:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 22:12:25 [DEBUG   ] spawn_process: at 2018-11-15 22:12:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 22:12:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 22:12:25 [DEBUG   ] spawn_process: at 2018-11-15 22:12:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 22:12:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 22:12:25 [DEBUG   ] spawn_process: at 2018-11-15 22:12:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 22:12:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 22:12:25 [DEBUG   ] spawn_process: at 2018-11-15 22:12:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 22:12:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 22:12:25 [DEBUG   ] spawn_process: at 2018-11-15 22:12:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 22:12:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 22:12:25 [DEBUG   ] spawn_process: at 2018-11-15 22:12:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 22:12:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 22:12:25 [DEBUG   ] spawn_process: at 2018-11-15 22:12:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 22:12:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 22:12:25 [DEBUG   ] spawn_process: at 2018-11-15 22:12:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 22:12:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 22:12:25 [DEBUG   ] spawn_process: at 2018-11-15 22:12:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 22:12:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 22:12:25 [DEBUG   ] spawn_process: at 2018-11-15 22:12:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 22:12:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 22:12:25 [DEBUG   ] spawn_process: at 2018-11-15 22:12:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 22:12:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:12:26 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 22:12:26 [WARNING ] (13, 1, 'bot')
2018-11-15 22:12:26 [WARNING ] (13, 1, 'bot')
2018-11-15 22:12:26 [WARNING ] (13, 1, 'bot')
2018-11-15 22:12:26 [WARNING ] (13, 1, 'bot')
2018-11-15 22:12:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 22:12:26 [DEBUG   ] Finished updating board flags in 1.177 seconds
2018-11-15 22:12:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 22:12:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 22:12:49 [DEBUG   ] Got command BAM from MCS: ref #519581
2018-11-15 22:12:49 [INFO    ] Finished processing BAM request
2018-11-15 22:12:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:12:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519581   8 58437 79969033 A  ERROR'
2018-11-15 22:12:49 [DEBUG   ] Got command BAM from MCS: ref #519582
2018-11-15 22:12:49 [INFO    ] Finished processing BAM request
2018-11-15 22:12:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:12:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519582   8 58437 79969037 A  ERROR'
2018-11-15 22:12:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 22:12:49 [DEBUG   ] spawn_process: at 2018-11-15 22:12:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 22:12:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 22:12:49 [DEBUG   ] spawn_process: at 2018-11-15 22:12:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 22:12:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 22:12:49 [DEBUG   ] spawn_process: at 2018-11-15 22:12:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 22:12:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 22:12:49 [DEBUG   ] spawn_process: at 2018-11-15 22:12:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 22:12:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 22:12:49 [DEBUG   ] spawn_process: at 2018-11-15 22:12:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 22:12:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 22:12:49 [DEBUG   ] spawn_process: at 2018-11-15 22:12:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 22:12:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 22:12:49 [DEBUG   ] spawn_process: at 2018-11-15 22:12:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 22:12:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 22:12:49 [DEBUG   ] spawn_process: at 2018-11-15 22:12:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 22:12:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 22:12:49 [DEBUG   ] spawn_process: at 2018-11-15 22:12:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 22:12:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 22:12:49 [DEBUG   ] spawn_process: at 2018-11-15 22:12:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 22:12:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 22:12:49 [DEBUG   ] spawn_process: at 2018-11-15 22:12:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 22:12:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 22:12:49 [DEBUG   ] spawn_process: at 2018-11-15 22:12:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 22:12:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 22:12:49 [DEBUG   ] spawn_process: at 2018-11-15 22:12:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 22:12:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 22:12:49 [DEBUG   ] spawn_process: at 2018-11-15 22:12:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 22:12:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 22:12:49 [DEBUG   ] spawn_process: at 2018-11-15 22:12:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 22:12:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 22:12:49 [DEBUG   ] spawn_process: at 2018-11-15 22:12:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 22:12:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 22:12:49 [DEBUG   ] spawn_process: at 2018-11-15 22:12:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 22:12:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 22:12:49 [DEBUG   ] spawn_process: at 2018-11-15 22:12:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 22:12:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 22:12:49 [DEBUG   ] spawn_process: at 2018-11-15 22:12:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 22:12:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 22:12:49 [DEBUG   ] spawn_process: at 2018-11-15 22:12:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 22:12:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 22:12:49 [DEBUG   ] spawn_process: at 2018-11-15 22:12:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 22:12:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 22:12:49 [DEBUG   ] spawn_process: at 2018-11-15 22:12:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 22:12:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 22:12:49 [DEBUG   ] spawn_process: at 2018-11-15 22:12:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 22:12:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 22:12:49 [DEBUG   ] spawn_process: at 2018-11-15 22:12:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 22:12:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 22:12:49 [DEBUG   ] spawn_process: at 2018-11-15 22:12:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 22:12:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 22:12:49 [DEBUG   ] spawn_process: at 2018-11-15 22:12:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 22:13:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 22:13:13 [DEBUG   ] Got command BAM from MCS: ref #519583
2018-11-15 22:13:13 [INFO    ] Finished processing BAM request
2018-11-15 22:13:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:13:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519583   8 58437 79993029 A  ERROR'
2018-11-15 22:13:13 [DEBUG   ] Got command BAM from MCS: ref #519584
2018-11-15 22:13:13 [INFO    ] Finished processing BAM request
2018-11-15 22:13:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:13:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519584   8 58437 79993033 A  ERROR'
2018-11-15 22:13:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 22:13:13 [DEBUG   ] spawn_process: at 2018-11-15 22:13:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 22:13:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 22:13:13 [DEBUG   ] spawn_process: at 2018-11-15 22:13:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 22:13:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 22:13:13 [DEBUG   ] spawn_process: at 2018-11-15 22:13:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 22:13:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 22:13:13 [DEBUG   ] spawn_process: at 2018-11-15 22:13:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 22:13:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 22:13:13 [DEBUG   ] spawn_process: at 2018-11-15 22:13:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 22:13:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 22:13:13 [DEBUG   ] spawn_process: at 2018-11-15 22:13:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 22:13:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 22:13:13 [DEBUG   ] spawn_process: at 2018-11-15 22:13:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 22:13:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 22:13:13 [DEBUG   ] spawn_process: at 2018-11-15 22:13:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 22:13:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 22:13:13 [DEBUG   ] spawn_process: at 2018-11-15 22:13:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 22:13:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 22:13:13 [DEBUG   ] spawn_process: at 2018-11-15 22:13:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 22:13:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 22:13:13 [DEBUG   ] spawn_process: at 2018-11-15 22:13:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 22:13:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 22:13:13 [DEBUG   ] spawn_process: at 2018-11-15 22:13:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 22:13:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 22:13:13 [DEBUG   ] spawn_process: at 2018-11-15 22:13:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 22:13:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 22:13:13 [DEBUG   ] spawn_process: at 2018-11-15 22:13:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 22:13:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 22:13:13 [DEBUG   ] spawn_process: at 2018-11-15 22:13:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 22:13:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 22:13:13 [DEBUG   ] spawn_process: at 2018-11-15 22:13:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 22:13:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 22:13:13 [DEBUG   ] spawn_process: at 2018-11-15 22:13:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 22:13:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 22:13:13 [DEBUG   ] spawn_process: at 2018-11-15 22:13:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 22:13:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 22:13:13 [DEBUG   ] spawn_process: at 2018-11-15 22:13:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 22:13:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 22:13:13 [DEBUG   ] spawn_process: at 2018-11-15 22:13:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 22:13:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 22:13:13 [DEBUG   ] spawn_process: at 2018-11-15 22:13:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 22:13:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 22:13:13 [DEBUG   ] spawn_process: at 2018-11-15 22:13:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 22:13:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 22:13:13 [DEBUG   ] spawn_process: at 2018-11-15 22:13:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 22:13:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 22:13:13 [DEBUG   ] spawn_process: at 2018-11-15 22:13:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 22:13:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 22:13:13 [DEBUG   ] spawn_process: at 2018-11-15 22:13:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 22:13:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 22:13:13 [DEBUG   ] spawn_process: at 2018-11-15 22:13:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 22:13:25 [DEBUG   ] Got command RPT from MCS: ref #519585
2018-11-15 22:13:25 [DEBUG   ] summary = ERROR
2018-11-15 22:13:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519585  13 58437 80005433 A  ERRORERROR'
2018-11-15 22:13:25 [DEBUG   ] Got command RPT from MCS: ref #519586
2018-11-15 22:13:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 22:13:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519586  77 58437 80005637 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 22:13:25 [DEBUG   ] Got command RPT from MCS: ref #519587
2018-11-15 22:13:25 [DEBUG   ] summary = ERROR
2018-11-15 22:13:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519587  13 58437 80005841 A  ERRORERROR'
2018-11-15 22:13:26 [DEBUG   ] Got command RPT from MCS: ref #519588
2018-11-15 22:13:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 22:13:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519588  77 58437 80006033 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 22:13:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 22:13:26 [DEBUG   ] Got command RPT from MCS: ref #519589
2018-11-15 22:13:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 22:13:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519589  12 58437 80006245 A  ERRORBŽÌÍ'
2018-11-15 22:13:26 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 22:13:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:13:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-15 22:13:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-11-15 22:13:26 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 22:13:26 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-15 22:13:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 22:13:26 [WARNING ] (13, 1, 'bot')
2018-11-15 22:13:26 [WARNING ] (13, 1, 'bot')
2018-11-15 22:13:26 [WARNING ] (13, 1, 'bot')
2018-11-15 22:13:26 [WARNING ] (13, 1, 'bot')
2018-11-15 22:13:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 22:13:26 [DEBUG   ] Finished updating board flags in 1.030 seconds
2018-11-15 22:13:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 22:13:37 [DEBUG   ] Got command BAM from MCS: ref #519591
2018-11-15 22:13:37 [INFO    ] Finished processing BAM request
2018-11-15 22:13:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:13:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519591   8 58437 80017025 A  ERROR'
2018-11-15 22:13:37 [DEBUG   ] Got command BAM from MCS: ref #519590
2018-11-15 22:13:37 [INFO    ] Finished processing BAM request
2018-11-15 22:13:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:13:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519590   8 58437 80017029 A  ERROR'
2018-11-15 22:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 22:13:37 [DEBUG   ] spawn_process: at 2018-11-15 22:13:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 22:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 22:13:37 [DEBUG   ] spawn_process: at 2018-11-15 22:13:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 22:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 22:13:37 [DEBUG   ] spawn_process: at 2018-11-15 22:13:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 22:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 22:13:37 [DEBUG   ] spawn_process: at 2018-11-15 22:13:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 22:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 22:13:37 [DEBUG   ] spawn_process: at 2018-11-15 22:13:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 22:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 22:13:37 [DEBUG   ] spawn_process: at 2018-11-15 22:13:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 22:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 22:13:37 [DEBUG   ] spawn_process: at 2018-11-15 22:13:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 22:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 22:13:37 [DEBUG   ] spawn_process: at 2018-11-15 22:13:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 22:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 22:13:37 [DEBUG   ] spawn_process: at 2018-11-15 22:13:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 22:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 22:13:37 [DEBUG   ] spawn_process: at 2018-11-15 22:13:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 22:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 22:13:37 [DEBUG   ] spawn_process: at 2018-11-15 22:13:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 22:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 22:13:37 [DEBUG   ] spawn_process: at 2018-11-15 22:13:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 22:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 22:13:37 [DEBUG   ] spawn_process: at 2018-11-15 22:13:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 22:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 22:13:37 [DEBUG   ] spawn_process: at 2018-11-15 22:13:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 22:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 22:13:37 [DEBUG   ] spawn_process: at 2018-11-15 22:13:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 22:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 22:13:37 [DEBUG   ] spawn_process: at 2018-11-15 22:13:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 22:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 22:13:37 [DEBUG   ] spawn_process: at 2018-11-15 22:13:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 22:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 22:13:37 [DEBUG   ] spawn_process: at 2018-11-15 22:13:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 22:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 22:13:37 [DEBUG   ] spawn_process: at 2018-11-15 22:13:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 22:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 22:13:37 [DEBUG   ] spawn_process: at 2018-11-15 22:13:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 22:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 22:13:37 [DEBUG   ] spawn_process: at 2018-11-15 22:13:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 22:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 22:13:37 [DEBUG   ] spawn_process: at 2018-11-15 22:13:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 22:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 22:13:37 [DEBUG   ] spawn_process: at 2018-11-15 22:13:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 22:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 22:13:37 [DEBUG   ] spawn_process: at 2018-11-15 22:13:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 22:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 22:13:37 [DEBUG   ] spawn_process: at 2018-11-15 22:13:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 22:13:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 22:13:37 [DEBUG   ] spawn_process: at 2018-11-15 22:13:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 22:13:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 22:14:01 [DEBUG   ] Got command BAM from MCS: ref #519592
2018-11-15 22:14:01 [INFO    ] Finished processing BAM request
2018-11-15 22:14:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:14:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519592   8 58437 80041025 A  ERROR'
2018-11-15 22:14:01 [DEBUG   ] Got command BAM from MCS: ref #519593
2018-11-15 22:14:01 [INFO    ] Finished processing BAM request
2018-11-15 22:14:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:14:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519593   8 58437 80041029 A  ERROR'
2018-11-15 22:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 22:14:01 [DEBUG   ] spawn_process: at 2018-11-15 22:14:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 22:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 22:14:01 [DEBUG   ] spawn_process: at 2018-11-15 22:14:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 22:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 22:14:01 [DEBUG   ] spawn_process: at 2018-11-15 22:14:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 22:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 22:14:01 [DEBUG   ] spawn_process: at 2018-11-15 22:14:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 22:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 22:14:01 [DEBUG   ] spawn_process: at 2018-11-15 22:14:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 22:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 22:14:01 [DEBUG   ] spawn_process: at 2018-11-15 22:14:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 22:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 22:14:01 [DEBUG   ] spawn_process: at 2018-11-15 22:14:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 22:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 22:14:01 [DEBUG   ] spawn_process: at 2018-11-15 22:14:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 22:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 22:14:01 [DEBUG   ] spawn_process: at 2018-11-15 22:14:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 22:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 22:14:01 [DEBUG   ] spawn_process: at 2018-11-15 22:14:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 22:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 22:14:01 [DEBUG   ] spawn_process: at 2018-11-15 22:14:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 22:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 22:14:01 [DEBUG   ] spawn_process: at 2018-11-15 22:14:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 22:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 22:14:01 [DEBUG   ] spawn_process: at 2018-11-15 22:14:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 22:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 22:14:01 [DEBUG   ] spawn_process: at 2018-11-15 22:14:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 22:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 22:14:01 [DEBUG   ] spawn_process: at 2018-11-15 22:14:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 22:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 22:14:01 [DEBUG   ] spawn_process: at 2018-11-15 22:14:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 22:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 22:14:01 [DEBUG   ] spawn_process: at 2018-11-15 22:14:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 22:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 22:14:01 [DEBUG   ] spawn_process: at 2018-11-15 22:14:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 22:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 22:14:01 [DEBUG   ] spawn_process: at 2018-11-15 22:14:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 22:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 22:14:01 [DEBUG   ] spawn_process: at 2018-11-15 22:14:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 22:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 22:14:01 [DEBUG   ] spawn_process: at 2018-11-15 22:14:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 22:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 22:14:01 [DEBUG   ] spawn_process: at 2018-11-15 22:14:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 22:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 22:14:01 [DEBUG   ] spawn_process: at 2018-11-15 22:14:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 22:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 22:14:01 [DEBUG   ] spawn_process: at 2018-11-15 22:14:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 22:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 22:14:01 [DEBUG   ] spawn_process: at 2018-11-15 22:14:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 22:14:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 22:14:01 [DEBUG   ] spawn_process: at 2018-11-15 22:14:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 22:14:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 22:14:25 [DEBUG   ] Got command BAM from MCS: ref #519595
2018-11-15 22:14:25 [INFO    ] Finished processing BAM request
2018-11-15 22:14:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:14:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519595   8 58437 80065025 A  ERROR'
2018-11-15 22:14:25 [DEBUG   ] Got command BAM from MCS: ref #519594
2018-11-15 22:14:25 [INFO    ] Finished processing BAM request
2018-11-15 22:14:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:14:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519594   8 58437 80065029 A  ERROR'
2018-11-15 22:14:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 22:14:25 [DEBUG   ] spawn_process: at 2018-11-15 22:14:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 22:14:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 22:14:25 [DEBUG   ] spawn_process: at 2018-11-15 22:14:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 22:14:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 22:14:25 [DEBUG   ] spawn_process: at 2018-11-15 22:14:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 22:14:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 22:14:25 [DEBUG   ] spawn_process: at 2018-11-15 22:14:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 22:14:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 22:14:25 [DEBUG   ] spawn_process: at 2018-11-15 22:14:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 22:14:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 22:14:25 [DEBUG   ] spawn_process: at 2018-11-15 22:14:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 22:14:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 22:14:25 [DEBUG   ] spawn_process: at 2018-11-15 22:14:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 22:14:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 22:14:25 [DEBUG   ] spawn_process: at 2018-11-15 22:14:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 22:14:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 22:14:25 [DEBUG   ] spawn_process: at 2018-11-15 22:14:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 22:14:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 22:14:25 [DEBUG   ] spawn_process: at 2018-11-15 22:14:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 22:14:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 22:14:25 [DEBUG   ] spawn_process: at 2018-11-15 22:14:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 22:14:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 22:14:25 [DEBUG   ] spawn_process: at 2018-11-15 22:14:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 22:14:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 22:14:25 [DEBUG   ] spawn_process: at 2018-11-15 22:14:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 22:14:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 22:14:25 [DEBUG   ] spawn_process: at 2018-11-15 22:14:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 22:14:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 22:14:25 [DEBUG   ] spawn_process: at 2018-11-15 22:14:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 22:14:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 22:14:25 [DEBUG   ] spawn_process: at 2018-11-15 22:14:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 22:14:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 22:14:25 [DEBUG   ] spawn_process: at 2018-11-15 22:14:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 22:14:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 22:14:25 [DEBUG   ] spawn_process: at 2018-11-15 22:14:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 22:14:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 22:14:25 [DEBUG   ] spawn_process: at 2018-11-15 22:14:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 22:14:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 22:14:25 [DEBUG   ] spawn_process: at 2018-11-15 22:14:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 22:14:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 22:14:25 [DEBUG   ] spawn_process: at 2018-11-15 22:14:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 22:14:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 22:14:25 [DEBUG   ] spawn_process: at 2018-11-15 22:14:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 22:14:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 22:14:25 [DEBUG   ] spawn_process: at 2018-11-15 22:14:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 22:14:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 22:14:25 [DEBUG   ] spawn_process: at 2018-11-15 22:14:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 22:14:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 22:14:25 [DEBUG   ] spawn_process: at 2018-11-15 22:14:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 22:14:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 22:14:25 [DEBUG   ] spawn_process: at 2018-11-15 22:14:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 22:14:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:14:26 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 22:14:26 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-15 22:14:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 22:14:26 [WARNING ] (13, 1, 'bot')
2018-11-15 22:14:26 [WARNING ] (13, 1, 'bot')
2018-11-15 22:14:26 [WARNING ] (13, 1, 'bot')
2018-11-15 22:14:26 [WARNING ] (13, 1, 'bot')
2018-11-15 22:14:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 22:14:26 [DEBUG   ] Finished updating board flags in 0.977 seconds
2018-11-15 22:14:28 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-15 22:14:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 22:14:49 [DEBUG   ] Got command BAM from MCS: ref #519601
2018-11-15 22:14:49 [INFO    ] Finished processing BAM request
2018-11-15 22:14:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:14:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519601   8 58437 80089029 A  ERROR'
2018-11-15 22:14:49 [DEBUG   ] Got command BAM from MCS: ref #519600
2018-11-15 22:14:49 [INFO    ] Finished processing BAM request
2018-11-15 22:14:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:14:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519600   8 58437 80089033 A  ERROR'
2018-11-15 22:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 22:14:49 [DEBUG   ] spawn_process: at 2018-11-15 22:14:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 22:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 22:14:49 [DEBUG   ] spawn_process: at 2018-11-15 22:14:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 22:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 22:14:49 [DEBUG   ] spawn_process: at 2018-11-15 22:14:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 22:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 22:14:49 [DEBUG   ] spawn_process: at 2018-11-15 22:14:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 22:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 22:14:49 [DEBUG   ] spawn_process: at 2018-11-15 22:14:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 22:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 22:14:49 [DEBUG   ] spawn_process: at 2018-11-15 22:14:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 22:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 22:14:49 [DEBUG   ] spawn_process: at 2018-11-15 22:14:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 22:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 22:14:49 [DEBUG   ] spawn_process: at 2018-11-15 22:14:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 22:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 22:14:49 [DEBUG   ] spawn_process: at 2018-11-15 22:14:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 22:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 22:14:49 [DEBUG   ] spawn_process: at 2018-11-15 22:14:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 22:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 22:14:49 [DEBUG   ] spawn_process: at 2018-11-15 22:14:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 22:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 22:14:49 [DEBUG   ] spawn_process: at 2018-11-15 22:14:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 22:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 22:14:49 [DEBUG   ] spawn_process: at 2018-11-15 22:14:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 22:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 22:14:49 [DEBUG   ] spawn_process: at 2018-11-15 22:14:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 22:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 22:14:49 [DEBUG   ] spawn_process: at 2018-11-15 22:14:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 22:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 22:14:49 [DEBUG   ] spawn_process: at 2018-11-15 22:14:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 22:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 22:14:49 [DEBUG   ] spawn_process: at 2018-11-15 22:14:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 22:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 22:14:49 [DEBUG   ] spawn_process: at 2018-11-15 22:14:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 22:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 22:14:49 [DEBUG   ] spawn_process: at 2018-11-15 22:14:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 22:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 22:14:49 [DEBUG   ] spawn_process: at 2018-11-15 22:14:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 22:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 22:14:49 [DEBUG   ] spawn_process: at 2018-11-15 22:14:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 22:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 22:14:49 [DEBUG   ] spawn_process: at 2018-11-15 22:14:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 22:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 22:14:49 [DEBUG   ] spawn_process: at 2018-11-15 22:14:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 22:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 22:14:49 [DEBUG   ] spawn_process: at 2018-11-15 22:14:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 22:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 22:14:49 [DEBUG   ] spawn_process: at 2018-11-15 22:14:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 22:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 22:14:49 [DEBUG   ] spawn_process: at 2018-11-15 22:14:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 22:15:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 22:15:13 [DEBUG   ] Got command BAM from MCS: ref #519603
2018-11-15 22:15:13 [INFO    ] Finished processing BAM request
2018-11-15 22:15:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:15:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519603   8 58437 80113029 A  ERROR'
2018-11-15 22:15:13 [DEBUG   ] Got command BAM from MCS: ref #519602
2018-11-15 22:15:13 [INFO    ] Finished processing BAM request
2018-11-15 22:15:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:15:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519602   8 58437 80113033 A  ERROR'
2018-11-15 22:15:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 22:15:13 [DEBUG   ] spawn_process: at 2018-11-15 22:15:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 22:15:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 22:15:13 [DEBUG   ] spawn_process: at 2018-11-15 22:15:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 22:15:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 22:15:13 [DEBUG   ] spawn_process: at 2018-11-15 22:15:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 22:15:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 22:15:13 [DEBUG   ] spawn_process: at 2018-11-15 22:15:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 22:15:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 22:15:13 [DEBUG   ] spawn_process: at 2018-11-15 22:15:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 22:15:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 22:15:13 [DEBUG   ] spawn_process: at 2018-11-15 22:15:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 22:15:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 22:15:13 [DEBUG   ] spawn_process: at 2018-11-15 22:15:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 22:15:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 22:15:13 [DEBUG   ] spawn_process: at 2018-11-15 22:15:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 22:15:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 22:15:13 [DEBUG   ] spawn_process: at 2018-11-15 22:15:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 22:15:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 22:15:13 [DEBUG   ] spawn_process: at 2018-11-15 22:15:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 22:15:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 22:15:13 [DEBUG   ] spawn_process: at 2018-11-15 22:15:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 22:15:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 22:15:13 [DEBUG   ] spawn_process: at 2018-11-15 22:15:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 22:15:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 22:15:13 [DEBUG   ] spawn_process: at 2018-11-15 22:15:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 22:15:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 22:15:13 [DEBUG   ] spawn_process: at 2018-11-15 22:15:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 22:15:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 22:15:13 [DEBUG   ] spawn_process: at 2018-11-15 22:15:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 22:15:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 22:15:13 [DEBUG   ] spawn_process: at 2018-11-15 22:15:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 22:15:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 22:15:13 [DEBUG   ] spawn_process: at 2018-11-15 22:15:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 22:15:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 22:15:13 [DEBUG   ] spawn_process: at 2018-11-15 22:15:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 22:15:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 22:15:13 [DEBUG   ] spawn_process: at 2018-11-15 22:15:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 22:15:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 22:15:13 [DEBUG   ] spawn_process: at 2018-11-15 22:15:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 22:15:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 22:15:13 [DEBUG   ] spawn_process: at 2018-11-15 22:15:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 22:15:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 22:15:13 [DEBUG   ] spawn_process: at 2018-11-15 22:15:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 22:15:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 22:15:13 [DEBUG   ] spawn_process: at 2018-11-15 22:15:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 22:15:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 22:15:13 [DEBUG   ] spawn_process: at 2018-11-15 22:15:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 22:15:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 22:15:13 [DEBUG   ] spawn_process: at 2018-11-15 22:15:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 22:15:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 22:15:13 [DEBUG   ] spawn_process: at 2018-11-15 22:15:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 22:15:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 22:15:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:15:27 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 22:15:27 [WARNING ] (13, 1, 'bot')
2018-11-15 22:15:27 [WARNING ] (13, 1, 'bot')
2018-11-15 22:15:27 [WARNING ] (13, 1, 'bot')
2018-11-15 22:15:27 [WARNING ] (13, 1, 'bot')
2018-11-15 22:15:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 22:15:27 [DEBUG   ] Finished updating board flags in 1.397 seconds
2018-11-15 22:15:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 22:15:37 [DEBUG   ] Got command BAM from MCS: ref #519604
2018-11-15 22:15:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519604   8 58437 80137234 A  ERROR'
2018-11-15 22:15:37 [DEBUG   ] Got command BAM from MCS: ref #519605
2018-11-15 22:15:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:15:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519605   8 58437 80137238 A  ERROR'
2018-11-15 22:15:37 [INFO    ] Finished processing BAM request
2018-11-15 22:15:37 [INFO    ] Finished processing BAM request
2018-11-15 22:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 22:15:37 [DEBUG   ] spawn_process: at 2018-11-15 22:15:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 22:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 22:15:37 [DEBUG   ] spawn_process: at 2018-11-15 22:15:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 22:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 22:15:37 [DEBUG   ] spawn_process: at 2018-11-15 22:15:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 22:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 22:15:37 [DEBUG   ] spawn_process: at 2018-11-15 22:15:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 22:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 22:15:37 [DEBUG   ] spawn_process: at 2018-11-15 22:15:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 22:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 22:15:37 [DEBUG   ] spawn_process: at 2018-11-15 22:15:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 22:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 22:15:37 [DEBUG   ] spawn_process: at 2018-11-15 22:15:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 22:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 22:15:37 [DEBUG   ] spawn_process: at 2018-11-15 22:15:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 22:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 22:15:37 [DEBUG   ] spawn_process: at 2018-11-15 22:15:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 22:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 22:15:37 [DEBUG   ] spawn_process: at 2018-11-15 22:15:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 22:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 22:15:37 [DEBUG   ] spawn_process: at 2018-11-15 22:15:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 22:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 22:15:37 [DEBUG   ] spawn_process: at 2018-11-15 22:15:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 22:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 22:15:37 [DEBUG   ] spawn_process: at 2018-11-15 22:15:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 22:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 22:15:37 [DEBUG   ] spawn_process: at 2018-11-15 22:15:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 22:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 22:15:37 [DEBUG   ] spawn_process: at 2018-11-15 22:15:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 22:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 22:15:37 [DEBUG   ] spawn_process: at 2018-11-15 22:15:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 22:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 22:15:37 [DEBUG   ] spawn_process: at 2018-11-15 22:15:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 22:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 22:15:37 [DEBUG   ] spawn_process: at 2018-11-15 22:15:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 22:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 22:15:37 [DEBUG   ] spawn_process: at 2018-11-15 22:15:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 22:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 22:15:37 [DEBUG   ] spawn_process: at 2018-11-15 22:15:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 22:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 22:15:37 [DEBUG   ] spawn_process: at 2018-11-15 22:15:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 22:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 22:15:37 [DEBUG   ] spawn_process: at 2018-11-15 22:15:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 22:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 22:15:37 [DEBUG   ] spawn_process: at 2018-11-15 22:15:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 22:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 22:15:37 [DEBUG   ] spawn_process: at 2018-11-15 22:15:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 22:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 22:15:37 [DEBUG   ] spawn_process: at 2018-11-15 22:15:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 22:15:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 22:15:37 [DEBUG   ] spawn_process: at 2018-11-15 22:15:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 22:15:45 [DEBUG   ] Got command RPT from MCS: ref #519606
2018-11-15 22:15:45 [DEBUG   ] summary = ERROR
2018-11-15 22:15:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519606  13 58437 80145217 A  ERRORERROR'
2018-11-15 22:15:45 [DEBUG   ] Got command RPT from MCS: ref #519607
2018-11-15 22:15:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 22:15:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519607  77 58437 80145218 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 22:15:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 22:16:01 [DEBUG   ] Got command BAM from MCS: ref #519624
2018-11-15 22:16:01 [INFO    ] Finished processing BAM request
2018-11-15 22:16:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:16:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519624   8 58437 80161026 A  ERROR'
2018-11-15 22:16:01 [DEBUG   ] Got command BAM from MCS: ref #519623
2018-11-15 22:16:01 [INFO    ] Finished processing BAM request
2018-11-15 22:16:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:16:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519623   8 58437 80161030 A  ERROR'
2018-11-15 22:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 22:16:01 [DEBUG   ] spawn_process: at 2018-11-15 22:16:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 22:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 22:16:01 [DEBUG   ] spawn_process: at 2018-11-15 22:16:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 22:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 22:16:01 [DEBUG   ] spawn_process: at 2018-11-15 22:16:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 22:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 22:16:01 [DEBUG   ] spawn_process: at 2018-11-15 22:16:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 22:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 22:16:01 [DEBUG   ] spawn_process: at 2018-11-15 22:16:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 22:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 22:16:01 [DEBUG   ] spawn_process: at 2018-11-15 22:16:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 22:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 22:16:01 [DEBUG   ] spawn_process: at 2018-11-15 22:16:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 22:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 22:16:01 [DEBUG   ] spawn_process: at 2018-11-15 22:16:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 22:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 22:16:01 [DEBUG   ] spawn_process: at 2018-11-15 22:16:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 22:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 22:16:01 [DEBUG   ] spawn_process: at 2018-11-15 22:16:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 22:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 22:16:01 [DEBUG   ] spawn_process: at 2018-11-15 22:16:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 22:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 22:16:01 [DEBUG   ] spawn_process: at 2018-11-15 22:16:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 22:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 22:16:01 [DEBUG   ] spawn_process: at 2018-11-15 22:16:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 22:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 22:16:01 [DEBUG   ] spawn_process: at 2018-11-15 22:16:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 22:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 22:16:01 [DEBUG   ] spawn_process: at 2018-11-15 22:16:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 22:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 22:16:01 [DEBUG   ] spawn_process: at 2018-11-15 22:16:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 22:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 22:16:01 [DEBUG   ] spawn_process: at 2018-11-15 22:16:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 22:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 22:16:01 [DEBUG   ] spawn_process: at 2018-11-15 22:16:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 22:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 22:16:01 [DEBUG   ] spawn_process: at 2018-11-15 22:16:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 22:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 22:16:01 [DEBUG   ] spawn_process: at 2018-11-15 22:16:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 22:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 22:16:01 [DEBUG   ] spawn_process: at 2018-11-15 22:16:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 22:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 22:16:01 [DEBUG   ] spawn_process: at 2018-11-15 22:16:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 22:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 22:16:01 [DEBUG   ] spawn_process: at 2018-11-15 22:16:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 22:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 22:16:01 [DEBUG   ] spawn_process: at 2018-11-15 22:16:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 22:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 22:16:01 [DEBUG   ] spawn_process: at 2018-11-15 22:16:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 22:16:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 22:16:01 [DEBUG   ] spawn_process: at 2018-11-15 22:16:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 22:16:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 22:16:25 [DEBUG   ] Got command BAM from MCS: ref #519625
2018-11-15 22:16:25 [INFO    ] Finished processing BAM request
2018-11-15 22:16:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:16:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519625   8 58437 80185025 A  ERROR'
2018-11-15 22:16:25 [DEBUG   ] Got command BAM from MCS: ref #519626
2018-11-15 22:16:25 [INFO    ] Finished processing BAM request
2018-11-15 22:16:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:16:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519626   8 58437 80185029 A  ERROR'
2018-11-15 22:16:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 22:16:25 [DEBUG   ] spawn_process: at 2018-11-15 22:16:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 22:16:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 22:16:25 [DEBUG   ] spawn_process: at 2018-11-15 22:16:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 22:16:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 22:16:25 [DEBUG   ] spawn_process: at 2018-11-15 22:16:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 22:16:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 22:16:25 [DEBUG   ] spawn_process: at 2018-11-15 22:16:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 22:16:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 22:16:25 [DEBUG   ] spawn_process: at 2018-11-15 22:16:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 22:16:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 22:16:25 [DEBUG   ] spawn_process: at 2018-11-15 22:16:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 22:16:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 22:16:25 [DEBUG   ] spawn_process: at 2018-11-15 22:16:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 22:16:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 22:16:25 [DEBUG   ] spawn_process: at 2018-11-15 22:16:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 22:16:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 22:16:25 [DEBUG   ] spawn_process: at 2018-11-15 22:16:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 22:16:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 22:16:25 [DEBUG   ] spawn_process: at 2018-11-15 22:16:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 22:16:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 22:16:25 [DEBUG   ] spawn_process: at 2018-11-15 22:16:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 22:16:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 22:16:25 [DEBUG   ] spawn_process: at 2018-11-15 22:16:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 22:16:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 22:16:25 [DEBUG   ] spawn_process: at 2018-11-15 22:16:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 22:16:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 22:16:25 [DEBUG   ] spawn_process: at 2018-11-15 22:16:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 22:16:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 22:16:25 [DEBUG   ] spawn_process: at 2018-11-15 22:16:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 22:16:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 22:16:25 [DEBUG   ] spawn_process: at 2018-11-15 22:16:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 22:16:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 22:16:25 [DEBUG   ] spawn_process: at 2018-11-15 22:16:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 22:16:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 22:16:25 [DEBUG   ] spawn_process: at 2018-11-15 22:16:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 22:16:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 22:16:25 [DEBUG   ] spawn_process: at 2018-11-15 22:16:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 22:16:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 22:16:25 [DEBUG   ] spawn_process: at 2018-11-15 22:16:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 22:16:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 22:16:25 [DEBUG   ] spawn_process: at 2018-11-15 22:16:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 22:16:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 22:16:25 [DEBUG   ] spawn_process: at 2018-11-15 22:16:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 22:16:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 22:16:25 [DEBUG   ] spawn_process: at 2018-11-15 22:16:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 22:16:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 22:16:25 [DEBUG   ] spawn_process: at 2018-11-15 22:16:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 22:16:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 22:16:25 [DEBUG   ] spawn_process: at 2018-11-15 22:16:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 22:16:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 22:16:25 [DEBUG   ] spawn_process: at 2018-11-15 22:16:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 22:16:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 22:16:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:16:27 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 22:16:27 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 22:16:27 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 22:16:27 [WARNING ] (13, 1, 'bot')
2018-11-15 22:16:27 [WARNING ] (13, 1, 'bot')
2018-11-15 22:16:27 [WARNING ] (13, 1, 'bot')
2018-11-15 22:16:27 [WARNING ] (13, 1, 'bot')
2018-11-15 22:16:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 22:16:27 [DEBUG   ] Finished updating board flags in 1.174 seconds
2018-11-15 22:16:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 22:16:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 22:16:49 [DEBUG   ] Got command BAM from MCS: ref #519628
2018-11-15 22:16:49 [INFO    ] Finished processing BAM request
2018-11-15 22:16:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:16:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519628   8 58437 80209029 A  ERROR'
2018-11-15 22:16:49 [DEBUG   ] Got command BAM from MCS: ref #519627
2018-11-15 22:16:49 [INFO    ] Finished processing BAM request
2018-11-15 22:16:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:16:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519627   8 58437 80209033 A  ERROR'
2018-11-15 22:16:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 22:16:49 [DEBUG   ] spawn_process: at 2018-11-15 22:16:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 22:16:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 22:16:49 [DEBUG   ] spawn_process: at 2018-11-15 22:16:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 22:16:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 22:16:49 [DEBUG   ] spawn_process: at 2018-11-15 22:16:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 22:16:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 22:16:49 [DEBUG   ] spawn_process: at 2018-11-15 22:16:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 22:16:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 22:16:49 [DEBUG   ] spawn_process: at 2018-11-15 22:16:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 22:16:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 22:16:49 [DEBUG   ] spawn_process: at 2018-11-15 22:16:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 22:16:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 22:16:49 [DEBUG   ] spawn_process: at 2018-11-15 22:16:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 22:16:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 22:16:49 [DEBUG   ] spawn_process: at 2018-11-15 22:16:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 22:16:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 22:16:49 [DEBUG   ] spawn_process: at 2018-11-15 22:16:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 22:16:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 22:16:49 [DEBUG   ] spawn_process: at 2018-11-15 22:16:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 22:16:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 22:16:49 [DEBUG   ] spawn_process: at 2018-11-15 22:16:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 22:16:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 22:16:49 [DEBUG   ] spawn_process: at 2018-11-15 22:16:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 22:16:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 22:16:49 [DEBUG   ] spawn_process: at 2018-11-15 22:16:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 22:16:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 22:16:49 [DEBUG   ] spawn_process: at 2018-11-15 22:16:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 22:16:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 22:16:49 [DEBUG   ] spawn_process: at 2018-11-15 22:16:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 22:16:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 22:16:49 [DEBUG   ] spawn_process: at 2018-11-15 22:16:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 22:16:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 22:16:49 [DEBUG   ] spawn_process: at 2018-11-15 22:16:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 22:16:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 22:16:49 [DEBUG   ] spawn_process: at 2018-11-15 22:16:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 22:16:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 22:16:49 [DEBUG   ] spawn_process: at 2018-11-15 22:16:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 22:16:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 22:16:49 [DEBUG   ] spawn_process: at 2018-11-15 22:16:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 22:16:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 22:16:49 [DEBUG   ] spawn_process: at 2018-11-15 22:16:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 22:16:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 22:16:49 [DEBUG   ] spawn_process: at 2018-11-15 22:16:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 22:16:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 22:16:49 [DEBUG   ] spawn_process: at 2018-11-15 22:16:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 22:16:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 22:16:49 [DEBUG   ] spawn_process: at 2018-11-15 22:16:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 22:16:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 22:16:49 [DEBUG   ] spawn_process: at 2018-11-15 22:16:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 22:16:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 22:16:49 [DEBUG   ] spawn_process: at 2018-11-15 22:16:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 22:17:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 22:17:13 [DEBUG   ] Got command BAM from MCS: ref #519629
2018-11-15 22:17:13 [INFO    ] Finished processing BAM request
2018-11-15 22:17:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:17:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519629   8 58437 80233025 A  ERROR'
2018-11-15 22:17:13 [DEBUG   ] Got command BAM from MCS: ref #519630
2018-11-15 22:17:13 [INFO    ] Finished processing BAM request
2018-11-15 22:17:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:17:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519630   8 58437 80233029 A  ERROR'
2018-11-15 22:17:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 22:17:13 [DEBUG   ] spawn_process: at 2018-11-15 22:17:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 22:17:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 22:17:13 [DEBUG   ] spawn_process: at 2018-11-15 22:17:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 22:17:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 22:17:13 [DEBUG   ] spawn_process: at 2018-11-15 22:17:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 22:17:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 22:17:13 [DEBUG   ] spawn_process: at 2018-11-15 22:17:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 22:17:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 22:17:13 [DEBUG   ] spawn_process: at 2018-11-15 22:17:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 22:17:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 22:17:13 [DEBUG   ] spawn_process: at 2018-11-15 22:17:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 22:17:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 22:17:13 [DEBUG   ] spawn_process: at 2018-11-15 22:17:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 22:17:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 22:17:13 [DEBUG   ] spawn_process: at 2018-11-15 22:17:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 22:17:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 22:17:13 [DEBUG   ] spawn_process: at 2018-11-15 22:17:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 22:17:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 22:17:13 [DEBUG   ] spawn_process: at 2018-11-15 22:17:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 22:17:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 22:17:13 [DEBUG   ] spawn_process: at 2018-11-15 22:17:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 22:17:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 22:17:13 [DEBUG   ] spawn_process: at 2018-11-15 22:17:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 22:17:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 22:17:13 [DEBUG   ] spawn_process: at 2018-11-15 22:17:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 22:17:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 22:17:13 [DEBUG   ] spawn_process: at 2018-11-15 22:17:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 22:17:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 22:17:13 [DEBUG   ] spawn_process: at 2018-11-15 22:17:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 22:17:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 22:17:13 [DEBUG   ] spawn_process: at 2018-11-15 22:17:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 22:17:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 22:17:13 [DEBUG   ] spawn_process: at 2018-11-15 22:17:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 22:17:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 22:17:13 [DEBUG   ] spawn_process: at 2018-11-15 22:17:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 22:17:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 22:17:13 [DEBUG   ] spawn_process: at 2018-11-15 22:17:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 22:17:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 22:17:13 [DEBUG   ] spawn_process: at 2018-11-15 22:17:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 22:17:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 22:17:13 [DEBUG   ] spawn_process: at 2018-11-15 22:17:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 22:17:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 22:17:13 [DEBUG   ] spawn_process: at 2018-11-15 22:17:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 22:17:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 22:17:13 [DEBUG   ] spawn_process: at 2018-11-15 22:17:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 22:17:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 22:17:13 [DEBUG   ] spawn_process: at 2018-11-15 22:17:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 22:17:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 22:17:13 [DEBUG   ] spawn_process: at 2018-11-15 22:17:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 22:17:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 22:17:13 [DEBUG   ] spawn_process: at 2018-11-15 22:17:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 22:17:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 22:17:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:17:27 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 22:17:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 22:17:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 22:17:27 [WARNING ] (13, 1, 'bot')
2018-11-15 22:17:27 [WARNING ] (13, 1, 'bot')
2018-11-15 22:17:27 [WARNING ] (13, 1, 'bot')
2018-11-15 22:17:27 [WARNING ] (13, 1, 'bot')
2018-11-15 22:17:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 22:17:27 [DEBUG   ] Finished updating board flags in 1.028 seconds
2018-11-15 22:17:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 22:17:37 [DEBUG   ] Got command BAM from MCS: ref #519635
2018-11-15 22:17:37 [INFO    ] Finished processing BAM request
2018-11-15 22:17:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:17:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519635   8 58437 80257029 A  ERROR'
2018-11-15 22:17:37 [DEBUG   ] Got command BAM from MCS: ref #519636
2018-11-15 22:17:37 [INFO    ] Finished processing BAM request
2018-11-15 22:17:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:17:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519636   8 58437 80257033 A  ERROR'
2018-11-15 22:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 22:17:37 [DEBUG   ] spawn_process: at 2018-11-15 22:17:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 22:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 22:17:37 [DEBUG   ] spawn_process: at 2018-11-15 22:17:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 22:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 22:17:37 [DEBUG   ] spawn_process: at 2018-11-15 22:17:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 22:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 22:17:37 [DEBUG   ] spawn_process: at 2018-11-15 22:17:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 22:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 22:17:37 [DEBUG   ] spawn_process: at 2018-11-15 22:17:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 22:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 22:17:37 [DEBUG   ] spawn_process: at 2018-11-15 22:17:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 22:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 22:17:37 [DEBUG   ] spawn_process: at 2018-11-15 22:17:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 22:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 22:17:37 [DEBUG   ] spawn_process: at 2018-11-15 22:17:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 22:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 22:17:37 [DEBUG   ] spawn_process: at 2018-11-15 22:17:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 22:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 22:17:37 [DEBUG   ] spawn_process: at 2018-11-15 22:17:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 22:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 22:17:37 [DEBUG   ] spawn_process: at 2018-11-15 22:17:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 22:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 22:17:37 [DEBUG   ] spawn_process: at 2018-11-15 22:17:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 22:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 22:17:37 [DEBUG   ] spawn_process: at 2018-11-15 22:17:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 22:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 22:17:37 [DEBUG   ] spawn_process: at 2018-11-15 22:17:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 22:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 22:17:37 [DEBUG   ] spawn_process: at 2018-11-15 22:17:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 22:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 22:17:37 [DEBUG   ] spawn_process: at 2018-11-15 22:17:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 22:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 22:17:37 [DEBUG   ] spawn_process: at 2018-11-15 22:17:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 22:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 22:17:37 [DEBUG   ] spawn_process: at 2018-11-15 22:17:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 22:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 22:17:37 [DEBUG   ] spawn_process: at 2018-11-15 22:17:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 22:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 22:17:37 [DEBUG   ] spawn_process: at 2018-11-15 22:17:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 22:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 22:17:37 [DEBUG   ] spawn_process: at 2018-11-15 22:17:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 22:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 22:17:37 [DEBUG   ] spawn_process: at 2018-11-15 22:17:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 22:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 22:17:37 [DEBUG   ] spawn_process: at 2018-11-15 22:17:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 22:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 22:17:37 [DEBUG   ] spawn_process: at 2018-11-15 22:17:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 22:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 22:17:37 [DEBUG   ] spawn_process: at 2018-11-15 22:17:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 22:17:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 22:17:37 [DEBUG   ] spawn_process: at 2018-11-15 22:17:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 22:17:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 22:18:01 [DEBUG   ] Got command BAM from MCS: ref #519638
2018-11-15 22:18:01 [INFO    ] Finished processing BAM request
2018-11-15 22:18:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:18:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519638   8 58437 80281025 A  ERROR'
2018-11-15 22:18:01 [DEBUG   ] Got command BAM from MCS: ref #519637
2018-11-15 22:18:01 [INFO    ] Finished processing BAM request
2018-11-15 22:18:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:18:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519637   8 58437 80281029 A  ERROR'
2018-11-15 22:18:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 22:18:01 [DEBUG   ] spawn_process: at 2018-11-15 22:18:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 22:18:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 22:18:01 [DEBUG   ] spawn_process: at 2018-11-15 22:18:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 22:18:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 22:18:01 [DEBUG   ] spawn_process: at 2018-11-15 22:18:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 22:18:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 22:18:01 [DEBUG   ] spawn_process: at 2018-11-15 22:18:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 22:18:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 22:18:01 [DEBUG   ] spawn_process: at 2018-11-15 22:18:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 22:18:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 22:18:01 [DEBUG   ] spawn_process: at 2018-11-15 22:18:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 22:18:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 22:18:01 [DEBUG   ] spawn_process: at 2018-11-15 22:18:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 22:18:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 22:18:01 [DEBUG   ] spawn_process: at 2018-11-15 22:18:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 22:18:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 22:18:01 [DEBUG   ] spawn_process: at 2018-11-15 22:18:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 22:18:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 22:18:01 [DEBUG   ] spawn_process: at 2018-11-15 22:18:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 22:18:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 22:18:01 [DEBUG   ] spawn_process: at 2018-11-15 22:18:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 22:18:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 22:18:01 [DEBUG   ] spawn_process: at 2018-11-15 22:18:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 22:18:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 22:18:01 [DEBUG   ] spawn_process: at 2018-11-15 22:18:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 22:18:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 22:18:01 [DEBUG   ] spawn_process: at 2018-11-15 22:18:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 22:18:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 22:18:01 [DEBUG   ] spawn_process: at 2018-11-15 22:18:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 22:18:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 22:18:01 [DEBUG   ] spawn_process: at 2018-11-15 22:18:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 22:18:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 22:18:01 [DEBUG   ] spawn_process: at 2018-11-15 22:18:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 22:18:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 22:18:01 [DEBUG   ] spawn_process: at 2018-11-15 22:18:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 22:18:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 22:18:01 [DEBUG   ] spawn_process: at 2018-11-15 22:18:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 22:18:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 22:18:01 [DEBUG   ] spawn_process: at 2018-11-15 22:18:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 22:18:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 22:18:01 [DEBUG   ] spawn_process: at 2018-11-15 22:18:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 22:18:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 22:18:01 [DEBUG   ] spawn_process: at 2018-11-15 22:18:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 22:18:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 22:18:01 [DEBUG   ] spawn_process: at 2018-11-15 22:18:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 22:18:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 22:18:01 [DEBUG   ] spawn_process: at 2018-11-15 22:18:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 22:18:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 22:18:01 [DEBUG   ] spawn_process: at 2018-11-15 22:18:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 22:18:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 22:18:01 [DEBUG   ] spawn_process: at 2018-11-15 22:18:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 22:18:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 22:18:25 [DEBUG   ] Got command BAM from MCS: ref #519642
2018-11-15 22:18:25 [INFO    ] Finished processing BAM request
2018-11-15 22:18:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:18:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519642   8 58437 80305029 A  ERROR'
2018-11-15 22:18:25 [DEBUG   ] Got command BAM from MCS: ref #519641
2018-11-15 22:18:25 [INFO    ] Finished processing BAM request
2018-11-15 22:18:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:18:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519641   8 58437 80305033 A  ERROR'
2018-11-15 22:18:25 [DEBUG   ] Got command RPT from MCS: ref #519643
2018-11-15 22:18:25 [DEBUG   ] summary = ERROR
2018-11-15 22:18:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519643  13 58437 80305513 A  ERRORERROR'
2018-11-15 22:18:25 [DEBUG   ] Got command RPT from MCS: ref #519644
2018-11-15 22:18:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 22:18:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519644  77 58437 80305717 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 22:18:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 22:18:25 [DEBUG   ] spawn_process: at 2018-11-15 22:18:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 22:18:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 22:18:25 [DEBUG   ] spawn_process: at 2018-11-15 22:18:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 22:18:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 22:18:25 [DEBUG   ] spawn_process: at 2018-11-15 22:18:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 22:18:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 22:18:25 [DEBUG   ] spawn_process: at 2018-11-15 22:18:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 22:18:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 22:18:25 [DEBUG   ] spawn_process: at 2018-11-15 22:18:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 22:18:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 22:18:25 [DEBUG   ] spawn_process: at 2018-11-15 22:18:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 22:18:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 22:18:25 [DEBUG   ] spawn_process: at 2018-11-15 22:18:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 22:18:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 22:18:25 [DEBUG   ] spawn_process: at 2018-11-15 22:18:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 22:18:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 22:18:25 [DEBUG   ] spawn_process: at 2018-11-15 22:18:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 22:18:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 22:18:25 [DEBUG   ] spawn_process: at 2018-11-15 22:18:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 22:18:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 22:18:25 [DEBUG   ] spawn_process: at 2018-11-15 22:18:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 22:18:25 [DEBUG   ] Got command RPT from MCS: ref #519645
2018-11-15 22:18:25 [DEBUG   ] summary = ERROR
2018-11-15 22:18:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519645  13 58437 80305922 A  ERRORERROR'
2018-11-15 22:18:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 22:18:25 [DEBUG   ] spawn_process: at 2018-11-15 22:18:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 22:18:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 22:18:25 [DEBUG   ] spawn_process: at 2018-11-15 22:18:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 22:18:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 22:18:25 [DEBUG   ] spawn_process: at 2018-11-15 22:18:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 22:18:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 22:18:25 [DEBUG   ] spawn_process: at 2018-11-15 22:18:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 22:18:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 22:18:25 [DEBUG   ] spawn_process: at 2018-11-15 22:18:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 22:18:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 22:18:25 [DEBUG   ] spawn_process: at 2018-11-15 22:18:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 22:18:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 22:18:25 [DEBUG   ] spawn_process: at 2018-11-15 22:18:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 22:18:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 22:18:25 [DEBUG   ] spawn_process: at 2018-11-15 22:18:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 22:18:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 22:18:25 [DEBUG   ] spawn_process: at 2018-11-15 22:18:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 22:18:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 22:18:25 [DEBUG   ] spawn_process: at 2018-11-15 22:18:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 22:18:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 22:18:25 [DEBUG   ] spawn_process: at 2018-11-15 22:18:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 22:18:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 22:18:25 [DEBUG   ] spawn_process: at 2018-11-15 22:18:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 22:18:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 22:18:25 [DEBUG   ] spawn_process: at 2018-11-15 22:18:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 22:18:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 22:18:25 [DEBUG   ] spawn_process: at 2018-11-15 22:18:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 22:18:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 22:18:25 [DEBUG   ] spawn_process: at 2018-11-15 22:18:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 22:18:26 [DEBUG   ] Got command RPT from MCS: ref #519646
2018-11-15 22:18:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 22:18:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519646  77 58437 80306125 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 22:18:26 [DEBUG   ] Got command RPT from MCS: ref #519648
2018-11-15 22:18:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 22:18:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519648  12 58437 80306317 A  ERRORB£ff'
2018-11-15 22:18:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 22:18:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-15 22:18:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:18:28 [DEBUG   ] Finished updating ant stats in 0.825 seconds
2018-11-15 22:18:28 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 22:18:28 [WARNING ] (13, 1, 'bot')
2018-11-15 22:18:28 [WARNING ] (13, 1, 'bot')
2018-11-15 22:18:28 [WARNING ] (13, 1, 'bot')
2018-11-15 22:18:28 [WARNING ] (13, 1, 'bot')
2018-11-15 22:18:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 22:18:28 [DEBUG   ] Finished updating board flags in 2.030 seconds
2018-11-15 22:18:48 [DEBUG   ] Finished updating ant stats in 0.775 seconds
2018-11-15 22:18:49 [DEBUG   ] Got command BAM from MCS: ref #519653
2018-11-15 22:18:49 [INFO    ] Finished processing BAM request
2018-11-15 22:18:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:18:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519653   8 58437 80329029 A  ERROR'
2018-11-15 22:18:49 [DEBUG   ] Got command BAM from MCS: ref #519654
2018-11-15 22:18:49 [INFO    ] Finished processing BAM request
2018-11-15 22:18:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:18:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519654   8 58437 80329033 A  ERROR'
2018-11-15 22:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 22:18:49 [DEBUG   ] spawn_process: at 2018-11-15 22:18:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 22:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 22:18:49 [DEBUG   ] spawn_process: at 2018-11-15 22:18:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 22:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 22:18:49 [DEBUG   ] spawn_process: at 2018-11-15 22:18:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 22:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 22:18:49 [DEBUG   ] spawn_process: at 2018-11-15 22:18:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 22:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 22:18:49 [DEBUG   ] spawn_process: at 2018-11-15 22:18:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 22:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 22:18:49 [DEBUG   ] spawn_process: at 2018-11-15 22:18:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 22:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 22:18:49 [DEBUG   ] spawn_process: at 2018-11-15 22:18:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 22:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 22:18:49 [DEBUG   ] spawn_process: at 2018-11-15 22:18:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 22:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 22:18:49 [DEBUG   ] spawn_process: at 2018-11-15 22:18:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 22:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 22:18:49 [DEBUG   ] spawn_process: at 2018-11-15 22:18:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 22:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 22:18:49 [DEBUG   ] spawn_process: at 2018-11-15 22:18:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 22:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 22:18:49 [DEBUG   ] spawn_process: at 2018-11-15 22:18:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 22:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 22:18:49 [DEBUG   ] spawn_process: at 2018-11-15 22:18:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 22:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 22:18:49 [DEBUG   ] spawn_process: at 2018-11-15 22:18:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 22:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 22:18:49 [DEBUG   ] spawn_process: at 2018-11-15 22:18:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 22:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 22:18:49 [DEBUG   ] spawn_process: at 2018-11-15 22:18:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 22:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 22:18:49 [DEBUG   ] spawn_process: at 2018-11-15 22:18:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 22:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 22:18:49 [DEBUG   ] spawn_process: at 2018-11-15 22:18:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 22:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 22:18:49 [DEBUG   ] spawn_process: at 2018-11-15 22:18:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 22:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 22:18:49 [DEBUG   ] spawn_process: at 2018-11-15 22:18:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 22:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 22:18:49 [DEBUG   ] spawn_process: at 2018-11-15 22:18:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 22:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 22:18:49 [DEBUG   ] spawn_process: at 2018-11-15 22:18:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 22:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 22:18:49 [DEBUG   ] spawn_process: at 2018-11-15 22:18:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 22:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 22:18:49 [DEBUG   ] spawn_process: at 2018-11-15 22:18:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 22:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 22:18:49 [DEBUG   ] spawn_process: at 2018-11-15 22:18:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 22:18:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 22:18:49 [DEBUG   ] spawn_process: at 2018-11-15 22:18:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 22:19:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 22:19:13 [DEBUG   ] Got command BAM from MCS: ref #519655
2018-11-15 22:19:13 [INFO    ] Finished processing BAM request
2018-11-15 22:19:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:19:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519655   8 58437 80353025 A  ERROR'
2018-11-15 22:19:13 [DEBUG   ] Got command BAM from MCS: ref #519656
2018-11-15 22:19:13 [INFO    ] Finished processing BAM request
2018-11-15 22:19:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:19:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519656   8 58437 80353029 A  ERROR'
2018-11-15 22:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 22:19:13 [DEBUG   ] spawn_process: at 2018-11-15 22:19:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 22:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 22:19:13 [DEBUG   ] spawn_process: at 2018-11-15 22:19:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 22:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 22:19:13 [DEBUG   ] spawn_process: at 2018-11-15 22:19:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 22:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 22:19:13 [DEBUG   ] spawn_process: at 2018-11-15 22:19:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 22:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 22:19:13 [DEBUG   ] spawn_process: at 2018-11-15 22:19:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 22:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 22:19:13 [DEBUG   ] spawn_process: at 2018-11-15 22:19:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 22:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 22:19:13 [DEBUG   ] spawn_process: at 2018-11-15 22:19:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 22:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 22:19:13 [DEBUG   ] spawn_process: at 2018-11-15 22:19:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 22:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 22:19:13 [DEBUG   ] spawn_process: at 2018-11-15 22:19:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 22:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 22:19:13 [DEBUG   ] spawn_process: at 2018-11-15 22:19:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 22:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 22:19:13 [DEBUG   ] spawn_process: at 2018-11-15 22:19:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 22:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 22:19:13 [DEBUG   ] spawn_process: at 2018-11-15 22:19:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 22:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 22:19:13 [DEBUG   ] spawn_process: at 2018-11-15 22:19:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 22:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 22:19:13 [DEBUG   ] spawn_process: at 2018-11-15 22:19:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 22:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 22:19:13 [DEBUG   ] spawn_process: at 2018-11-15 22:19:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 22:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 22:19:13 [DEBUG   ] spawn_process: at 2018-11-15 22:19:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 22:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 22:19:13 [DEBUG   ] spawn_process: at 2018-11-15 22:19:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 22:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 22:19:13 [DEBUG   ] spawn_process: at 2018-11-15 22:19:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 22:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 22:19:13 [DEBUG   ] spawn_process: at 2018-11-15 22:19:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 22:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 22:19:13 [DEBUG   ] spawn_process: at 2018-11-15 22:19:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 22:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 22:19:13 [DEBUG   ] spawn_process: at 2018-11-15 22:19:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 22:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 22:19:13 [DEBUG   ] spawn_process: at 2018-11-15 22:19:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 22:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 22:19:13 [DEBUG   ] spawn_process: at 2018-11-15 22:19:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 22:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 22:19:13 [DEBUG   ] spawn_process: at 2018-11-15 22:19:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 22:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 22:19:13 [DEBUG   ] spawn_process: at 2018-11-15 22:19:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 22:19:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 22:19:13 [DEBUG   ] spawn_process: at 2018-11-15 22:19:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 22:19:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:19:28 [DEBUG   ] Finished updating ant stats in 0.629 seconds
2018-11-15 22:19:28 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 22:19:28 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-15 22:19:28 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 22:19:28 [WARNING ] (13, 1, 'bot')
2018-11-15 22:19:28 [WARNING ] (13, 1, 'bot')
2018-11-15 22:19:28 [WARNING ] (13, 1, 'bot')
2018-11-15 22:19:28 [WARNING ] (13, 1, 'bot')
2018-11-15 22:19:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 22:19:28 [DEBUG   ] Finished updating board flags in 2.012 seconds
2018-11-15 22:19:37 [DEBUG   ] Got command BAM from MCS: ref #519658
2018-11-15 22:19:37 [INFO    ] Finished processing BAM request
2018-11-15 22:19:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:19:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519658   8 58437 80377025 A  ERROR'
2018-11-15 22:19:37 [DEBUG   ] Got command BAM from MCS: ref #519657
2018-11-15 22:19:37 [INFO    ] Finished processing BAM request
2018-11-15 22:19:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:19:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519657   8 58437 80377029 A  ERROR'
2018-11-15 22:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 22:19:37 [DEBUG   ] spawn_process: at 2018-11-15 22:19:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 22:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 22:19:37 [DEBUG   ] spawn_process: at 2018-11-15 22:19:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 22:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 22:19:37 [DEBUG   ] spawn_process: at 2018-11-15 22:19:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 22:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 22:19:37 [DEBUG   ] spawn_process: at 2018-11-15 22:19:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 22:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 22:19:37 [DEBUG   ] spawn_process: at 2018-11-15 22:19:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 22:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 22:19:37 [DEBUG   ] spawn_process: at 2018-11-15 22:19:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 22:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 22:19:37 [DEBUG   ] spawn_process: at 2018-11-15 22:19:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 22:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 22:19:37 [DEBUG   ] spawn_process: at 2018-11-15 22:19:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 22:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 22:19:37 [DEBUG   ] spawn_process: at 2018-11-15 22:19:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 22:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 22:19:37 [DEBUG   ] spawn_process: at 2018-11-15 22:19:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 22:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 22:19:37 [DEBUG   ] spawn_process: at 2018-11-15 22:19:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 22:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 22:19:37 [DEBUG   ] spawn_process: at 2018-11-15 22:19:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 22:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 22:19:37 [DEBUG   ] spawn_process: at 2018-11-15 22:19:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 22:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 22:19:37 [DEBUG   ] spawn_process: at 2018-11-15 22:19:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 22:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 22:19:37 [DEBUG   ] spawn_process: at 2018-11-15 22:19:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 22:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 22:19:37 [DEBUG   ] spawn_process: at 2018-11-15 22:19:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 22:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 22:19:37 [DEBUG   ] spawn_process: at 2018-11-15 22:19:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 22:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 22:19:37 [DEBUG   ] spawn_process: at 2018-11-15 22:19:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 22:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 22:19:37 [DEBUG   ] spawn_process: at 2018-11-15 22:19:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 22:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 22:19:37 [DEBUG   ] spawn_process: at 2018-11-15 22:19:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 22:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 22:19:37 [DEBUG   ] spawn_process: at 2018-11-15 22:19:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 22:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 22:19:37 [DEBUG   ] spawn_process: at 2018-11-15 22:19:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 22:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 22:19:37 [DEBUG   ] spawn_process: at 2018-11-15 22:19:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 22:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 22:19:37 [DEBUG   ] spawn_process: at 2018-11-15 22:19:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 22:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 22:19:37 [DEBUG   ] spawn_process: at 2018-11-15 22:19:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 22:19:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 22:19:37 [DEBUG   ] spawn_process: at 2018-11-15 22:19:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 22:19:48 [DEBUG   ] Finished updating ant stats in 0.574 seconds
2018-11-15 22:20:01 [DEBUG   ] Got command BAM from MCS: ref #519659
2018-11-15 22:20:01 [INFO    ] Finished processing BAM request
2018-11-15 22:20:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:20:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519659   8 58437 80401025 A  ERROR'
2018-11-15 22:20:01 [DEBUG   ] Got command BAM from MCS: ref #519660
2018-11-15 22:20:01 [INFO    ] Finished processing BAM request
2018-11-15 22:20:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:20:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519660   8 58437 80401029 A  ERROR'
2018-11-15 22:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 22:20:01 [DEBUG   ] spawn_process: at 2018-11-15 22:20:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 22:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 22:20:01 [DEBUG   ] spawn_process: at 2018-11-15 22:20:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 22:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 22:20:01 [DEBUG   ] spawn_process: at 2018-11-15 22:20:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 22:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 22:20:01 [DEBUG   ] spawn_process: at 2018-11-15 22:20:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 22:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 22:20:01 [DEBUG   ] spawn_process: at 2018-11-15 22:20:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 22:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 22:20:01 [DEBUG   ] spawn_process: at 2018-11-15 22:20:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 22:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 22:20:01 [DEBUG   ] spawn_process: at 2018-11-15 22:20:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 22:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 22:20:01 [DEBUG   ] spawn_process: at 2018-11-15 22:20:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 22:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 22:20:01 [DEBUG   ] spawn_process: at 2018-11-15 22:20:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 22:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 22:20:01 [DEBUG   ] spawn_process: at 2018-11-15 22:20:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 22:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 22:20:01 [DEBUG   ] spawn_process: at 2018-11-15 22:20:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 22:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 22:20:01 [DEBUG   ] spawn_process: at 2018-11-15 22:20:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 22:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 22:20:01 [DEBUG   ] spawn_process: at 2018-11-15 22:20:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 22:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 22:20:01 [DEBUG   ] spawn_process: at 2018-11-15 22:20:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 22:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 22:20:01 [DEBUG   ] spawn_process: at 2018-11-15 22:20:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 22:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 22:20:01 [DEBUG   ] spawn_process: at 2018-11-15 22:20:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 22:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 22:20:01 [DEBUG   ] spawn_process: at 2018-11-15 22:20:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 22:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 22:20:01 [DEBUG   ] spawn_process: at 2018-11-15 22:20:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 22:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 22:20:01 [DEBUG   ] spawn_process: at 2018-11-15 22:20:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 22:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 22:20:01 [DEBUG   ] spawn_process: at 2018-11-15 22:20:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 22:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 22:20:01 [DEBUG   ] spawn_process: at 2018-11-15 22:20:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 22:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 22:20:01 [DEBUG   ] spawn_process: at 2018-11-15 22:20:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 22:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 22:20:01 [DEBUG   ] spawn_process: at 2018-11-15 22:20:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 22:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 22:20:01 [DEBUG   ] spawn_process: at 2018-11-15 22:20:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 22:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 22:20:01 [DEBUG   ] spawn_process: at 2018-11-15 22:20:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 22:20:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 22:20:01 [DEBUG   ] spawn_process: at 2018-11-15 22:20:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 22:20:08 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 22:20:25 [DEBUG   ] Got command BAM from MCS: ref #519662
2018-11-15 22:20:25 [INFO    ] Finished processing BAM request
2018-11-15 22:20:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:20:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519662   8 58437 80425029 A  ERROR'
2018-11-15 22:20:25 [DEBUG   ] Got command BAM from MCS: ref #519661
2018-11-15 22:20:25 [INFO    ] Finished processing BAM request
2018-11-15 22:20:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:20:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519661   8 58437 80425033 A  ERROR'
2018-11-15 22:20:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 22:20:25 [DEBUG   ] spawn_process: at 2018-11-15 22:20:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 22:20:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 22:20:25 [DEBUG   ] spawn_process: at 2018-11-15 22:20:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 22:20:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 22:20:25 [DEBUG   ] spawn_process: at 2018-11-15 22:20:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 22:20:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 22:20:25 [DEBUG   ] spawn_process: at 2018-11-15 22:20:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 22:20:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 22:20:25 [DEBUG   ] spawn_process: at 2018-11-15 22:20:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 22:20:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 22:20:25 [DEBUG   ] spawn_process: at 2018-11-15 22:20:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 22:20:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 22:20:25 [DEBUG   ] spawn_process: at 2018-11-15 22:20:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 22:20:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 22:20:25 [DEBUG   ] spawn_process: at 2018-11-15 22:20:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 22:20:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 22:20:25 [DEBUG   ] spawn_process: at 2018-11-15 22:20:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 22:20:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 22:20:25 [DEBUG   ] spawn_process: at 2018-11-15 22:20:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 22:20:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 22:20:25 [DEBUG   ] spawn_process: at 2018-11-15 22:20:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 22:20:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 22:20:25 [DEBUG   ] spawn_process: at 2018-11-15 22:20:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 22:20:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 22:20:25 [DEBUG   ] spawn_process: at 2018-11-15 22:20:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 22:20:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 22:20:25 [DEBUG   ] spawn_process: at 2018-11-15 22:20:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 22:20:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 22:20:25 [DEBUG   ] spawn_process: at 2018-11-15 22:20:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 22:20:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 22:20:25 [DEBUG   ] spawn_process: at 2018-11-15 22:20:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 22:20:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 22:20:25 [DEBUG   ] spawn_process: at 2018-11-15 22:20:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 22:20:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 22:20:25 [DEBUG   ] spawn_process: at 2018-11-15 22:20:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 22:20:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 22:20:25 [DEBUG   ] spawn_process: at 2018-11-15 22:20:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 22:20:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 22:20:25 [DEBUG   ] spawn_process: at 2018-11-15 22:20:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 22:20:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 22:20:25 [DEBUG   ] spawn_process: at 2018-11-15 22:20:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 22:20:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 22:20:25 [DEBUG   ] spawn_process: at 2018-11-15 22:20:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 22:20:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 22:20:25 [DEBUG   ] spawn_process: at 2018-11-15 22:20:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 22:20:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 22:20:25 [DEBUG   ] spawn_process: at 2018-11-15 22:20:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 22:20:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 22:20:25 [DEBUG   ] spawn_process: at 2018-11-15 22:20:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 22:20:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 22:20:25 [DEBUG   ] spawn_process: at 2018-11-15 22:20:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 22:20:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 22:20:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:20:27 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 22:20:27 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 22:20:27 [WARNING ] (13, 1, 'bot')
2018-11-15 22:20:27 [WARNING ] (13, 1, 'bot')
2018-11-15 22:20:27 [WARNING ] (13, 1, 'bot')
2018-11-15 22:20:27 [WARNING ] (13, 1, 'bot')
2018-11-15 22:20:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 22:20:27 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-11-15 22:20:28 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-15 22:20:45 [DEBUG   ] Got command RPT from MCS: ref #519667
2018-11-15 22:20:45 [DEBUG   ] summary = ERROR
2018-11-15 22:20:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519667  13 58437 80445217 A  ERRORERROR'
2018-11-15 22:20:45 [DEBUG   ] Got command RPT from MCS: ref #519668
2018-11-15 22:20:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 22:20:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519668  77 58437 80445218 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 22:20:49 [DEBUG   ] Got command BAM from MCS: ref #519685
2018-11-15 22:20:49 [INFO    ] Finished processing BAM request
2018-11-15 22:20:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:20:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519685   8 58437 80449025 A  ERROR'
2018-11-15 22:20:49 [DEBUG   ] Got command BAM from MCS: ref #519684
2018-11-15 22:20:49 [INFO    ] Finished processing BAM request
2018-11-15 22:20:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:20:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519684   8 58437 80449029 A  ERROR'
2018-11-15 22:20:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 22:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 22:20:49 [DEBUG   ] spawn_process: at 2018-11-15 22:20:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 22:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 22:20:49 [DEBUG   ] spawn_process: at 2018-11-15 22:20:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 22:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 22:20:49 [DEBUG   ] spawn_process: at 2018-11-15 22:20:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 22:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 22:20:49 [DEBUG   ] spawn_process: at 2018-11-15 22:20:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 22:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 22:20:49 [DEBUG   ] spawn_process: at 2018-11-15 22:20:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 22:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 22:20:49 [DEBUG   ] spawn_process: at 2018-11-15 22:20:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 22:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 22:20:49 [DEBUG   ] spawn_process: at 2018-11-15 22:20:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 22:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 22:20:49 [DEBUG   ] spawn_process: at 2018-11-15 22:20:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 22:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 22:20:49 [DEBUG   ] spawn_process: at 2018-11-15 22:20:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 22:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 22:20:49 [DEBUG   ] spawn_process: at 2018-11-15 22:20:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 22:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 22:20:49 [DEBUG   ] spawn_process: at 2018-11-15 22:20:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 22:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 22:20:49 [DEBUG   ] spawn_process: at 2018-11-15 22:20:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 22:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 22:20:49 [DEBUG   ] spawn_process: at 2018-11-15 22:20:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 22:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 22:20:49 [DEBUG   ] spawn_process: at 2018-11-15 22:20:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 22:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 22:20:49 [DEBUG   ] spawn_process: at 2018-11-15 22:20:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 22:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 22:20:49 [DEBUG   ] spawn_process: at 2018-11-15 22:20:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 22:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 22:20:49 [DEBUG   ] spawn_process: at 2018-11-15 22:20:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 22:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 22:20:49 [DEBUG   ] spawn_process: at 2018-11-15 22:20:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 22:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 22:20:49 [DEBUG   ] spawn_process: at 2018-11-15 22:20:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 22:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 22:20:49 [DEBUG   ] spawn_process: at 2018-11-15 22:20:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 22:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 22:20:49 [DEBUG   ] spawn_process: at 2018-11-15 22:20:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 22:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 22:20:49 [DEBUG   ] spawn_process: at 2018-11-15 22:20:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 22:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 22:20:49 [DEBUG   ] spawn_process: at 2018-11-15 22:20:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 22:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 22:20:49 [DEBUG   ] spawn_process: at 2018-11-15 22:20:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 22:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 22:20:49 [DEBUG   ] spawn_process: at 2018-11-15 22:20:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 22:20:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 22:20:49 [DEBUG   ] spawn_process: at 2018-11-15 22:20:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 22:21:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 22:21:13 [DEBUG   ] Got command BAM from MCS: ref #519686
2018-11-15 22:21:13 [INFO    ] Finished processing BAM request
2018-11-15 22:21:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:21:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519686   8 58437 80473029 A  ERROR'
2018-11-15 22:21:13 [DEBUG   ] Got command BAM from MCS: ref #519687
2018-11-15 22:21:13 [INFO    ] Finished processing BAM request
2018-11-15 22:21:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:21:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519687   8 58437 80473033 A  ERROR'
2018-11-15 22:21:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 22:21:13 [DEBUG   ] spawn_process: at 2018-11-15 22:21:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 22:21:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 22:21:13 [DEBUG   ] spawn_process: at 2018-11-15 22:21:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 22:21:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 22:21:13 [DEBUG   ] spawn_process: at 2018-11-15 22:21:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 22:21:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 22:21:13 [DEBUG   ] spawn_process: at 2018-11-15 22:21:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 22:21:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 22:21:13 [DEBUG   ] spawn_process: at 2018-11-15 22:21:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 22:21:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 22:21:13 [DEBUG   ] spawn_process: at 2018-11-15 22:21:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 22:21:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 22:21:13 [DEBUG   ] spawn_process: at 2018-11-15 22:21:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 22:21:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 22:21:13 [DEBUG   ] spawn_process: at 2018-11-15 22:21:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 22:21:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 22:21:13 [DEBUG   ] spawn_process: at 2018-11-15 22:21:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 22:21:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 22:21:13 [DEBUG   ] spawn_process: at 2018-11-15 22:21:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 22:21:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 22:21:13 [DEBUG   ] spawn_process: at 2018-11-15 22:21:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 22:21:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 22:21:13 [DEBUG   ] spawn_process: at 2018-11-15 22:21:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 22:21:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 22:21:13 [DEBUG   ] spawn_process: at 2018-11-15 22:21:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 22:21:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 22:21:13 [DEBUG   ] spawn_process: at 2018-11-15 22:21:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 22:21:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 22:21:13 [DEBUG   ] spawn_process: at 2018-11-15 22:21:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 22:21:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 22:21:13 [DEBUG   ] spawn_process: at 2018-11-15 22:21:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 22:21:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 22:21:13 [DEBUG   ] spawn_process: at 2018-11-15 22:21:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 22:21:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 22:21:13 [DEBUG   ] spawn_process: at 2018-11-15 22:21:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 22:21:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 22:21:13 [DEBUG   ] spawn_process: at 2018-11-15 22:21:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 22:21:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 22:21:13 [DEBUG   ] spawn_process: at 2018-11-15 22:21:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 22:21:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 22:21:13 [DEBUG   ] spawn_process: at 2018-11-15 22:21:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 22:21:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 22:21:13 [DEBUG   ] spawn_process: at 2018-11-15 22:21:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 22:21:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 22:21:13 [DEBUG   ] spawn_process: at 2018-11-15 22:21:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 22:21:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 22:21:13 [DEBUG   ] spawn_process: at 2018-11-15 22:21:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 22:21:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 22:21:13 [DEBUG   ] spawn_process: at 2018-11-15 22:21:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 22:21:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 22:21:13 [DEBUG   ] spawn_process: at 2018-11-15 22:21:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 22:21:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 22:21:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 22:21:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:21:28 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 22:21:28 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-15 22:21:28 [WARNING ] (13, 1, 'bot')
2018-11-15 22:21:28 [WARNING ] (13, 1, 'bot')
2018-11-15 22:21:28 [WARNING ] (13, 1, 'bot')
2018-11-15 22:21:28 [WARNING ] (13, 1, 'bot')
2018-11-15 22:21:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 22:21:28 [DEBUG   ] Finished updating board flags in 1.965 seconds
2018-11-15 22:21:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 22:21:37 [DEBUG   ] Got command BAM from MCS: ref #519689
2018-11-15 22:21:37 [INFO    ] Finished processing BAM request
2018-11-15 22:21:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:21:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519689   8 58437 80497025 A  ERROR'
2018-11-15 22:21:37 [DEBUG   ] Got command BAM from MCS: ref #519688
2018-11-15 22:21:37 [INFO    ] Finished processing BAM request
2018-11-15 22:21:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:21:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519688   8 58437 80497029 A  ERROR'
2018-11-15 22:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 22:21:37 [DEBUG   ] spawn_process: at 2018-11-15 22:21:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 22:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 22:21:37 [DEBUG   ] spawn_process: at 2018-11-15 22:21:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 22:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 22:21:37 [DEBUG   ] spawn_process: at 2018-11-15 22:21:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 22:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 22:21:37 [DEBUG   ] spawn_process: at 2018-11-15 22:21:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 22:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 22:21:37 [DEBUG   ] spawn_process: at 2018-11-15 22:21:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 22:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 22:21:37 [DEBUG   ] spawn_process: at 2018-11-15 22:21:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 22:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 22:21:37 [DEBUG   ] spawn_process: at 2018-11-15 22:21:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 22:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 22:21:37 [DEBUG   ] spawn_process: at 2018-11-15 22:21:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 22:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 22:21:37 [DEBUG   ] spawn_process: at 2018-11-15 22:21:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 22:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 22:21:37 [DEBUG   ] spawn_process: at 2018-11-15 22:21:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 22:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 22:21:37 [DEBUG   ] spawn_process: at 2018-11-15 22:21:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 22:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 22:21:37 [DEBUG   ] spawn_process: at 2018-11-15 22:21:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 22:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 22:21:37 [DEBUG   ] spawn_process: at 2018-11-15 22:21:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 22:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 22:21:37 [DEBUG   ] spawn_process: at 2018-11-15 22:21:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 22:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 22:21:37 [DEBUG   ] spawn_process: at 2018-11-15 22:21:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 22:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 22:21:37 [DEBUG   ] spawn_process: at 2018-11-15 22:21:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 22:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 22:21:37 [DEBUG   ] spawn_process: at 2018-11-15 22:21:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 22:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 22:21:37 [DEBUG   ] spawn_process: at 2018-11-15 22:21:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 22:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 22:21:37 [DEBUG   ] spawn_process: at 2018-11-15 22:21:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 22:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 22:21:37 [DEBUG   ] spawn_process: at 2018-11-15 22:21:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 22:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 22:21:37 [DEBUG   ] spawn_process: at 2018-11-15 22:21:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 22:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 22:21:37 [DEBUG   ] spawn_process: at 2018-11-15 22:21:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 22:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 22:21:37 [DEBUG   ] spawn_process: at 2018-11-15 22:21:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 22:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 22:21:37 [DEBUG   ] spawn_process: at 2018-11-15 22:21:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 22:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 22:21:37 [DEBUG   ] spawn_process: at 2018-11-15 22:21:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 22:21:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 22:21:37 [DEBUG   ] spawn_process: at 2018-11-15 22:21:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 22:21:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 22:22:01 [DEBUG   ] Got command BAM from MCS: ref #519690
2018-11-15 22:22:01 [INFO    ] Finished processing BAM request
2018-11-15 22:22:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:22:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519690   8 58437 80521033 A  ERROR'
2018-11-15 22:22:01 [DEBUG   ] Got command BAM from MCS: ref #519691
2018-11-15 22:22:01 [INFO    ] Finished processing BAM request
2018-11-15 22:22:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:22:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519691   8 58437 80521037 A  ERROR'
2018-11-15 22:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 22:22:01 [DEBUG   ] spawn_process: at 2018-11-15 22:22:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 22:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 22:22:01 [DEBUG   ] spawn_process: at 2018-11-15 22:22:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 22:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 22:22:01 [DEBUG   ] spawn_process: at 2018-11-15 22:22:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 22:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 22:22:01 [DEBUG   ] spawn_process: at 2018-11-15 22:22:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 22:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 22:22:01 [DEBUG   ] spawn_process: at 2018-11-15 22:22:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 22:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 22:22:01 [DEBUG   ] spawn_process: at 2018-11-15 22:22:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 22:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 22:22:01 [DEBUG   ] spawn_process: at 2018-11-15 22:22:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 22:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 22:22:01 [DEBUG   ] spawn_process: at 2018-11-15 22:22:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 22:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 22:22:01 [DEBUG   ] spawn_process: at 2018-11-15 22:22:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 22:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 22:22:01 [DEBUG   ] spawn_process: at 2018-11-15 22:22:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 22:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 22:22:01 [DEBUG   ] spawn_process: at 2018-11-15 22:22:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 22:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 22:22:01 [DEBUG   ] spawn_process: at 2018-11-15 22:22:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 22:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 22:22:01 [DEBUG   ] spawn_process: at 2018-11-15 22:22:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 22:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 22:22:01 [DEBUG   ] spawn_process: at 2018-11-15 22:22:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 22:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 22:22:01 [DEBUG   ] spawn_process: at 2018-11-15 22:22:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 22:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 22:22:01 [DEBUG   ] spawn_process: at 2018-11-15 22:22:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 22:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 22:22:01 [DEBUG   ] spawn_process: at 2018-11-15 22:22:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 22:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 22:22:01 [DEBUG   ] spawn_process: at 2018-11-15 22:22:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 22:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 22:22:01 [DEBUG   ] spawn_process: at 2018-11-15 22:22:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 22:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 22:22:01 [DEBUG   ] spawn_process: at 2018-11-15 22:22:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 22:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 22:22:01 [DEBUG   ] spawn_process: at 2018-11-15 22:22:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 22:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 22:22:01 [DEBUG   ] spawn_process: at 2018-11-15 22:22:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 22:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 22:22:01 [DEBUG   ] spawn_process: at 2018-11-15 22:22:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 22:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 22:22:01 [DEBUG   ] spawn_process: at 2018-11-15 22:22:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 22:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 22:22:01 [DEBUG   ] spawn_process: at 2018-11-15 22:22:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 22:22:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 22:22:01 [DEBUG   ] spawn_process: at 2018-11-15 22:22:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 22:22:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 22:22:25 [DEBUG   ] Got command BAM from MCS: ref #519693
2018-11-15 22:22:25 [INFO    ] Finished processing BAM request
2018-11-15 22:22:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:22:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519693   8 58437 80545033 A  ERROR'
2018-11-15 22:22:25 [DEBUG   ] Got command BAM from MCS: ref #519692
2018-11-15 22:22:25 [INFO    ] Finished processing BAM request
2018-11-15 22:22:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:22:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519692   8 58437 80545037 A  ERROR'
2018-11-15 22:22:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 22:22:25 [DEBUG   ] spawn_process: at 2018-11-15 22:22:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 22:22:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 22:22:25 [DEBUG   ] spawn_process: at 2018-11-15 22:22:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 22:22:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 22:22:25 [DEBUG   ] spawn_process: at 2018-11-15 22:22:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 22:22:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 22:22:25 [DEBUG   ] spawn_process: at 2018-11-15 22:22:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 22:22:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 22:22:25 [DEBUG   ] spawn_process: at 2018-11-15 22:22:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 22:22:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 22:22:25 [DEBUG   ] spawn_process: at 2018-11-15 22:22:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 22:22:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 22:22:25 [DEBUG   ] spawn_process: at 2018-11-15 22:22:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 22:22:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 22:22:25 [DEBUG   ] spawn_process: at 2018-11-15 22:22:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 22:22:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 22:22:25 [DEBUG   ] spawn_process: at 2018-11-15 22:22:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 22:22:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 22:22:25 [DEBUG   ] spawn_process: at 2018-11-15 22:22:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 22:22:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 22:22:25 [DEBUG   ] spawn_process: at 2018-11-15 22:22:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 22:22:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 22:22:25 [DEBUG   ] spawn_process: at 2018-11-15 22:22:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 22:22:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 22:22:25 [DEBUG   ] spawn_process: at 2018-11-15 22:22:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 22:22:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 22:22:25 [DEBUG   ] spawn_process: at 2018-11-15 22:22:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 22:22:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 22:22:25 [DEBUG   ] spawn_process: at 2018-11-15 22:22:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 22:22:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 22:22:25 [DEBUG   ] spawn_process: at 2018-11-15 22:22:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 22:22:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 22:22:25 [DEBUG   ] spawn_process: at 2018-11-15 22:22:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 22:22:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 22:22:25 [DEBUG   ] spawn_process: at 2018-11-15 22:22:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 22:22:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 22:22:25 [DEBUG   ] spawn_process: at 2018-11-15 22:22:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 22:22:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 22:22:25 [DEBUG   ] spawn_process: at 2018-11-15 22:22:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 22:22:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 22:22:25 [DEBUG   ] spawn_process: at 2018-11-15 22:22:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 22:22:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 22:22:25 [DEBUG   ] spawn_process: at 2018-11-15 22:22:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 22:22:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 22:22:25 [DEBUG   ] spawn_process: at 2018-11-15 22:22:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 22:22:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 22:22:25 [DEBUG   ] spawn_process: at 2018-11-15 22:22:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 22:22:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 22:22:25 [DEBUG   ] spawn_process: at 2018-11-15 22:22:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 22:22:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 22:22:25 [DEBUG   ] spawn_process: at 2018-11-15 22:22:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 22:22:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:22:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-15 22:22:27 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 22:22:27 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-15 22:22:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 22:22:27 [WARNING ] (13, 1, 'bot')
2018-11-15 22:22:27 [WARNING ] (13, 1, 'bot')
2018-11-15 22:22:27 [WARNING ] (13, 1, 'bot')
2018-11-15 22:22:27 [WARNING ] (13, 1, 'bot')
2018-11-15 22:22:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 22:22:27 [DEBUG   ] Finished updating board flags in 1.198 seconds
2018-11-15 22:22:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 22:22:49 [DEBUG   ] Got command BAM from MCS: ref #519694
2018-11-15 22:22:49 [INFO    ] Finished processing BAM request
2018-11-15 22:22:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:22:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519694   8 58437 80569033 A  ERROR'
2018-11-15 22:22:49 [DEBUG   ] Got command BAM from MCS: ref #519695
2018-11-15 22:22:49 [INFO    ] Finished processing BAM request
2018-11-15 22:22:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:22:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519695   8 58437 80569037 A  ERROR'
2018-11-15 22:22:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 22:22:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 22:22:49 [DEBUG   ] spawn_process: at 2018-11-15 22:22:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 22:22:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 22:22:49 [DEBUG   ] spawn_process: at 2018-11-15 22:22:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 22:22:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 22:22:49 [DEBUG   ] spawn_process: at 2018-11-15 22:22:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 22:22:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 22:22:49 [DEBUG   ] spawn_process: at 2018-11-15 22:22:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 22:22:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 22:22:49 [DEBUG   ] spawn_process: at 2018-11-15 22:22:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 22:22:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 22:22:49 [DEBUG   ] spawn_process: at 2018-11-15 22:22:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 22:22:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 22:22:49 [DEBUG   ] spawn_process: at 2018-11-15 22:22:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 22:22:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 22:22:49 [DEBUG   ] spawn_process: at 2018-11-15 22:22:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 22:22:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 22:22:49 [DEBUG   ] spawn_process: at 2018-11-15 22:22:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 22:22:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 22:22:49 [DEBUG   ] spawn_process: at 2018-11-15 22:22:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 22:22:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 22:22:49 [DEBUG   ] spawn_process: at 2018-11-15 22:22:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 22:22:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 22:22:49 [DEBUG   ] spawn_process: at 2018-11-15 22:22:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 22:22:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 22:22:49 [DEBUG   ] spawn_process: at 2018-11-15 22:22:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 22:22:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 22:22:49 [DEBUG   ] spawn_process: at 2018-11-15 22:22:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 22:22:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 22:22:49 [DEBUG   ] spawn_process: at 2018-11-15 22:22:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 22:22:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 22:22:49 [DEBUG   ] spawn_process: at 2018-11-15 22:22:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 22:22:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 22:22:49 [DEBUG   ] spawn_process: at 2018-11-15 22:22:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 22:22:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 22:22:49 [DEBUG   ] spawn_process: at 2018-11-15 22:22:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 22:22:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 22:22:49 [DEBUG   ] spawn_process: at 2018-11-15 22:22:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 22:22:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 22:22:49 [DEBUG   ] spawn_process: at 2018-11-15 22:22:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 22:22:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 22:22:49 [DEBUG   ] spawn_process: at 2018-11-15 22:22:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 22:22:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 22:22:49 [DEBUG   ] spawn_process: at 2018-11-15 22:22:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 22:22:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 22:22:49 [DEBUG   ] spawn_process: at 2018-11-15 22:22:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 22:22:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 22:22:49 [DEBUG   ] spawn_process: at 2018-11-15 22:22:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 22:22:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 22:22:49 [DEBUG   ] spawn_process: at 2018-11-15 22:22:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 22:22:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 22:22:49 [DEBUG   ] spawn_process: at 2018-11-15 22:22:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 22:23:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 22:23:13 [DEBUG   ] Got command BAM from MCS: ref #519697
2018-11-15 22:23:13 [INFO    ] Finished processing BAM request
2018-11-15 22:23:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:23:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519697   8 58437 80593029 A  ERROR'
2018-11-15 22:23:13 [DEBUG   ] Got command BAM from MCS: ref #519696
2018-11-15 22:23:13 [INFO    ] Finished processing BAM request
2018-11-15 22:23:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:23:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519696   8 58437 80593033 A  ERROR'
2018-11-15 22:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 22:23:13 [DEBUG   ] spawn_process: at 2018-11-15 22:23:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 22:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 22:23:13 [DEBUG   ] spawn_process: at 2018-11-15 22:23:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 22:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 22:23:13 [DEBUG   ] spawn_process: at 2018-11-15 22:23:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 22:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 22:23:13 [DEBUG   ] spawn_process: at 2018-11-15 22:23:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 22:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 22:23:13 [DEBUG   ] spawn_process: at 2018-11-15 22:23:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 22:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 22:23:13 [DEBUG   ] spawn_process: at 2018-11-15 22:23:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 22:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 22:23:13 [DEBUG   ] spawn_process: at 2018-11-15 22:23:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 22:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 22:23:13 [DEBUG   ] spawn_process: at 2018-11-15 22:23:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 22:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 22:23:13 [DEBUG   ] spawn_process: at 2018-11-15 22:23:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 22:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 22:23:13 [DEBUG   ] spawn_process: at 2018-11-15 22:23:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 22:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 22:23:13 [DEBUG   ] spawn_process: at 2018-11-15 22:23:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 22:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 22:23:13 [DEBUG   ] spawn_process: at 2018-11-15 22:23:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 22:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 22:23:13 [DEBUG   ] spawn_process: at 2018-11-15 22:23:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 22:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 22:23:13 [DEBUG   ] spawn_process: at 2018-11-15 22:23:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 22:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 22:23:13 [DEBUG   ] spawn_process: at 2018-11-15 22:23:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 22:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 22:23:13 [DEBUG   ] spawn_process: at 2018-11-15 22:23:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 22:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 22:23:13 [DEBUG   ] spawn_process: at 2018-11-15 22:23:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 22:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 22:23:13 [DEBUG   ] spawn_process: at 2018-11-15 22:23:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 22:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 22:23:13 [DEBUG   ] spawn_process: at 2018-11-15 22:23:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 22:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 22:23:13 [DEBUG   ] spawn_process: at 2018-11-15 22:23:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 22:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 22:23:13 [DEBUG   ] spawn_process: at 2018-11-15 22:23:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 22:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 22:23:13 [DEBUG   ] spawn_process: at 2018-11-15 22:23:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 22:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 22:23:13 [DEBUG   ] spawn_process: at 2018-11-15 22:23:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 22:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 22:23:13 [DEBUG   ] spawn_process: at 2018-11-15 22:23:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 22:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 22:23:13 [DEBUG   ] spawn_process: at 2018-11-15 22:23:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 22:23:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 22:23:13 [DEBUG   ] spawn_process: at 2018-11-15 22:23:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 22:23:25 [DEBUG   ] Got command RPT from MCS: ref #519698
2018-11-15 22:23:25 [DEBUG   ] summary = ERROR
2018-11-15 22:23:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519698  13 58437 80605609 A  ERRORERROR'
2018-11-15 22:23:25 [DEBUG   ] Got command RPT from MCS: ref #519699
2018-11-15 22:23:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 22:23:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519699  77 58437 80605801 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 22:23:26 [DEBUG   ] Got command RPT from MCS: ref #519700
2018-11-15 22:23:26 [DEBUG   ] summary = ERROR
2018-11-15 22:23:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519700  13 58437 80606009 A  ERRORERROR'
2018-11-15 22:23:26 [DEBUG   ] Got command RPT from MCS: ref #519701
2018-11-15 22:23:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 22:23:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519701  77 58437 80606213 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 22:23:26 [DEBUG   ] Got command RPT from MCS: ref #519702
2018-11-15 22:23:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 22:23:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519702  12 58437 80606405 A  ERRORB£ff'
2018-11-15 22:23:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 22:23:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:23:28 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 22:23:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 22:23:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 22:23:28 [WARNING ] (13, 1, 'bot')
2018-11-15 22:23:28 [WARNING ] (13, 1, 'bot')
2018-11-15 22:23:28 [WARNING ] (13, 1, 'bot')
2018-11-15 22:23:28 [WARNING ] (13, 1, 'bot')
2018-11-15 22:23:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 22:23:28 [DEBUG   ] Finished updating board flags in 1.598 seconds
2018-11-15 22:23:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 22:23:37 [DEBUG   ] Got command BAM from MCS: ref #519707
2018-11-15 22:23:37 [INFO    ] Finished processing BAM request
2018-11-15 22:23:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:23:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519707   8 58437 80617033 A  ERROR'
2018-11-15 22:23:37 [DEBUG   ] Got command BAM from MCS: ref #519708
2018-11-15 22:23:37 [INFO    ] Finished processing BAM request
2018-11-15 22:23:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:23:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519708   8 58437 80617037 A  ERROR'
2018-11-15 22:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 22:23:37 [DEBUG   ] spawn_process: at 2018-11-15 22:23:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 22:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 22:23:37 [DEBUG   ] spawn_process: at 2018-11-15 22:23:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 22:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 22:23:37 [DEBUG   ] spawn_process: at 2018-11-15 22:23:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 22:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 22:23:37 [DEBUG   ] spawn_process: at 2018-11-15 22:23:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 22:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 22:23:37 [DEBUG   ] spawn_process: at 2018-11-15 22:23:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 22:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 22:23:37 [DEBUG   ] spawn_process: at 2018-11-15 22:23:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 22:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 22:23:37 [DEBUG   ] spawn_process: at 2018-11-15 22:23:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 22:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 22:23:37 [DEBUG   ] spawn_process: at 2018-11-15 22:23:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 22:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 22:23:37 [DEBUG   ] spawn_process: at 2018-11-15 22:23:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 22:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 22:23:37 [DEBUG   ] spawn_process: at 2018-11-15 22:23:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 22:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 22:23:37 [DEBUG   ] spawn_process: at 2018-11-15 22:23:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 22:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 22:23:37 [DEBUG   ] spawn_process: at 2018-11-15 22:23:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 22:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 22:23:37 [DEBUG   ] spawn_process: at 2018-11-15 22:23:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 22:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 22:23:37 [DEBUG   ] spawn_process: at 2018-11-15 22:23:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 22:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 22:23:37 [DEBUG   ] spawn_process: at 2018-11-15 22:23:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 22:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 22:23:37 [DEBUG   ] spawn_process: at 2018-11-15 22:23:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 22:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 22:23:37 [DEBUG   ] spawn_process: at 2018-11-15 22:23:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 22:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 22:23:37 [DEBUG   ] spawn_process: at 2018-11-15 22:23:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 22:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 22:23:37 [DEBUG   ] spawn_process: at 2018-11-15 22:23:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 22:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 22:23:37 [DEBUG   ] spawn_process: at 2018-11-15 22:23:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 22:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 22:23:37 [DEBUG   ] spawn_process: at 2018-11-15 22:23:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 22:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 22:23:37 [DEBUG   ] spawn_process: at 2018-11-15 22:23:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 22:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 22:23:37 [DEBUG   ] spawn_process: at 2018-11-15 22:23:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 22:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 22:23:37 [DEBUG   ] spawn_process: at 2018-11-15 22:23:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 22:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 22:23:37 [DEBUG   ] spawn_process: at 2018-11-15 22:23:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 22:23:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 22:23:37 [DEBUG   ] spawn_process: at 2018-11-15 22:23:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 22:23:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 22:24:01 [DEBUG   ] Got command BAM from MCS: ref #519709
2018-11-15 22:24:01 [INFO    ] Finished processing BAM request
2018-11-15 22:24:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:24:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519709   8 58437 80641029 A  ERROR'
2018-11-15 22:24:01 [DEBUG   ] Got command BAM from MCS: ref #519710
2018-11-15 22:24:01 [INFO    ] Finished processing BAM request
2018-11-15 22:24:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:24:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519710   8 58437 80641033 A  ERROR'
2018-11-15 22:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 22:24:01 [DEBUG   ] spawn_process: at 2018-11-15 22:24:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 22:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 22:24:01 [DEBUG   ] spawn_process: at 2018-11-15 22:24:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 22:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 22:24:01 [DEBUG   ] spawn_process: at 2018-11-15 22:24:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 22:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 22:24:01 [DEBUG   ] spawn_process: at 2018-11-15 22:24:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 22:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 22:24:01 [DEBUG   ] spawn_process: at 2018-11-15 22:24:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 22:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 22:24:01 [DEBUG   ] spawn_process: at 2018-11-15 22:24:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 22:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 22:24:01 [DEBUG   ] spawn_process: at 2018-11-15 22:24:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 22:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 22:24:01 [DEBUG   ] spawn_process: at 2018-11-15 22:24:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 22:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 22:24:01 [DEBUG   ] spawn_process: at 2018-11-15 22:24:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 22:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 22:24:01 [DEBUG   ] spawn_process: at 2018-11-15 22:24:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 22:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 22:24:01 [DEBUG   ] spawn_process: at 2018-11-15 22:24:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 22:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 22:24:01 [DEBUG   ] spawn_process: at 2018-11-15 22:24:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 22:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 22:24:01 [DEBUG   ] spawn_process: at 2018-11-15 22:24:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 22:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 22:24:01 [DEBUG   ] spawn_process: at 2018-11-15 22:24:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 22:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 22:24:01 [DEBUG   ] spawn_process: at 2018-11-15 22:24:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 22:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 22:24:01 [DEBUG   ] spawn_process: at 2018-11-15 22:24:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 22:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 22:24:01 [DEBUG   ] spawn_process: at 2018-11-15 22:24:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 22:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 22:24:01 [DEBUG   ] spawn_process: at 2018-11-15 22:24:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 22:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 22:24:01 [DEBUG   ] spawn_process: at 2018-11-15 22:24:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 22:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 22:24:01 [DEBUG   ] spawn_process: at 2018-11-15 22:24:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 22:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 22:24:01 [DEBUG   ] spawn_process: at 2018-11-15 22:24:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 22:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 22:24:01 [DEBUG   ] spawn_process: at 2018-11-15 22:24:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 22:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 22:24:01 [DEBUG   ] spawn_process: at 2018-11-15 22:24:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 22:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 22:24:01 [DEBUG   ] spawn_process: at 2018-11-15 22:24:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 22:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 22:24:01 [DEBUG   ] spawn_process: at 2018-11-15 22:24:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 22:24:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 22:24:01 [DEBUG   ] spawn_process: at 2018-11-15 22:24:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 22:24:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 22:24:25 [DEBUG   ] Got command BAM from MCS: ref #519712
2018-11-15 22:24:25 [INFO    ] Finished processing BAM request
2018-11-15 22:24:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:24:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519712   8 58437 80665029 A  ERROR'
2018-11-15 22:24:25 [DEBUG   ] Got command BAM from MCS: ref #519711
2018-11-15 22:24:25 [INFO    ] Finished processing BAM request
2018-11-15 22:24:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:24:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519711   8 58437 80665033 A  ERROR'
2018-11-15 22:24:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 22:24:25 [DEBUG   ] spawn_process: at 2018-11-15 22:24:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 22:24:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 22:24:25 [DEBUG   ] spawn_process: at 2018-11-15 22:24:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 22:24:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 22:24:25 [DEBUG   ] spawn_process: at 2018-11-15 22:24:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 22:24:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 22:24:25 [DEBUG   ] spawn_process: at 2018-11-15 22:24:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 22:24:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 22:24:25 [DEBUG   ] spawn_process: at 2018-11-15 22:24:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 22:24:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 22:24:25 [DEBUG   ] spawn_process: at 2018-11-15 22:24:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 22:24:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 22:24:25 [DEBUG   ] spawn_process: at 2018-11-15 22:24:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 22:24:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 22:24:25 [DEBUG   ] spawn_process: at 2018-11-15 22:24:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 22:24:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 22:24:25 [DEBUG   ] spawn_process: at 2018-11-15 22:24:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 22:24:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 22:24:25 [DEBUG   ] spawn_process: at 2018-11-15 22:24:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 22:24:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 22:24:25 [DEBUG   ] spawn_process: at 2018-11-15 22:24:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 22:24:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 22:24:25 [DEBUG   ] spawn_process: at 2018-11-15 22:24:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 22:24:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 22:24:25 [DEBUG   ] spawn_process: at 2018-11-15 22:24:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 22:24:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 22:24:25 [DEBUG   ] spawn_process: at 2018-11-15 22:24:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 22:24:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 22:24:25 [DEBUG   ] spawn_process: at 2018-11-15 22:24:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 22:24:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 22:24:25 [DEBUG   ] spawn_process: at 2018-11-15 22:24:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 22:24:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 22:24:25 [DEBUG   ] spawn_process: at 2018-11-15 22:24:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 22:24:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 22:24:25 [DEBUG   ] spawn_process: at 2018-11-15 22:24:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 22:24:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 22:24:25 [DEBUG   ] spawn_process: at 2018-11-15 22:24:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 22:24:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 22:24:25 [DEBUG   ] spawn_process: at 2018-11-15 22:24:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 22:24:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 22:24:25 [DEBUG   ] spawn_process: at 2018-11-15 22:24:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 22:24:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 22:24:25 [DEBUG   ] spawn_process: at 2018-11-15 22:24:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 22:24:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 22:24:25 [DEBUG   ] spawn_process: at 2018-11-15 22:24:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 22:24:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 22:24:25 [DEBUG   ] spawn_process: at 2018-11-15 22:24:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 22:24:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 22:24:25 [DEBUG   ] spawn_process: at 2018-11-15 22:24:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 22:24:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 22:24:25 [DEBUG   ] spawn_process: at 2018-11-15 22:24:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 22:24:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 22:24:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 22:24:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:24:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 22:24:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-11-15 22:24:28 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 22:24:28 [WARNING ] (13, 1, 'bot')
2018-11-15 22:24:28 [WARNING ] (13, 1, 'bot')
2018-11-15 22:24:28 [WARNING ] (13, 1, 'bot')
2018-11-15 22:24:28 [WARNING ] (13, 1, 'bot')
2018-11-15 22:24:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 22:24:28 [DEBUG   ] Finished updating board flags in 1.408 seconds
2018-11-15 22:24:29 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-15 22:24:49 [DEBUG   ] Got command BAM from MCS: ref #519714
2018-11-15 22:24:49 [INFO    ] Finished processing BAM request
2018-11-15 22:24:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:24:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519714   8 58437 80689025 A  ERROR'
2018-11-15 22:24:49 [DEBUG   ] Got command BAM from MCS: ref #519713
2018-11-15 22:24:49 [INFO    ] Finished processing BAM request
2018-11-15 22:24:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 22:24:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   519713   8 58437 80689029 A  ERROR'
2018-11-15 22:24:49 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 22:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 22:24:49 [DEBUG   ] spawn_process: at 2018-11-15 22:24:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 22:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 22:24:49 [DEBUG   ] spawn_process: at 2018-11-15 22:24:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 22:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 22:24:49 [DEBUG   ] spawn_process: at 2018-11-15 22:24:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 22:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 22:24:49 [DEBUG   ] spawn_process: at 2018-11-15 22:24:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 22:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 22:24:49 [DEBUG   ] spawn_process: at 2018-11-15 22:24:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 22:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 22:24:49 [DEBUG   ] spawn_process: at 2018-11-15 22:24:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 22:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 22:24:49 [DEBUG   ] spawn_process: at 2018-11-15 22:24:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 22:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 22:24:49 [DEBUG   ] spawn_process: at 2018-11-15 22:24:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 22:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 22:24:49 [DEBUG   ] spawn_process: at 2018-11-15 22:24:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 22:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 22:24:49 [DEBUG   ] spawn_process: at 2018-11-15 22:24:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 22:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 22:24:49 [DEBUG   ] spawn_process: at 2018-11-15 22:24:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 22:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 22:24:49 [DEBUG   ] spawn_process: at 2018-11-15 22:24:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 22:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 22:24:49 [DEBUG   ] spawn_process: at 2018-11-15 22:24:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 22:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 22:24:49 [DEBUG   ] spawn_process: at 2018-11-15 22:24:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 22:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 22:24:49 [DEBUG   ] spawn_process: at 2018-11-15 22:24:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 22:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 22:24:49 [DEBUG   ] spawn_process: at 2018-11-15 22:24:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 22:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 22:24:49 [DEBUG   ] spawn_process: at 2018-11-15 22:24:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 22:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 22:24:49 [DEBUG   ] spawn_process: at 2018-11-15 22:24:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 22:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 22:24:49 [DEBUG   ] spawn_process: at 2018-11-15 22:24:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 22:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 22:24:49 [DEBUG   ] spawn_process: at 2018-11-15 22:24:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 22:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 22:24:49 [DEBUG   ] spawn_process: at 2018-11-15 22:24:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 22:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 22:24:49 [DEBUG   ] spawn_process: at 2018-11-15 22:24:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 22:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 22:24:49 [DEBUG   ] spawn_process: at 2018-11-15 22:24:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 22:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 22:24:49 [DEBUG   ] spawn_process: at 2018-11-15 22:24:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 22:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 22:24:49 [DEBUG   ] spawn_process: at 2018-11-15 22:24:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 22:24:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 22:24:49 [DEBUG   ] spawn_process: at 2018-11-15 22:24:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 22:25:09 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-15 22:25:14 [DEBUG   ] Got command STP from MCS: ref #519716
2018-11-15 22:25:14 [INFO    ] Finished processing BAM request
2018-11-15 22:25:14 [INFO    ] Shutdown the adder chain on beam #2
2018-11-15 22:25:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP   519716   8 58437 80714125 A  ERROR'
2018-11-15 22:25:14 [DEBUG   ] Got command STP from MCS: ref #519715
2018-11-15 22:25:14 [INFO    ] Finished processing BAM request
2018-11-15 22:25:14 [INFO    ] Shutdown the adder chain on beam #3
2018-11-15 22:25:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP   519715   8 58437 80714129 A  ERROR'
2018-11-15 22:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 22:25:14 [DEBUG   ] spawn_process: at 2018-11-15 22:25:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 22:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 22:25:14 [DEBUG   ] spawn_process: at 2018-11-15 22:25:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 22:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 22:25:14 [DEBUG   ] spawn_process: at 2018-11-15 22:25:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 22:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 22:25:14 [DEBUG   ] spawn_process: at 2018-11-15 22:25:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 22:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 22:25:14 [DEBUG   ] spawn_process: at 2018-11-15 22:25:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 22:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 22:25:14 [DEBUG   ] spawn_process: at 2018-11-15 22:25:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 22:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 22:25:14 [DEBUG   ] spawn_process: at 2018-11-15 22:25:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 22:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 22:25:14 [DEBUG   ] spawn_process: at 2018-11-15 22:25:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 22:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 22:25:14 [DEBUG   ] spawn_process: at 2018-11-15 22:25:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 22:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 22:25:14 [DEBUG   ] spawn_process: at 2018-11-15 22:25:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 22:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 22:25:14 [DEBUG   ] spawn_process: at 2018-11-15 22:25:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 22:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 22:25:14 [DEBUG   ] spawn_process: at 2018-11-15 22:25:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 22:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 22:25:14 [DEBUG   ] spawn_process: at 2018-11-15 22:25:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 22:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 22:25:14 [DEBUG   ] spawn_process: at 2018-11-15 22:25:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 22:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 22:25:14 [DEBUG   ] spawn_process: at 2018-11-15 22:25:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 22:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 22:25:14 [DEBUG   ] spawn_process: at 2018-11-15 22:25:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 22:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 22:25:14 [DEBUG   ] spawn_process: at 2018-11-15 22:25:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 22:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 22:25:14 [DEBUG   ] spawn_process: at 2018-11-15 22:25:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 22:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 22:25:14 [DEBUG   ] spawn_process: at 2018-11-15 22:25:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 22:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 22:25:14 [DEBUG   ] spawn_process: at 2018-11-15 22:25:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 22:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 22:25:14 [DEBUG   ] spawn_process: at 2018-11-15 22:25:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 22:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 22:25:14 [DEBUG   ] spawn_process: at 2018-11-15 22:25:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 22:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 22:25:14 [DEBUG   ] spawn_process: at 2018-11-15 22:25:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 22:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 22:25:14 [DEBUG   ] spawn_process: at 2018-11-15 22:25:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 22:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 22:25:14 [DEBUG   ] spawn_process: at 2018-11-15 22:25:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 22:25:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 22:25:14 [DEBUG   ] spawn_process: at 2018-11-15 22:25:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 22:25:29 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-11-15 22:25:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 22:25:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:25:29 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-11-15 22:25:29 [WARNING ] (13, 1, 'bot')
2018-11-15 22:25:29 [WARNING ] (13, 1, 'bot')
2018-11-15 22:25:29 [WARNING ] (13, 1, 'bot')
2018-11-15 22:25:29 [WARNING ] (13, 1, 'bot')
2018-11-15 22:25:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 22:25:29 [DEBUG   ] Finished updating board flags in 2.790 seconds
2018-11-15 22:25:45 [DEBUG   ] Got command RPT from MCS: ref #519717
2018-11-15 22:25:45 [DEBUG   ] summary = ERROR
2018-11-15 22:25:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519717  13 58437 80745217 A  ERRORERROR'
2018-11-15 22:25:45 [DEBUG   ] Got command RPT from MCS: ref #519718
2018-11-15 22:25:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 22:25:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519718  77 58437 80745218 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 22:25:49 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2018-11-15 22:26:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 22:26:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:26:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 22:26:28 [WARNING ] (13, 1, 'bot')
2018-11-15 22:26:28 [WARNING ] (13, 1, 'bot')
2018-11-15 22:26:28 [WARNING ] (13, 1, 'bot')
2018-11-15 22:26:28 [WARNING ] (13, 1, 'bot')
2018-11-15 22:26:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 22:26:28 [DEBUG   ] Finished updating board flags in 1.175 seconds
2018-11-15 22:26:29 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-15 22:26:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 22:27:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 22:27:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:27:28 [WARNING ] (13, 1, 'bot')
2018-11-15 22:27:28 [WARNING ] (13, 1, 'bot')
2018-11-15 22:27:28 [WARNING ] (13, 1, 'bot')
2018-11-15 22:27:28 [WARNING ] (13, 1, 'bot')
2018-11-15 22:27:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 22:27:28 [DEBUG   ] Finished updating board flags in 1.005 seconds
2018-11-15 22:27:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 22:27:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 22:28:09 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 22:28:25 [DEBUG   ] Got command RPT from MCS: ref #519740
2018-11-15 22:28:25 [DEBUG   ] summary = ERROR
2018-11-15 22:28:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519740  13 58437 80905685 A  ERRORERROR'
2018-11-15 22:28:25 [DEBUG   ] Got command RPT from MCS: ref #519741
2018-11-15 22:28:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 22:28:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519741  77 58437 80905889 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 22:28:26 [DEBUG   ] Got command RPT from MCS: ref #519742
2018-11-15 22:28:26 [DEBUG   ] summary = ERROR
2018-11-15 22:28:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519742  13 58437 80906093 A  ERRORERROR'
2018-11-15 22:28:26 [DEBUG   ] Got command RPT from MCS: ref #519744
2018-11-15 22:28:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 22:28:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519744  77 58437 80906297 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 22:28:26 [DEBUG   ] Got command RPT from MCS: ref #519745
2018-11-15 22:28:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 22:28:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519745  12 58437 80906489 A  ERRORBœ™š'
2018-11-15 22:28:27 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 22:28:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:28:28 [WARNING ] (13, 1, 'bot')
2018-11-15 22:28:28 [WARNING ] (13, 1, 'bot')
2018-11-15 22:28:28 [WARNING ] (13, 1, 'bot')
2018-11-15 22:28:28 [WARNING ] (13, 1, 'bot')
2018-11-15 22:28:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 22:28:28 [DEBUG   ] Finished updating board flags in 1.068 seconds
2018-11-15 22:28:29 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 22:28:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 22:29:09 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 22:29:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:29:29 [DEBUG   ] Finished updating ant stats in 0.630 seconds
2018-11-15 22:29:29 [WARNING ] (13, 1, 'bot')
2018-11-15 22:29:29 [WARNING ] (13, 1, 'bot')
2018-11-15 22:29:29 [WARNING ] (13, 1, 'bot')
2018-11-15 22:29:29 [WARNING ] (13, 1, 'bot')
2018-11-15 22:29:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 22:29:29 [DEBUG   ] Finished updating board flags in 2.001 seconds
2018-11-15 22:29:49 [DEBUG   ] Finished updating ant stats in 0.574 seconds
2018-11-15 22:30:09 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 22:30:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:30:28 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 22:30:28 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-15 22:30:28 [WARNING ] (13, 1, 'bot')
2018-11-15 22:30:28 [WARNING ] (13, 1, 'bot')
2018-11-15 22:30:28 [WARNING ] (13, 1, 'bot')
2018-11-15 22:30:28 [WARNING ] (13, 1, 'bot')
2018-11-15 22:30:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 22:30:28 [DEBUG   ] Finished updating board flags in 1.414 seconds
2018-11-15 22:30:29 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 22:30:45 [DEBUG   ] Got command RPT from MCS: ref #519754
2018-11-15 22:30:45 [DEBUG   ] summary = ERROR
2018-11-15 22:30:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519754  13 58437 81045221 A  ERRORERROR'
2018-11-15 22:30:45 [DEBUG   ] Got command RPT from MCS: ref #519755
2018-11-15 22:30:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 22:30:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519755  77 58437 81045222 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 22:30:49 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 22:31:09 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 22:31:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-15 22:31:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:31:28 [WARNING ] (13, 1, 'bot')
2018-11-15 22:31:28 [WARNING ] (13, 1, 'bot')
2018-11-15 22:31:28 [WARNING ] (13, 1, 'bot')
2018-11-15 22:31:28 [WARNING ] (13, 1, 'bot')
2018-11-15 22:31:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 22:31:28 [DEBUG   ] Finished updating board flags in 1.442 seconds
2018-11-15 22:31:29 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 22:31:49 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 22:32:09 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 22:32:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:32:28 [WARNING ] (13, 1, 'bot')
2018-11-15 22:32:28 [WARNING ] (13, 1, 'bot')
2018-11-15 22:32:28 [WARNING ] (13, 1, 'bot')
2018-11-15 22:32:28 [WARNING ] (13, 1, 'bot')
2018-11-15 22:32:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 22:32:28 [DEBUG   ] Finished updating board flags in 1.332 seconds
2018-11-15 22:32:29 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 22:32:49 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 22:33:09 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 22:33:25 [DEBUG   ] Got command RPT from MCS: ref #519775
2018-11-15 22:33:25 [DEBUG   ] summary = ERROR
2018-11-15 22:33:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519775  13 58437 81205769 A  ERRORERROR'
2018-11-15 22:33:25 [DEBUG   ] Got command RPT from MCS: ref #519776
2018-11-15 22:33:25 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 22:33:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519776  77 58437 81205973 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 22:33:26 [DEBUG   ] Got command RPT from MCS: ref #519777
2018-11-15 22:33:26 [DEBUG   ] summary = ERROR
2018-11-15 22:33:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519777  13 58437 81206177 A  ERRORERROR'
2018-11-15 22:33:26 [DEBUG   ] Got command RPT from MCS: ref #519778
2018-11-15 22:33:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 22:33:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519778  77 58437 81206381 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 22:33:26 [DEBUG   ] Got command RPT from MCS: ref #519779
2018-11-15 22:33:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 22:33:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519779  12 58437 81206573 A  ERRORB™™š'
2018-11-15 22:33:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:33:28 [WARNING ] (13, 1, 'bot')
2018-11-15 22:33:28 [WARNING ] (13, 1, 'bot')
2018-11-15 22:33:28 [WARNING ] (13, 1, 'bot')
2018-11-15 22:33:28 [WARNING ] (13, 1, 'bot')
2018-11-15 22:33:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 22:33:28 [DEBUG   ] Finished updating board flags in 1.263 seconds
2018-11-15 22:33:29 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 22:33:49 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 22:34:09 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 22:34:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 22:34:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:34:29 [DEBUG   ] Finished updating ant stats in 0.429 seconds
2018-11-15 22:34:29 [WARNING ] (13, 1, 'bot')
2018-11-15 22:34:29 [WARNING ] (13, 1, 'bot')
2018-11-15 22:34:29 [WARNING ] (13, 1, 'bot')
2018-11-15 22:34:29 [WARNING ] (13, 1, 'bot')
2018-11-15 22:34:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 22:34:29 [DEBUG   ] Finished updating board flags in 1.762 seconds
2018-11-15 22:34:49 [DEBUG   ] Finished updating ant stats in 0.374 seconds
2018-11-15 22:35:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 22:35:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 22:35:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:35:30 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-15 22:35:30 [WARNING ] (13, 1, 'bot')
2018-11-15 22:35:30 [WARNING ] (13, 1, 'bot')
2018-11-15 22:35:30 [WARNING ] (13, 1, 'bot')
2018-11-15 22:35:30 [WARNING ] (13, 1, 'bot')
2018-11-15 22:35:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 22:35:30 [DEBUG   ] Finished updating board flags in 2.666 seconds
2018-11-15 22:35:45 [DEBUG   ] Got command RPT from MCS: ref #519784
2018-11-15 22:35:45 [DEBUG   ] summary = ERROR
2018-11-15 22:35:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519784  13 58437 81345217 A  ERRORERROR'
2018-11-15 22:35:45 [DEBUG   ] Got command RPT from MCS: ref #519785
2018-11-15 22:35:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 22:35:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519785  77 58437 81345218 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 22:35:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 22:36:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 22:36:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:36:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 22:36:28 [WARNING ] (13, 1, 'bot')
2018-11-15 22:36:28 [WARNING ] (13, 1, 'bot')
2018-11-15 22:36:28 [WARNING ] (13, 1, 'bot')
2018-11-15 22:36:28 [WARNING ] (13, 1, 'bot')
2018-11-15 22:36:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 22:36:28 [DEBUG   ] Finished updating board flags in 0.915 seconds
2018-11-15 22:36:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 22:36:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 22:37:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 22:37:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:37:29 [WARNING ] (13, 1, 'bot')
2018-11-15 22:37:29 [WARNING ] (13, 1, 'bot')
2018-11-15 22:37:29 [WARNING ] (13, 1, 'bot')
2018-11-15 22:37:29 [WARNING ] (13, 1, 'bot')
2018-11-15 22:37:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 22:37:29 [DEBUG   ] Finished updating board flags in 1.404 seconds
2018-11-15 22:37:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 22:37:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 22:38:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 22:38:25 [DEBUG   ] Got command RPT from MCS: ref #519803
2018-11-15 22:38:25 [DEBUG   ] summary = ERROR
2018-11-15 22:38:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519803  13 58437 81505857 A  ERRORERROR'
2018-11-15 22:38:26 [DEBUG   ] Got command RPT from MCS: ref #519804
2018-11-15 22:38:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 22:38:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519804  77 58437 81506061 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 22:38:26 [DEBUG   ] Got command RPT from MCS: ref #519805
2018-11-15 22:38:26 [DEBUG   ] summary = ERROR
2018-11-15 22:38:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519805  13 58437 81506265 A  ERRORERROR'
2018-11-15 22:38:26 [DEBUG   ] Got command RPT from MCS: ref #519807
2018-11-15 22:38:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 22:38:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519807  77 58437 81506457 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 22:38:26 [DEBUG   ] Got command RPT from MCS: ref #519808
2018-11-15 22:38:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 22:38:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519808  12 58437 81506661 A  ERRORB™™š'
2018-11-15 22:38:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:38:29 [WARNING ] (13, 1, 'bot')
2018-11-15 22:38:29 [WARNING ] (13, 1, 'bot')
2018-11-15 22:38:29 [WARNING ] (13, 1, 'bot')
2018-11-15 22:38:29 [WARNING ] (13, 1, 'bot')
2018-11-15 22:38:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 22:38:29 [DEBUG   ] Finished updating board flags in 1.374 seconds
2018-11-15 22:38:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 22:38:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 22:39:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 22:39:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:39:29 [WARNING ] (13, 1, 'bot')
2018-11-15 22:39:29 [WARNING ] (13, 1, 'bot')
2018-11-15 22:39:29 [WARNING ] (13, 1, 'bot')
2018-11-15 22:39:29 [WARNING ] (13, 1, 'bot')
2018-11-15 22:39:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 22:39:29 [DEBUG   ] Finished updating board flags in 1.244 seconds
2018-11-15 22:39:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 22:39:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 22:40:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 22:40:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:40:29 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-15 22:40:29 [WARNING ] (13, 1, 'bot')
2018-11-15 22:40:29 [WARNING ] (13, 1, 'bot')
2018-11-15 22:40:29 [WARNING ] (13, 1, 'bot')
2018-11-15 22:40:29 [WARNING ] (13, 1, 'bot')
2018-11-15 22:40:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 22:40:29 [DEBUG   ] Finished updating board flags in 1.194 seconds
2018-11-15 22:40:30 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 22:40:45 [DEBUG   ] Got command RPT from MCS: ref #519817
2018-11-15 22:40:45 [DEBUG   ] summary = ERROR
2018-11-15 22:40:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519817  13 58437 81645221 A  ERRORERROR'
2018-11-15 22:40:45 [DEBUG   ] Got command RPT from MCS: ref #519818
2018-11-15 22:40:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 22:40:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519818  77 58437 81645222 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 22:40:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 22:41:10 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 22:41:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:41:30 [DEBUG   ] Finished updating ant stats in 1.236 seconds
2018-11-15 22:41:30 [WARNING ] (13, 1, 'bot')
2018-11-15 22:41:30 [WARNING ] (13, 1, 'bot')
2018-11-15 22:41:30 [WARNING ] (13, 1, 'bot')
2018-11-15 22:41:30 [WARNING ] (13, 1, 'bot')
2018-11-15 22:41:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 22:41:30 [DEBUG   ] Finished updating board flags in 2.083 seconds
2018-11-15 22:41:50 [DEBUG   ] Finished updating ant stats in 1.166 seconds
2018-11-15 22:42:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 22:42:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:42:30 [DEBUG   ] Finished updating ant stats in 1.028 seconds
2018-11-15 22:42:30 [WARNING ] (13, 1, 'bot')
2018-11-15 22:42:30 [WARNING ] (13, 1, 'bot')
2018-11-15 22:42:30 [WARNING ] (13, 1, 'bot')
2018-11-15 22:42:30 [WARNING ] (13, 1, 'bot')
2018-11-15 22:42:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 22:42:30 [DEBUG   ] Finished updating board flags in 1.917 seconds
2018-11-15 22:42:50 [DEBUG   ] Finished updating ant stats in 0.978 seconds
2018-11-15 22:43:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 22:43:25 [DEBUG   ] Got command RPT from MCS: ref #519838
2018-11-15 22:43:25 [DEBUG   ] summary = ERROR
2018-11-15 22:43:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519838  13 58437 81805949 A  ERRORERROR'
2018-11-15 22:43:26 [DEBUG   ] Got command RPT from MCS: ref #519839
2018-11-15 22:43:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 22:43:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519839  77 58437 81806153 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 22:43:26 [DEBUG   ] Got command RPT from MCS: ref #519840
2018-11-15 22:43:26 [DEBUG   ] summary = ERROR
2018-11-15 22:43:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519840  13 58437 81806345 A  ERRORERROR'
2018-11-15 22:43:26 [DEBUG   ] Got command RPT from MCS: ref #519841
2018-11-15 22:43:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 22:43:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519841  77 58437 81806549 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 22:43:26 [DEBUG   ] Got command RPT from MCS: ref #519842
2018-11-15 22:43:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 22:43:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519842  12 58437 81806753 A  ERRORB˜™š'
2018-11-15 22:43:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-15 22:43:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:43:30 [DEBUG   ] Finished updating ant stats in 0.829 seconds
2018-11-15 22:43:30 [WARNING ] (13, 1, 'bot')
2018-11-15 22:43:30 [WARNING ] (13, 1, 'bot')
2018-11-15 22:43:30 [WARNING ] (13, 1, 'bot')
2018-11-15 22:43:30 [WARNING ] (13, 1, 'bot')
2018-11-15 22:43:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 22:43:30 [DEBUG   ] Finished updating board flags in 1.828 seconds
2018-11-15 22:43:50 [DEBUG   ] Finished updating ant stats in 0.774 seconds
2018-11-15 22:44:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 22:44:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:44:29 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 22:44:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-15 22:44:29 [WARNING ] (13, 1, 'bot')
2018-11-15 22:44:29 [WARNING ] (13, 1, 'bot')
2018-11-15 22:44:29 [WARNING ] (13, 1, 'bot')
2018-11-15 22:44:29 [WARNING ] (13, 1, 'bot')
2018-11-15 22:44:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 22:44:29 [DEBUG   ] Finished updating board flags in 1.198 seconds
2018-11-15 22:44:30 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-15 22:44:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 22:45:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 22:45:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:45:29 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 22:45:30 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-15 22:45:30 [WARNING ] (13, 1, 'bot')
2018-11-15 22:45:30 [WARNING ] (13, 1, 'bot')
2018-11-15 22:45:30 [WARNING ] (13, 1, 'bot')
2018-11-15 22:45:30 [WARNING ] (13, 1, 'bot')
2018-11-15 22:45:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 22:45:30 [DEBUG   ] Finished updating board flags in 1.532 seconds
2018-11-15 22:45:45 [DEBUG   ] Got command RPT from MCS: ref #519847
2018-11-15 22:45:45 [DEBUG   ] summary = ERROR
2018-11-15 22:45:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519847  13 58437 81945225 A  ERRORERROR'
2018-11-15 22:45:45 [DEBUG   ] Got command RPT from MCS: ref #519848
2018-11-15 22:45:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 22:45:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519848  77 58437 81945226 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 22:45:50 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 22:46:10 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 22:46:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:46:30 [DEBUG   ] Finished updating ant stats in 0.430 seconds
2018-11-15 22:46:30 [WARNING ] (13, 1, 'bot')
2018-11-15 22:46:30 [WARNING ] (13, 1, 'bot')
2018-11-15 22:46:30 [WARNING ] (13, 1, 'bot')
2018-11-15 22:46:30 [WARNING ] (13, 1, 'bot')
2018-11-15 22:46:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 22:46:30 [DEBUG   ] Finished updating board flags in 1.465 seconds
2018-11-15 22:46:50 [DEBUG   ] Finished updating ant stats in 0.374 seconds
2018-11-15 22:47:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 22:47:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:47:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-15 22:47:30 [WARNING ] (13, 1, 'bot')
2018-11-15 22:47:30 [WARNING ] (13, 1, 'bot')
2018-11-15 22:47:30 [WARNING ] (13, 1, 'bot')
2018-11-15 22:47:30 [WARNING ] (13, 1, 'bot')
2018-11-15 22:47:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 22:47:30 [DEBUG   ] Finished updating board flags in 1.384 seconds
2018-11-15 22:47:31 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 22:47:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 22:48:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 22:48:26 [DEBUG   ] Got command RPT from MCS: ref #519877
2018-11-15 22:48:26 [DEBUG   ] summary = ERROR
2018-11-15 22:48:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519877  13 58437 82106029 A  ERRORERROR'
2018-11-15 22:48:26 [DEBUG   ] Got command RPT from MCS: ref #519878
2018-11-15 22:48:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 22:48:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519878  77 58437 82106233 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 22:48:26 [DEBUG   ] Got command RPT from MCS: ref #519879
2018-11-15 22:48:26 [DEBUG   ] summary = ERROR
2018-11-15 22:48:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519879  13 58437 82106437 A  ERRORERROR'
2018-11-15 22:48:26 [DEBUG   ] Got command RPT from MCS: ref #519881
2018-11-15 22:48:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 22:48:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519881  77 58437 82106629 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 22:48:26 [DEBUG   ] Got command RPT from MCS: ref #519883
2018-11-15 22:48:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 22:48:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519883  12 58437 82106833 A  ERRORB˜™š'
2018-11-15 22:48:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:48:30 [WARNING ] (13, 1, 'bot')
2018-11-15 22:48:30 [WARNING ] (13, 1, 'bot')
2018-11-15 22:48:30 [WARNING ] (13, 1, 'bot')
2018-11-15 22:48:30 [WARNING ] (13, 1, 'bot')
2018-11-15 22:48:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 22:48:30 [DEBUG   ] Finished updating board flags in 1.193 seconds
2018-11-15 22:48:31 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-15 22:48:51 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 22:49:11 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 22:49:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:49:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-15 22:49:31 [DEBUG   ] Finished updating ant stats in 1.229 seconds
2018-11-15 22:49:31 [WARNING ] (13, 1, 'bot')
2018-11-15 22:49:31 [WARNING ] (13, 1, 'bot')
2018-11-15 22:49:31 [WARNING ] (13, 1, 'bot')
2018-11-15 22:49:31 [WARNING ] (13, 1, 'bot')
2018-11-15 22:49:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 22:49:31 [DEBUG   ] Finished updating board flags in 2.037 seconds
2018-11-15 22:49:51 [DEBUG   ] Finished updating ant stats in 1.173 seconds
2018-11-15 22:50:11 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2018-11-15 22:50:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:50:31 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 22:50:31 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-15 22:50:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-15 22:50:31 [WARNING ] (13, 1, 'bot')
2018-11-15 22:50:31 [WARNING ] (13, 1, 'bot')
2018-11-15 22:50:31 [WARNING ] (13, 1, 'bot')
2018-11-15 22:50:31 [WARNING ] (13, 1, 'bot')
2018-11-15 22:50:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 22:50:31 [DEBUG   ] Finished updating board flags in 2.135 seconds
2018-11-15 22:50:45 [DEBUG   ] Got command RPT from MCS: ref #519896
2018-11-15 22:50:45 [DEBUG   ] summary = ERROR
2018-11-15 22:50:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519896  13 58437 82245221 A  ERRORERROR'
2018-11-15 22:50:45 [DEBUG   ] Got command RPT from MCS: ref #519897
2018-11-15 22:50:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 22:50:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519897  77 58437 82245222 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 22:50:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 22:51:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 22:51:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:51:31 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-15 22:51:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 22:51:31 [WARNING ] (13, 1, 'bot')
2018-11-15 22:51:31 [WARNING ] (13, 1, 'bot')
2018-11-15 22:51:31 [WARNING ] (13, 1, 'bot')
2018-11-15 22:51:31 [WARNING ] (13, 1, 'bot')
2018-11-15 22:51:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 22:51:31 [DEBUG   ] Finished updating board flags in 1.986 seconds
2018-11-15 22:51:51 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-11-15 22:52:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 22:52:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:52:31 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-15 22:52:31 [WARNING ] (13, 1, 'bot')
2018-11-15 22:52:31 [WARNING ] (13, 1, 'bot')
2018-11-15 22:52:31 [WARNING ] (13, 1, 'bot')
2018-11-15 22:52:31 [WARNING ] (13, 1, 'bot')
2018-11-15 22:52:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 22:52:31 [DEBUG   ] Finished updating board flags in 1.584 seconds
2018-11-15 22:52:51 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-15 22:53:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 22:53:26 [DEBUG   ] Got command RPT from MCS: ref #519913
2018-11-15 22:53:26 [DEBUG   ] summary = ERROR
2018-11-15 22:53:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519913  13 58437 82406121 A  ERRORERROR'
2018-11-15 22:53:26 [DEBUG   ] Got command RPT from MCS: ref #519914
2018-11-15 22:53:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 22:53:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519914  77 58437 82406325 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 22:53:26 [DEBUG   ] Got command RPT from MCS: ref #519915
2018-11-15 22:53:26 [DEBUG   ] summary = ERROR
2018-11-15 22:53:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519915  13 58437 82406517 A  ERRORERROR'
2018-11-15 22:53:26 [DEBUG   ] Got command RPT from MCS: ref #519916
2018-11-15 22:53:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 22:53:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519916  77 58437 82406721 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 22:53:26 [DEBUG   ] Got command RPT from MCS: ref #519917
2018-11-15 22:53:26 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 22:53:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519917  12 58437 82406925 A  ERRORB˜™š'
2018-11-15 22:53:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:53:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-15 22:53:31 [DEBUG   ] Finished updating ant stats in 0.628 seconds
2018-11-15 22:53:31 [WARNING ] (13, 1, 'bot')
2018-11-15 22:53:31 [WARNING ] (13, 1, 'bot')
2018-11-15 22:53:31 [WARNING ] (13, 1, 'bot')
2018-11-15 22:53:31 [WARNING ] (13, 1, 'bot')
2018-11-15 22:53:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 22:53:31 [DEBUG   ] Finished updating board flags in 1.498 seconds
2018-11-15 22:53:51 [DEBUG   ] Finished updating ant stats in 0.573 seconds
2018-11-15 22:54:11 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 22:54:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:54:31 [DEBUG   ] Finished updating ant stats in 0.427 seconds
2018-11-15 22:54:31 [WARNING ] (13, 1, 'bot')
2018-11-15 22:54:31 [WARNING ] (13, 1, 'bot')
2018-11-15 22:54:31 [WARNING ] (13, 1, 'bot')
2018-11-15 22:54:31 [WARNING ] (13, 1, 'bot')
2018-11-15 22:54:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 22:54:31 [DEBUG   ] Finished updating board flags in 1.397 seconds
2018-11-15 22:54:51 [DEBUG   ] Finished updating ant stats in 0.377 seconds
2018-11-15 22:55:12 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 22:55:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:55:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-15 22:55:31 [WARNING ] (13, 1, 'bot')
2018-11-15 22:55:31 [WARNING ] (13, 1, 'bot')
2018-11-15 22:55:31 [WARNING ] (13, 1, 'bot')
2018-11-15 22:55:31 [WARNING ] (13, 1, 'bot')
2018-11-15 22:55:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 22:55:31 [DEBUG   ] Finished updating board flags in 1.177 seconds
2018-11-15 22:55:32 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-11-15 22:55:45 [DEBUG   ] Got command RPT from MCS: ref #519922
2018-11-15 22:55:45 [DEBUG   ] summary = ERROR
2018-11-15 22:55:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519922  13 58437 82545229 A  ERRORERROR'
2018-11-15 22:55:45 [DEBUG   ] Got command RPT from MCS: ref #519923
2018-11-15 22:55:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 22:55:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519923  77 58437 82545230 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 22:55:52 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-15 22:56:12 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-15 22:56:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 22:56:32 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-15 22:56:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:56:32 [WARNING ] (13, 1, 'bot')
2018-11-15 22:56:32 [WARNING ] (13, 1, 'bot')
2018-11-15 22:56:32 [WARNING ] (13, 1, 'bot')
2018-11-15 22:56:32 [WARNING ] (13, 1, 'bot')
2018-11-15 22:56:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 22:56:32 [DEBUG   ] Finished updating board flags in 2.393 seconds
2018-11-15 22:56:52 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 22:57:00 [DEBUG   ] Got command RPT from MCS: ref #519943
2018-11-15 22:57:00 [DEBUG   ] summary = ERROR
2018-11-15 22:57:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519943  13 58437 82620805 A  ERRORERROR'
2018-11-15 22:57:00 [DEBUG   ] Got command RPT from MCS: ref #519944
2018-11-15 22:57:00 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 22:57:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519944  77 58437 82620806 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 22:57:05 [DEBUG   ] Got command INI from MCS: ref #519945
2018-11-15 22:57:05 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-11-15 22:57:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI   519945   8 58437 82625813 ABOOTING'
2018-11-15 22:57:26 [INFO    ] -------------------
2018-11-15 22:57:26 [INFO    ]  LWA board status
2018-11-15 22:57:26 [INFO    ] -------------------
2018-11-15 22:57:26 [INFO    ] DP 1: 2 lwa27
2018-11-15 22:57:26 [INFO    ] DP 1: 3 lwa24
2018-11-15 22:57:26 [INFO    ] DP 1: 4 lwa23
2018-11-15 22:57:26 [INFO    ] DP 1: 5 lwa18
2018-11-15 22:57:26 [INFO    ] DP 1: 6 lwa10
2018-11-15 22:57:26 [INFO    ] DP 1: 7 lwa32
2018-11-15 22:57:26 [INFO    ] DP 1: 8 lwa11
2018-11-15 22:57:26 [INFO    ] DP 1: 9 lwa30
2018-11-15 22:57:26 [INFO    ] DP 1: 10 lwa12
2018-11-15 22:57:26 [INFO    ] DP 1: 11 lwa8
2018-11-15 22:57:26 [INFO    ] DP 1: 12 lwa13
2018-11-15 22:57:26 [INFO    ] DP 1: 13 lwa26
2018-11-15 22:57:26 [INFO    ] DP 1: 14 lwa14
2018-11-15 22:57:26 [INFO    ] DP 1: 16 lwa22
2018-11-15 22:57:26 [INFO    ] DP 1: 17 lwa20
2018-11-15 22:57:26 [INFO    ] DP 1: 18 lwa1
2018-11-15 22:57:26 [INFO    ] DP 1: 19 lwa5
2018-11-15 22:57:26 [INFO    ] DP 1: 20 lwa25
2018-11-15 22:57:26 [INFO    ] DP 1: 21 lwa35
2018-11-15 22:57:26 [INFO    ] DP 1: 22 lwa19
2018-11-15 22:57:26 [INFO    ] DP 1: 23 lwa21
2018-11-15 22:57:26 [INFO    ] DP 1: 24 lwa6
2018-11-15 22:57:26 [INFO    ] DP 1: 25 lwa7
2018-11-15 22:57:26 [INFO    ] DP 1: 26 lwa33
2018-11-15 22:57:26 [INFO    ] DP 1: 27 lwa15
2018-11-15 22:57:26 [INFO    ] DP 1: 28 lwa28
2018-11-15 22:57:26 [INFO    ] DP 2: 1 lwa16
2018-11-15 22:57:26 [INFO    ] DP 2: 15 lwa34
2018-11-15 22:57:26 [INFO    ] Total of 28 boards
2018-11-15 22:57:26 [INFO    ] Total of 260 stands
2018-11-15 22:57:26 [INFO    ] -------------------
2018-11-15 22:57:26 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-11-15 22:57:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-11-15 22:57:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-11-15 22:57:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-11-15 22:57:27 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-11-15 22:57:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-11-15 22:57:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-11-15 22:57:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-11-15 22:57:28 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-11-15 22:57:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-11-15 22:57:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-11-15 22:57:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-11-15 22:57:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-11-15 22:57:29 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-11-15 22:57:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-11-15 22:57:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-11-15 22:57:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-11-15 22:57:30 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-11-15 22:57:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-11-15 22:57:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-11-15 22:57:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-11-15 22:57:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-11-15 22:57:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-11-15 22:57:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-11-15 22:57:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-11-15 22:57:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-11-15 22:57:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-11-15 22:57:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-11-15 22:57:33 [DEBUG   ] 2018-11-15 22:57:33 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1669
2018-11-15 22:57:33 [DEBUG   ] 2018-11-15 22:57:33 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1670
2018-11-15 22:57:33 [DEBUG   ] 2018-11-15 22:57:33 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1671
2018-11-15 22:57:33 [DEBUG   ] 2018-11-15 22:57:33 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1672
2018-11-15 22:57:33 [DEBUG   ] 2018-11-15 22:57:33 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1673
2018-11-15 22:57:33 [DEBUG   ] 2018-11-15 22:57:33 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1674
2018-11-15 22:57:33 [DEBUG   ] 2018-11-15 22:57:33 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1675
2018-11-15 22:57:33 [DEBUG   ] 2018-11-15 22:57:33 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1676
2018-11-15 22:57:33 [DEBUG   ] 2018-11-15 22:57:33 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1677
2018-11-15 22:57:33 [DEBUG   ] 2018-11-15 22:57:33 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1678
2018-11-15 22:57:33 [DEBUG   ] 2018-11-15 22:57:33 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1679
2018-11-15 22:57:33 [DEBUG   ] 2018-11-15 22:57:33 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1680
2018-11-15 22:57:33 [DEBUG   ] 2018-11-15 22:57:33 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1681
2018-11-15 22:57:33 [DEBUG   ] 2018-11-15 22:57:33 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1682
2018-11-15 22:57:33 [DEBUG   ] 2018-11-15 22:57:33 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1683
2018-11-15 22:57:33 [DEBUG   ] 2018-11-15 22:57:33 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1684
2018-11-15 22:57:33 [DEBUG   ] 2018-11-15 22:57:33 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1685
2018-11-15 22:57:33 [DEBUG   ] 2018-11-15 22:57:33 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1686
2018-11-15 22:57:33 [DEBUG   ] 2018-11-15 22:57:33 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1687
2018-11-15 22:57:33 [DEBUG   ] 2018-11-15 22:57:33 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1688
2018-11-15 22:57:33 [DEBUG   ] 2018-11-15 22:57:33 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1689
2018-11-15 22:57:33 [DEBUG   ] 2018-11-15 22:57:33 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1690
2018-11-15 22:57:33 [DEBUG   ] 2018-11-15 22:57:33 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1691
2018-11-15 22:57:33 [DEBUG   ] 2018-11-15 22:57:33 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1692
2018-11-15 22:57:33 [DEBUG   ] 2018-11-15 22:57:33 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1693
2018-11-15 22:57:33 [DEBUG   ] 2018-11-15 22:57:33 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 1694
2018-11-15 22:57:45 [DEBUG   ] 2018-11-15 22:57:45 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1669 exited with status 0
2018-11-15 22:57:45 [DEBUG   ] 2018-11-15 22:57:45 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1670 exited with status 0
2018-11-15 22:57:45 [DEBUG   ] 2018-11-15 22:57:45 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1671 exited with status 0
2018-11-15 22:57:45 [DEBUG   ] 2018-11-15 22:57:45 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1672 exited with status 0
2018-11-15 22:57:45 [DEBUG   ] 2018-11-15 22:57:45 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1673 exited with status 0
2018-11-15 22:57:45 [DEBUG   ] 2018-11-15 22:57:45 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1674 exited with status 0
2018-11-15 22:57:45 [DEBUG   ] 2018-11-15 22:57:45 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1675 exited with status 0
2018-11-15 22:57:45 [DEBUG   ] 2018-11-15 22:57:45 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1676 exited with status 0
2018-11-15 22:57:45 [DEBUG   ] 2018-11-15 22:57:45 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1677 exited with status 0
2018-11-15 22:57:45 [DEBUG   ] 2018-11-15 22:57:45 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1678 exited with status 0
2018-11-15 22:57:45 [DEBUG   ] 2018-11-15 22:57:45 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1679 exited with status 0
2018-11-15 22:57:45 [DEBUG   ] 2018-11-15 22:57:45 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1680 exited with status 0
2018-11-15 22:57:45 [DEBUG   ] 2018-11-15 22:57:45 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1681 exited with status 0
2018-11-15 22:57:45 [DEBUG   ] 2018-11-15 22:57:45 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1682 exited with status 0
2018-11-15 22:57:45 [DEBUG   ] 2018-11-15 22:57:45 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1683 exited with status 0
2018-11-15 22:57:45 [DEBUG   ] 2018-11-15 22:57:45 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1684 exited with status 0
2018-11-15 22:57:45 [DEBUG   ] 2018-11-15 22:57:45 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1685 exited with status 0
2018-11-15 22:57:45 [DEBUG   ] 2018-11-15 22:57:45 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1686 exited with status 0
2018-11-15 22:57:45 [DEBUG   ] 2018-11-15 22:57:45 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1687 exited with status 0
2018-11-15 22:57:45 [DEBUG   ] 2018-11-15 22:57:45 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1688 exited with status 0
2018-11-15 22:57:45 [DEBUG   ] 2018-11-15 22:57:45 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1689 exited with status 0
2018-11-15 22:57:45 [DEBUG   ] 2018-11-15 22:57:45 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1690 exited with status 0
2018-11-15 22:57:45 [DEBUG   ] 2018-11-15 22:57:45 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1691 exited with status 0
2018-11-15 22:57:45 [DEBUG   ] 2018-11-15 22:57:45 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1692 exited with status 0
2018-11-15 22:57:45 [DEBUG   ] 2018-11-15 22:57:45 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1693 exited with status 0
2018-11-15 22:57:45 [DEBUG   ] 2018-11-15 22:57:45 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 1694 exited with status 0
2018-11-15 22:57:45 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-11-15 22:57:45 [DEBUG   ] spawn_process: at 2018-11-15 22:57:45 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-11-15 22:57:45 [DEBUG   ] spawn_process: at 2018-11-15 22:57:45 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-11-15 22:57:45 [DEBUG   ] spawn_process: at 2018-11-15 22:57:45 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-11-15 22:57:45 [DEBUG   ] spawn_process: at 2018-11-15 22:57:45 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-11-15 22:57:45 [DEBUG   ] spawn_process: at 2018-11-15 22:57:45 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-11-15 22:57:45 [DEBUG   ] spawn_process: at 2018-11-15 22:57:45 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-11-15 22:57:45 [DEBUG   ] spawn_process: at 2018-11-15 22:57:45 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-11-15 22:57:45 [DEBUG   ] spawn_process: at 2018-11-15 22:57:45 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-11-15 22:57:45 [DEBUG   ] spawn_process: at 2018-11-15 22:57:45 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-11-15 22:57:45 [DEBUG   ] spawn_process: at 2018-11-15 22:57:45 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-11-15 22:57:45 [DEBUG   ] spawn_process: at 2018-11-15 22:57:45 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-11-15 22:57:45 [DEBUG   ] spawn_process: at 2018-11-15 22:57:45 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-11-15 22:57:45 [DEBUG   ] spawn_process: at 2018-11-15 22:57:45 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-11-15 22:57:45 [DEBUG   ] spawn_process: at 2018-11-15 22:57:45 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-11-15 22:57:45 [DEBUG   ] spawn_process: at 2018-11-15 22:57:45 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-11-15 22:57:45 [DEBUG   ] spawn_process: at 2018-11-15 22:57:45 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-11-15 22:57:45 [DEBUG   ] spawn_process: at 2018-11-15 22:57:45 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-11-15 22:57:45 [DEBUG   ] spawn_process: at 2018-11-15 22:57:45 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-11-15 22:57:45 [DEBUG   ] spawn_process: at 2018-11-15 22:57:45 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-11-15 22:57:45 [DEBUG   ] spawn_process: at 2018-11-15 22:57:45 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-11-15 22:57:45 [DEBUG   ] spawn_process: at 2018-11-15 22:57:45 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-11-15 22:57:45 [DEBUG   ] spawn_process: at 2018-11-15 22:57:45 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-11-15 22:57:45 [DEBUG   ] spawn_process: at 2018-11-15 22:57:45 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-11-15 22:57:45 [DEBUG   ] spawn_process: at 2018-11-15 22:57:45 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-11-15 22:57:45 [DEBUG   ] spawn_process: at 2018-11-15 22:57:45 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-11-15 22:57:45 [DEBUG   ] spawn_process: at 2018-11-15 22:57:45 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-11-15 22:57:45 [DEBUG   ] 2018-11-15 22:57:45 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 1721
2018-11-15 22:57:45 [DEBUG   ] 2018-11-15 22:57:45 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 1722
2018-11-15 22:57:51 [DEBUG   ] 2018-11-15 22:57:51 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 1721 exited with status 0
2018-11-15 22:57:51 [DEBUG   ] 2018-11-15 22:57:51 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 1722 exited with status 0
2018-11-15 22:57:51 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-11-15 22:57:51 [DEBUG   ] spawn_process: at 2018-11-15 22:57:51 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-11-15 22:57:51 [DEBUG   ] spawn_process: at 2018-11-15 22:57:51 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-11-15 22:57:51 [INFO    ] Setting Beam 1 xbars
2018-11-15 22:57:51 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-11-15 22:57:51 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-11-15 22:57:51 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-11-15 22:57:51 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-11-15 22:57:52 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-11-15 22:57:52 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-11-15 22:57:52 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-11-15 22:57:52 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-11-15 22:57:52 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-11-15 22:57:52 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-11-15 22:57:52 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-11-15 22:57:52 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-11-15 22:57:52 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-11-15 22:57:52 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-11-15 22:57:53 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-11-15 22:57:53 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-11-15 22:57:53 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-11-15 22:57:53 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-11-15 22:57:53 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-11-15 22:57:53 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-11-15 22:57:53 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-11-15 22:57:53 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-11-15 22:57:53 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-11-15 22:57:54 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-11-15 22:57:54 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-11-15 22:57:54 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-11-15 22:57:54 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-11-15 22:57:54 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-11-15 22:57:54 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-11-15 22:57:54 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-11-15 22:57:54 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-11-15 22:57:54 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-11-15 22:57:55 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-11-15 22:57:55 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-11-15 22:57:55 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-11-15 22:57:55 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-11-15 22:57:55 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-11-15 22:57:55 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-11-15 22:57:55 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-11-15 22:57:55 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-11-15 22:57:55 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-11-15 22:57:56 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-11-15 22:57:56 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-11-15 22:57:56 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-11-15 22:57:56 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-11-15 22:57:56 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-11-15 22:57:56 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-11-15 22:57:56 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-11-15 22:57:56 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-11-15 22:57:56 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-11-15 22:57:57 [INFO    ] Setting Beam 2 xbars
2018-11-15 22:57:57 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-11-15 22:57:57 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-11-15 22:57:57 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-11-15 22:57:57 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-11-15 22:57:57 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-11-15 22:57:57 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-11-15 22:57:57 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-11-15 22:57:57 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-11-15 22:57:57 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-11-15 22:57:57 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-11-15 22:57:58 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-11-15 22:57:58 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-11-15 22:57:58 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-11-15 22:57:58 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-11-15 22:57:58 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-11-15 22:57:58 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-11-15 22:57:58 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-11-15 22:57:58 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-11-15 22:57:58 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-11-15 22:57:59 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-11-15 22:57:59 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-11-15 22:57:59 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-11-15 22:57:59 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-11-15 22:57:59 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-11-15 22:57:59 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-11-15 22:57:59 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-11-15 22:57:59 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-11-15 22:57:59 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-11-15 22:58:00 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-11-15 22:58:00 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-11-15 22:58:00 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-11-15 22:58:00 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-11-15 22:58:00 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-11-15 22:58:00 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-11-15 22:58:00 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-11-15 22:58:00 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-11-15 22:58:00 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-11-15 22:58:01 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-11-15 22:58:01 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-11-15 22:58:01 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-11-15 22:58:01 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-11-15 22:58:01 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-11-15 22:58:01 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-11-15 22:58:01 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-11-15 22:58:01 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-11-15 22:58:01 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-11-15 22:58:01 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-11-15 22:58:02 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-11-15 22:58:02 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-11-15 22:58:02 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-11-15 22:58:02 [INFO    ] Setting Beam 3 xbars
2018-11-15 22:58:02 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-11-15 22:58:02 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-11-15 22:58:02 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-11-15 22:58:02 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-11-15 22:58:02 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-11-15 22:58:02 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-11-15 22:58:03 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-11-15 22:58:03 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-11-15 22:58:03 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-11-15 22:58:03 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-11-15 22:58:03 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-11-15 22:58:03 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-11-15 22:58:03 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-11-15 22:58:03 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-11-15 22:58:03 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-11-15 22:58:04 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-11-15 22:58:04 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-11-15 22:58:04 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-11-15 22:58:04 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-11-15 22:58:04 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-11-15 22:58:04 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-11-15 22:58:04 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-11-15 22:58:04 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-11-15 22:58:04 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-11-15 22:58:04 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-11-15 22:58:05 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-11-15 22:58:05 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-11-15 22:58:05 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-11-15 22:58:05 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-11-15 22:58:05 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-11-15 22:58:05 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-11-15 22:58:05 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-11-15 22:58:05 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-11-15 22:58:05 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-11-15 22:58:06 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-11-15 22:58:06 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-11-15 22:58:06 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-11-15 22:58:06 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-11-15 22:58:06 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-11-15 22:58:06 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-11-15 22:58:06 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-11-15 22:58:06 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-11-15 22:58:06 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-11-15 22:58:07 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-11-15 22:58:07 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-11-15 22:58:07 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-11-15 22:58:07 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-11-15 22:58:07 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-11-15 22:58:07 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-11-15 22:58:07 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-11-15 22:58:07 [INFO    ] Setting Beam 4 xbars
2018-11-15 22:58:07 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-11-15 22:58:07 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-11-15 22:58:08 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-11-15 22:58:08 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-11-15 22:58:08 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-11-15 22:58:08 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-11-15 22:58:08 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-11-15 22:58:08 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-11-15 22:58:08 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-11-15 22:58:08 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-11-15 22:58:08 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-11-15 22:58:08 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-11-15 22:58:09 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-11-15 22:58:09 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-11-15 22:58:09 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-11-15 22:58:09 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-11-15 22:58:09 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-11-15 22:58:09 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-11-15 22:58:09 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-11-15 22:58:09 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-11-15 22:58:09 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-11-15 22:58:10 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-11-15 22:58:10 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-11-15 22:58:10 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-11-15 22:58:10 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-11-15 22:58:10 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-11-15 22:58:10 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-11-15 22:58:10 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-11-15 22:58:10 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-11-15 22:58:10 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-11-15 22:58:11 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-11-15 22:58:11 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-11-15 22:58:11 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-11-15 22:58:11 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-11-15 22:58:11 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-11-15 22:58:11 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-11-15 22:58:11 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-11-15 22:58:11 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-11-15 22:58:11 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-11-15 22:58:12 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-11-15 22:58:12 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-11-15 22:58:12 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-11-15 22:58:12 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-11-15 22:58:12 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-11-15 22:58:12 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-11-15 22:58:12 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-11-15 22:58:12 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-11-15 22:58:12 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-11-15 22:58:12 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-11-15 22:58:13 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-11-15 22:58:13 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-11-15 22:58:13 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-11-15 22:58:13 [INFO    ] All xbars set
2018-11-15 22:58:13 [INFO    ] Setting adder chain routing for all beams
2018-11-15 22:58:18 [INFO    ] Setting beam ids
2018-11-15 22:58:26 [DEBUG   ] Got command RPT from MCS: ref #519948
2018-11-15 22:58:26 [DEBUG   ] summary = BOOTING
2018-11-15 22:58:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519948  15 58437 82706201 ABOOTINGBOOTING'
2018-11-15 22:58:28 [INFO    ] Starting beam delay calibration
2018-11-15 22:58:40 [INFO    ] Beam 1 latency is 6687
2018-11-15 22:58:40 [INFO    ] Beam 2 latency is 5761
2018-11-15 22:58:40 [INFO    ] Beam 3 latency is 5745
2018-11-15 22:58:40 [INFO    ] Beam 4 latency is 6681
2018-11-15 22:58:40 [INFO    ] Stop calibration
2018-11-15 22:58:48 [ERROR   ] Beam delay calibration failed
2018-11-15 22:58:48 [CRITICAL] Calibration failed
2018-11-15 22:58:48 [DEBUG   ] spawn_process: at 2018-11-15 22:58:48 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-11-15 22:58:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-11-15 22:58:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-11-15 22:58:48 [DEBUG   ] spawn_process: at 2018-11-15 22:58:48 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-11-15 22:58:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-11-15 22:58:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-11-15 22:58:48 [DEBUG   ] spawn_process: at 2018-11-15 22:58:48 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-11-15 22:58:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-11-15 22:58:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-11-15 22:58:48 [DEBUG   ] spawn_process: at 2018-11-15 22:58:48 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-11-15 22:58:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-11-15 22:58:48 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-11-15 22:58:48 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-11-15 22:58:49 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 276 ms (1542322729.278 s) with PID 3407 and time 1542322730
2018-11-15 22:58:49 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-11-15 22:58:49 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 362 ms (1542322729.364 s) with PID 3410 and time 1542322730
2018-11-15 22:58:50 [DEBUG   ] Finished updating ant stats in 0.883 seconds
2018-11-15 22:58:50 [INFO    ] Started antennas statistics background thread
2018-11-15 22:58:50 [INFO    ] Started board flags background thread
2018-11-15 22:58:50 [INFO    ] Started BAM background thread
2018-11-15 22:58:50 [INFO    ] Finished the INI process (ref. #519945) in 104.672 s
2018-11-15 22:58:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:58:51 [WARNING ] (13, 1, 'bot')
2018-11-15 22:58:51 [WARNING ] (13, 1, 'bot')
2018-11-15 22:58:51 [WARNING ] (13, 1, 'bot')
2018-11-15 22:58:51 [WARNING ] (13, 1, 'bot')
2018-11-15 22:58:51 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-11-15 22:58:51 [DEBUG   ] Finished updating board flags in 1.068 seconds
2018-11-15 22:59:10 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 22:59:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 22:59:50 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 22:59:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 22:59:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-15 22:59:51 [WARNING ] (13, 1, 'bot')
2018-11-15 22:59:51 [WARNING ] (13, 1, 'bot')
2018-11-15 22:59:51 [WARNING ] (13, 1, 'bot')
2018-11-15 22:59:51 [WARNING ] (13, 1, 'bot')
2018-11-15 22:59:51 [CRITICAL] MGT underflow detected on beam(s) 1, 2, 3, 4
2018-11-15 22:59:51 [DEBUG   ] Finished updating board flags in 0.989 seconds
2018-11-15 23:00:05 [DEBUG   ] Got command RPT from MCS: ref #519958
2018-11-15 23:00:05 [DEBUG   ] summary = ERROR
2018-11-15 23:00:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519958  13 58437 82805809 A  ERRORERROR'
2018-11-15 23:00:05 [DEBUG   ] Got command RPT from MCS: ref #519959
2018-11-15 23:00:05 [DEBUG   ] info = T_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 23:00:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519959  98 58437 82805810 A  ERRORT_NOM1 T_NOM2 T_NOM3 T_NOM4! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 23:00:10 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-15 23:00:10 [DEBUG   ] Got command INI from MCS: ref #519960
2018-11-15 23:00:10 [INFO    ] Parsing config file '/lwa/software/defaults.cfg'
2018-11-15 23:00:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_INI   519960   8 58437 82810829 ABOOTING'
2018-11-15 23:00:31 [INFO    ] -------------------
2018-11-15 23:00:31 [INFO    ]  LWA board status
2018-11-15 23:00:31 [INFO    ] -------------------
2018-11-15 23:00:31 [INFO    ] DP 1: 2 lwa27
2018-11-15 23:00:31 [INFO    ] DP 1: 3 lwa24
2018-11-15 23:00:31 [INFO    ] DP 1: 4 lwa23
2018-11-15 23:00:31 [INFO    ] DP 1: 5 lwa18
2018-11-15 23:00:31 [INFO    ] DP 1: 6 lwa10
2018-11-15 23:00:31 [INFO    ] DP 1: 7 lwa32
2018-11-15 23:00:31 [INFO    ] DP 1: 8 lwa11
2018-11-15 23:00:31 [INFO    ] DP 1: 9 lwa30
2018-11-15 23:00:31 [INFO    ] DP 1: 10 lwa12
2018-11-15 23:00:31 [INFO    ] DP 1: 11 lwa8
2018-11-15 23:00:31 [INFO    ] DP 1: 12 lwa13
2018-11-15 23:00:31 [INFO    ] DP 1: 13 lwa26
2018-11-15 23:00:31 [INFO    ] DP 1: 14 lwa14
2018-11-15 23:00:31 [INFO    ] DP 1: 16 lwa22
2018-11-15 23:00:31 [INFO    ] DP 1: 17 lwa20
2018-11-15 23:00:31 [INFO    ] DP 1: 18 lwa1
2018-11-15 23:00:31 [INFO    ] DP 1: 19 lwa5
2018-11-15 23:00:31 [INFO    ] DP 1: 20 lwa25
2018-11-15 23:00:31 [INFO    ] DP 1: 21 lwa35
2018-11-15 23:00:31 [INFO    ] DP 1: 22 lwa19
2018-11-15 23:00:31 [INFO    ] DP 1: 23 lwa21
2018-11-15 23:00:31 [INFO    ] DP 1: 24 lwa6
2018-11-15 23:00:31 [INFO    ] DP 1: 25 lwa7
2018-11-15 23:00:31 [INFO    ] DP 1: 26 lwa33
2018-11-15 23:00:31 [INFO    ] DP 1: 27 lwa15
2018-11-15 23:00:31 [INFO    ] DP 1: 28 lwa28
2018-11-15 23:00:31 [INFO    ] DP 2: 1 lwa16
2018-11-15 23:00:31 [INFO    ] DP 2: 15 lwa34
2018-11-15 23:00:31 [INFO    ] Total of 28 boards
2018-11-15 23:00:31 [INFO    ] Total of 260 stands
2018-11-15 23:00:31 [INFO    ] -------------------
2018-11-15 23:00:31 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /lwa/software/dp_shutdown.sh
2018-11-15 23:00:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 /lwa/software/dp_shutdown.sh
2018-11-15 23:00:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 /lwa/software/dp_shutdown.sh
2018-11-15 23:00:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 /lwa/software/dp_shutdown.sh
2018-11-15 23:00:32 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 /lwa/software/dp_shutdown.sh
2018-11-15 23:00:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 /lwa/software/dp_shutdown.sh
2018-11-15 23:00:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 /lwa/software/dp_shutdown.sh
2018-11-15 23:00:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 /lwa/software/dp_shutdown.sh
2018-11-15 23:00:33 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 /lwa/software/dp_shutdown.sh
2018-11-15 23:00:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 /lwa/software/dp_shutdown.sh
2018-11-15 23:00:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 /lwa/software/dp_shutdown.sh
2018-11-15 23:00:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 /lwa/software/dp_shutdown.sh
2018-11-15 23:00:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 /lwa/software/dp_shutdown.sh
2018-11-15 23:00:34 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 /lwa/software/dp_shutdown.sh
2018-11-15 23:00:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /lwa/software/dp_shutdown.sh
2018-11-15 23:00:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 /lwa/software/dp_shutdown.sh
2018-11-15 23:00:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 /lwa/software/dp_shutdown.sh
2018-11-15 23:00:35 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 /lwa/software/dp_shutdown.sh
2018-11-15 23:00:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 /lwa/software/dp_shutdown.sh
2018-11-15 23:00:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 /lwa/software/dp_shutdown.sh
2018-11-15 23:00:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 /lwa/software/dp_shutdown.sh
2018-11-15 23:00:36 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 /lwa/software/dp_shutdown.sh
2018-11-15 23:00:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 /lwa/software/dp_shutdown.sh
2018-11-15 23:00:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 /lwa/software/dp_shutdown.sh
2018-11-15 23:00:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 /lwa/software/dp_shutdown.sh
2018-11-15 23:00:37 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 /lwa/software/dp_shutdown.sh
2018-11-15 23:00:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 /lwa/software/dp_shutdown.sh
2018-11-15 23:00:38 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 /lwa/software/dp_shutdown.sh
2018-11-15 23:00:38 [DEBUG   ] 2018-11-15 23:00:38 Starting ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3979
2018-11-15 23:00:38 [DEBUG   ] 2018-11-15 23:00:38 Starting ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3980
2018-11-15 23:00:38 [DEBUG   ] 2018-11-15 23:00:38 Starting ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3981
2018-11-15 23:00:38 [DEBUG   ] 2018-11-15 23:00:38 Starting ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3982
2018-11-15 23:00:38 [DEBUG   ] 2018-11-15 23:00:38 Starting ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3983
2018-11-15 23:00:38 [DEBUG   ] 2018-11-15 23:00:38 Starting ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3984
2018-11-15 23:00:38 [DEBUG   ] 2018-11-15 23:00:38 Starting ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3985
2018-11-15 23:00:38 [DEBUG   ] 2018-11-15 23:00:38 Starting ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3986
2018-11-15 23:00:38 [DEBUG   ] 2018-11-15 23:00:38 Starting ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3987
2018-11-15 23:00:38 [DEBUG   ] 2018-11-15 23:00:38 Starting ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3988
2018-11-15 23:00:38 [DEBUG   ] 2018-11-15 23:00:38 Starting ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3989
2018-11-15 23:00:38 [DEBUG   ] 2018-11-15 23:00:38 Starting ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3990
2018-11-15 23:00:38 [DEBUG   ] 2018-11-15 23:00:38 Starting ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3991
2018-11-15 23:00:38 [DEBUG   ] 2018-11-15 23:00:38 Starting ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3992
2018-11-15 23:00:38 [DEBUG   ] 2018-11-15 23:00:38 Starting ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3993
2018-11-15 23:00:38 [DEBUG   ] 2018-11-15 23:00:38 Starting ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3994
2018-11-15 23:00:38 [DEBUG   ] 2018-11-15 23:00:38 Starting ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3995
2018-11-15 23:00:38 [DEBUG   ] 2018-11-15 23:00:38 Starting ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3996
2018-11-15 23:00:38 [DEBUG   ] 2018-11-15 23:00:38 Starting ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3997
2018-11-15 23:00:38 [DEBUG   ] 2018-11-15 23:00:38 Starting ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3998
2018-11-15 23:00:38 [DEBUG   ] 2018-11-15 23:00:38 Starting ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 3999
2018-11-15 23:00:38 [DEBUG   ] 2018-11-15 23:00:38 Starting ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4000
2018-11-15 23:00:38 [DEBUG   ] 2018-11-15 23:00:38 Starting ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4001
2018-11-15 23:00:38 [DEBUG   ] 2018-11-15 23:00:38 Starting ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4002
2018-11-15 23:00:38 [DEBUG   ] 2018-11-15 23:00:38 Starting ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4003
2018-11-15 23:00:38 [DEBUG   ] 2018-11-15 23:00:38 Starting ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] pid 4004
2018-11-15 23:00:45 [DEBUG   ] Got command RPT from MCS: ref #519961
2018-11-15 23:00:45 [DEBUG   ] summary = BOOTING
2018-11-15 23:00:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519961  15 58437 82845221 ABOOTINGBOOTING'
2018-11-15 23:00:45 [DEBUG   ] Got command RPT from MCS: ref #519962
2018-11-15 23:00:45 [DEBUG   ] info = Running INI sequence
2018-11-15 23:00:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519962  28 58437 82845222 ABOOTINGRunning INI sequence'
2018-11-15 23:00:50 [DEBUG   ] 2018-11-15 23:00:50 ['/usr/local/bin/lwa27', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3979 exited with status 0
2018-11-15 23:00:50 [DEBUG   ] 2018-11-15 23:00:50 ['/usr/local/bin/lwa24', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3980 exited with status 0
2018-11-15 23:00:50 [DEBUG   ] 2018-11-15 23:00:50 ['/usr/local/bin/lwa23', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3981 exited with status 0
2018-11-15 23:00:50 [DEBUG   ] 2018-11-15 23:00:50 ['/usr/local/bin/lwa18', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3982 exited with status 0
2018-11-15 23:00:50 [DEBUG   ] 2018-11-15 23:00:50 ['/usr/local/bin/lwa10', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3983 exited with status 0
2018-11-15 23:00:50 [DEBUG   ] 2018-11-15 23:00:50 ['/usr/local/bin/lwa32', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3984 exited with status 0
2018-11-15 23:00:50 [DEBUG   ] 2018-11-15 23:00:50 ['/usr/local/bin/lwa11', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3985 exited with status 0
2018-11-15 23:00:50 [DEBUG   ] 2018-11-15 23:00:50 ['/usr/local/bin/lwa30', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3986 exited with status 0
2018-11-15 23:00:50 [DEBUG   ] 2018-11-15 23:00:50 ['/usr/local/bin/lwa12', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3987 exited with status 0
2018-11-15 23:00:50 [DEBUG   ] 2018-11-15 23:00:50 ['/usr/local/bin/lwa8', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3988 exited with status 0
2018-11-15 23:00:50 [DEBUG   ] 2018-11-15 23:00:50 ['/usr/local/bin/lwa13', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3989 exited with status 0
2018-11-15 23:00:50 [DEBUG   ] 2018-11-15 23:00:50 ['/usr/local/bin/lwa26', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3990 exited with status 0
2018-11-15 23:00:50 [DEBUG   ] 2018-11-15 23:00:50 ['/usr/local/bin/lwa14', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3991 exited with status 0
2018-11-15 23:00:50 [DEBUG   ] 2018-11-15 23:00:50 ['/usr/local/bin/lwa22', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3992 exited with status 0
2018-11-15 23:00:50 [DEBUG   ] 2018-11-15 23:00:50 ['/usr/local/bin/lwa20', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3993 exited with status 0
2018-11-15 23:00:50 [DEBUG   ] 2018-11-15 23:00:50 ['/usr/local/bin/lwa1', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3994 exited with status 0
2018-11-15 23:00:50 [DEBUG   ] 2018-11-15 23:00:50 ['/usr/local/bin/lwa5', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3995 exited with status 0
2018-11-15 23:00:50 [DEBUG   ] 2018-11-15 23:00:50 ['/usr/local/bin/lwa25', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3996 exited with status 0
2018-11-15 23:00:50 [DEBUG   ] 2018-11-15 23:00:50 ['/usr/local/bin/lwa35', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3997 exited with status 0
2018-11-15 23:00:50 [DEBUG   ] 2018-11-15 23:00:50 ['/usr/local/bin/lwa19', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3998 exited with status 0
2018-11-15 23:00:50 [DEBUG   ] 2018-11-15 23:00:50 ['/usr/local/bin/lwa21', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 3999 exited with status 0
2018-11-15 23:00:50 [DEBUG   ] 2018-11-15 23:00:50 ['/usr/local/bin/lwa6', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4000 exited with status 0
2018-11-15 23:00:50 [DEBUG   ] 2018-11-15 23:00:50 ['/usr/local/bin/lwa7', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4001 exited with status 0
2018-11-15 23:00:50 [DEBUG   ] 2018-11-15 23:00:50 ['/usr/local/bin/lwa33', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4002 exited with status 0
2018-11-15 23:00:50 [DEBUG   ] 2018-11-15 23:00:50 ['/usr/local/bin/lwa15', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4003 exited with status 0
2018-11-15 23:00:50 [DEBUG   ] 2018-11-15 23:00:50 ['/usr/local/bin/lwa28', '/lwa/software/Start.sh', '/lwa/hardware/lwa_dp_top_2_1_1_49.bin', '/lwa/software'] Process 4004 exited with status 0
2018-11-15 23:00:50 [INFO    ] Finish loading DP1 firmware'/lwa/hardware/lwa_dp_top_2_1_1_49.bin'
2018-11-15 23:00:50 [DEBUG   ] spawn_process: at 2018-11-15 23:00:50 running ['/usr/local/bin/lwa27', '/lwa/software/dp1_init.sh']
2018-11-15 23:00:50 [DEBUG   ] spawn_process: at 2018-11-15 23:00:50 running ['/usr/local/bin/lwa24', '/lwa/software/dp1_init.sh']
2018-11-15 23:00:50 [DEBUG   ] spawn_process: at 2018-11-15 23:00:50 running ['/usr/local/bin/lwa23', '/lwa/software/dp1_init.sh']
2018-11-15 23:00:50 [DEBUG   ] spawn_process: at 2018-11-15 23:00:50 running ['/usr/local/bin/lwa18', '/lwa/software/dp1_init.sh']
2018-11-15 23:00:50 [DEBUG   ] spawn_process: at 2018-11-15 23:00:50 running ['/usr/local/bin/lwa10', '/lwa/software/dp1_init.sh']
2018-11-15 23:00:50 [DEBUG   ] spawn_process: at 2018-11-15 23:00:50 running ['/usr/local/bin/lwa32', '/lwa/software/dp1_init.sh']
2018-11-15 23:00:50 [DEBUG   ] spawn_process: at 2018-11-15 23:00:50 running ['/usr/local/bin/lwa11', '/lwa/software/dp1_init.sh']
2018-11-15 23:00:50 [DEBUG   ] spawn_process: at 2018-11-15 23:00:50 running ['/usr/local/bin/lwa30', '/lwa/software/dp1_init.sh']
2018-11-15 23:00:50 [DEBUG   ] spawn_process: at 2018-11-15 23:00:50 running ['/usr/local/bin/lwa12', '/lwa/software/dp1_init.sh']
2018-11-15 23:00:50 [DEBUG   ] spawn_process: at 2018-11-15 23:00:50 running ['/usr/local/bin/lwa8', '/lwa/software/dp1_init.sh']
2018-11-15 23:00:50 [DEBUG   ] spawn_process: at 2018-11-15 23:00:50 running ['/usr/local/bin/lwa13', '/lwa/software/dp1_init.sh']
2018-11-15 23:00:50 [DEBUG   ] spawn_process: at 2018-11-15 23:00:50 running ['/usr/local/bin/lwa26', '/lwa/software/dp1_init.sh']
2018-11-15 23:00:50 [DEBUG   ] spawn_process: at 2018-11-15 23:00:50 running ['/usr/local/bin/lwa14', '/lwa/software/dp1_init.sh']
2018-11-15 23:00:50 [DEBUG   ] spawn_process: at 2018-11-15 23:00:50 running ['/usr/local/bin/lwa22', '/lwa/software/dp1_init.sh']
2018-11-15 23:00:50 [DEBUG   ] spawn_process: at 2018-11-15 23:00:50 running ['/usr/local/bin/lwa20', '/lwa/software/dp1_init.sh']
2018-11-15 23:00:50 [DEBUG   ] spawn_process: at 2018-11-15 23:00:50 running ['/usr/local/bin/lwa1', '/lwa/software/dp1_init.sh']
2018-11-15 23:00:50 [DEBUG   ] spawn_process: at 2018-11-15 23:00:50 running ['/usr/local/bin/lwa5', '/lwa/software/dp1_init.sh']
2018-11-15 23:00:50 [DEBUG   ] spawn_process: at 2018-11-15 23:00:50 running ['/usr/local/bin/lwa25', '/lwa/software/dp1_init.sh']
2018-11-15 23:00:50 [DEBUG   ] spawn_process: at 2018-11-15 23:00:50 running ['/usr/local/bin/lwa35', '/lwa/software/dp1_init.sh']
2018-11-15 23:00:50 [DEBUG   ] spawn_process: at 2018-11-15 23:00:50 running ['/usr/local/bin/lwa19', '/lwa/software/dp1_init.sh']
2018-11-15 23:00:50 [DEBUG   ] spawn_process: at 2018-11-15 23:00:50 running ['/usr/local/bin/lwa21', '/lwa/software/dp1_init.sh']
2018-11-15 23:00:50 [DEBUG   ] spawn_process: at 2018-11-15 23:00:50 running ['/usr/local/bin/lwa6', '/lwa/software/dp1_init.sh']
2018-11-15 23:00:50 [DEBUG   ] spawn_process: at 2018-11-15 23:00:50 running ['/usr/local/bin/lwa7', '/lwa/software/dp1_init.sh']
2018-11-15 23:00:50 [DEBUG   ] spawn_process: at 2018-11-15 23:00:50 running ['/usr/local/bin/lwa33', '/lwa/software/dp1_init.sh']
2018-11-15 23:00:50 [DEBUG   ] spawn_process: at 2018-11-15 23:00:50 running ['/usr/local/bin/lwa15', '/lwa/software/dp1_init.sh']
2018-11-15 23:00:50 [DEBUG   ] spawn_process: at 2018-11-15 23:00:50 running ['/usr/local/bin/lwa28', '/lwa/software/dp1_init.sh']
2018-11-15 23:00:50 [DEBUG   ] 2018-11-15 23:00:50 Starting ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 4031
2018-11-15 23:00:50 [DEBUG   ] 2018-11-15 23:00:50 Starting ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] pid 4032
2018-11-15 23:00:56 [DEBUG   ] 2018-11-15 23:00:56 ['/usr/local/bin/lwa16', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 4031 exited with status 0
2018-11-15 23:00:56 [DEBUG   ] 2018-11-15 23:00:56 ['/usr/local/bin/lwa34', '/lwa/software/Start2.sh', '/lwa/hardware/lwa_drx_top_3_2_0_6.bin', '/lwa/software'] Process 4032 exited with status 0
2018-11-15 23:00:56 [INFO    ] Finish loading DP2 firmware '/lwa/hardware/lwa_drx_top_3_2_0_6.bin'
2018-11-15 23:00:56 [DEBUG   ] spawn_process: at 2018-11-15 23:00:56 running ['/usr/local/bin/lwa16', '/lwa/software/dp2_init.sh']
2018-11-15 23:00:56 [DEBUG   ] spawn_process: at 2018-11-15 23:00:56 running ['/usr/local/bin/lwa34', '/lwa/software/dp2_init.sh']
2018-11-15 23:00:56 [INFO    ] Setting Beam 1 xbars
2018-11-15 23:00:56 [DEBUG   ] board 11 xbars (bd11 to bd5 through bot5) - beam 1
2018-11-15 23:00:56 [DEBUG   ] board 5 xbars (bd5 from bd11 through bot1) - beam 1
2018-11-15 23:00:56 [DEBUG   ] board 5 xbars (bd5 to bd13 through bot5) - beam 1
2018-11-15 23:00:56 [DEBUG   ] board 13 xbars (bd13 from bd5 through bot1) - beam 1
2018-11-15 23:00:56 [DEBUG   ] board 13 xbars (bd13 to bd7 through bot5) - beam 1
2018-11-15 23:00:57 [DEBUG   ] board 7 xbars (bd7 from bd13 through bot1) - beam 1
2018-11-15 23:00:57 [DEBUG   ] board 7 xbars (bd7 to bd9 through bot5) - beam 1
2018-11-15 23:00:57 [DEBUG   ] board 9 xbars (bd9 from bd7 through bot1) - beam 1
2018-11-15 23:00:57 [DEBUG   ] board 9 xbars (bd9 to bd3 through bot5) - beam 1
2018-11-15 23:00:57 [DEBUG   ] board 3 xbars (bd3 from bd9 through bot1) - beam 1
2018-11-15 23:00:57 [DEBUG   ] board 3 xbars (bd3 to bd2 through bot5) - beam 1
2018-11-15 23:00:57 [DEBUG   ] board 2 xbars (bd2 from bd3 through bot1) - beam 1
2018-11-15 23:00:57 [DEBUG   ] board 2 xbars (bd2 to bd6 through bot5) - beam 1
2018-11-15 23:00:57 [DEBUG   ] board 6 xbars (bd6 from bd2 through bot1) - beam 1
2018-11-15 23:00:58 [DEBUG   ] board 6 xbars (bd6 to bd12 through bot5) - beam 1
2018-11-15 23:00:58 [DEBUG   ] board 12 xbars (bd12 from bd6 through bot1) - beam 1
2018-11-15 23:00:58 [DEBUG   ] board 12 xbars (bd12 to bd8 through bot5) - beam 1
2018-11-15 23:00:58 [DEBUG   ] board 8 xbars (bd8 from bd12 through bot1) - beam 1
2018-11-15 23:00:58 [DEBUG   ] board 8 xbars (bd8 to bd4 through bot5) - beam 1
2018-11-15 23:00:58 [DEBUG   ] board 4 xbars (bd4 from bd8 through bot1) - beam 1
2018-11-15 23:00:58 [DEBUG   ] board 4 xbars (bd4 to bd10 through bot5) - beam 1
2018-11-15 23:00:58 [DEBUG   ] board 10 xbars (bd10 from bd4 through bot1) - beam 1
2018-11-15 23:00:58 [DEBUG   ] board 10 xbars (bd10 to bd14 through bot5) - beam 1
2018-11-15 23:00:59 [DEBUG   ] board 14 xbars (bd14 from bd10 through top1) - beam 1
2018-11-15 23:00:59 [DEBUG   ] board 28 xbars  (bd 28 to bd24 through top1)- beam 1
2018-11-15 23:00:59 [DEBUG   ] board 24 xbars (bd24 from bd28 through bot5) - beam 1
2018-11-15 23:00:59 [DEBUG   ] board 24 xbars (bd24 to bd18 through bot1) - beam 1
2018-11-15 23:00:59 [DEBUG   ] board 18 xbars (bd18 from bd24 through bot5) - beam 1
2018-11-15 23:00:59 [DEBUG   ] board 18 xbars (bd18 to bd22 through bot1) - beam 1
2018-11-15 23:00:59 [DEBUG   ] board 22 xbars (bd22 from bd18 through bot5) - beam 1
2018-11-15 23:00:59 [DEBUG   ] board 22 xbars (bd22 to bd26 through bot1) - beam 1
2018-11-15 23:00:59 [DEBUG   ] board 26 xbars (bd26 from bd22 through bot5) - beam 1
2018-11-15 23:00:59 [DEBUG   ] board 26 xbars (bd26 to bd20 through bot1) - beam 1
2018-11-15 23:01:00 [DEBUG   ] board 20 xbars (bd20 from bd26 through bot5) - beam 1
2018-11-15 23:01:00 [DEBUG   ] board 20 xbars (bd20 to bd16 through bot1) - beam 1
2018-11-15 23:01:00 [DEBUG   ] board 16 xbars (bd16 from bd20 through bot5) - beam 1
2018-11-15 23:01:00 [DEBUG   ] board 16 xbars (bd16 to bd17 through bot1) - beam 1
2018-11-15 23:01:00 [DEBUG   ] board 17 xbars (bd17 from bd16 through bot5) - beam 1
2018-11-15 23:01:00 [DEBUG   ] board 17 xbars (bd17 to bd23 through bot1) - beam 1
2018-11-15 23:01:00 [DEBUG   ] board 23 xbars (bd23 from bd17 through bot5) - beam 1
2018-11-15 23:01:00 [DEBUG   ] board 23 xbars (bd23 to bd21 through bot1) - beam 1
2018-11-15 23:01:00 [DEBUG   ] board 21 xbars (bd21 from bd23 through bot5) - beam 1
2018-11-15 23:01:01 [DEBUG   ] board 21 xbars (bd21 to bd27 through bot1) - beam 1
2018-11-15 23:01:01 [DEBUG   ] board 27 xbars (bd27 from bd21 through bot5) - beam 1
2018-11-15 23:01:01 [DEBUG   ] board 27 xbars (bd27 to bd19 through bot1) - beam 1
2018-11-15 23:01:01 [DEBUG   ] board 19 xbars (bd19 from bd27 through bot5) - beam 1
2018-11-15 23:01:01 [DEBUG   ] board 19 xbars (bd19 to bd25 through bot1) - beam 1
2018-11-15 23:01:01 [DEBUG   ] board 25 xbars (bd25 from bd19 through bot5) - beam 1
2018-11-15 23:01:01 [DEBUG   ] board 25 xbars (bd25 to bd15 through bot1) - beam 1
2018-11-15 23:01:01 [DEBUG   ] board 15 xbars (board 15 from board 25 through bot5) - beam 1
2018-11-15 23:01:01 [INFO    ] Setting Beam 2 xbars
2018-11-15 23:01:01 [DEBUG   ] board 3 xbars (bd3 to bd7 through top1) - beam 2
2018-11-15 23:01:02 [DEBUG   ] board 7 xbars (bd7 from bd3 through top5) - beam 2
2018-11-15 23:01:02 [DEBUG   ] board 7 xbars (bd7 to bd11 through top1) - beam 2
2018-11-15 23:01:02 [DEBUG   ] board 11 xbars (bd11 from bd7 through top5) - beam 2
2018-11-15 23:01:02 [DEBUG   ] board 11 xbars (bd11 to bd13 through top1) - beam 2
2018-11-15 23:01:02 [DEBUG   ] board 13 xbars (bd13 from bd11 through top5) - beam 2
2018-11-15 23:01:02 [DEBUG   ] board 13 xbars (bd13 to bd9 through top1) - beam 2
2018-11-15 23:01:02 [DEBUG   ] board 9 xbars (bd9 from bd13 through top5) - beam 2
2018-11-15 23:01:02 [DEBUG   ] board 9 xbars (bd9 to bd5 through top1) - beam 2
2018-11-15 23:01:02 [DEBUG   ] board 5 xbars (bd5 from bd9 through top5) - beam 2
2018-11-15 23:01:02 [DEBUG   ] board 5 xbars (bd5 to bd2 through top1) - beam 2
2018-11-15 23:01:03 [DEBUG   ] board 2 xbars (bd2 from bd5 through top5) - beam 2
2018-11-15 23:01:03 [DEBUG   ] board 2 xbars (bd2 to bd4 through top1) - beam 2
2018-11-15 23:01:03 [DEBUG   ] board 4 xbars (bd4 from bd2 through top5) - beam 2
2018-11-15 23:01:03 [DEBUG   ] board 4 xbars (bd4 to bd6 through top1) - beam 2
2018-11-15 23:01:03 [DEBUG   ] board 6 xbars (bd6 from bd4 through top5) - beam 2
2018-11-15 23:01:03 [DEBUG   ] board 6 xbars (bd6 to bd8 through top1) - beam 2
2018-11-15 23:01:03 [DEBUG   ] board 8 xbars (bd8 from bd6 through top5) - beam 2
2018-11-15 23:01:03 [DEBUG   ] board 8 xbars (bd8 to bd10 through top1) - beam 2
2018-11-15 23:01:03 [DEBUG   ] board 10 xbars (bd10 from bd8 through top5) - beam 2
2018-11-15 23:01:04 [DEBUG   ] board 10 xbars (bd10 to bd12 through top1) - beam 2
2018-11-15 23:01:04 [DEBUG   ] board 12 xbars (bd12 from bd10 through top5) - beam 2
2018-11-15 23:01:04 [DEBUG   ] board 12 xbars (bd12 to bd14 through top1) - beam 2
2018-11-15 23:01:04 [DEBUG   ] board 14 xbars (bd14 from bd12 through bot5) - beam 2
2018-11-15 23:01:04 [DEBUG   ] board 28 xbars (bd28 to bd26 through bot5) - beam 2
2018-11-15 23:01:04 [DEBUG   ] board 26 xbars (bd26 from bd28 through top1) - beam 2
2018-11-15 23:01:04 [DEBUG   ] board 26 xbars (bd26 to bd24 through top5) - beam 2
2018-11-15 23:01:04 [DEBUG   ] board 24 xbars (bd24 from bd26 through top1) - beam 2
2018-11-15 23:01:04 [DEBUG   ] board 24 xbars (bd24 to bd22 through top5) - beam 2
2018-11-15 23:01:05 [DEBUG   ] board 22 xbars (bd22 from bd24 through top1) - beam 2
2018-11-15 23:01:05 [DEBUG   ] board 22 xbars (bd22 to bd20 through top5) - beam 2
2018-11-15 23:01:05 [DEBUG   ] board 20 xbars (bd20 from bd22 through top1) - beam 2
2018-11-15 23:01:05 [DEBUG   ] board 20 xbars (bd20 to bd18 through top5) - beam 2
2018-11-15 23:01:05 [DEBUG   ] board 18 xbars (bd18 from bd20 through top1) - beam 2
2018-11-15 23:01:05 [DEBUG   ] board 18 xbars (bd18 to bd16 through top5) - beam 2
2018-11-15 23:01:05 [DEBUG   ] board 16 xbars (bd16 from bd18 through top1) - beam 2
2018-11-15 23:01:05 [DEBUG   ] board 16 xbars (bd16 to bd19 through top5) - beam 2
2018-11-15 23:01:05 [DEBUG   ] board 19 xbars (bd19 from bd16 through top1) - beam 2
2018-11-15 23:01:06 [DEBUG   ] board 19 xbars (bd19 to bd23 through top5) - beam 2
2018-11-15 23:01:06 [DEBUG   ] board 23 xbars (bd23 from bd19 through top1) - beam 2
2018-11-15 23:01:06 [DEBUG   ] board 23 xbars (bd23 to bd27 through top5) - beam 2
2018-11-15 23:01:06 [DEBUG   ] board 27 xbars (bd27 from bd23 through top1) - beam 2
2018-11-15 23:01:06 [DEBUG   ] board 27 xbars (bd27 to bd25 through top5) - beam 2
2018-11-15 23:01:06 [DEBUG   ] board 25 xbars (bd25 from bd27 through top1) - beam 2
2018-11-15 23:01:06 [DEBUG   ] board 25 xbars (bd25 to bd21 through top5) - beam 2
2018-11-15 23:01:06 [DEBUG   ] board 21 xbars (bd21 from bd25 through top1) - beam 2
2018-11-15 23:01:06 [DEBUG   ] board 21 xbars (bd21 to bd17 through top5) - beam 2
2018-11-15 23:01:07 [DEBUG   ] board 17 xbars (bd17 from bd21 through top1) - beam 2
2018-11-15 23:01:07 [DEBUG   ] board 17 xbars (bd17 to bd15 through top5) - beam 2
2018-11-15 23:01:07 [DEBUG   ] board 15 xbars (bd15 from bd17 through top1) - beam 2
2018-11-15 23:01:07 [INFO    ] Setting Beam 3 xbars
2018-11-15 23:01:07 [DEBUG   ] board 25 xbars (bd25 to bd19 through bot5) - beam 3
2018-11-15 23:01:07 [DEBUG   ] board 19 xbars (bd19 from bd25 through bot1) - beam 3
2018-11-15 23:01:07 [DEBUG   ] board 19 xbars (bd19 to bd27 through bot5) - beam 3
2018-11-15 23:01:07 [DEBUG   ] board 27 xbars (bd27 from bd19 through bot1) - beam 3
2018-11-15 23:01:07 [DEBUG   ] board 27 xbars (bd27 to bd21 through bot5) - beam 3
2018-11-15 23:01:07 [DEBUG   ] board 21 xbars (bd21 from bd27 through bot1) - beam 3
2018-11-15 23:01:07 [DEBUG   ] board 21 xbars (bd21 to bd23 through bot5) - beam 3
2018-11-15 23:01:08 [DEBUG   ] board 23 xbars (bd23 from bd21 through bot1) - beam 3
2018-11-15 23:01:08 [DEBUG   ] board 23 xbars (bd23 to bd17 through bot5) - beam 3
2018-11-15 23:01:08 [DEBUG   ] board 17 xbars (bd17 from bd23 through bot1) - beam 3
2018-11-15 23:01:08 [DEBUG   ] board 17 xbars (bd17 to bd16 through bot5) - beam 3
2018-11-15 23:01:08 [DEBUG   ] board 16 xbars (bd16 from bd17 through bot1) - beam 3
2018-11-15 23:01:08 [DEBUG   ] board 16 xbars (bd16 to bd20 through bot5) - beam 3
2018-11-15 23:01:08 [DEBUG   ] board 20 xbars (bd20 from bd16 through bot1) - beam 3
2018-11-15 23:01:08 [DEBUG   ] board 20 xbars (bd20 to bd26 through bot5) - beam 3
2018-11-15 23:01:08 [DEBUG   ] board 26 xbars (bd26 from bd20 through bot1) - beam 3
2018-11-15 23:01:09 [DEBUG   ] board 26 xbars (bd26 to bd22 through bot5) - beam 3
2018-11-15 23:01:09 [DEBUG   ] board 22 xbars (bd22 from bd26 through bot1) - beam 3
2018-11-15 23:01:09 [DEBUG   ] board 22 xbars (bd22 to bd18 through bot5) - beam 3
2018-11-15 23:01:09 [DEBUG   ] board 18 xbars (bd18 from bd22 through bot1) - beam 3
2018-11-15 23:01:09 [DEBUG   ] board 18 xbars (bd18 to bd24 through bot5) - beam 3
2018-11-15 23:01:09 [DEBUG   ] board 24 xbars (bd24 from bd18 through bot1) - beam 3
2018-11-15 23:01:09 [DEBUG   ] board 24 xbars (bd24 to bd28 through bot5) - beam 3
2018-11-15 23:01:09 [DEBUG   ] board 28 xbars (bd28 from bd24 through top1) - beam 3
2018-11-15 23:01:09 [DEBUG   ] board 14 xbars (bd14 to bd10 through top1) - beam 3
2018-11-15 23:01:10 [DEBUG   ] board 10 xbars (bd10 from bd14 through bot5) - beam 3
2018-11-15 23:01:10 [DEBUG   ] board 10 xbars (bd10 to bd4 through bot1) - beam 3
2018-11-15 23:01:10 [DEBUG   ] board 4 xbars (bd4 from bd10 through bot5) - beam 3
2018-11-15 23:01:10 [DEBUG   ] board 4 xbars (bd4 to bd8 through bot1) - beam 3
2018-11-15 23:01:10 [DEBUG   ] board 8 xbars (bd8 from bd4 through bot5) - beam 3
2018-11-15 23:01:10 [DEBUG   ] board 8 xbars (bd8 to bd12 through bot1) - beam 3
2018-11-15 23:01:10 [DEBUG   ] board 12 xbars (bd12 from bd8 through bot5) - beam 3
2018-11-15 23:01:10 [DEBUG   ] board 12 xbars (bd12 to bd6 through bot1) - beam 3
2018-11-15 23:01:10 [DEBUG   ] board 6 xbars (bd6 from bd12 through bot5) - beam 3
2018-11-15 23:01:11 [DEBUG   ] board 6 xbars (bd6 to bd2 through bot1) - beam 3
2018-11-15 23:01:11 [DEBUG   ] board 2 xbars (bd2 from bd6 through bot5) - beam 3
2018-11-15 23:01:11 [DEBUG   ] board 2 xbars (bd2 to bd3 through bot1) - beam 3
2018-11-15 23:01:11 [DEBUG   ] board 3 xbars (bd3 from bd2 through bot5) - beam 3
2018-11-15 23:01:11 [DEBUG   ] board 3 xbars (bd3 to bd9 through bot1) - beam 3
2018-11-15 23:01:11 [DEBUG   ] board 9 xbars (bd9 from bd3 through bot5) - beam 3
2018-11-15 23:01:11 [DEBUG   ] board 9 xbars (bd9 to bd7 through bot1) - beam 3
2018-11-15 23:01:11 [DEBUG   ] board 7 xbars (bd7 from bd9 through bot5) - beam 3
2018-11-15 23:01:11 [DEBUG   ] board 7 xbars (bd7 to bd13 through bot1) - beam 3
2018-11-15 23:01:12 [DEBUG   ] board 13 xbars (bd13 from bd7 through bot5) - beam 3
2018-11-15 23:01:12 [DEBUG   ] board 13 xbars (bd13 to bd5 through bot1) - beam 3
2018-11-15 23:01:12 [DEBUG   ] board 5 xbars (bd5 from bd13 through bot5) - beam 3
2018-11-15 23:01:12 [DEBUG   ] board 5 xbars (bd5 to bd11 through bot1) - beam 3
2018-11-15 23:01:12 [DEBUG   ] board 11 xbars (bd11 from bd5 through bot5) - beam 3
2018-11-15 23:01:12 [DEBUG   ] board 11 xbars (bd11 to bd1 through bot1) - beam 3
2018-11-15 23:01:12 [DEBUG   ] board 1 xbars (bd1 from bd11 through bot5) - beam 3
2018-11-15 23:01:12 [INFO    ] Setting Beam 4 xbars
2018-11-15 23:01:12 [DEBUG   ] board 17 xbars (bd17 to bd21 through top1) - beam 4
2018-11-15 23:01:12 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-11-15 23:01:13 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-11-15 23:01:13 [DEBUG   ] board 21 xbars (bd21 from bd17 through top5) - beam 4
2018-11-15 23:01:13 [DEBUG   ] board 21 xbars (bd21 to bd25 through top1) - beam 4
2018-11-15 23:01:13 [DEBUG   ] board 25 xbars (bd25 from bd21 through top5) - beam 4
2018-11-15 23:01:13 [DEBUG   ] board 25 xbars (bd25 to bd27 through top1) - beam 4
2018-11-15 23:01:13 [DEBUG   ] board 27 xbars (bd27 from bd25 through top5) - beam 4
2018-11-15 23:01:13 [DEBUG   ] board 27 xbars (bd27 to bd23 through top1) - beam 4
2018-11-15 23:01:13 [DEBUG   ] board 23 xbars (bd23 from bd27 through top5) - beam 4
2018-11-15 23:01:13 [DEBUG   ] board 23 xbars (bd23 to bd19 through top1) - beam 4
2018-11-15 23:01:13 [DEBUG   ] board 19 xbars (bd19 from bd23 through top5) - beam 4
2018-11-15 23:01:14 [DEBUG   ] board 19 xbars (bd19 to bd16 through top1) - beam 4
2018-11-15 23:01:14 [DEBUG   ] board 16 xbars (bd16 from bd19 through top5) - beam 4
2018-11-15 23:01:14 [DEBUG   ] board 16 xbars (bd16 to bd18 through top1) - beam 4
2018-11-15 23:01:14 [DEBUG   ] board 18 xbars (bd18 from bd16 through top5) - beam 4
2018-11-15 23:01:14 [DEBUG   ] board 18 xbars (bd18 to bd20 through top1) - beam 4
2018-11-15 23:01:14 [DEBUG   ] board 20 xbars (bd20 from bd18 through top5) - beam 4
2018-11-15 23:01:14 [DEBUG   ] board 20 xbars (bd20 to bd22 through top1) - beam 4
2018-11-15 23:01:14 [DEBUG   ] board 22 xbars (bd22 from bd20 through top5) - beam 4
2018-11-15 23:01:14 [DEBUG   ] board 22 xbars (bd22 to bd24 through top1) - beam 4
2018-11-15 23:01:15 [DEBUG   ] board 24 xbars (bd24 from bd22 through top5) - beam 4
2018-11-15 23:01:15 [DEBUG   ] board 24 xbars (bd24 to bd26 through top1) - beam 4
2018-11-15 23:01:15 [DEBUG   ] board 26 xbars (bd26 from bd24 through top5) - beam 4
2018-11-15 23:01:15 [DEBUG   ] board 26 xbars (bd26 to bd28 through top1) - beam 4
2018-11-15 23:01:15 [DEBUG   ] board 28 xbars (bd28 from bd26 through bot5) - beam 4
2018-11-15 23:01:15 [DEBUG   ] board 14 xbars (bd14 to bd12 through bot5) - beam 4
2018-11-15 23:01:15 [DEBUG   ] board 12 xbars (bd12 from bd14 through top1) - beam 4
2018-11-15 23:01:15 [DEBUG   ] board 12 xbars (bd12 to bd10 through top5) - beam 4
2018-11-15 23:01:15 [DEBUG   ] board 10 xbars (bd10 from bd12 through top1) - beam 4
2018-11-15 23:01:16 [DEBUG   ] board 10 xbars (bd10 to bd8 through top5) - beam 4
2018-11-15 23:01:16 [DEBUG   ] board 8 xbars (bd8 from bd10 through top1) - beam 4
2018-11-15 23:01:16 [DEBUG   ] board 8 xbars (bd8 to bd6 through top5) - beam 4
2018-11-15 23:01:16 [DEBUG   ] board 6 xbars (bd6 from bd8 through top1) - beam 4
2018-11-15 23:01:16 [DEBUG   ] board 6 xbars (bd6 to bd4 through top5) - beam 4
2018-11-15 23:01:16 [DEBUG   ] board 4 xbars (bd4 from bd6 through top1) - beam 4
2018-11-15 23:01:16 [DEBUG   ] board 4 xbars (bd4 to bd2 through top5) - beam 4
2018-11-15 23:01:16 [DEBUG   ] board 2 xbars (bd2 from bd4 through top1) - beam 4
2018-11-15 23:01:16 [DEBUG   ] board 2 xbars (bd2 to bd5 through top5) - beam 4
2018-11-15 23:01:17 [DEBUG   ] board 5 xbars (bd5 from bd2 through top1) - beam 4
2018-11-15 23:01:17 [DEBUG   ] board 5 xbars (bd5 to bd9 through top5) - beam 4
2018-11-15 23:01:17 [DEBUG   ] board 9 xbars (bd9 from bd5 through top1) - beam 4
2018-11-15 23:01:17 [DEBUG   ] board 9 xbars (bd9 to bd13 through top5) - beam 4
2018-11-15 23:01:17 [DEBUG   ] board 13 xbars (bd13 from bd9 through top1) - beam 4
2018-11-15 23:01:17 [DEBUG   ] board 13 xbars (bd13 to bd11 through top5) - beam 4
2018-11-15 23:01:17 [DEBUG   ] board 11 xbars (bd11 from bd13 through top1) - beam 4
2018-11-15 23:01:17 [DEBUG   ] board 11 xbars (bd11 to bd7 through top5) - beam 4
2018-11-15 23:01:17 [DEBUG   ] board 7 xbars (bd7 from bd11 through top1) - beam 4
2018-11-15 23:01:17 [DEBUG   ] board 7 xbars (bd7 to bd3 through top5) - beam 4
2018-11-15 23:01:18 [DEBUG   ] board 3 xbars (bd3 from bd7 through top1) - beam 4
2018-11-15 23:01:18 [DEBUG   ] board 3 xbars (bd3 to bd1 through top5) - beam 4
2018-11-15 23:01:18 [DEBUG   ] board 1 xbars (bd1 from bd3 through top1) - beam 4
2018-11-15 23:01:18 [INFO    ] All xbars set
2018-11-15 23:01:18 [INFO    ] Setting adder chain routing for all beams
2018-11-15 23:01:23 [INFO    ] Setting beam ids
2018-11-15 23:01:33 [INFO    ] Starting beam delay calibration
2018-11-15 23:01:45 [INFO    ] Beam 1 latency is 5724
2018-11-15 23:01:45 [INFO    ] Beam 2 latency is 5734
2018-11-15 23:01:45 [INFO    ] Beam 3 latency is 5730
2018-11-15 23:01:45 [INFO    ] Beam 4 latency is 5716
2018-11-15 23:01:45 [INFO    ] Stop calibration
2018-11-15 23:01:53 [INFO    ] Beam delay calibration successful
2018-11-15 23:01:53 [INFO    ] Calibration passed
2018-11-15 23:01:53 [DEBUG   ] spawn_process: at 2018-11-15 23:01:53 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 4 1 192.168.0.1 192.168.0.33 10000']
2018-11-15 23:01:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x138 8909
2018-11-15 23:01:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 5 0x13c 9111
2018-11-15 23:01:53 [DEBUG   ] spawn_process: at 2018-11-15 23:01:53 running ['/usr/local/bin/lwa34', '/lwa/software/cfg_eth 2 1 192.168.0.2 192.168.0.34 10000']
2018-11-15 23:01:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x138 8a0a
2018-11-15 23:01:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 /ape/core/xwl 1 0x13c 9212
2018-11-15 23:01:53 [DEBUG   ] spawn_process: at 2018-11-15 23:01:53 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 4 1 192.168.0.3 192.168.0.35 10000']
2018-11-15 23:01:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x138 8b0b
2018-11-15 23:01:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 5 0x13c 9313
2018-11-15 23:01:53 [DEBUG   ] spawn_process: at 2018-11-15 23:01:53 running ['/usr/local/bin/lwa16', '/lwa/software/cfg_eth 2 1 192.168.0.4 192.168.0.36 10000']
2018-11-15 23:01:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x138 8c0c
2018-11-15 23:01:53 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 /ape/core/xwl 1 0x13c 9414
2018-11-15 23:01:53 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -2 msec
2018-11-15 23:01:54 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa16 at 276 ms (1542322914.278 s) with PID 5611 and time 1542322915
2018-11-15 23:01:54 [DEBUG   ] SetDRXTime: DP2 - DP/MCS NTP skew is -1 msec
2018-11-15 23:01:54 [DEBUG   ] SetDRXTime: started set_drx_time on hostname lwa34 at 367 ms (1542322914.369 s) with PID 5614 and time 1542322915
2018-11-15 23:01:55 [DEBUG   ] Finished updating ant stats in 0.878 seconds
2018-11-15 23:01:55 [INFO    ] Started antennas statistics background thread
2018-11-15 23:01:55 [INFO    ] Started board flags background thread
2018-11-15 23:01:55 [INFO    ] Started BAM background thread
2018-11-15 23:01:55 [INFO    ] Finished the INI process (ref. #519960) in 104.664 s
2018-11-15 23:01:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 23:01:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 23:01:56 [WARNING ] (13, 1, 'bot')
2018-11-15 23:01:56 [WARNING ] (13, 1, 'bot')
2018-11-15 23:01:56 [WARNING ] (13, 1, 'bot')
2018-11-15 23:01:56 [WARNING ] (13, 1, 'bot')
2018-11-15 23:01:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 23:01:56 [DEBUG   ] Finished updating board flags in 1.065 seconds
2018-11-15 23:02:15 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-15 23:02:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 23:02:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 23:02:55 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 23:02:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 23:02:56 [WARNING ] (13, 1, 'bot')
2018-11-15 23:02:56 [WARNING ] (13, 1, 'bot')
2018-11-15 23:02:56 [WARNING ] (13, 1, 'bot')
2018-11-15 23:02:56 [WARNING ] (13, 1, 'bot')
2018-11-15 23:02:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 23:02:56 [DEBUG   ] Finished updating board flags in 0.989 seconds
2018-11-15 23:03:10 [DEBUG   ] Got command RPT from MCS: ref #519982
2018-11-15 23:03:10 [DEBUG   ] summary = ERROR
2018-11-15 23:03:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519982  13 58437 82990813 A  ERRORERROR'
2018-11-15 23:03:10 [DEBUG   ] Got command RPT from MCS: ref #519983
2018-11-15 23:03:10 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 23:03:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519983  77 58437 82990814 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 23:03:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 23:03:26 [DEBUG   ] Got command RPT from MCS: ref #519984
2018-11-15 23:03:26 [DEBUG   ] summary = ERROR
2018-11-15 23:03:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519984  13 58437 83006285 A  ERRORERROR'
2018-11-15 23:03:26 [DEBUG   ] Got command RPT from MCS: ref #519985
2018-11-15 23:03:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 23:03:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519985  77 58437 83006489 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 23:03:26 [DEBUG   ] Got command RPT from MCS: ref #519986
2018-11-15 23:03:26 [DEBUG   ] summary = ERROR
2018-11-15 23:03:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519986  13 58437 83006693 A  ERRORERROR'
2018-11-15 23:03:26 [DEBUG   ] Got command RPT from MCS: ref #519987
2018-11-15 23:03:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 23:03:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519987  77 58437 83006897 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 23:03:27 [DEBUG   ] Got command RPT from MCS: ref #519988
2018-11-15 23:03:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 23:03:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519988  12 58437 83007089 A  ERRORB˜™š'
2018-11-15 23:03:35 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-15 23:03:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 23:03:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 23:03:57 [WARNING ] (13, 1, 'bot')
2018-11-15 23:03:57 [WARNING ] (13, 1, 'bot')
2018-11-15 23:03:57 [WARNING ] (13, 1, 'bot')
2018-11-15 23:03:57 [WARNING ] (13, 1, 'bot')
2018-11-15 23:03:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 23:03:57 [DEBUG   ] Finished updating board flags in 1.879 seconds
2018-11-15 23:04:15 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-15 23:04:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 23:04:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-15 23:04:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 23:04:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-15 23:04:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-15 23:04:57 [WARNING ] (13, 1, 'bot')
2018-11-15 23:04:57 [WARNING ] (13, 1, 'bot')
2018-11-15 23:04:57 [WARNING ] (13, 1, 'bot')
2018-11-15 23:04:57 [WARNING ] (13, 1, 'bot')
2018-11-15 23:04:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 23:04:57 [DEBUG   ] Finished updating board flags in 1.815 seconds
2018-11-15 23:05:15 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-15 23:05:35 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-15 23:05:45 [DEBUG   ] Got command RPT from MCS: ref #519993
2018-11-15 23:05:45 [DEBUG   ] summary = ERROR
2018-11-15 23:05:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519993  13 58437 83145221 A  ERRORERROR'
2018-11-15 23:05:45 [DEBUG   ] Got command RPT from MCS: ref #519994
2018-11-15 23:05:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 23:05:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   519994  77 58437 83145222 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 23:05:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-15 23:05:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 23:05:57 [WARNING ] (13, 1, 'bot')
2018-11-15 23:05:57 [WARNING ] (13, 1, 'bot')
2018-11-15 23:05:57 [WARNING ] (13, 1, 'bot')
2018-11-15 23:05:57 [WARNING ] (13, 1, 'bot')
2018-11-15 23:05:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 23:05:57 [DEBUG   ] Finished updating board flags in 1.726 seconds
2018-11-15 23:06:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 23:06:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 23:06:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-15 23:06:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 23:06:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 23:06:56 [WARNING ] (13, 1, 'bot')
2018-11-15 23:06:56 [WARNING ] (13, 1, 'bot')
2018-11-15 23:06:56 [WARNING ] (13, 1, 'bot')
2018-11-15 23:06:56 [WARNING ] (13, 1, 'bot')
2018-11-15 23:06:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 23:06:56 [DEBUG   ] Finished updating board flags in 1.057 seconds
2018-11-15 23:07:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 23:07:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 23:07:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-15 23:07:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 23:07:56 [WARNING ] (13, 1, 'bot')
2018-11-15 23:07:56 [WARNING ] (13, 1, 'bot')
2018-11-15 23:07:56 [WARNING ] (13, 1, 'bot')
2018-11-15 23:07:56 [WARNING ] (13, 1, 'bot')
2018-11-15 23:07:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 23:07:56 [DEBUG   ] Finished updating board flags in 1.008 seconds
2018-11-15 23:08:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 23:08:26 [DEBUG   ] Got command RPT from MCS: ref #520012
2018-11-15 23:08:26 [DEBUG   ] summary = ERROR
2018-11-15 23:08:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520012  13 58437 83306373 A  ERRORERROR'
2018-11-15 23:08:26 [DEBUG   ] Got command RPT from MCS: ref #520013
2018-11-15 23:08:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 23:08:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520013  77 58437 83306577 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 23:08:26 [DEBUG   ] Got command RPT from MCS: ref #520014
2018-11-15 23:08:26 [DEBUG   ] summary = ERROR
2018-11-15 23:08:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520014  13 58437 83306793 A  ERRORERROR'
2018-11-15 23:08:26 [DEBUG   ] Got command RPT from MCS: ref #520016
2018-11-15 23:08:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 23:08:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520016  77 58437 83306973 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 23:08:27 [DEBUG   ] Got command RPT from MCS: ref #520017
2018-11-15 23:08:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 23:08:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520017  12 58437 83307177 A  ERRORB™™š'
2018-11-15 23:08:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 23:08:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-15 23:08:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 23:08:57 [WARNING ] (13, 1, 'bot')
2018-11-15 23:08:57 [WARNING ] (13, 1, 'bot')
2018-11-15 23:08:57 [WARNING ] (13, 1, 'bot')
2018-11-15 23:08:57 [WARNING ] (13, 1, 'bot')
2018-11-15 23:08:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 23:08:57 [DEBUG   ] Finished updating board flags in 1.555 seconds
2018-11-15 23:09:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 23:09:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 23:09:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-15 23:09:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 23:09:57 [WARNING ] (13, 1, 'bot')
2018-11-15 23:09:57 [WARNING ] (13, 1, 'bot')
2018-11-15 23:09:57 [WARNING ] (13, 1, 'bot')
2018-11-15 23:09:57 [WARNING ] (13, 1, 'bot')
2018-11-15 23:09:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 23:09:57 [DEBUG   ] Finished updating board flags in 1.465 seconds
2018-11-15 23:10:15 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2018-11-15 23:10:35 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-15 23:10:45 [DEBUG   ] Got command RPT from MCS: ref #520026
2018-11-15 23:10:45 [DEBUG   ] summary = ERROR
2018-11-15 23:10:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520026  13 58437 83445233 A  ERRORERROR'
2018-11-15 23:10:45 [DEBUG   ] Got command RPT from MCS: ref #520027
2018-11-15 23:10:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 23:10:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520027  77 58437 83445234 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 23:10:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 23:10:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 23:10:57 [WARNING ] (13, 1, 'bot')
2018-11-15 23:10:57 [WARNING ] (13, 1, 'bot')
2018-11-15 23:10:57 [WARNING ] (13, 1, 'bot')
2018-11-15 23:10:57 [WARNING ] (13, 1, 'bot')
2018-11-15 23:10:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 23:10:57 [DEBUG   ] Finished updating board flags in 1.406 seconds
2018-11-15 23:11:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 23:11:35 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-15 23:11:55 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-15 23:11:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 23:11:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 23:11:57 [WARNING ] (13, 1, 'bot')
2018-11-15 23:11:57 [WARNING ] (13, 1, 'bot')
2018-11-15 23:11:57 [WARNING ] (13, 1, 'bot')
2018-11-15 23:11:57 [WARNING ] (13, 1, 'bot')
2018-11-15 23:11:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 23:11:57 [DEBUG   ] Finished updating board flags in 1.320 seconds
2018-11-15 23:12:15 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-15 23:12:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 23:12:55 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-15 23:12:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 23:12:57 [WARNING ] (13, 1, 'bot')
2018-11-15 23:12:57 [WARNING ] (13, 1, 'bot')
2018-11-15 23:12:57 [WARNING ] (13, 1, 'bot')
2018-11-15 23:12:57 [WARNING ] (13, 1, 'bot')
2018-11-15 23:12:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 23:12:57 [DEBUG   ] Finished updating board flags in 1.204 seconds
2018-11-15 23:13:15 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-15 23:13:26 [DEBUG   ] Got command RPT from MCS: ref #520047
2018-11-15 23:13:26 [DEBUG   ] summary = ERROR
2018-11-15 23:13:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520047  13 58437 83606453 A  ERRORERROR'
2018-11-15 23:13:26 [DEBUG   ] Got command RPT from MCS: ref #520048
2018-11-15 23:13:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 23:13:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520048  77 58437 83606657 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 23:13:26 [DEBUG   ] Got command RPT from MCS: ref #520049
2018-11-15 23:13:26 [DEBUG   ] summary = ERROR
2018-11-15 23:13:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520049  13 58437 83606861 A  ERRORERROR'
2018-11-15 23:13:27 [DEBUG   ] Got command RPT from MCS: ref #520050
2018-11-15 23:13:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 23:13:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520050  77 58437 83607065 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 23:13:27 [DEBUG   ] Got command RPT from MCS: ref #520051
2018-11-15 23:13:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 23:13:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520051  12 58437 83607257 A  ERRORB™™š'
2018-11-15 23:13:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 23:13:55 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 23:13:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 23:13:57 [WARNING ] (13, 1, 'bot')
2018-11-15 23:13:57 [WARNING ] (13, 1, 'bot')
2018-11-15 23:13:57 [WARNING ] (13, 1, 'bot')
2018-11-15 23:13:57 [WARNING ] (13, 1, 'bot')
2018-11-15 23:13:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 23:13:57 [DEBUG   ] Finished updating board flags in 1.215 seconds
2018-11-15 23:14:15 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-15 23:14:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 23:14:55 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-15 23:14:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 23:14:57 [WARNING ] (13, 1, 'bot')
2018-11-15 23:14:57 [WARNING ] (13, 1, 'bot')
2018-11-15 23:14:57 [WARNING ] (13, 1, 'bot')
2018-11-15 23:14:57 [WARNING ] (13, 1, 'bot')
2018-11-15 23:14:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 23:14:57 [DEBUG   ] Finished updating board flags in 1.177 seconds
2018-11-15 23:15:15 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-15 23:15:35 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-15 23:15:45 [DEBUG   ] Got command RPT from MCS: ref #520056
2018-11-15 23:15:45 [DEBUG   ] summary = ERROR
2018-11-15 23:15:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520056  13 58437 83745225 A  ERRORERROR'
2018-11-15 23:15:45 [DEBUG   ] Got command RPT from MCS: ref #520057
2018-11-15 23:15:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 23:15:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520057  77 58437 83745226 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 23:15:55 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-15 23:15:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 23:15:57 [WARNING ] (13, 1, 'bot')
2018-11-15 23:15:57 [WARNING ] (13, 1, 'bot')
2018-11-15 23:15:57 [WARNING ] (13, 1, 'bot')
2018-11-15 23:15:57 [WARNING ] (13, 1, 'bot')
2018-11-15 23:15:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 23:15:57 [DEBUG   ] Finished updating board flags in 1.036 seconds
2018-11-15 23:16:15 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-15 23:16:35 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-15 23:16:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 23:16:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 23:16:57 [WARNING ] (13, 1, 'bot')
2018-11-15 23:16:57 [WARNING ] (13, 1, 'bot')
2018-11-15 23:16:57 [WARNING ] (13, 1, 'bot')
2018-11-15 23:16:57 [WARNING ] (13, 1, 'bot')
2018-11-15 23:16:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 23:16:57 [DEBUG   ] Finished updating board flags in 1.477 seconds
2018-11-15 23:17:15 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 23:17:22 [DEBUG   ] Got command BAM from MCS: ref #520077
2018-11-15 23:17:22 [INFO    ] Finished processing BAM request
2018-11-15 23:17:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:17:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520077   8 58437 83842025 A  ERROR'
2018-11-15 23:17:22 [DEBUG   ] Got command BAM from MCS: ref #520078
2018-11-15 23:17:22 [INFO    ] Finished processing BAM request
2018-11-15 23:17:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:17:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520078   8 58437 83842029 A  ERROR'
2018-11-15 23:17:22 [DEBUG   ] Got command DRX from MCS: ref #520080
2018-11-15 23:17:22 [INFO    ] sending drx command to lwa34
2018-11-15 23:17:22 [DEBUG   ] run_process: at 2018-11-15 23:17:22 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 1 35100000.0 7 9 9']
2018-11-15 23:17:22 [DEBUG   ] drx = exited with status True, code 0x00
2018-11-15 23:17:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   520080   8 58437 83842105 A  ERROR'
2018-11-15 23:17:22 [DEBUG   ] Got command DRX from MCS: ref #520079
2018-11-15 23:17:22 [INFO    ] sending drx command to lwa16
2018-11-15 23:17:22 [DEBUG   ] run_process: at 2018-11-15 23:17:22 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 1 64500000.0 7 9 9']
2018-11-15 23:17:22 [DEBUG   ] drx = exited with status True, code 0x00
2018-11-15 23:17:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   520079   8 58437 83842109 A  ERROR'
2018-11-15 23:17:22 [DEBUG   ] Got command DRX from MCS: ref #520081
2018-11-15 23:17:22 [INFO    ] sending drx command to lwa16
2018-11-15 23:17:22 [DEBUG   ] run_process: at 2018-11-15 23:17:22 running ['/usr/local/bin/lwa16', '/lwa/software/drx 5 2 79200000.0 7 9 9']
2018-11-15 23:17:22 [DEBUG   ] drx = exited with status True, code 0x00
2018-11-15 23:17:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   520081   8 58437 83842113 A  ERROR'
2018-11-15 23:17:22 [DEBUG   ] Got command DRX from MCS: ref #520082
2018-11-15 23:17:22 [INFO    ] sending drx command to lwa34
2018-11-15 23:17:22 [DEBUG   ] run_process: at 2018-11-15 23:17:22 running ['/usr/local/bin/lwa34', '/lwa/software/drx 1 2 49800000.0 7 9 9']
2018-11-15 23:17:22 [DEBUG   ] drx = exited with status True, code 0x00
2018-11-15 23:17:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_DRX   520082   8 58437 83842117 A  ERROR'
2018-11-15 23:17:22 [INFO    ] Finished starting DRX
2018-11-15 23:17:22 [INFO    ] Finished starting DRX
2018-11-15 23:17:22 [INFO    ] Finished starting DRX
2018-11-15 23:17:22 [INFO    ] Finished starting DRX
2018-11-15 23:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 23:17:22 [DEBUG   ] spawn_process: at 2018-11-15 23:17:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 23:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 23:17:22 [DEBUG   ] spawn_process: at 2018-11-15 23:17:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 23:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 23:17:22 [DEBUG   ] spawn_process: at 2018-11-15 23:17:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 23:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 23:17:22 [DEBUG   ] spawn_process: at 2018-11-15 23:17:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 23:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 23:17:22 [DEBUG   ] spawn_process: at 2018-11-15 23:17:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 23:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 23:17:22 [DEBUG   ] spawn_process: at 2018-11-15 23:17:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 23:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 23:17:22 [DEBUG   ] spawn_process: at 2018-11-15 23:17:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 23:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 23:17:22 [DEBUG   ] spawn_process: at 2018-11-15 23:17:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 23:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 23:17:22 [DEBUG   ] spawn_process: at 2018-11-15 23:17:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 23:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 23:17:22 [DEBUG   ] spawn_process: at 2018-11-15 23:17:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 23:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 23:17:22 [DEBUG   ] spawn_process: at 2018-11-15 23:17:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 23:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 23:17:22 [DEBUG   ] spawn_process: at 2018-11-15 23:17:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 23:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 23:17:22 [DEBUG   ] spawn_process: at 2018-11-15 23:17:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 23:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 23:17:22 [DEBUG   ] spawn_process: at 2018-11-15 23:17:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 23:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 23:17:22 [DEBUG   ] spawn_process: at 2018-11-15 23:17:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 23:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 23:17:22 [DEBUG   ] spawn_process: at 2018-11-15 23:17:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 23:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 23:17:22 [DEBUG   ] spawn_process: at 2018-11-15 23:17:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 23:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 23:17:22 [DEBUG   ] spawn_process: at 2018-11-15 23:17:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 23:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 23:17:22 [DEBUG   ] spawn_process: at 2018-11-15 23:17:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 23:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 23:17:22 [DEBUG   ] spawn_process: at 2018-11-15 23:17:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 23:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 23:17:22 [DEBUG   ] spawn_process: at 2018-11-15 23:17:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 23:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 23:17:22 [DEBUG   ] spawn_process: at 2018-11-15 23:17:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 23:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 23:17:22 [DEBUG   ] spawn_process: at 2018-11-15 23:17:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 23:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 23:17:22 [DEBUG   ] spawn_process: at 2018-11-15 23:17:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 23:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 23:17:22 [DEBUG   ] spawn_process: at 2018-11-15 23:17:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 23:17:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 23:17:22 [DEBUG   ] spawn_process: at 2018-11-15 23:17:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 23:17:35 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 23:17:55 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 23:17:56 [DEBUG   ] Got command BAM from MCS: ref #520089
2018-11-15 23:17:56 [INFO    ] Finished processing BAM request
2018-11-15 23:17:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:17:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520089   8 58437 83876033 A  ERROR'
2018-11-15 23:17:56 [DEBUG   ] Got command BAM from MCS: ref #520090
2018-11-15 23:17:56 [INFO    ] Finished processing BAM request
2018-11-15 23:17:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:17:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520090   8 58437 83876037 A  ERROR'
2018-11-15 23:17:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 23:17:56 [DEBUG   ] spawn_process: at 2018-11-15 23:17:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 23:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 23:17:57 [DEBUG   ] spawn_process: at 2018-11-15 23:17:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 23:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 23:17:57 [DEBUG   ] spawn_process: at 2018-11-15 23:17:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 23:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 23:17:57 [DEBUG   ] spawn_process: at 2018-11-15 23:17:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 23:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 23:17:57 [DEBUG   ] spawn_process: at 2018-11-15 23:17:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 23:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 23:17:57 [DEBUG   ] spawn_process: at 2018-11-15 23:17:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 23:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 23:17:57 [DEBUG   ] spawn_process: at 2018-11-15 23:17:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 23:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 23:17:57 [DEBUG   ] spawn_process: at 2018-11-15 23:17:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 23:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 23:17:57 [DEBUG   ] spawn_process: at 2018-11-15 23:17:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 23:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 23:17:57 [DEBUG   ] spawn_process: at 2018-11-15 23:17:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 23:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 23:17:57 [DEBUG   ] spawn_process: at 2018-11-15 23:17:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 23:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 23:17:57 [DEBUG   ] spawn_process: at 2018-11-15 23:17:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 23:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 23:17:57 [DEBUG   ] spawn_process: at 2018-11-15 23:17:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 23:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 23:17:57 [DEBUG   ] spawn_process: at 2018-11-15 23:17:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 23:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 23:17:57 [DEBUG   ] spawn_process: at 2018-11-15 23:17:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 23:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 23:17:57 [DEBUG   ] spawn_process: at 2018-11-15 23:17:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 23:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 23:17:57 [DEBUG   ] spawn_process: at 2018-11-15 23:17:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 23:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 23:17:57 [DEBUG   ] spawn_process: at 2018-11-15 23:17:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 23:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 23:17:57 [DEBUG   ] spawn_process: at 2018-11-15 23:17:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 23:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 23:17:57 [DEBUG   ] spawn_process: at 2018-11-15 23:17:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 23:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 23:17:57 [DEBUG   ] spawn_process: at 2018-11-15 23:17:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 23:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 23:17:57 [DEBUG   ] spawn_process: at 2018-11-15 23:17:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 23:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 23:17:57 [DEBUG   ] spawn_process: at 2018-11-15 23:17:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 23:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 23:17:57 [DEBUG   ] spawn_process: at 2018-11-15 23:17:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 23:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 23:17:57 [DEBUG   ] spawn_process: at 2018-11-15 23:17:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 23:17:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 23:17:57 [DEBUG   ] spawn_process: at 2018-11-15 23:17:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 23:17:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 23:17:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:17:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:17:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:17:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:17:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 23:17:58 [DEBUG   ] Finished updating board flags in 1.924 seconds
2018-11-15 23:18:15 [DEBUG   ] Finished updating ant stats in 0.394 seconds
2018-11-15 23:18:26 [DEBUG   ] Got command RPT from MCS: ref #520093
2018-11-15 23:18:26 [DEBUG   ] summary = ERROR
2018-11-15 23:18:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520093  13 58437 83906541 A  ERRORERROR'
2018-11-15 23:18:26 [DEBUG   ] Got command RPT from MCS: ref #520094
2018-11-15 23:18:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 23:18:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520094  77 58437 83906745 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 23:18:26 [DEBUG   ] Got command RPT from MCS: ref #520095
2018-11-15 23:18:26 [DEBUG   ] summary = ERROR
2018-11-15 23:18:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520095  13 58437 83906949 A  ERRORERROR'
2018-11-15 23:18:27 [DEBUG   ] Got command RPT from MCS: ref #520097
2018-11-15 23:18:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 23:18:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520097  77 58437 83907141 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 23:18:27 [DEBUG   ] Got command RPT from MCS: ref #520098
2018-11-15 23:18:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 23:18:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520098  12 58437 83907345 A  ERRORBœ™š'
2018-11-15 23:18:30 [DEBUG   ] Got command BAM from MCS: ref #520104
2018-11-15 23:18:30 [INFO    ] Finished processing BAM request
2018-11-15 23:18:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:18:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520104   8 58437 83910029 A  ERROR'
2018-11-15 23:18:30 [DEBUG   ] Got command BAM from MCS: ref #520103
2018-11-15 23:18:30 [INFO    ] Finished processing BAM request
2018-11-15 23:18:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:18:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520103   8 58437 83910037 A  ERROR'
2018-11-15 23:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 23:18:30 [DEBUG   ] spawn_process: at 2018-11-15 23:18:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 23:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 23:18:30 [DEBUG   ] spawn_process: at 2018-11-15 23:18:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 23:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 23:18:30 [DEBUG   ] spawn_process: at 2018-11-15 23:18:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 23:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 23:18:30 [DEBUG   ] spawn_process: at 2018-11-15 23:18:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 23:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 23:18:30 [DEBUG   ] spawn_process: at 2018-11-15 23:18:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 23:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 23:18:30 [DEBUG   ] spawn_process: at 2018-11-15 23:18:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 23:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 23:18:30 [DEBUG   ] spawn_process: at 2018-11-15 23:18:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 23:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 23:18:30 [DEBUG   ] spawn_process: at 2018-11-15 23:18:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 23:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 23:18:30 [DEBUG   ] spawn_process: at 2018-11-15 23:18:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 23:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 23:18:30 [DEBUG   ] spawn_process: at 2018-11-15 23:18:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 23:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 23:18:30 [DEBUG   ] spawn_process: at 2018-11-15 23:18:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 23:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 23:18:30 [DEBUG   ] spawn_process: at 2018-11-15 23:18:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 23:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 23:18:30 [DEBUG   ] spawn_process: at 2018-11-15 23:18:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 23:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 23:18:30 [DEBUG   ] spawn_process: at 2018-11-15 23:18:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 23:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 23:18:30 [DEBUG   ] spawn_process: at 2018-11-15 23:18:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 23:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 23:18:30 [DEBUG   ] spawn_process: at 2018-11-15 23:18:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 23:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 23:18:30 [DEBUG   ] spawn_process: at 2018-11-15 23:18:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 23:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 23:18:30 [DEBUG   ] spawn_process: at 2018-11-15 23:18:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 23:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 23:18:30 [DEBUG   ] spawn_process: at 2018-11-15 23:18:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 23:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 23:18:30 [DEBUG   ] spawn_process: at 2018-11-15 23:18:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 23:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 23:18:30 [DEBUG   ] spawn_process: at 2018-11-15 23:18:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 23:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 23:18:30 [DEBUG   ] spawn_process: at 2018-11-15 23:18:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 23:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 23:18:30 [DEBUG   ] spawn_process: at 2018-11-15 23:18:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 23:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 23:18:30 [DEBUG   ] spawn_process: at 2018-11-15 23:18:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 23:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 23:18:30 [DEBUG   ] spawn_process: at 2018-11-15 23:18:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 23:18:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 23:18:30 [DEBUG   ] spawn_process: at 2018-11-15 23:18:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 23:18:36 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-15 23:18:56 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-15 23:18:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 23:18:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 23:18:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-15 23:18:57 [WARNING ] (13, 1, 'bot')
2018-11-15 23:18:57 [WARNING ] (13, 1, 'bot')
2018-11-15 23:18:57 [WARNING ] (13, 1, 'bot')
2018-11-15 23:18:57 [WARNING ] (13, 1, 'bot')
2018-11-15 23:18:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 23:18:57 [DEBUG   ] Finished updating board flags in 1.236 seconds
2018-11-15 23:19:04 [DEBUG   ] Got command BAM from MCS: ref #520105
2018-11-15 23:19:04 [INFO    ] Finished processing BAM request
2018-11-15 23:19:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:19:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520105   8 58437 83944029 A  ERROR'
2018-11-15 23:19:04 [DEBUG   ] Got command BAM from MCS: ref #520106
2018-11-15 23:19:04 [INFO    ] Finished processing BAM request
2018-11-15 23:19:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:19:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520106   8 58437 83944037 A  ERROR'
2018-11-15 23:19:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 23:19:04 [DEBUG   ] spawn_process: at 2018-11-15 23:19:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 23:19:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 23:19:04 [DEBUG   ] spawn_process: at 2018-11-15 23:19:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 23:19:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 23:19:04 [DEBUG   ] spawn_process: at 2018-11-15 23:19:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 23:19:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 23:19:04 [DEBUG   ] spawn_process: at 2018-11-15 23:19:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 23:19:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 23:19:04 [DEBUG   ] spawn_process: at 2018-11-15 23:19:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 23:19:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 23:19:04 [DEBUG   ] spawn_process: at 2018-11-15 23:19:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 23:19:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 23:19:04 [DEBUG   ] spawn_process: at 2018-11-15 23:19:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 23:19:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 23:19:04 [DEBUG   ] spawn_process: at 2018-11-15 23:19:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 23:19:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 23:19:04 [DEBUG   ] spawn_process: at 2018-11-15 23:19:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 23:19:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 23:19:04 [DEBUG   ] spawn_process: at 2018-11-15 23:19:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 23:19:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 23:19:04 [DEBUG   ] spawn_process: at 2018-11-15 23:19:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 23:19:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 23:19:04 [DEBUG   ] spawn_process: at 2018-11-15 23:19:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 23:19:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 23:19:04 [DEBUG   ] spawn_process: at 2018-11-15 23:19:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 23:19:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 23:19:04 [DEBUG   ] spawn_process: at 2018-11-15 23:19:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 23:19:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 23:19:04 [DEBUG   ] spawn_process: at 2018-11-15 23:19:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 23:19:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 23:19:04 [DEBUG   ] spawn_process: at 2018-11-15 23:19:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 23:19:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 23:19:04 [DEBUG   ] spawn_process: at 2018-11-15 23:19:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 23:19:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 23:19:04 [DEBUG   ] spawn_process: at 2018-11-15 23:19:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 23:19:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 23:19:04 [DEBUG   ] spawn_process: at 2018-11-15 23:19:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 23:19:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 23:19:04 [DEBUG   ] spawn_process: at 2018-11-15 23:19:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 23:19:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 23:19:04 [DEBUG   ] spawn_process: at 2018-11-15 23:19:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 23:19:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 23:19:04 [DEBUG   ] spawn_process: at 2018-11-15 23:19:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 23:19:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 23:19:04 [DEBUG   ] spawn_process: at 2018-11-15 23:19:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 23:19:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 23:19:04 [DEBUG   ] spawn_process: at 2018-11-15 23:19:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 23:19:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 23:19:04 [DEBUG   ] spawn_process: at 2018-11-15 23:19:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 23:19:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 23:19:04 [DEBUG   ] spawn_process: at 2018-11-15 23:19:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 23:19:16 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-15 23:19:36 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-15 23:19:38 [DEBUG   ] Got command BAM from MCS: ref #520108
2018-11-15 23:19:38 [INFO    ] Finished processing BAM request
2018-11-15 23:19:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:19:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520108   8 58437 83978029 A  ERROR'
2018-11-15 23:19:38 [DEBUG   ] Got command BAM from MCS: ref #520107
2018-11-15 23:19:38 [INFO    ] Finished processing BAM request
2018-11-15 23:19:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:19:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520107   8 58437 83978033 A  ERROR'
2018-11-15 23:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 23:19:38 [DEBUG   ] spawn_process: at 2018-11-15 23:19:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 23:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 23:19:38 [DEBUG   ] spawn_process: at 2018-11-15 23:19:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 23:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 23:19:38 [DEBUG   ] spawn_process: at 2018-11-15 23:19:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 23:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 23:19:38 [DEBUG   ] spawn_process: at 2018-11-15 23:19:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 23:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 23:19:38 [DEBUG   ] spawn_process: at 2018-11-15 23:19:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 23:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 23:19:38 [DEBUG   ] spawn_process: at 2018-11-15 23:19:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 23:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 23:19:38 [DEBUG   ] spawn_process: at 2018-11-15 23:19:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 23:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 23:19:38 [DEBUG   ] spawn_process: at 2018-11-15 23:19:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 23:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 23:19:38 [DEBUG   ] spawn_process: at 2018-11-15 23:19:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 23:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 23:19:38 [DEBUG   ] spawn_process: at 2018-11-15 23:19:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 23:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 23:19:38 [DEBUG   ] spawn_process: at 2018-11-15 23:19:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 23:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 23:19:38 [DEBUG   ] spawn_process: at 2018-11-15 23:19:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 23:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 23:19:38 [DEBUG   ] spawn_process: at 2018-11-15 23:19:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 23:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 23:19:38 [DEBUG   ] spawn_process: at 2018-11-15 23:19:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 23:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 23:19:38 [DEBUG   ] spawn_process: at 2018-11-15 23:19:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 23:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 23:19:38 [DEBUG   ] spawn_process: at 2018-11-15 23:19:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 23:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 23:19:38 [DEBUG   ] spawn_process: at 2018-11-15 23:19:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 23:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 23:19:38 [DEBUG   ] spawn_process: at 2018-11-15 23:19:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 23:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 23:19:38 [DEBUG   ] spawn_process: at 2018-11-15 23:19:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 23:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 23:19:38 [DEBUG   ] spawn_process: at 2018-11-15 23:19:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 23:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 23:19:38 [DEBUG   ] spawn_process: at 2018-11-15 23:19:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 23:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 23:19:38 [DEBUG   ] spawn_process: at 2018-11-15 23:19:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 23:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 23:19:38 [DEBUG   ] spawn_process: at 2018-11-15 23:19:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 23:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 23:19:38 [DEBUG   ] spawn_process: at 2018-11-15 23:19:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 23:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 23:19:38 [DEBUG   ] spawn_process: at 2018-11-15 23:19:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 23:19:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 23:19:38 [DEBUG   ] spawn_process: at 2018-11-15 23:19:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 23:19:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 23:19:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 23:19:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-11-15 23:19:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:19:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:19:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:19:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:19:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 23:19:58 [DEBUG   ] Finished updating board flags in 1.788 seconds
2018-11-15 23:20:11 [DEBUG   ] Got command BAM from MCS: ref #520109
2018-11-15 23:20:11 [INFO    ] Finished processing BAM request
2018-11-15 23:20:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:20:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520109   8 58437 84011029 A  ERROR'
2018-11-15 23:20:11 [DEBUG   ] Got command BAM from MCS: ref #520110
2018-11-15 23:20:11 [INFO    ] Finished processing BAM request
2018-11-15 23:20:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:20:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520110   8 58437 84011033 A  ERROR'
2018-11-15 23:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 23:20:11 [DEBUG   ] spawn_process: at 2018-11-15 23:20:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 23:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 23:20:11 [DEBUG   ] spawn_process: at 2018-11-15 23:20:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 23:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 23:20:11 [DEBUG   ] spawn_process: at 2018-11-15 23:20:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 23:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 23:20:11 [DEBUG   ] spawn_process: at 2018-11-15 23:20:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 23:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 23:20:11 [DEBUG   ] spawn_process: at 2018-11-15 23:20:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 23:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 23:20:11 [DEBUG   ] spawn_process: at 2018-11-15 23:20:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 23:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 23:20:11 [DEBUG   ] spawn_process: at 2018-11-15 23:20:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 23:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 23:20:11 [DEBUG   ] spawn_process: at 2018-11-15 23:20:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 23:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 23:20:11 [DEBUG   ] spawn_process: at 2018-11-15 23:20:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 23:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 23:20:11 [DEBUG   ] spawn_process: at 2018-11-15 23:20:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 23:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 23:20:11 [DEBUG   ] spawn_process: at 2018-11-15 23:20:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 23:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 23:20:11 [DEBUG   ] spawn_process: at 2018-11-15 23:20:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 23:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 23:20:11 [DEBUG   ] spawn_process: at 2018-11-15 23:20:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 23:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 23:20:11 [DEBUG   ] spawn_process: at 2018-11-15 23:20:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 23:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 23:20:11 [DEBUG   ] spawn_process: at 2018-11-15 23:20:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 23:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 23:20:11 [DEBUG   ] spawn_process: at 2018-11-15 23:20:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 23:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 23:20:11 [DEBUG   ] spawn_process: at 2018-11-15 23:20:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 23:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 23:20:11 [DEBUG   ] spawn_process: at 2018-11-15 23:20:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 23:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 23:20:11 [DEBUG   ] spawn_process: at 2018-11-15 23:20:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 23:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 23:20:11 [DEBUG   ] spawn_process: at 2018-11-15 23:20:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 23:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 23:20:11 [DEBUG   ] spawn_process: at 2018-11-15 23:20:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 23:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 23:20:11 [DEBUG   ] spawn_process: at 2018-11-15 23:20:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 23:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 23:20:11 [DEBUG   ] spawn_process: at 2018-11-15 23:20:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 23:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 23:20:11 [DEBUG   ] spawn_process: at 2018-11-15 23:20:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 23:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 23:20:11 [DEBUG   ] spawn_process: at 2018-11-15 23:20:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 23:20:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 23:20:11 [DEBUG   ] spawn_process: at 2018-11-15 23:20:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 23:20:16 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-15 23:20:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 23:20:44 [DEBUG   ] Got command BAM from MCS: ref #520115
2018-11-15 23:20:44 [INFO    ] Finished processing BAM request
2018-11-15 23:20:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:20:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520115   8 58437 84044033 A  ERROR'
2018-11-15 23:20:44 [DEBUG   ] Got command BAM from MCS: ref #520116
2018-11-15 23:20:44 [INFO    ] Finished processing BAM request
2018-11-15 23:20:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:20:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520116   8 58437 84044037 A  ERROR'
2018-11-15 23:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 23:20:44 [DEBUG   ] spawn_process: at 2018-11-15 23:20:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 23:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 23:20:44 [DEBUG   ] spawn_process: at 2018-11-15 23:20:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 23:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 23:20:44 [DEBUG   ] spawn_process: at 2018-11-15 23:20:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 23:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 23:20:44 [DEBUG   ] spawn_process: at 2018-11-15 23:20:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 23:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 23:20:44 [DEBUG   ] spawn_process: at 2018-11-15 23:20:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 23:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 23:20:44 [DEBUG   ] spawn_process: at 2018-11-15 23:20:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 23:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 23:20:44 [DEBUG   ] spawn_process: at 2018-11-15 23:20:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 23:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 23:20:44 [DEBUG   ] spawn_process: at 2018-11-15 23:20:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 23:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 23:20:44 [DEBUG   ] spawn_process: at 2018-11-15 23:20:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 23:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 23:20:44 [DEBUG   ] spawn_process: at 2018-11-15 23:20:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 23:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 23:20:44 [DEBUG   ] spawn_process: at 2018-11-15 23:20:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 23:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 23:20:44 [DEBUG   ] spawn_process: at 2018-11-15 23:20:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 23:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 23:20:44 [DEBUG   ] spawn_process: at 2018-11-15 23:20:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 23:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 23:20:44 [DEBUG   ] spawn_process: at 2018-11-15 23:20:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 23:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 23:20:44 [DEBUG   ] spawn_process: at 2018-11-15 23:20:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 23:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 23:20:44 [DEBUG   ] spawn_process: at 2018-11-15 23:20:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 23:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 23:20:44 [DEBUG   ] spawn_process: at 2018-11-15 23:20:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 23:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 23:20:44 [DEBUG   ] spawn_process: at 2018-11-15 23:20:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 23:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 23:20:44 [DEBUG   ] spawn_process: at 2018-11-15 23:20:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 23:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 23:20:44 [DEBUG   ] spawn_process: at 2018-11-15 23:20:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 23:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 23:20:44 [DEBUG   ] spawn_process: at 2018-11-15 23:20:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 23:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 23:20:44 [DEBUG   ] spawn_process: at 2018-11-15 23:20:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 23:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 23:20:44 [DEBUG   ] spawn_process: at 2018-11-15 23:20:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 23:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 23:20:44 [DEBUG   ] spawn_process: at 2018-11-15 23:20:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 23:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 23:20:44 [DEBUG   ] spawn_process: at 2018-11-15 23:20:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 23:20:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 23:20:44 [DEBUG   ] spawn_process: at 2018-11-15 23:20:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 23:20:45 [DEBUG   ] Got command RPT from MCS: ref #520117
2018-11-15 23:20:45 [DEBUG   ] summary = ERROR
2018-11-15 23:20:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520117  13 58437 84045225 A  ERRORERROR'
2018-11-15 23:20:45 [DEBUG   ] Got command RPT from MCS: ref #520118
2018-11-15 23:20:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 23:20:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520118  77 58437 84045226 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 23:20:56 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-15 23:20:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 23:20:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 23:20:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-15 23:20:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 23:20:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa21, chip 2
2018-11-15 23:20:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:20:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:20:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:20:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:20:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 23:20:58 [DEBUG   ] Finished updating board flags in 1.552 seconds
2018-11-15 23:21:16 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-11-15 23:21:17 [DEBUG   ] Got command BAM from MCS: ref #520135
2018-11-15 23:21:17 [INFO    ] Finished processing BAM request
2018-11-15 23:21:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:21:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520135   8 58437 84077033 A  ERROR'
2018-11-15 23:21:17 [DEBUG   ] Got command BAM from MCS: ref #520134
2018-11-15 23:21:17 [INFO    ] Finished processing BAM request
2018-11-15 23:21:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:21:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520134   8 58437 84077037 A  ERROR'
2018-11-15 23:21:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 23:21:17 [DEBUG   ] spawn_process: at 2018-11-15 23:21:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 23:21:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 23:21:17 [DEBUG   ] spawn_process: at 2018-11-15 23:21:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 23:21:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 23:21:17 [DEBUG   ] spawn_process: at 2018-11-15 23:21:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 23:21:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 23:21:17 [DEBUG   ] spawn_process: at 2018-11-15 23:21:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 23:21:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 23:21:17 [DEBUG   ] spawn_process: at 2018-11-15 23:21:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 23:21:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 23:21:17 [DEBUG   ] spawn_process: at 2018-11-15 23:21:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 23:21:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 23:21:17 [DEBUG   ] spawn_process: at 2018-11-15 23:21:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 23:21:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 23:21:17 [DEBUG   ] spawn_process: at 2018-11-15 23:21:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 23:21:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 23:21:17 [DEBUG   ] spawn_process: at 2018-11-15 23:21:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 23:21:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 23:21:17 [DEBUG   ] spawn_process: at 2018-11-15 23:21:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 23:21:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 23:21:17 [DEBUG   ] spawn_process: at 2018-11-15 23:21:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 23:21:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 23:21:17 [DEBUG   ] spawn_process: at 2018-11-15 23:21:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 23:21:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 23:21:17 [DEBUG   ] spawn_process: at 2018-11-15 23:21:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 23:21:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 23:21:17 [DEBUG   ] spawn_process: at 2018-11-15 23:21:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 23:21:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 23:21:17 [DEBUG   ] spawn_process: at 2018-11-15 23:21:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 23:21:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 23:21:17 [DEBUG   ] spawn_process: at 2018-11-15 23:21:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 23:21:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 23:21:17 [DEBUG   ] spawn_process: at 2018-11-15 23:21:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 23:21:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 23:21:17 [DEBUG   ] spawn_process: at 2018-11-15 23:21:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 23:21:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 23:21:17 [DEBUG   ] spawn_process: at 2018-11-15 23:21:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 23:21:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 23:21:17 [DEBUG   ] spawn_process: at 2018-11-15 23:21:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 23:21:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 23:21:17 [DEBUG   ] spawn_process: at 2018-11-15 23:21:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 23:21:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 23:21:17 [DEBUG   ] spawn_process: at 2018-11-15 23:21:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 23:21:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 23:21:17 [DEBUG   ] spawn_process: at 2018-11-15 23:21:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 23:21:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 23:21:17 [DEBUG   ] spawn_process: at 2018-11-15 23:21:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 23:21:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 23:21:17 [DEBUG   ] spawn_process: at 2018-11-15 23:21:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 23:21:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 23:21:17 [DEBUG   ] spawn_process: at 2018-11-15 23:21:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 23:21:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 23:21:50 [DEBUG   ] Got command BAM from MCS: ref #520136
2018-11-15 23:21:50 [INFO    ] Finished processing BAM request
2018-11-15 23:21:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:21:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520136   8 58437 84110033 A  ERROR'
2018-11-15 23:21:50 [DEBUG   ] Got command BAM from MCS: ref #520137
2018-11-15 23:21:50 [INFO    ] Finished processing BAM request
2018-11-15 23:21:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:21:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520137   8 58437 84110037 A  ERROR'
2018-11-15 23:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 23:21:50 [DEBUG   ] spawn_process: at 2018-11-15 23:21:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 23:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 23:21:50 [DEBUG   ] spawn_process: at 2018-11-15 23:21:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 23:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 23:21:50 [DEBUG   ] spawn_process: at 2018-11-15 23:21:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 23:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 23:21:50 [DEBUG   ] spawn_process: at 2018-11-15 23:21:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 23:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 23:21:50 [DEBUG   ] spawn_process: at 2018-11-15 23:21:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 23:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 23:21:50 [DEBUG   ] spawn_process: at 2018-11-15 23:21:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 23:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 23:21:50 [DEBUG   ] spawn_process: at 2018-11-15 23:21:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 23:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 23:21:50 [DEBUG   ] spawn_process: at 2018-11-15 23:21:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 23:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 23:21:50 [DEBUG   ] spawn_process: at 2018-11-15 23:21:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 23:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 23:21:50 [DEBUG   ] spawn_process: at 2018-11-15 23:21:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 23:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 23:21:50 [DEBUG   ] spawn_process: at 2018-11-15 23:21:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 23:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 23:21:50 [DEBUG   ] spawn_process: at 2018-11-15 23:21:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 23:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 23:21:50 [DEBUG   ] spawn_process: at 2018-11-15 23:21:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 23:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 23:21:50 [DEBUG   ] spawn_process: at 2018-11-15 23:21:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 23:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 23:21:50 [DEBUG   ] spawn_process: at 2018-11-15 23:21:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 23:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 23:21:50 [DEBUG   ] spawn_process: at 2018-11-15 23:21:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 23:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 23:21:50 [DEBUG   ] spawn_process: at 2018-11-15 23:21:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 23:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 23:21:50 [DEBUG   ] spawn_process: at 2018-11-15 23:21:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 23:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 23:21:50 [DEBUG   ] spawn_process: at 2018-11-15 23:21:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 23:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 23:21:50 [DEBUG   ] spawn_process: at 2018-11-15 23:21:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 23:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 23:21:50 [DEBUG   ] spawn_process: at 2018-11-15 23:21:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 23:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 23:21:50 [DEBUG   ] spawn_process: at 2018-11-15 23:21:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 23:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 23:21:50 [DEBUG   ] spawn_process: at 2018-11-15 23:21:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 23:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 23:21:50 [DEBUG   ] spawn_process: at 2018-11-15 23:21:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 23:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 23:21:50 [DEBUG   ] spawn_process: at 2018-11-15 23:21:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 23:21:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 23:21:50 [DEBUG   ] spawn_process: at 2018-11-15 23:21:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 23:21:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 23:21:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-11-15 23:21:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 23:21:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 23:21:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 23:21:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:21:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:21:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:21:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:21:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 23:21:58 [DEBUG   ] Finished updating board flags in 1.412 seconds
2018-11-15 23:22:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 23:22:23 [DEBUG   ] Got command BAM from MCS: ref #520139
2018-11-15 23:22:23 [INFO    ] Finished processing BAM request
2018-11-15 23:22:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:22:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520139   8 58437 84143025 A  ERROR'
2018-11-15 23:22:23 [DEBUG   ] Got command BAM from MCS: ref #520138
2018-11-15 23:22:23 [INFO    ] Finished processing BAM request
2018-11-15 23:22:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:22:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520138   8 58437 84143029 A  ERROR'
2018-11-15 23:22:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 23:22:23 [DEBUG   ] spawn_process: at 2018-11-15 23:22:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 23:22:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 23:22:23 [DEBUG   ] spawn_process: at 2018-11-15 23:22:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 23:22:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 23:22:23 [DEBUG   ] spawn_process: at 2018-11-15 23:22:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 23:22:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 23:22:23 [DEBUG   ] spawn_process: at 2018-11-15 23:22:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 23:22:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 23:22:23 [DEBUG   ] spawn_process: at 2018-11-15 23:22:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 23:22:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 23:22:23 [DEBUG   ] spawn_process: at 2018-11-15 23:22:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 23:22:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 23:22:23 [DEBUG   ] spawn_process: at 2018-11-15 23:22:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 23:22:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 23:22:23 [DEBUG   ] spawn_process: at 2018-11-15 23:22:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 23:22:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 23:22:23 [DEBUG   ] spawn_process: at 2018-11-15 23:22:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 23:22:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 23:22:23 [DEBUG   ] spawn_process: at 2018-11-15 23:22:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 23:22:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 23:22:23 [DEBUG   ] spawn_process: at 2018-11-15 23:22:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 23:22:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 23:22:23 [DEBUG   ] spawn_process: at 2018-11-15 23:22:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 23:22:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 23:22:23 [DEBUG   ] spawn_process: at 2018-11-15 23:22:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 23:22:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 23:22:23 [DEBUG   ] spawn_process: at 2018-11-15 23:22:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 23:22:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 23:22:23 [DEBUG   ] spawn_process: at 2018-11-15 23:22:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 23:22:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 23:22:23 [DEBUG   ] spawn_process: at 2018-11-15 23:22:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 23:22:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 23:22:23 [DEBUG   ] spawn_process: at 2018-11-15 23:22:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 23:22:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 23:22:23 [DEBUG   ] spawn_process: at 2018-11-15 23:22:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 23:22:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 23:22:23 [DEBUG   ] spawn_process: at 2018-11-15 23:22:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 23:22:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 23:22:23 [DEBUG   ] spawn_process: at 2018-11-15 23:22:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 23:22:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 23:22:23 [DEBUG   ] spawn_process: at 2018-11-15 23:22:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 23:22:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 23:22:23 [DEBUG   ] spawn_process: at 2018-11-15 23:22:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 23:22:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 23:22:23 [DEBUG   ] spawn_process: at 2018-11-15 23:22:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 23:22:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 23:22:23 [DEBUG   ] spawn_process: at 2018-11-15 23:22:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 23:22:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 23:22:23 [DEBUG   ] spawn_process: at 2018-11-15 23:22:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 23:22:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 23:22:23 [DEBUG   ] spawn_process: at 2018-11-15 23:22:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 23:22:36 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-15 23:22:56 [DEBUG   ] Got command BAM from MCS: ref #520140
2018-11-15 23:22:56 [INFO    ] Finished processing BAM request
2018-11-15 23:22:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:22:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520140   8 58437 84176029 A  ERROR'
2018-11-15 23:22:56 [DEBUG   ] Got command BAM from MCS: ref #520141
2018-11-15 23:22:56 [INFO    ] Finished processing BAM request
2018-11-15 23:22:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:22:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520141   8 58437 84176033 A  ERROR'
2018-11-15 23:22:56 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 23:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 23:22:56 [DEBUG   ] spawn_process: at 2018-11-15 23:22:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 23:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 23:22:56 [DEBUG   ] spawn_process: at 2018-11-15 23:22:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 23:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 23:22:56 [DEBUG   ] spawn_process: at 2018-11-15 23:22:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 23:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 23:22:56 [DEBUG   ] spawn_process: at 2018-11-15 23:22:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 23:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 23:22:56 [DEBUG   ] spawn_process: at 2018-11-15 23:22:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 23:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 23:22:56 [DEBUG   ] spawn_process: at 2018-11-15 23:22:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 23:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 23:22:56 [DEBUG   ] spawn_process: at 2018-11-15 23:22:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 23:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 23:22:56 [DEBUG   ] spawn_process: at 2018-11-15 23:22:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 23:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 23:22:56 [DEBUG   ] spawn_process: at 2018-11-15 23:22:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 23:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 23:22:56 [DEBUG   ] spawn_process: at 2018-11-15 23:22:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 23:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 23:22:56 [DEBUG   ] spawn_process: at 2018-11-15 23:22:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 23:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 23:22:56 [DEBUG   ] spawn_process: at 2018-11-15 23:22:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 23:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 23:22:56 [DEBUG   ] spawn_process: at 2018-11-15 23:22:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 23:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 23:22:56 [DEBUG   ] spawn_process: at 2018-11-15 23:22:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 23:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 23:22:56 [DEBUG   ] spawn_process: at 2018-11-15 23:22:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 23:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 23:22:56 [DEBUG   ] spawn_process: at 2018-11-15 23:22:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 23:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 23:22:56 [DEBUG   ] spawn_process: at 2018-11-15 23:22:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 23:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 23:22:56 [DEBUG   ] spawn_process: at 2018-11-15 23:22:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 23:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 23:22:56 [DEBUG   ] spawn_process: at 2018-11-15 23:22:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 23:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 23:22:56 [DEBUG   ] spawn_process: at 2018-11-15 23:22:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 23:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 23:22:56 [DEBUG   ] spawn_process: at 2018-11-15 23:22:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 23:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 23:22:56 [DEBUG   ] spawn_process: at 2018-11-15 23:22:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 23:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 23:22:56 [DEBUG   ] spawn_process: at 2018-11-15 23:22:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 23:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 23:22:56 [DEBUG   ] spawn_process: at 2018-11-15 23:22:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 23:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 23:22:56 [DEBUG   ] spawn_process: at 2018-11-15 23:22:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 23:22:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 23:22:56 [DEBUG   ] spawn_process: at 2018-11-15 23:22:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 23:22:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-11-15 23:22:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 23:22:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 23:22:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 23:22:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:22:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:22:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:22:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:22:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 23:22:58 [DEBUG   ] Finished updating board flags in 1.395 seconds
2018-11-15 23:23:16 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-15 23:23:26 [DEBUG   ] Got command RPT from MCS: ref #520142
2018-11-15 23:23:26 [DEBUG   ] summary = ERROR
2018-11-15 23:23:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520142  13 58437 84206629 A  ERRORERROR'
2018-11-15 23:23:26 [DEBUG   ] Got command RPT from MCS: ref #520143
2018-11-15 23:23:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 23:23:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520143  77 58437 84206833 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 23:23:27 [DEBUG   ] Got command RPT from MCS: ref #520144
2018-11-15 23:23:27 [DEBUG   ] summary = ERROR
2018-11-15 23:23:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520144  13 58437 84207025 A  ERRORERROR'
2018-11-15 23:23:27 [DEBUG   ] Got command RPT from MCS: ref #520145
2018-11-15 23:23:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 23:23:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520145  77 58437 84207229 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 23:23:27 [DEBUG   ] Got command RPT from MCS: ref #520146
2018-11-15 23:23:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 23:23:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520146  12 58437 84207433 A  ERRORB¢ff'
2018-11-15 23:23:29 [DEBUG   ] Got command BAM from MCS: ref #520148
2018-11-15 23:23:29 [INFO    ] Finished processing BAM request
2018-11-15 23:23:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:23:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520148   8 58437 84209033 A  ERROR'
2018-11-15 23:23:29 [DEBUG   ] Got command BAM from MCS: ref #520147
2018-11-15 23:23:29 [INFO    ] Finished processing BAM request
2018-11-15 23:23:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:23:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520147   8 58437 84209037 A  ERROR'
2018-11-15 23:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 23:23:29 [DEBUG   ] spawn_process: at 2018-11-15 23:23:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 23:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 23:23:29 [DEBUG   ] spawn_process: at 2018-11-15 23:23:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 23:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 23:23:29 [DEBUG   ] spawn_process: at 2018-11-15 23:23:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 23:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 23:23:29 [DEBUG   ] spawn_process: at 2018-11-15 23:23:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 23:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 23:23:29 [DEBUG   ] spawn_process: at 2018-11-15 23:23:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 23:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 23:23:29 [DEBUG   ] spawn_process: at 2018-11-15 23:23:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 23:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 23:23:29 [DEBUG   ] spawn_process: at 2018-11-15 23:23:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 23:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 23:23:29 [DEBUG   ] spawn_process: at 2018-11-15 23:23:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 23:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 23:23:29 [DEBUG   ] spawn_process: at 2018-11-15 23:23:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 23:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 23:23:29 [DEBUG   ] spawn_process: at 2018-11-15 23:23:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 23:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 23:23:29 [DEBUG   ] spawn_process: at 2018-11-15 23:23:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 23:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 23:23:29 [DEBUG   ] spawn_process: at 2018-11-15 23:23:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 23:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 23:23:29 [DEBUG   ] spawn_process: at 2018-11-15 23:23:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 23:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 23:23:29 [DEBUG   ] spawn_process: at 2018-11-15 23:23:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 23:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 23:23:29 [DEBUG   ] spawn_process: at 2018-11-15 23:23:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 23:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 23:23:29 [DEBUG   ] spawn_process: at 2018-11-15 23:23:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 23:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 23:23:29 [DEBUG   ] spawn_process: at 2018-11-15 23:23:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 23:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 23:23:29 [DEBUG   ] spawn_process: at 2018-11-15 23:23:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 23:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 23:23:29 [DEBUG   ] spawn_process: at 2018-11-15 23:23:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 23:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 23:23:29 [DEBUG   ] spawn_process: at 2018-11-15 23:23:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 23:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 23:23:29 [DEBUG   ] spawn_process: at 2018-11-15 23:23:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 23:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 23:23:29 [DEBUG   ] spawn_process: at 2018-11-15 23:23:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 23:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 23:23:29 [DEBUG   ] spawn_process: at 2018-11-15 23:23:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 23:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 23:23:29 [DEBUG   ] spawn_process: at 2018-11-15 23:23:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 23:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 23:23:29 [DEBUG   ] spawn_process: at 2018-11-15 23:23:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 23:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 23:23:29 [DEBUG   ] spawn_process: at 2018-11-15 23:23:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 23:23:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 23:23:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 23:23:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 23:23:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-15 23:23:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 23:23:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:23:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:23:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:23:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:23:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 23:23:58 [DEBUG   ] Finished updating board flags in 1.200 seconds
2018-11-15 23:24:02 [DEBUG   ] Got command BAM from MCS: ref #520154
2018-11-15 23:24:02 [INFO    ] Finished processing BAM request
2018-11-15 23:24:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:24:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520154   8 58437 84242033 A  ERROR'
2018-11-15 23:24:02 [DEBUG   ] Got command BAM from MCS: ref #520153
2018-11-15 23:24:02 [INFO    ] Finished processing BAM request
2018-11-15 23:24:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:24:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520153   8 58437 84242037 A  ERROR'
2018-11-15 23:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 23:24:02 [DEBUG   ] spawn_process: at 2018-11-15 23:24:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 23:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 23:24:02 [DEBUG   ] spawn_process: at 2018-11-15 23:24:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 23:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 23:24:02 [DEBUG   ] spawn_process: at 2018-11-15 23:24:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 23:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 23:24:02 [DEBUG   ] spawn_process: at 2018-11-15 23:24:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 23:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 23:24:02 [DEBUG   ] spawn_process: at 2018-11-15 23:24:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 23:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 23:24:02 [DEBUG   ] spawn_process: at 2018-11-15 23:24:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 23:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 23:24:02 [DEBUG   ] spawn_process: at 2018-11-15 23:24:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 23:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 23:24:02 [DEBUG   ] spawn_process: at 2018-11-15 23:24:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 23:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 23:24:02 [DEBUG   ] spawn_process: at 2018-11-15 23:24:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 23:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 23:24:02 [DEBUG   ] spawn_process: at 2018-11-15 23:24:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 23:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 23:24:02 [DEBUG   ] spawn_process: at 2018-11-15 23:24:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 23:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 23:24:02 [DEBUG   ] spawn_process: at 2018-11-15 23:24:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 23:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 23:24:02 [DEBUG   ] spawn_process: at 2018-11-15 23:24:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 23:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 23:24:02 [DEBUG   ] spawn_process: at 2018-11-15 23:24:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 23:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 23:24:02 [DEBUG   ] spawn_process: at 2018-11-15 23:24:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 23:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 23:24:02 [DEBUG   ] spawn_process: at 2018-11-15 23:24:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 23:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 23:24:02 [DEBUG   ] spawn_process: at 2018-11-15 23:24:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 23:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 23:24:02 [DEBUG   ] spawn_process: at 2018-11-15 23:24:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 23:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 23:24:02 [DEBUG   ] spawn_process: at 2018-11-15 23:24:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 23:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 23:24:02 [DEBUG   ] spawn_process: at 2018-11-15 23:24:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 23:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 23:24:02 [DEBUG   ] spawn_process: at 2018-11-15 23:24:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 23:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 23:24:02 [DEBUG   ] spawn_process: at 2018-11-15 23:24:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 23:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 23:24:02 [DEBUG   ] spawn_process: at 2018-11-15 23:24:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 23:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 23:24:02 [DEBUG   ] spawn_process: at 2018-11-15 23:24:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 23:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 23:24:02 [DEBUG   ] spawn_process: at 2018-11-15 23:24:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 23:24:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 23:24:02 [DEBUG   ] spawn_process: at 2018-11-15 23:24:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 23:24:16 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-15 23:24:35 [DEBUG   ] Got command BAM from MCS: ref #520156
2018-11-15 23:24:35 [INFO    ] Finished processing BAM request
2018-11-15 23:24:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:24:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520156   8 58437 84275025 A  ERROR'
2018-11-15 23:24:35 [DEBUG   ] Got command BAM from MCS: ref #520155
2018-11-15 23:24:35 [INFO    ] Finished processing BAM request
2018-11-15 23:24:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:24:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520155   8 58437 84275033 A  ERROR'
2018-11-15 23:24:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 23:24:35 [DEBUG   ] spawn_process: at 2018-11-15 23:24:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 23:24:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 23:24:35 [DEBUG   ] spawn_process: at 2018-11-15 23:24:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 23:24:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 23:24:35 [DEBUG   ] spawn_process: at 2018-11-15 23:24:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 23:24:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 23:24:35 [DEBUG   ] spawn_process: at 2018-11-15 23:24:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 23:24:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 23:24:35 [DEBUG   ] spawn_process: at 2018-11-15 23:24:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 23:24:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 23:24:35 [DEBUG   ] spawn_process: at 2018-11-15 23:24:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 23:24:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 23:24:35 [DEBUG   ] spawn_process: at 2018-11-15 23:24:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 23:24:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 23:24:35 [DEBUG   ] spawn_process: at 2018-11-15 23:24:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 23:24:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 23:24:35 [DEBUG   ] spawn_process: at 2018-11-15 23:24:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 23:24:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 23:24:35 [DEBUG   ] spawn_process: at 2018-11-15 23:24:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 23:24:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 23:24:35 [DEBUG   ] spawn_process: at 2018-11-15 23:24:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 23:24:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 23:24:35 [DEBUG   ] spawn_process: at 2018-11-15 23:24:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 23:24:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 23:24:35 [DEBUG   ] spawn_process: at 2018-11-15 23:24:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 23:24:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 23:24:35 [DEBUG   ] spawn_process: at 2018-11-15 23:24:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 23:24:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 23:24:35 [DEBUG   ] spawn_process: at 2018-11-15 23:24:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 23:24:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 23:24:35 [DEBUG   ] spawn_process: at 2018-11-15 23:24:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 23:24:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 23:24:35 [DEBUG   ] spawn_process: at 2018-11-15 23:24:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 23:24:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 23:24:35 [DEBUG   ] spawn_process: at 2018-11-15 23:24:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 23:24:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 23:24:35 [DEBUG   ] spawn_process: at 2018-11-15 23:24:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 23:24:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 23:24:35 [DEBUG   ] spawn_process: at 2018-11-15 23:24:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 23:24:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 23:24:35 [DEBUG   ] spawn_process: at 2018-11-15 23:24:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 23:24:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 23:24:35 [DEBUG   ] spawn_process: at 2018-11-15 23:24:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 23:24:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 23:24:35 [DEBUG   ] spawn_process: at 2018-11-15 23:24:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 23:24:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 23:24:35 [DEBUG   ] spawn_process: at 2018-11-15 23:24:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 23:24:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 23:24:35 [DEBUG   ] spawn_process: at 2018-11-15 23:24:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 23:24:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 23:24:35 [DEBUG   ] spawn_process: at 2018-11-15 23:24:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 23:24:36 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-15 23:24:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 23:24:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-15 23:24:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 23:24:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 23:24:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 23:24:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:24:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:24:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:24:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:24:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 23:24:58 [DEBUG   ] Finished updating board flags in 1.210 seconds
2018-11-15 23:25:08 [DEBUG   ] Got command BAM from MCS: ref #520158
2018-11-15 23:25:08 [INFO    ] Finished processing BAM request
2018-11-15 23:25:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:25:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520158   8 58437 84308033 A  ERROR'
2018-11-15 23:25:08 [DEBUG   ] Got command BAM from MCS: ref #520157
2018-11-15 23:25:08 [INFO    ] Finished processing BAM request
2018-11-15 23:25:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:25:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520157   8 58437 84308037 A  ERROR'
2018-11-15 23:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 23:25:08 [DEBUG   ] spawn_process: at 2018-11-15 23:25:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 23:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 23:25:08 [DEBUG   ] spawn_process: at 2018-11-15 23:25:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 23:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 23:25:08 [DEBUG   ] spawn_process: at 2018-11-15 23:25:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 23:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 23:25:08 [DEBUG   ] spawn_process: at 2018-11-15 23:25:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 23:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 23:25:08 [DEBUG   ] spawn_process: at 2018-11-15 23:25:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 23:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 23:25:08 [DEBUG   ] spawn_process: at 2018-11-15 23:25:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 23:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 23:25:08 [DEBUG   ] spawn_process: at 2018-11-15 23:25:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 23:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 23:25:08 [DEBUG   ] spawn_process: at 2018-11-15 23:25:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 23:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 23:25:08 [DEBUG   ] spawn_process: at 2018-11-15 23:25:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 23:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 23:25:08 [DEBUG   ] spawn_process: at 2018-11-15 23:25:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 23:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 23:25:08 [DEBUG   ] spawn_process: at 2018-11-15 23:25:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 23:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 23:25:08 [DEBUG   ] spawn_process: at 2018-11-15 23:25:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 23:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 23:25:08 [DEBUG   ] spawn_process: at 2018-11-15 23:25:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 23:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 23:25:08 [DEBUG   ] spawn_process: at 2018-11-15 23:25:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 23:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 23:25:08 [DEBUG   ] spawn_process: at 2018-11-15 23:25:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 23:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 23:25:08 [DEBUG   ] spawn_process: at 2018-11-15 23:25:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 23:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 23:25:08 [DEBUG   ] spawn_process: at 2018-11-15 23:25:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 23:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 23:25:08 [DEBUG   ] spawn_process: at 2018-11-15 23:25:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 23:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 23:25:08 [DEBUG   ] spawn_process: at 2018-11-15 23:25:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 23:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 23:25:08 [DEBUG   ] spawn_process: at 2018-11-15 23:25:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 23:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 23:25:08 [DEBUG   ] spawn_process: at 2018-11-15 23:25:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 23:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 23:25:08 [DEBUG   ] spawn_process: at 2018-11-15 23:25:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 23:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 23:25:08 [DEBUG   ] spawn_process: at 2018-11-15 23:25:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 23:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 23:25:08 [DEBUG   ] spawn_process: at 2018-11-15 23:25:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 23:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 23:25:08 [DEBUG   ] spawn_process: at 2018-11-15 23:25:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 23:25:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 23:25:08 [DEBUG   ] spawn_process: at 2018-11-15 23:25:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 23:25:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 23:25:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 23:25:41 [DEBUG   ] Got command BAM from MCS: ref #520160
2018-11-15 23:25:41 [INFO    ] Finished processing BAM request
2018-11-15 23:25:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:25:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520160   8 58437 84341025 A  ERROR'
2018-11-15 23:25:41 [DEBUG   ] Got command BAM from MCS: ref #520159
2018-11-15 23:25:41 [INFO    ] Finished processing BAM request
2018-11-15 23:25:41 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:25:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520159   8 58437 84341029 A  ERROR'
2018-11-15 23:25:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 23:25:41 [DEBUG   ] spawn_process: at 2018-11-15 23:25:41 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 23:25:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 23:25:41 [DEBUG   ] spawn_process: at 2018-11-15 23:25:41 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 23:25:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 23:25:41 [DEBUG   ] spawn_process: at 2018-11-15 23:25:41 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 23:25:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 23:25:41 [DEBUG   ] spawn_process: at 2018-11-15 23:25:41 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 23:25:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 23:25:41 [DEBUG   ] spawn_process: at 2018-11-15 23:25:41 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 23:25:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 23:25:41 [DEBUG   ] spawn_process: at 2018-11-15 23:25:41 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 23:25:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 23:25:41 [DEBUG   ] spawn_process: at 2018-11-15 23:25:41 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 23:25:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 23:25:41 [DEBUG   ] spawn_process: at 2018-11-15 23:25:41 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 23:25:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 23:25:41 [DEBUG   ] spawn_process: at 2018-11-15 23:25:41 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 23:25:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 23:25:41 [DEBUG   ] spawn_process: at 2018-11-15 23:25:41 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 23:25:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 23:25:41 [DEBUG   ] spawn_process: at 2018-11-15 23:25:41 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 23:25:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 23:25:41 [DEBUG   ] spawn_process: at 2018-11-15 23:25:41 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 23:25:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 23:25:41 [DEBUG   ] spawn_process: at 2018-11-15 23:25:41 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 23:25:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 23:25:41 [DEBUG   ] spawn_process: at 2018-11-15 23:25:41 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 23:25:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 23:25:41 [DEBUG   ] spawn_process: at 2018-11-15 23:25:41 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 23:25:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 23:25:41 [DEBUG   ] spawn_process: at 2018-11-15 23:25:41 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 23:25:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 23:25:41 [DEBUG   ] spawn_process: at 2018-11-15 23:25:41 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 23:25:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 23:25:41 [DEBUG   ] spawn_process: at 2018-11-15 23:25:41 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 23:25:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 23:25:41 [DEBUG   ] spawn_process: at 2018-11-15 23:25:41 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 23:25:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 23:25:41 [DEBUG   ] spawn_process: at 2018-11-15 23:25:41 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 23:25:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 23:25:41 [DEBUG   ] spawn_process: at 2018-11-15 23:25:41 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 23:25:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 23:25:41 [DEBUG   ] spawn_process: at 2018-11-15 23:25:41 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 23:25:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 23:25:41 [DEBUG   ] spawn_process: at 2018-11-15 23:25:41 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 23:25:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 23:25:41 [DEBUG   ] spawn_process: at 2018-11-15 23:25:41 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 23:25:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 23:25:41 [DEBUG   ] spawn_process: at 2018-11-15 23:25:41 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 23:25:41 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 23:25:41 [DEBUG   ] spawn_process: at 2018-11-15 23:25:41 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 23:25:45 [DEBUG   ] Got command RPT from MCS: ref #520161
2018-11-15 23:25:45 [DEBUG   ] summary = ERROR
2018-11-15 23:25:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520161  13 58437 84345229 A  ERRORERROR'
2018-11-15 23:25:45 [DEBUG   ] Got command RPT from MCS: ref #520162
2018-11-15 23:25:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 23:25:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520162  77 58437 84345230 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 23:25:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 23:25:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-11-15 23:25:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 23:25:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 23:25:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:25:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:25:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:25:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:25:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 23:25:58 [DEBUG   ] Finished updating board flags in 1.198 seconds
2018-11-15 23:26:14 [DEBUG   ] Got command BAM from MCS: ref #520178
2018-11-15 23:26:14 [INFO    ] Finished processing BAM request
2018-11-15 23:26:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:26:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520178   8 58437 84374029 A  ERROR'
2018-11-15 23:26:14 [DEBUG   ] Got command BAM from MCS: ref #520179
2018-11-15 23:26:14 [INFO    ] Finished processing BAM request
2018-11-15 23:26:14 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:26:14 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520179   8 58437 84374033 A  ERROR'
2018-11-15 23:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 23:26:14 [DEBUG   ] spawn_process: at 2018-11-15 23:26:14 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 23:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 23:26:14 [DEBUG   ] spawn_process: at 2018-11-15 23:26:14 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 23:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 23:26:14 [DEBUG   ] spawn_process: at 2018-11-15 23:26:14 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 23:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 23:26:14 [DEBUG   ] spawn_process: at 2018-11-15 23:26:14 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 23:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 23:26:14 [DEBUG   ] spawn_process: at 2018-11-15 23:26:14 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 23:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 23:26:14 [DEBUG   ] spawn_process: at 2018-11-15 23:26:14 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 23:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 23:26:14 [DEBUG   ] spawn_process: at 2018-11-15 23:26:14 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 23:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 23:26:14 [DEBUG   ] spawn_process: at 2018-11-15 23:26:14 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 23:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 23:26:14 [DEBUG   ] spawn_process: at 2018-11-15 23:26:14 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 23:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 23:26:14 [DEBUG   ] spawn_process: at 2018-11-15 23:26:14 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 23:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 23:26:14 [DEBUG   ] spawn_process: at 2018-11-15 23:26:14 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 23:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 23:26:14 [DEBUG   ] spawn_process: at 2018-11-15 23:26:14 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 23:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 23:26:14 [DEBUG   ] spawn_process: at 2018-11-15 23:26:14 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 23:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 23:26:14 [DEBUG   ] spawn_process: at 2018-11-15 23:26:14 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 23:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 23:26:14 [DEBUG   ] spawn_process: at 2018-11-15 23:26:14 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 23:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 23:26:14 [DEBUG   ] spawn_process: at 2018-11-15 23:26:14 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 23:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 23:26:14 [DEBUG   ] spawn_process: at 2018-11-15 23:26:14 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 23:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 23:26:14 [DEBUG   ] spawn_process: at 2018-11-15 23:26:14 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 23:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 23:26:14 [DEBUG   ] spawn_process: at 2018-11-15 23:26:14 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 23:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 23:26:14 [DEBUG   ] spawn_process: at 2018-11-15 23:26:14 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 23:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 23:26:14 [DEBUG   ] spawn_process: at 2018-11-15 23:26:14 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 23:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 23:26:14 [DEBUG   ] spawn_process: at 2018-11-15 23:26:14 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 23:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 23:26:14 [DEBUG   ] spawn_process: at 2018-11-15 23:26:14 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 23:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 23:26:14 [DEBUG   ] spawn_process: at 2018-11-15 23:26:14 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 23:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 23:26:14 [DEBUG   ] spawn_process: at 2018-11-15 23:26:14 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 23:26:14 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 23:26:14 [DEBUG   ] spawn_process: at 2018-11-15 23:26:14 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 23:26:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 23:26:36 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-15 23:26:47 [DEBUG   ] Got command BAM from MCS: ref #520185
2018-11-15 23:26:47 [INFO    ] Finished processing BAM request
2018-11-15 23:26:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:26:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520185   8 58437 84407025 A  ERROR'
2018-11-15 23:26:47 [DEBUG   ] Got command BAM from MCS: ref #520184
2018-11-15 23:26:47 [INFO    ] Finished processing BAM request
2018-11-15 23:26:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:26:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520184   8 58437 84407029 A  ERROR'
2018-11-15 23:26:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 23:26:47 [DEBUG   ] spawn_process: at 2018-11-15 23:26:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 23:26:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 23:26:47 [DEBUG   ] spawn_process: at 2018-11-15 23:26:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 23:26:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 23:26:47 [DEBUG   ] spawn_process: at 2018-11-15 23:26:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 23:26:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 23:26:47 [DEBUG   ] spawn_process: at 2018-11-15 23:26:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 23:26:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 23:26:47 [DEBUG   ] spawn_process: at 2018-11-15 23:26:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 23:26:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 23:26:47 [DEBUG   ] spawn_process: at 2018-11-15 23:26:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 23:26:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 23:26:47 [DEBUG   ] spawn_process: at 2018-11-15 23:26:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 23:26:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 23:26:47 [DEBUG   ] spawn_process: at 2018-11-15 23:26:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 23:26:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 23:26:47 [DEBUG   ] spawn_process: at 2018-11-15 23:26:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 23:26:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 23:26:47 [DEBUG   ] spawn_process: at 2018-11-15 23:26:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 23:26:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 23:26:47 [DEBUG   ] spawn_process: at 2018-11-15 23:26:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 23:26:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 23:26:47 [DEBUG   ] spawn_process: at 2018-11-15 23:26:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 23:26:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 23:26:47 [DEBUG   ] spawn_process: at 2018-11-15 23:26:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 23:26:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 23:26:47 [DEBUG   ] spawn_process: at 2018-11-15 23:26:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 23:26:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 23:26:47 [DEBUG   ] spawn_process: at 2018-11-15 23:26:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 23:26:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 23:26:47 [DEBUG   ] spawn_process: at 2018-11-15 23:26:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 23:26:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 23:26:47 [DEBUG   ] spawn_process: at 2018-11-15 23:26:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 23:26:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 23:26:47 [DEBUG   ] spawn_process: at 2018-11-15 23:26:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 23:26:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 23:26:47 [DEBUG   ] spawn_process: at 2018-11-15 23:26:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 23:26:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 23:26:47 [DEBUG   ] spawn_process: at 2018-11-15 23:26:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 23:26:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 23:26:47 [DEBUG   ] spawn_process: at 2018-11-15 23:26:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 23:26:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 23:26:47 [DEBUG   ] spawn_process: at 2018-11-15 23:26:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 23:26:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 23:26:47 [DEBUG   ] spawn_process: at 2018-11-15 23:26:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 23:26:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 23:26:47 [DEBUG   ] spawn_process: at 2018-11-15 23:26:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 23:26:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 23:26:47 [DEBUG   ] spawn_process: at 2018-11-15 23:26:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 23:26:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 23:26:47 [DEBUG   ] spawn_process: at 2018-11-15 23:26:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 23:26:56 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-15 23:26:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 23:26:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2018-11-15 23:26:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 23:26:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-15 23:26:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-15 23:26:58 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 23:26:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 23:26:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:26:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:26:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:26:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:26:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 23:26:58 [DEBUG   ] Finished updating board flags in 1.004 seconds
2018-11-15 23:27:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 23:27:20 [DEBUG   ] Got command BAM from MCS: ref #520187
2018-11-15 23:27:20 [INFO    ] Finished processing BAM request
2018-11-15 23:27:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:27:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520187   8 58437 84440033 A  ERROR'
2018-11-15 23:27:20 [DEBUG   ] Got command BAM from MCS: ref #520186
2018-11-15 23:27:20 [INFO    ] Finished processing BAM request
2018-11-15 23:27:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:27:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520186   8 58437 84440037 A  ERROR'
2018-11-15 23:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 23:27:20 [DEBUG   ] spawn_process: at 2018-11-15 23:27:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 23:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 23:27:20 [DEBUG   ] spawn_process: at 2018-11-15 23:27:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 23:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 23:27:20 [DEBUG   ] spawn_process: at 2018-11-15 23:27:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 23:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 23:27:20 [DEBUG   ] spawn_process: at 2018-11-15 23:27:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 23:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 23:27:20 [DEBUG   ] spawn_process: at 2018-11-15 23:27:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 23:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 23:27:20 [DEBUG   ] spawn_process: at 2018-11-15 23:27:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 23:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 23:27:20 [DEBUG   ] spawn_process: at 2018-11-15 23:27:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 23:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 23:27:20 [DEBUG   ] spawn_process: at 2018-11-15 23:27:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 23:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 23:27:20 [DEBUG   ] spawn_process: at 2018-11-15 23:27:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 23:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 23:27:20 [DEBUG   ] spawn_process: at 2018-11-15 23:27:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 23:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 23:27:20 [DEBUG   ] spawn_process: at 2018-11-15 23:27:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 23:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 23:27:20 [DEBUG   ] spawn_process: at 2018-11-15 23:27:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 23:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 23:27:20 [DEBUG   ] spawn_process: at 2018-11-15 23:27:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 23:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 23:27:20 [DEBUG   ] spawn_process: at 2018-11-15 23:27:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 23:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 23:27:20 [DEBUG   ] spawn_process: at 2018-11-15 23:27:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 23:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 23:27:20 [DEBUG   ] spawn_process: at 2018-11-15 23:27:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 23:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 23:27:20 [DEBUG   ] spawn_process: at 2018-11-15 23:27:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 23:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 23:27:20 [DEBUG   ] spawn_process: at 2018-11-15 23:27:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 23:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 23:27:20 [DEBUG   ] spawn_process: at 2018-11-15 23:27:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 23:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 23:27:20 [DEBUG   ] spawn_process: at 2018-11-15 23:27:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 23:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 23:27:20 [DEBUG   ] spawn_process: at 2018-11-15 23:27:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 23:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 23:27:20 [DEBUG   ] spawn_process: at 2018-11-15 23:27:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 23:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 23:27:20 [DEBUG   ] spawn_process: at 2018-11-15 23:27:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 23:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 23:27:20 [DEBUG   ] spawn_process: at 2018-11-15 23:27:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 23:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 23:27:20 [DEBUG   ] spawn_process: at 2018-11-15 23:27:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 23:27:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 23:27:20 [DEBUG   ] spawn_process: at 2018-11-15 23:27:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 23:27:36 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-15 23:27:53 [DEBUG   ] Got command BAM from MCS: ref #520189
2018-11-15 23:27:53 [INFO    ] Finished processing BAM request
2018-11-15 23:27:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:27:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520189   8 58437 84473029 A  ERROR'
2018-11-15 23:27:53 [DEBUG   ] Got command BAM from MCS: ref #520188
2018-11-15 23:27:53 [INFO    ] Finished processing BAM request
2018-11-15 23:27:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:27:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520188   8 58437 84473033 A  ERROR'
2018-11-15 23:27:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 23:27:53 [DEBUG   ] spawn_process: at 2018-11-15 23:27:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 23:27:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 23:27:53 [DEBUG   ] spawn_process: at 2018-11-15 23:27:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 23:27:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 23:27:53 [DEBUG   ] spawn_process: at 2018-11-15 23:27:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 23:27:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 23:27:53 [DEBUG   ] spawn_process: at 2018-11-15 23:27:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 23:27:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 23:27:53 [DEBUG   ] spawn_process: at 2018-11-15 23:27:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 23:27:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 23:27:53 [DEBUG   ] spawn_process: at 2018-11-15 23:27:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 23:27:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 23:27:53 [DEBUG   ] spawn_process: at 2018-11-15 23:27:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 23:27:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 23:27:53 [DEBUG   ] spawn_process: at 2018-11-15 23:27:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 23:27:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 23:27:53 [DEBUG   ] spawn_process: at 2018-11-15 23:27:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 23:27:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 23:27:53 [DEBUG   ] spawn_process: at 2018-11-15 23:27:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 23:27:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 23:27:53 [DEBUG   ] spawn_process: at 2018-11-15 23:27:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 23:27:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 23:27:53 [DEBUG   ] spawn_process: at 2018-11-15 23:27:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 23:27:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 23:27:53 [DEBUG   ] spawn_process: at 2018-11-15 23:27:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 23:27:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 23:27:53 [DEBUG   ] spawn_process: at 2018-11-15 23:27:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 23:27:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 23:27:53 [DEBUG   ] spawn_process: at 2018-11-15 23:27:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 23:27:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 23:27:53 [DEBUG   ] spawn_process: at 2018-11-15 23:27:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 23:27:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 23:27:53 [DEBUG   ] spawn_process: at 2018-11-15 23:27:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 23:27:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 23:27:53 [DEBUG   ] spawn_process: at 2018-11-15 23:27:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 23:27:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 23:27:53 [DEBUG   ] spawn_process: at 2018-11-15 23:27:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 23:27:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 23:27:53 [DEBUG   ] spawn_process: at 2018-11-15 23:27:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 23:27:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 23:27:53 [DEBUG   ] spawn_process: at 2018-11-15 23:27:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 23:27:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 23:27:53 [DEBUG   ] spawn_process: at 2018-11-15 23:27:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 23:27:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 23:27:53 [DEBUG   ] spawn_process: at 2018-11-15 23:27:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 23:27:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 23:27:53 [DEBUG   ] spawn_process: at 2018-11-15 23:27:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 23:27:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 23:27:53 [DEBUG   ] spawn_process: at 2018-11-15 23:27:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 23:27:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 23:27:53 [DEBUG   ] spawn_process: at 2018-11-15 23:27:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 23:27:56 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-15 23:27:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-11-15 23:27:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-11-15 23:27:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-15 23:27:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 23:27:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 23:27:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 23:27:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 23:27:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 23:27:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:27:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:27:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:27:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:27:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 23:27:58 [DEBUG   ] Finished updating board flags in 0.991 seconds
2018-11-15 23:28:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 23:28:26 [DEBUG   ] Got command BAM from MCS: ref #520193
2018-11-15 23:28:26 [INFO    ] Finished processing BAM request
2018-11-15 23:28:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:28:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520193   8 58437 84506029 A  ERROR'
2018-11-15 23:28:26 [DEBUG   ] Got command BAM from MCS: ref #520192
2018-11-15 23:28:26 [INFO    ] Finished processing BAM request
2018-11-15 23:28:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:28:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520192   8 58437 84506033 A  ERROR'
2018-11-15 23:28:26 [DEBUG   ] Got command RPT from MCS: ref #520194
2018-11-15 23:28:26 [DEBUG   ] summary = ERROR
2018-11-15 23:28:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520194  13 58437 84506717 A  ERRORERROR'
2018-11-15 23:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 23:28:26 [DEBUG   ] spawn_process: at 2018-11-15 23:28:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 23:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 23:28:26 [DEBUG   ] spawn_process: at 2018-11-15 23:28:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 23:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 23:28:26 [DEBUG   ] spawn_process: at 2018-11-15 23:28:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 23:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 23:28:26 [DEBUG   ] spawn_process: at 2018-11-15 23:28:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 23:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 23:28:26 [DEBUG   ] spawn_process: at 2018-11-15 23:28:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 23:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 23:28:26 [DEBUG   ] spawn_process: at 2018-11-15 23:28:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 23:28:26 [DEBUG   ] Got command RPT from MCS: ref #520195
2018-11-15 23:28:26 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 23:28:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520195  77 58437 84506911 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 23:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 23:28:26 [DEBUG   ] spawn_process: at 2018-11-15 23:28:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 23:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 23:28:26 [DEBUG   ] spawn_process: at 2018-11-15 23:28:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 23:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 23:28:26 [DEBUG   ] spawn_process: at 2018-11-15 23:28:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 23:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 23:28:26 [DEBUG   ] spawn_process: at 2018-11-15 23:28:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 23:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 23:28:26 [DEBUG   ] spawn_process: at 2018-11-15 23:28:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 23:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 23:28:26 [DEBUG   ] spawn_process: at 2018-11-15 23:28:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 23:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 23:28:26 [DEBUG   ] spawn_process: at 2018-11-15 23:28:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 23:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 23:28:26 [DEBUG   ] spawn_process: at 2018-11-15 23:28:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 23:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 23:28:26 [DEBUG   ] spawn_process: at 2018-11-15 23:28:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 23:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 23:28:26 [DEBUG   ] spawn_process: at 2018-11-15 23:28:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 23:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 23:28:26 [DEBUG   ] spawn_process: at 2018-11-15 23:28:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 23:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 23:28:26 [DEBUG   ] spawn_process: at 2018-11-15 23:28:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 23:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 23:28:26 [DEBUG   ] spawn_process: at 2018-11-15 23:28:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 23:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 23:28:26 [DEBUG   ] spawn_process: at 2018-11-15 23:28:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 23:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 23:28:26 [DEBUG   ] spawn_process: at 2018-11-15 23:28:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 23:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 23:28:26 [DEBUG   ] spawn_process: at 2018-11-15 23:28:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 23:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 23:28:26 [DEBUG   ] spawn_process: at 2018-11-15 23:28:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 23:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 23:28:26 [DEBUG   ] spawn_process: at 2018-11-15 23:28:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 23:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 23:28:26 [DEBUG   ] spawn_process: at 2018-11-15 23:28:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 23:28:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 23:28:26 [DEBUG   ] spawn_process: at 2018-11-15 23:28:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 23:28:27 [DEBUG   ] Got command RPT from MCS: ref #520196
2018-11-15 23:28:27 [DEBUG   ] summary = ERROR
2018-11-15 23:28:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520196  13 58437 84507113 A  ERRORERROR'
2018-11-15 23:28:27 [DEBUG   ] Got command RPT from MCS: ref #520198
2018-11-15 23:28:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 23:28:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520198  77 58437 84507317 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 23:28:27 [DEBUG   ] Got command RPT from MCS: ref #520199
2018-11-15 23:28:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 23:28:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520199  12 58437 84507521 A  ERRORB£ff'
2018-11-15 23:28:36 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-15 23:28:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 23:28:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 23:28:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 23:28:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:28:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:28:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:28:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:28:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 23:28:58 [DEBUG   ] Finished updating board flags in 1.279 seconds
2018-11-15 23:28:59 [DEBUG   ] Got command BAM from MCS: ref #520205
2018-11-15 23:28:59 [INFO    ] Finished processing BAM request
2018-11-15 23:28:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:28:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520205   8 58437 84539029 A  ERROR'
2018-11-15 23:28:59 [DEBUG   ] Got command BAM from MCS: ref #520204
2018-11-15 23:28:59 [INFO    ] Finished processing BAM request
2018-11-15 23:28:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:28:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520204   8 58437 84539033 A  ERROR'
2018-11-15 23:28:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 23:28:59 [DEBUG   ] spawn_process: at 2018-11-15 23:28:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 23:28:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 23:28:59 [DEBUG   ] spawn_process: at 2018-11-15 23:28:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 23:28:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 23:28:59 [DEBUG   ] spawn_process: at 2018-11-15 23:28:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 23:28:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 23:28:59 [DEBUG   ] spawn_process: at 2018-11-15 23:28:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 23:28:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 23:28:59 [DEBUG   ] spawn_process: at 2018-11-15 23:28:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 23:28:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 23:28:59 [DEBUG   ] spawn_process: at 2018-11-15 23:28:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 23:28:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 23:28:59 [DEBUG   ] spawn_process: at 2018-11-15 23:28:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 23:28:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 23:28:59 [DEBUG   ] spawn_process: at 2018-11-15 23:28:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 23:28:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 23:28:59 [DEBUG   ] spawn_process: at 2018-11-15 23:28:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 23:28:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 23:28:59 [DEBUG   ] spawn_process: at 2018-11-15 23:28:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 23:28:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 23:28:59 [DEBUG   ] spawn_process: at 2018-11-15 23:28:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 23:28:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 23:28:59 [DEBUG   ] spawn_process: at 2018-11-15 23:28:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 23:28:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 23:28:59 [DEBUG   ] spawn_process: at 2018-11-15 23:28:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 23:28:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 23:28:59 [DEBUG   ] spawn_process: at 2018-11-15 23:28:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 23:28:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 23:28:59 [DEBUG   ] spawn_process: at 2018-11-15 23:28:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 23:28:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 23:28:59 [DEBUG   ] spawn_process: at 2018-11-15 23:28:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 23:28:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 23:28:59 [DEBUG   ] spawn_process: at 2018-11-15 23:28:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 23:28:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 23:28:59 [DEBUG   ] spawn_process: at 2018-11-15 23:28:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 23:28:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 23:28:59 [DEBUG   ] spawn_process: at 2018-11-15 23:28:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 23:28:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 23:28:59 [DEBUG   ] spawn_process: at 2018-11-15 23:28:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 23:28:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 23:28:59 [DEBUG   ] spawn_process: at 2018-11-15 23:28:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 23:28:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 23:28:59 [DEBUG   ] spawn_process: at 2018-11-15 23:28:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 23:28:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 23:28:59 [DEBUG   ] spawn_process: at 2018-11-15 23:28:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 23:28:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 23:28:59 [DEBUG   ] spawn_process: at 2018-11-15 23:28:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 23:28:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 23:28:59 [DEBUG   ] spawn_process: at 2018-11-15 23:28:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 23:28:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 23:28:59 [DEBUG   ] spawn_process: at 2018-11-15 23:28:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 23:29:16 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-15 23:29:32 [DEBUG   ] Got command BAM from MCS: ref #520208
2018-11-15 23:29:32 [INFO    ] Finished processing BAM request
2018-11-15 23:29:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:29:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520208   8 58437 84572033 A  ERROR'
2018-11-15 23:29:32 [DEBUG   ] Got command BAM from MCS: ref #520207
2018-11-15 23:29:32 [INFO    ] Finished processing BAM request
2018-11-15 23:29:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:29:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520207   8 58437 84572037 A  ERROR'
2018-11-15 23:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 23:29:32 [DEBUG   ] spawn_process: at 2018-11-15 23:29:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 23:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 23:29:32 [DEBUG   ] spawn_process: at 2018-11-15 23:29:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 23:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 23:29:32 [DEBUG   ] spawn_process: at 2018-11-15 23:29:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 23:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 23:29:32 [DEBUG   ] spawn_process: at 2018-11-15 23:29:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 23:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 23:29:32 [DEBUG   ] spawn_process: at 2018-11-15 23:29:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 23:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 23:29:32 [DEBUG   ] spawn_process: at 2018-11-15 23:29:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 23:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 23:29:32 [DEBUG   ] spawn_process: at 2018-11-15 23:29:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 23:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 23:29:32 [DEBUG   ] spawn_process: at 2018-11-15 23:29:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 23:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 23:29:32 [DEBUG   ] spawn_process: at 2018-11-15 23:29:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 23:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 23:29:32 [DEBUG   ] spawn_process: at 2018-11-15 23:29:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 23:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 23:29:32 [DEBUG   ] spawn_process: at 2018-11-15 23:29:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 23:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 23:29:32 [DEBUG   ] spawn_process: at 2018-11-15 23:29:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 23:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 23:29:32 [DEBUG   ] spawn_process: at 2018-11-15 23:29:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 23:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 23:29:32 [DEBUG   ] spawn_process: at 2018-11-15 23:29:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 23:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 23:29:32 [DEBUG   ] spawn_process: at 2018-11-15 23:29:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 23:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 23:29:32 [DEBUG   ] spawn_process: at 2018-11-15 23:29:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 23:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 23:29:32 [DEBUG   ] spawn_process: at 2018-11-15 23:29:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 23:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 23:29:32 [DEBUG   ] spawn_process: at 2018-11-15 23:29:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 23:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 23:29:32 [DEBUG   ] spawn_process: at 2018-11-15 23:29:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 23:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 23:29:32 [DEBUG   ] spawn_process: at 2018-11-15 23:29:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 23:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 23:29:32 [DEBUG   ] spawn_process: at 2018-11-15 23:29:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 23:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 23:29:32 [DEBUG   ] spawn_process: at 2018-11-15 23:29:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 23:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 23:29:32 [DEBUG   ] spawn_process: at 2018-11-15 23:29:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 23:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 23:29:32 [DEBUG   ] spawn_process: at 2018-11-15 23:29:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 23:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 23:29:32 [DEBUG   ] spawn_process: at 2018-11-15 23:29:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 23:29:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 23:29:32 [DEBUG   ] spawn_process: at 2018-11-15 23:29:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 23:29:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 23:29:56 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-15 23:29:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 23:29:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 23:29:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 23:29:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:29:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:29:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:29:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:29:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 23:29:58 [DEBUG   ] Finished updating board flags in 1.247 seconds
2018-11-15 23:30:04 [DEBUG   ] Got command BAM from MCS: ref #520213
2018-11-15 23:30:04 [INFO    ] Finished processing BAM request
2018-11-15 23:30:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:30:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520213   8 58437 84604033 A  ERROR'
2018-11-15 23:30:04 [DEBUG   ] Got command BAM from MCS: ref #520212
2018-11-15 23:30:04 [INFO    ] Finished processing BAM request
2018-11-15 23:30:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:30:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520212   8 58437 84604037 A  ERROR'
2018-11-15 23:30:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 23:30:04 [DEBUG   ] spawn_process: at 2018-11-15 23:30:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 23:30:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 23:30:04 [DEBUG   ] spawn_process: at 2018-11-15 23:30:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 23:30:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 23:30:04 [DEBUG   ] spawn_process: at 2018-11-15 23:30:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 23:30:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 23:30:04 [DEBUG   ] spawn_process: at 2018-11-15 23:30:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 23:30:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 23:30:04 [DEBUG   ] spawn_process: at 2018-11-15 23:30:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 23:30:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 23:30:04 [DEBUG   ] spawn_process: at 2018-11-15 23:30:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 23:30:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 23:30:04 [DEBUG   ] spawn_process: at 2018-11-15 23:30:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 23:30:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 23:30:04 [DEBUG   ] spawn_process: at 2018-11-15 23:30:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 23:30:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 23:30:04 [DEBUG   ] spawn_process: at 2018-11-15 23:30:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 23:30:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 23:30:04 [DEBUG   ] spawn_process: at 2018-11-15 23:30:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 23:30:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 23:30:04 [DEBUG   ] spawn_process: at 2018-11-15 23:30:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 23:30:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 23:30:04 [DEBUG   ] spawn_process: at 2018-11-15 23:30:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 23:30:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 23:30:04 [DEBUG   ] spawn_process: at 2018-11-15 23:30:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 23:30:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 23:30:04 [DEBUG   ] spawn_process: at 2018-11-15 23:30:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 23:30:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 23:30:04 [DEBUG   ] spawn_process: at 2018-11-15 23:30:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 23:30:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 23:30:04 [DEBUG   ] spawn_process: at 2018-11-15 23:30:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 23:30:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 23:30:04 [DEBUG   ] spawn_process: at 2018-11-15 23:30:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 23:30:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 23:30:04 [DEBUG   ] spawn_process: at 2018-11-15 23:30:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 23:30:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 23:30:04 [DEBUG   ] spawn_process: at 2018-11-15 23:30:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 23:30:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 23:30:04 [DEBUG   ] spawn_process: at 2018-11-15 23:30:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 23:30:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 23:30:04 [DEBUG   ] spawn_process: at 2018-11-15 23:30:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 23:30:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 23:30:04 [DEBUG   ] spawn_process: at 2018-11-15 23:30:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 23:30:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 23:30:04 [DEBUG   ] spawn_process: at 2018-11-15 23:30:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 23:30:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 23:30:04 [DEBUG   ] spawn_process: at 2018-11-15 23:30:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 23:30:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 23:30:04 [DEBUG   ] spawn_process: at 2018-11-15 23:30:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 23:30:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 23:30:04 [DEBUG   ] spawn_process: at 2018-11-15 23:30:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 23:30:16 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-15 23:30:36 [DEBUG   ] Got command BAM from MCS: ref #520215
2018-11-15 23:30:36 [INFO    ] Finished processing BAM request
2018-11-15 23:30:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:30:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520215   8 58437 84636025 A  ERROR'
2018-11-15 23:30:36 [DEBUG   ] Got command BAM from MCS: ref #520214
2018-11-15 23:30:36 [INFO    ] Finished processing BAM request
2018-11-15 23:30:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:30:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520214   8 58437 84636029 A  ERROR'
2018-11-15 23:30:36 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-11-15 23:30:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 23:30:36 [DEBUG   ] spawn_process: at 2018-11-15 23:30:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 23:30:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 23:30:37 [DEBUG   ] spawn_process: at 2018-11-15 23:30:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 23:30:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 23:30:37 [DEBUG   ] spawn_process: at 2018-11-15 23:30:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 23:30:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 23:30:37 [DEBUG   ] spawn_process: at 2018-11-15 23:30:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 23:30:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 23:30:37 [DEBUG   ] spawn_process: at 2018-11-15 23:30:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 23:30:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 23:30:37 [DEBUG   ] spawn_process: at 2018-11-15 23:30:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 23:30:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 23:30:37 [DEBUG   ] spawn_process: at 2018-11-15 23:30:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 23:30:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 23:30:37 [DEBUG   ] spawn_process: at 2018-11-15 23:30:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 23:30:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 23:30:37 [DEBUG   ] spawn_process: at 2018-11-15 23:30:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 23:30:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 23:30:37 [DEBUG   ] spawn_process: at 2018-11-15 23:30:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 23:30:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 23:30:37 [DEBUG   ] spawn_process: at 2018-11-15 23:30:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 23:30:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 23:30:37 [DEBUG   ] spawn_process: at 2018-11-15 23:30:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 23:30:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 23:30:37 [DEBUG   ] spawn_process: at 2018-11-15 23:30:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 23:30:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 23:30:37 [DEBUG   ] spawn_process: at 2018-11-15 23:30:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 23:30:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 23:30:37 [DEBUG   ] spawn_process: at 2018-11-15 23:30:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 23:30:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 23:30:37 [DEBUG   ] spawn_process: at 2018-11-15 23:30:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 23:30:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 23:30:37 [DEBUG   ] spawn_process: at 2018-11-15 23:30:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 23:30:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 23:30:37 [DEBUG   ] spawn_process: at 2018-11-15 23:30:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 23:30:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 23:30:37 [DEBUG   ] spawn_process: at 2018-11-15 23:30:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 23:30:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 23:30:37 [DEBUG   ] spawn_process: at 2018-11-15 23:30:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 23:30:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 23:30:37 [DEBUG   ] spawn_process: at 2018-11-15 23:30:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 23:30:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 23:30:37 [DEBUG   ] spawn_process: at 2018-11-15 23:30:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 23:30:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 23:30:37 [DEBUG   ] spawn_process: at 2018-11-15 23:30:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 23:30:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 23:30:37 [DEBUG   ] spawn_process: at 2018-11-15 23:30:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 23:30:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 23:30:37 [DEBUG   ] spawn_process: at 2018-11-15 23:30:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 23:30:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 23:30:37 [DEBUG   ] spawn_process: at 2018-11-15 23:30:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 23:30:45 [DEBUG   ] Got command RPT from MCS: ref #520216
2018-11-15 23:30:45 [DEBUG   ] summary = ERROR
2018-11-15 23:30:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520216  13 58437 84645237 A  ERRORERROR'
2018-11-15 23:30:45 [DEBUG   ] Got command RPT from MCS: ref #520217
2018-11-15 23:30:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 23:30:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520217  77 58437 84645238 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 23:30:56 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-15 23:30:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-11-15 23:30:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-11-15 23:30:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 23:30:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-15 23:30:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 23:30:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:30:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:30:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:30:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:30:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 23:30:58 [DEBUG   ] Finished updating board flags in 1.226 seconds
2018-11-15 23:31:08 [DEBUG   ] Got command BAM from MCS: ref #520234
2018-11-15 23:31:08 [INFO    ] Finished processing BAM request
2018-11-15 23:31:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:31:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520234   8 58437 84668029 A  ERROR'
2018-11-15 23:31:08 [DEBUG   ] Got command BAM from MCS: ref #520233
2018-11-15 23:31:08 [INFO    ] Finished processing BAM request
2018-11-15 23:31:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:31:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520233   8 58437 84668033 A  ERROR'
2018-11-15 23:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 23:31:08 [DEBUG   ] spawn_process: at 2018-11-15 23:31:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 23:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 23:31:08 [DEBUG   ] spawn_process: at 2018-11-15 23:31:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 23:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 23:31:08 [DEBUG   ] spawn_process: at 2018-11-15 23:31:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 23:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 23:31:08 [DEBUG   ] spawn_process: at 2018-11-15 23:31:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 23:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 23:31:08 [DEBUG   ] spawn_process: at 2018-11-15 23:31:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 23:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 23:31:08 [DEBUG   ] spawn_process: at 2018-11-15 23:31:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 23:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 23:31:08 [DEBUG   ] spawn_process: at 2018-11-15 23:31:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 23:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 23:31:08 [DEBUG   ] spawn_process: at 2018-11-15 23:31:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 23:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 23:31:08 [DEBUG   ] spawn_process: at 2018-11-15 23:31:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 23:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 23:31:08 [DEBUG   ] spawn_process: at 2018-11-15 23:31:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 23:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 23:31:08 [DEBUG   ] spawn_process: at 2018-11-15 23:31:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 23:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 23:31:08 [DEBUG   ] spawn_process: at 2018-11-15 23:31:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 23:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 23:31:08 [DEBUG   ] spawn_process: at 2018-11-15 23:31:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 23:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 23:31:08 [DEBUG   ] spawn_process: at 2018-11-15 23:31:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 23:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 23:31:08 [DEBUG   ] spawn_process: at 2018-11-15 23:31:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 23:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 23:31:08 [DEBUG   ] spawn_process: at 2018-11-15 23:31:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 23:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 23:31:08 [DEBUG   ] spawn_process: at 2018-11-15 23:31:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 23:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 23:31:08 [DEBUG   ] spawn_process: at 2018-11-15 23:31:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 23:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 23:31:08 [DEBUG   ] spawn_process: at 2018-11-15 23:31:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 23:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 23:31:08 [DEBUG   ] spawn_process: at 2018-11-15 23:31:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 23:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 23:31:08 [DEBUG   ] spawn_process: at 2018-11-15 23:31:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 23:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 23:31:08 [DEBUG   ] spawn_process: at 2018-11-15 23:31:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 23:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 23:31:08 [DEBUG   ] spawn_process: at 2018-11-15 23:31:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 23:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 23:31:08 [DEBUG   ] spawn_process: at 2018-11-15 23:31:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 23:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 23:31:08 [DEBUG   ] spawn_process: at 2018-11-15 23:31:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 23:31:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 23:31:08 [DEBUG   ] spawn_process: at 2018-11-15 23:31:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 23:31:16 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-15 23:31:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 23:31:40 [DEBUG   ] Got command BAM from MCS: ref #520235
2018-11-15 23:31:40 [INFO    ] Finished processing BAM request
2018-11-15 23:31:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:31:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520235   8 58437 84700033 A  ERROR'
2018-11-15 23:31:40 [DEBUG   ] Got command BAM from MCS: ref #520236
2018-11-15 23:31:40 [INFO    ] Finished processing BAM request
2018-11-15 23:31:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:31:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520236   8 58437 84700037 A  ERROR'
2018-11-15 23:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 23:31:40 [DEBUG   ] spawn_process: at 2018-11-15 23:31:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 23:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 23:31:40 [DEBUG   ] spawn_process: at 2018-11-15 23:31:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 23:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 23:31:40 [DEBUG   ] spawn_process: at 2018-11-15 23:31:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 23:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 23:31:40 [DEBUG   ] spawn_process: at 2018-11-15 23:31:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 23:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 23:31:40 [DEBUG   ] spawn_process: at 2018-11-15 23:31:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 23:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 23:31:40 [DEBUG   ] spawn_process: at 2018-11-15 23:31:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 23:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 23:31:40 [DEBUG   ] spawn_process: at 2018-11-15 23:31:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 23:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 23:31:40 [DEBUG   ] spawn_process: at 2018-11-15 23:31:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 23:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 23:31:40 [DEBUG   ] spawn_process: at 2018-11-15 23:31:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 23:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 23:31:40 [DEBUG   ] spawn_process: at 2018-11-15 23:31:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 23:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 23:31:40 [DEBUG   ] spawn_process: at 2018-11-15 23:31:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 23:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 23:31:40 [DEBUG   ] spawn_process: at 2018-11-15 23:31:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 23:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 23:31:40 [DEBUG   ] spawn_process: at 2018-11-15 23:31:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 23:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 23:31:40 [DEBUG   ] spawn_process: at 2018-11-15 23:31:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 23:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 23:31:40 [DEBUG   ] spawn_process: at 2018-11-15 23:31:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 23:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 23:31:40 [DEBUG   ] spawn_process: at 2018-11-15 23:31:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 23:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 23:31:40 [DEBUG   ] spawn_process: at 2018-11-15 23:31:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 23:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 23:31:40 [DEBUG   ] spawn_process: at 2018-11-15 23:31:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 23:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 23:31:40 [DEBUG   ] spawn_process: at 2018-11-15 23:31:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 23:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 23:31:40 [DEBUG   ] spawn_process: at 2018-11-15 23:31:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 23:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 23:31:40 [DEBUG   ] spawn_process: at 2018-11-15 23:31:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 23:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 23:31:40 [DEBUG   ] spawn_process: at 2018-11-15 23:31:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 23:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 23:31:40 [DEBUG   ] spawn_process: at 2018-11-15 23:31:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 23:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 23:31:40 [DEBUG   ] spawn_process: at 2018-11-15 23:31:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 23:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 23:31:40 [DEBUG   ] spawn_process: at 2018-11-15 23:31:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 23:31:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 23:31:40 [DEBUG   ] spawn_process: at 2018-11-15 23:31:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 23:31:56 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-15 23:31:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 23:31:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-15 23:31:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-11-15 23:31:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 23:31:58 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-15 23:31:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 23:31:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:31:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:31:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:31:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:31:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 23:31:58 [DEBUG   ] Finished updating board flags in 1.107 seconds
2018-11-15 23:32:12 [DEBUG   ] Got command BAM from MCS: ref #520237
2018-11-15 23:32:12 [INFO    ] Finished processing BAM request
2018-11-15 23:32:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:32:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520237   8 58437 84732029 A  ERROR'
2018-11-15 23:32:12 [DEBUG   ] Got command BAM from MCS: ref #520238
2018-11-15 23:32:12 [INFO    ] Finished processing BAM request
2018-11-15 23:32:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:32:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520238   8 58437 84732033 A  ERROR'
2018-11-15 23:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 23:32:12 [DEBUG   ] spawn_process: at 2018-11-15 23:32:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 23:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 23:32:12 [DEBUG   ] spawn_process: at 2018-11-15 23:32:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 23:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 23:32:12 [DEBUG   ] spawn_process: at 2018-11-15 23:32:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 23:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 23:32:12 [DEBUG   ] spawn_process: at 2018-11-15 23:32:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 23:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 23:32:12 [DEBUG   ] spawn_process: at 2018-11-15 23:32:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 23:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 23:32:12 [DEBUG   ] spawn_process: at 2018-11-15 23:32:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 23:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 23:32:12 [DEBUG   ] spawn_process: at 2018-11-15 23:32:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 23:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 23:32:12 [DEBUG   ] spawn_process: at 2018-11-15 23:32:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 23:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 23:32:12 [DEBUG   ] spawn_process: at 2018-11-15 23:32:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 23:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 23:32:12 [DEBUG   ] spawn_process: at 2018-11-15 23:32:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 23:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 23:32:12 [DEBUG   ] spawn_process: at 2018-11-15 23:32:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 23:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 23:32:12 [DEBUG   ] spawn_process: at 2018-11-15 23:32:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 23:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 23:32:12 [DEBUG   ] spawn_process: at 2018-11-15 23:32:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 23:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 23:32:12 [DEBUG   ] spawn_process: at 2018-11-15 23:32:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 23:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 23:32:12 [DEBUG   ] spawn_process: at 2018-11-15 23:32:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 23:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 23:32:12 [DEBUG   ] spawn_process: at 2018-11-15 23:32:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 23:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 23:32:12 [DEBUG   ] spawn_process: at 2018-11-15 23:32:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 23:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 23:32:12 [DEBUG   ] spawn_process: at 2018-11-15 23:32:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 23:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 23:32:12 [DEBUG   ] spawn_process: at 2018-11-15 23:32:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 23:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 23:32:12 [DEBUG   ] spawn_process: at 2018-11-15 23:32:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 23:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 23:32:12 [DEBUG   ] spawn_process: at 2018-11-15 23:32:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 23:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 23:32:12 [DEBUG   ] spawn_process: at 2018-11-15 23:32:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 23:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 23:32:12 [DEBUG   ] spawn_process: at 2018-11-15 23:32:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 23:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 23:32:12 [DEBUG   ] spawn_process: at 2018-11-15 23:32:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 23:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 23:32:12 [DEBUG   ] spawn_process: at 2018-11-15 23:32:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 23:32:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 23:32:12 [DEBUG   ] spawn_process: at 2018-11-15 23:32:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 23:32:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 23:32:36 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-15 23:32:44 [DEBUG   ] Got command BAM from MCS: ref #520244
2018-11-15 23:32:44 [INFO    ] Finished processing BAM request
2018-11-15 23:32:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:32:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520244   8 58437 84764033 A  ERROR'
2018-11-15 23:32:44 [DEBUG   ] Got command BAM from MCS: ref #520243
2018-11-15 23:32:44 [INFO    ] Finished processing BAM request
2018-11-15 23:32:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:32:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520243   8 58437 84764037 A  ERROR'
2018-11-15 23:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 23:32:44 [DEBUG   ] spawn_process: at 2018-11-15 23:32:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 23:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 23:32:44 [DEBUG   ] spawn_process: at 2018-11-15 23:32:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 23:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 23:32:44 [DEBUG   ] spawn_process: at 2018-11-15 23:32:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 23:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 23:32:44 [DEBUG   ] spawn_process: at 2018-11-15 23:32:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 23:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 23:32:44 [DEBUG   ] spawn_process: at 2018-11-15 23:32:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 23:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 23:32:44 [DEBUG   ] spawn_process: at 2018-11-15 23:32:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 23:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 23:32:44 [DEBUG   ] spawn_process: at 2018-11-15 23:32:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 23:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 23:32:44 [DEBUG   ] spawn_process: at 2018-11-15 23:32:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 23:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 23:32:44 [DEBUG   ] spawn_process: at 2018-11-15 23:32:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 23:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 23:32:44 [DEBUG   ] spawn_process: at 2018-11-15 23:32:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 23:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 23:32:44 [DEBUG   ] spawn_process: at 2018-11-15 23:32:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 23:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 23:32:44 [DEBUG   ] spawn_process: at 2018-11-15 23:32:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 23:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 23:32:44 [DEBUG   ] spawn_process: at 2018-11-15 23:32:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 23:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 23:32:44 [DEBUG   ] spawn_process: at 2018-11-15 23:32:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 23:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 23:32:44 [DEBUG   ] spawn_process: at 2018-11-15 23:32:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 23:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 23:32:44 [DEBUG   ] spawn_process: at 2018-11-15 23:32:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 23:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 23:32:44 [DEBUG   ] spawn_process: at 2018-11-15 23:32:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 23:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 23:32:44 [DEBUG   ] spawn_process: at 2018-11-15 23:32:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 23:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 23:32:44 [DEBUG   ] spawn_process: at 2018-11-15 23:32:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 23:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 23:32:44 [DEBUG   ] spawn_process: at 2018-11-15 23:32:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 23:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 23:32:44 [DEBUG   ] spawn_process: at 2018-11-15 23:32:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 23:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 23:32:44 [DEBUG   ] spawn_process: at 2018-11-15 23:32:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 23:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 23:32:44 [DEBUG   ] spawn_process: at 2018-11-15 23:32:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 23:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 23:32:44 [DEBUG   ] spawn_process: at 2018-11-15 23:32:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 23:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 23:32:44 [DEBUG   ] spawn_process: at 2018-11-15 23:32:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 23:32:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 23:32:44 [DEBUG   ] spawn_process: at 2018-11-15 23:32:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 23:32:56 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-15 23:32:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 23:32:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 23:32:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:32:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:32:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:32:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:32:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 23:32:58 [DEBUG   ] Finished updating board flags in 1.034 seconds
2018-11-15 23:33:16 [DEBUG   ] Got command BAM from MCS: ref #520246
2018-11-15 23:33:16 [INFO    ] Finished processing BAM request
2018-11-15 23:33:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:33:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520246   8 58437 84796029 A  ERROR'
2018-11-15 23:33:16 [DEBUG   ] Got command BAM from MCS: ref #520245
2018-11-15 23:33:16 [INFO    ] Finished processing BAM request
2018-11-15 23:33:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:33:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520245   8 58437 84796033 A  ERROR'
2018-11-15 23:33:16 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-15 23:33:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 23:33:17 [DEBUG   ] spawn_process: at 2018-11-15 23:33:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 23:33:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 23:33:17 [DEBUG   ] spawn_process: at 2018-11-15 23:33:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 23:33:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 23:33:17 [DEBUG   ] spawn_process: at 2018-11-15 23:33:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 23:33:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 23:33:17 [DEBUG   ] spawn_process: at 2018-11-15 23:33:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 23:33:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 23:33:17 [DEBUG   ] spawn_process: at 2018-11-15 23:33:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 23:33:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 23:33:17 [DEBUG   ] spawn_process: at 2018-11-15 23:33:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 23:33:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 23:33:17 [DEBUG   ] spawn_process: at 2018-11-15 23:33:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 23:33:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 23:33:17 [DEBUG   ] spawn_process: at 2018-11-15 23:33:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 23:33:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 23:33:17 [DEBUG   ] spawn_process: at 2018-11-15 23:33:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 23:33:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 23:33:17 [DEBUG   ] spawn_process: at 2018-11-15 23:33:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 23:33:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 23:33:17 [DEBUG   ] spawn_process: at 2018-11-15 23:33:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 23:33:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 23:33:17 [DEBUG   ] spawn_process: at 2018-11-15 23:33:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 23:33:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 23:33:17 [DEBUG   ] spawn_process: at 2018-11-15 23:33:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 23:33:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 23:33:17 [DEBUG   ] spawn_process: at 2018-11-15 23:33:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 23:33:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 23:33:17 [DEBUG   ] spawn_process: at 2018-11-15 23:33:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 23:33:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 23:33:17 [DEBUG   ] spawn_process: at 2018-11-15 23:33:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 23:33:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 23:33:17 [DEBUG   ] spawn_process: at 2018-11-15 23:33:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 23:33:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 23:33:17 [DEBUG   ] spawn_process: at 2018-11-15 23:33:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 23:33:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 23:33:17 [DEBUG   ] spawn_process: at 2018-11-15 23:33:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 23:33:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 23:33:17 [DEBUG   ] spawn_process: at 2018-11-15 23:33:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 23:33:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 23:33:17 [DEBUG   ] spawn_process: at 2018-11-15 23:33:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 23:33:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 23:33:17 [DEBUG   ] spawn_process: at 2018-11-15 23:33:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 23:33:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 23:33:17 [DEBUG   ] spawn_process: at 2018-11-15 23:33:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 23:33:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 23:33:17 [DEBUG   ] spawn_process: at 2018-11-15 23:33:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 23:33:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 23:33:17 [DEBUG   ] spawn_process: at 2018-11-15 23:33:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 23:33:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 23:33:17 [DEBUG   ] spawn_process: at 2018-11-15 23:33:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 23:33:26 [DEBUG   ] Got command RPT from MCS: ref #520247
2018-11-15 23:33:26 [DEBUG   ] summary = ERROR
2018-11-15 23:33:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520247  13 58437 84806797 A  ERRORERROR'
2018-11-15 23:33:27 [DEBUG   ] Got command RPT from MCS: ref #520248
2018-11-15 23:33:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 23:33:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520248  77 58437 84807001 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 23:33:27 [DEBUG   ] Got command RPT from MCS: ref #520249
2018-11-15 23:33:27 [DEBUG   ] summary = ERROR
2018-11-15 23:33:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520249  13 58437 84807205 A  ERRORERROR'
2018-11-15 23:33:27 [DEBUG   ] Got command RPT from MCS: ref #520250
2018-11-15 23:33:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 23:33:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520250  77 58437 84807397 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 23:33:27 [DEBUG   ] Got command RPT from MCS: ref #520251
2018-11-15 23:33:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 23:33:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520251  12 58437 84807601 A  ERRORB£ff'
2018-11-15 23:33:36 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-15 23:33:48 [DEBUG   ] Got command BAM from MCS: ref #520253
2018-11-15 23:33:48 [INFO    ] Finished processing BAM request
2018-11-15 23:33:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:33:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520253   8 58437 84828029 A  ERROR'
2018-11-15 23:33:48 [DEBUG   ] Got command BAM from MCS: ref #520252
2018-11-15 23:33:48 [INFO    ] Finished processing BAM request
2018-11-15 23:33:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:33:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520252   8 58437 84828033 A  ERROR'
2018-11-15 23:33:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 23:33:48 [DEBUG   ] spawn_process: at 2018-11-15 23:33:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 23:33:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 23:33:48 [DEBUG   ] spawn_process: at 2018-11-15 23:33:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 23:33:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 23:33:48 [DEBUG   ] spawn_process: at 2018-11-15 23:33:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 23:33:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 23:33:48 [DEBUG   ] spawn_process: at 2018-11-15 23:33:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 23:33:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 23:33:48 [DEBUG   ] spawn_process: at 2018-11-15 23:33:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 23:33:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 23:33:48 [DEBUG   ] spawn_process: at 2018-11-15 23:33:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 23:33:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 23:33:48 [DEBUG   ] spawn_process: at 2018-11-15 23:33:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 23:33:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 23:33:48 [DEBUG   ] spawn_process: at 2018-11-15 23:33:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 23:33:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 23:33:48 [DEBUG   ] spawn_process: at 2018-11-15 23:33:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 23:33:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 23:33:48 [DEBUG   ] spawn_process: at 2018-11-15 23:33:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 23:33:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 23:33:48 [DEBUG   ] spawn_process: at 2018-11-15 23:33:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 23:33:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 23:33:48 [DEBUG   ] spawn_process: at 2018-11-15 23:33:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 23:33:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 23:33:48 [DEBUG   ] spawn_process: at 2018-11-15 23:33:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 23:33:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 23:33:48 [DEBUG   ] spawn_process: at 2018-11-15 23:33:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 23:33:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 23:33:48 [DEBUG   ] spawn_process: at 2018-11-15 23:33:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 23:33:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 23:33:48 [DEBUG   ] spawn_process: at 2018-11-15 23:33:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 23:33:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 23:33:48 [DEBUG   ] spawn_process: at 2018-11-15 23:33:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 23:33:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 23:33:48 [DEBUG   ] spawn_process: at 2018-11-15 23:33:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 23:33:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 23:33:48 [DEBUG   ] spawn_process: at 2018-11-15 23:33:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 23:33:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 23:33:48 [DEBUG   ] spawn_process: at 2018-11-15 23:33:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 23:33:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 23:33:48 [DEBUG   ] spawn_process: at 2018-11-15 23:33:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 23:33:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 23:33:48 [DEBUG   ] spawn_process: at 2018-11-15 23:33:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 23:33:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 23:33:48 [DEBUG   ] spawn_process: at 2018-11-15 23:33:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 23:33:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 23:33:48 [DEBUG   ] spawn_process: at 2018-11-15 23:33:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 23:33:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 23:33:48 [DEBUG   ] spawn_process: at 2018-11-15 23:33:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 23:33:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 23:33:48 [DEBUG   ] spawn_process: at 2018-11-15 23:33:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 23:33:56 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-15 23:33:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 23:33:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 23:33:58 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-15 23:33:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 23:33:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:33:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:33:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:33:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:33:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 23:33:58 [DEBUG   ] Finished updating board flags in 1.008 seconds
2018-11-15 23:34:16 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-15 23:34:20 [DEBUG   ] Got command BAM from MCS: ref #520254
2018-11-15 23:34:20 [INFO    ] Finished processing BAM request
2018-11-15 23:34:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:34:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520254   8 58437 84860033 A  ERROR'
2018-11-15 23:34:20 [DEBUG   ] Got command BAM from MCS: ref #520255
2018-11-15 23:34:20 [INFO    ] Finished processing BAM request
2018-11-15 23:34:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:34:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520255   8 58437 84860037 A  ERROR'
2018-11-15 23:34:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 23:34:20 [DEBUG   ] spawn_process: at 2018-11-15 23:34:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 23:34:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 23:34:20 [DEBUG   ] spawn_process: at 2018-11-15 23:34:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 23:34:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 23:34:20 [DEBUG   ] spawn_process: at 2018-11-15 23:34:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 23:34:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 23:34:20 [DEBUG   ] spawn_process: at 2018-11-15 23:34:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 23:34:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 23:34:20 [DEBUG   ] spawn_process: at 2018-11-15 23:34:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 23:34:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 23:34:20 [DEBUG   ] spawn_process: at 2018-11-15 23:34:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 23:34:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 23:34:20 [DEBUG   ] spawn_process: at 2018-11-15 23:34:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 23:34:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 23:34:20 [DEBUG   ] spawn_process: at 2018-11-15 23:34:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 23:34:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 23:34:20 [DEBUG   ] spawn_process: at 2018-11-15 23:34:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 23:34:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 23:34:20 [DEBUG   ] spawn_process: at 2018-11-15 23:34:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 23:34:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 23:34:20 [DEBUG   ] spawn_process: at 2018-11-15 23:34:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 23:34:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 23:34:20 [DEBUG   ] spawn_process: at 2018-11-15 23:34:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 23:34:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 23:34:20 [DEBUG   ] spawn_process: at 2018-11-15 23:34:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 23:34:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 23:34:20 [DEBUG   ] spawn_process: at 2018-11-15 23:34:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 23:34:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 23:34:20 [DEBUG   ] spawn_process: at 2018-11-15 23:34:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 23:34:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 23:34:20 [DEBUG   ] spawn_process: at 2018-11-15 23:34:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 23:34:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 23:34:20 [DEBUG   ] spawn_process: at 2018-11-15 23:34:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 23:34:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 23:34:20 [DEBUG   ] spawn_process: at 2018-11-15 23:34:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 23:34:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 23:34:20 [DEBUG   ] spawn_process: at 2018-11-15 23:34:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 23:34:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 23:34:20 [DEBUG   ] spawn_process: at 2018-11-15 23:34:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 23:34:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 23:34:20 [DEBUG   ] spawn_process: at 2018-11-15 23:34:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 23:34:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 23:34:20 [DEBUG   ] spawn_process: at 2018-11-15 23:34:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 23:34:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 23:34:20 [DEBUG   ] spawn_process: at 2018-11-15 23:34:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 23:34:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 23:34:20 [DEBUG   ] spawn_process: at 2018-11-15 23:34:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 23:34:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 23:34:20 [DEBUG   ] spawn_process: at 2018-11-15 23:34:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 23:34:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 23:34:20 [DEBUG   ] spawn_process: at 2018-11-15 23:34:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 23:34:36 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-15 23:34:52 [DEBUG   ] Got command BAM from MCS: ref #520257
2018-11-15 23:34:52 [INFO    ] Finished processing BAM request
2018-11-15 23:34:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:34:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520257   8 58437 84892029 A  ERROR'
2018-11-15 23:34:52 [DEBUG   ] Got command BAM from MCS: ref #520256
2018-11-15 23:34:52 [INFO    ] Finished processing BAM request
2018-11-15 23:34:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:34:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520256   8 58437 84892033 A  ERROR'
2018-11-15 23:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 23:34:52 [DEBUG   ] spawn_process: at 2018-11-15 23:34:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 23:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 23:34:52 [DEBUG   ] spawn_process: at 2018-11-15 23:34:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 23:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 23:34:52 [DEBUG   ] spawn_process: at 2018-11-15 23:34:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 23:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 23:34:52 [DEBUG   ] spawn_process: at 2018-11-15 23:34:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 23:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 23:34:52 [DEBUG   ] spawn_process: at 2018-11-15 23:34:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 23:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 23:34:52 [DEBUG   ] spawn_process: at 2018-11-15 23:34:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 23:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 23:34:52 [DEBUG   ] spawn_process: at 2018-11-15 23:34:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 23:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 23:34:52 [DEBUG   ] spawn_process: at 2018-11-15 23:34:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 23:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 23:34:52 [DEBUG   ] spawn_process: at 2018-11-15 23:34:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 23:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 23:34:52 [DEBUG   ] spawn_process: at 2018-11-15 23:34:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 23:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 23:34:52 [DEBUG   ] spawn_process: at 2018-11-15 23:34:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 23:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 23:34:52 [DEBUG   ] spawn_process: at 2018-11-15 23:34:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 23:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 23:34:52 [DEBUG   ] spawn_process: at 2018-11-15 23:34:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 23:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 23:34:52 [DEBUG   ] spawn_process: at 2018-11-15 23:34:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 23:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 23:34:52 [DEBUG   ] spawn_process: at 2018-11-15 23:34:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 23:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 23:34:52 [DEBUG   ] spawn_process: at 2018-11-15 23:34:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 23:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 23:34:52 [DEBUG   ] spawn_process: at 2018-11-15 23:34:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 23:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 23:34:52 [DEBUG   ] spawn_process: at 2018-11-15 23:34:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 23:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 23:34:52 [DEBUG   ] spawn_process: at 2018-11-15 23:34:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 23:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 23:34:52 [DEBUG   ] spawn_process: at 2018-11-15 23:34:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 23:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 23:34:52 [DEBUG   ] spawn_process: at 2018-11-15 23:34:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 23:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 23:34:52 [DEBUG   ] spawn_process: at 2018-11-15 23:34:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 23:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 23:34:52 [DEBUG   ] spawn_process: at 2018-11-15 23:34:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 23:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 23:34:52 [DEBUG   ] spawn_process: at 2018-11-15 23:34:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 23:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 23:34:52 [DEBUG   ] spawn_process: at 2018-11-15 23:34:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 23:34:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 23:34:52 [DEBUG   ] spawn_process: at 2018-11-15 23:34:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 23:34:56 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-15 23:34:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 23:34:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 23:34:58 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 23:34:58 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 23:34:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:34:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:34:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:34:58 [WARNING ] (13, 1, 'bot')
2018-11-15 23:34:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 23:34:58 [DEBUG   ] Finished updating board flags in 0.955 seconds
2018-11-15 23:35:16 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 23:35:24 [DEBUG   ] Got command BAM from MCS: ref #520258
2018-11-15 23:35:24 [INFO    ] Finished processing BAM request
2018-11-15 23:35:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:35:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520258   8 58437 84924025 A  ERROR'
2018-11-15 23:35:24 [DEBUG   ] Got command BAM from MCS: ref #520259
2018-11-15 23:35:24 [INFO    ] Finished processing BAM request
2018-11-15 23:35:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:35:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520259   8 58437 84924029 A  ERROR'
2018-11-15 23:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 23:35:24 [DEBUG   ] spawn_process: at 2018-11-15 23:35:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 23:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 23:35:24 [DEBUG   ] spawn_process: at 2018-11-15 23:35:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 23:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 23:35:24 [DEBUG   ] spawn_process: at 2018-11-15 23:35:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 23:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 23:35:24 [DEBUG   ] spawn_process: at 2018-11-15 23:35:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 23:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 23:35:24 [DEBUG   ] spawn_process: at 2018-11-15 23:35:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 23:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 23:35:24 [DEBUG   ] spawn_process: at 2018-11-15 23:35:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 23:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 23:35:24 [DEBUG   ] spawn_process: at 2018-11-15 23:35:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 23:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 23:35:24 [DEBUG   ] spawn_process: at 2018-11-15 23:35:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 23:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 23:35:24 [DEBUG   ] spawn_process: at 2018-11-15 23:35:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 23:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 23:35:24 [DEBUG   ] spawn_process: at 2018-11-15 23:35:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 23:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 23:35:24 [DEBUG   ] spawn_process: at 2018-11-15 23:35:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 23:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 23:35:24 [DEBUG   ] spawn_process: at 2018-11-15 23:35:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 23:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 23:35:24 [DEBUG   ] spawn_process: at 2018-11-15 23:35:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 23:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 23:35:24 [DEBUG   ] spawn_process: at 2018-11-15 23:35:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 23:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 23:35:24 [DEBUG   ] spawn_process: at 2018-11-15 23:35:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 23:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 23:35:24 [DEBUG   ] spawn_process: at 2018-11-15 23:35:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 23:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 23:35:24 [DEBUG   ] spawn_process: at 2018-11-15 23:35:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 23:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 23:35:24 [DEBUG   ] spawn_process: at 2018-11-15 23:35:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 23:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 23:35:24 [DEBUG   ] spawn_process: at 2018-11-15 23:35:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 23:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 23:35:24 [DEBUG   ] spawn_process: at 2018-11-15 23:35:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 23:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 23:35:24 [DEBUG   ] spawn_process: at 2018-11-15 23:35:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 23:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 23:35:24 [DEBUG   ] spawn_process: at 2018-11-15 23:35:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 23:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 23:35:24 [DEBUG   ] spawn_process: at 2018-11-15 23:35:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 23:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 23:35:24 [DEBUG   ] spawn_process: at 2018-11-15 23:35:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 23:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 23:35:24 [DEBUG   ] spawn_process: at 2018-11-15 23:35:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 23:35:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 23:35:24 [DEBUG   ] spawn_process: at 2018-11-15 23:35:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 23:35:36 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-15 23:35:45 [DEBUG   ] Got command RPT from MCS: ref #520264
2018-11-15 23:35:45 [DEBUG   ] summary = ERROR
2018-11-15 23:35:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520264  13 58437 84945233 A  ERRORERROR'
2018-11-15 23:35:45 [DEBUG   ] Got command RPT from MCS: ref #520265
2018-11-15 23:35:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 23:35:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520265  77 58437 84945234 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 23:35:56 [DEBUG   ] Got command BAM from MCS: ref #520281
2018-11-15 23:35:56 [INFO    ] Finished processing BAM request
2018-11-15 23:35:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:35:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520281   8 58437 84956025 A  ERROR'
2018-11-15 23:35:56 [DEBUG   ] Got command BAM from MCS: ref #520282
2018-11-15 23:35:56 [INFO    ] Finished processing BAM request
2018-11-15 23:35:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:35:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520282   8 58437 84956029 A  ERROR'
2018-11-15 23:35:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 23:35:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 23:35:56 [DEBUG   ] spawn_process: at 2018-11-15 23:35:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 23:35:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 23:35:56 [DEBUG   ] spawn_process: at 2018-11-15 23:35:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 23:35:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 23:35:56 [DEBUG   ] spawn_process: at 2018-11-15 23:35:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 23:35:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 23:35:56 [DEBUG   ] spawn_process: at 2018-11-15 23:35:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 23:35:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 23:35:56 [DEBUG   ] spawn_process: at 2018-11-15 23:35:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 23:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 23:35:57 [DEBUG   ] spawn_process: at 2018-11-15 23:35:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 23:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 23:35:57 [DEBUG   ] spawn_process: at 2018-11-15 23:35:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 23:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 23:35:57 [DEBUG   ] spawn_process: at 2018-11-15 23:35:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 23:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 23:35:57 [DEBUG   ] spawn_process: at 2018-11-15 23:35:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 23:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 23:35:57 [DEBUG   ] spawn_process: at 2018-11-15 23:35:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 23:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 23:35:57 [DEBUG   ] spawn_process: at 2018-11-15 23:35:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 23:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 23:35:57 [DEBUG   ] spawn_process: at 2018-11-15 23:35:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 23:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 23:35:57 [DEBUG   ] spawn_process: at 2018-11-15 23:35:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 23:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 23:35:57 [DEBUG   ] spawn_process: at 2018-11-15 23:35:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 23:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 23:35:57 [DEBUG   ] spawn_process: at 2018-11-15 23:35:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 23:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 23:35:57 [DEBUG   ] spawn_process: at 2018-11-15 23:35:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 23:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 23:35:57 [DEBUG   ] spawn_process: at 2018-11-15 23:35:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 23:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 23:35:57 [DEBUG   ] spawn_process: at 2018-11-15 23:35:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 23:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 23:35:57 [DEBUG   ] spawn_process: at 2018-11-15 23:35:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 23:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 23:35:57 [DEBUG   ] spawn_process: at 2018-11-15 23:35:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 23:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 23:35:57 [DEBUG   ] spawn_process: at 2018-11-15 23:35:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 23:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 23:35:57 [DEBUG   ] spawn_process: at 2018-11-15 23:35:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 23:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 23:35:57 [DEBUG   ] spawn_process: at 2018-11-15 23:35:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 23:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 23:35:57 [DEBUG   ] spawn_process: at 2018-11-15 23:35:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 23:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 23:35:57 [DEBUG   ] spawn_process: at 2018-11-15 23:35:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 23:35:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 23:35:57 [DEBUG   ] spawn_process: at 2018-11-15 23:35:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 23:35:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 23:35:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 23:35:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-11-15 23:35:59 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 23:35:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 23:35:59 [WARNING ] (13, 1, 'bot')
2018-11-15 23:35:59 [WARNING ] (13, 1, 'bot')
2018-11-15 23:35:59 [WARNING ] (13, 1, 'bot')
2018-11-15 23:35:59 [WARNING ] (13, 1, 'bot')
2018-11-15 23:35:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 23:35:59 [DEBUG   ] Finished updating board flags in 1.391 seconds
2018-11-15 23:36:16 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-15 23:36:28 [DEBUG   ] Got command BAM from MCS: ref #520284
2018-11-15 23:36:28 [INFO    ] Finished processing BAM request
2018-11-15 23:36:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:36:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520284   8 58437 84988025 A  ERROR'
2018-11-15 23:36:28 [DEBUG   ] Got command BAM from MCS: ref #520283
2018-11-15 23:36:28 [INFO    ] Finished processing BAM request
2018-11-15 23:36:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:36:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520283   8 58437 84988029 A  ERROR'
2018-11-15 23:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 23:36:28 [DEBUG   ] spawn_process: at 2018-11-15 23:36:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 23:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 23:36:28 [DEBUG   ] spawn_process: at 2018-11-15 23:36:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 23:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 23:36:28 [DEBUG   ] spawn_process: at 2018-11-15 23:36:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 23:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 23:36:28 [DEBUG   ] spawn_process: at 2018-11-15 23:36:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 23:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 23:36:28 [DEBUG   ] spawn_process: at 2018-11-15 23:36:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 23:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 23:36:28 [DEBUG   ] spawn_process: at 2018-11-15 23:36:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 23:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 23:36:28 [DEBUG   ] spawn_process: at 2018-11-15 23:36:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 23:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 23:36:28 [DEBUG   ] spawn_process: at 2018-11-15 23:36:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 23:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 23:36:28 [DEBUG   ] spawn_process: at 2018-11-15 23:36:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 23:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 23:36:28 [DEBUG   ] spawn_process: at 2018-11-15 23:36:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 23:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 23:36:28 [DEBUG   ] spawn_process: at 2018-11-15 23:36:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 23:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 23:36:28 [DEBUG   ] spawn_process: at 2018-11-15 23:36:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 23:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 23:36:28 [DEBUG   ] spawn_process: at 2018-11-15 23:36:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 23:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 23:36:28 [DEBUG   ] spawn_process: at 2018-11-15 23:36:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 23:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 23:36:28 [DEBUG   ] spawn_process: at 2018-11-15 23:36:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 23:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 23:36:28 [DEBUG   ] spawn_process: at 2018-11-15 23:36:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 23:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 23:36:28 [DEBUG   ] spawn_process: at 2018-11-15 23:36:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 23:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 23:36:28 [DEBUG   ] spawn_process: at 2018-11-15 23:36:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 23:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 23:36:28 [DEBUG   ] spawn_process: at 2018-11-15 23:36:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 23:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 23:36:28 [DEBUG   ] spawn_process: at 2018-11-15 23:36:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 23:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 23:36:28 [DEBUG   ] spawn_process: at 2018-11-15 23:36:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 23:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 23:36:28 [DEBUG   ] spawn_process: at 2018-11-15 23:36:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 23:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 23:36:28 [DEBUG   ] spawn_process: at 2018-11-15 23:36:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 23:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 23:36:28 [DEBUG   ] spawn_process: at 2018-11-15 23:36:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 23:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 23:36:28 [DEBUG   ] spawn_process: at 2018-11-15 23:36:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 23:36:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 23:36:28 [DEBUG   ] spawn_process: at 2018-11-15 23:36:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 23:36:36 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-15 23:36:56 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-15 23:36:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 23:36:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-15 23:36:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 23:36:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-15 23:36:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 23:36:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-11-15 23:36:59 [WARNING ] MonitorFlags: Temperature 82.20 > 80 on hostname lwa21, chip 2
2018-11-15 23:36:59 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-15 23:36:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 23:36:59 [WARNING ] (13, 1, 'bot')
2018-11-15 23:36:59 [WARNING ] (13, 1, 'bot')
2018-11-15 23:36:59 [WARNING ] (13, 1, 'bot')
2018-11-15 23:36:59 [WARNING ] (13, 1, 'bot')
2018-11-15 23:36:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 23:36:59 [DEBUG   ] Finished updating board flags in 1.174 seconds
2018-11-15 23:37:00 [DEBUG   ] Got command BAM from MCS: ref #520286
2018-11-15 23:37:00 [INFO    ] Finished processing BAM request
2018-11-15 23:37:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:37:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520286   8 58437 85020025 A  ERROR'
2018-11-15 23:37:00 [DEBUG   ] Got command BAM from MCS: ref #520285
2018-11-15 23:37:00 [INFO    ] Finished processing BAM request
2018-11-15 23:37:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:37:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520285   8 58437 85020029 A  ERROR'
2018-11-15 23:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 23:37:00 [DEBUG   ] spawn_process: at 2018-11-15 23:37:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 23:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 23:37:00 [DEBUG   ] spawn_process: at 2018-11-15 23:37:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 23:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 23:37:00 [DEBUG   ] spawn_process: at 2018-11-15 23:37:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 23:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 23:37:00 [DEBUG   ] spawn_process: at 2018-11-15 23:37:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 23:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 23:37:00 [DEBUG   ] spawn_process: at 2018-11-15 23:37:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 23:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 23:37:00 [DEBUG   ] spawn_process: at 2018-11-15 23:37:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 23:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 23:37:00 [DEBUG   ] spawn_process: at 2018-11-15 23:37:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 23:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 23:37:00 [DEBUG   ] spawn_process: at 2018-11-15 23:37:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 23:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 23:37:00 [DEBUG   ] spawn_process: at 2018-11-15 23:37:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 23:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 23:37:00 [DEBUG   ] spawn_process: at 2018-11-15 23:37:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 23:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 23:37:00 [DEBUG   ] spawn_process: at 2018-11-15 23:37:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 23:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 23:37:00 [DEBUG   ] spawn_process: at 2018-11-15 23:37:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 23:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 23:37:00 [DEBUG   ] spawn_process: at 2018-11-15 23:37:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 23:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 23:37:00 [DEBUG   ] spawn_process: at 2018-11-15 23:37:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 23:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 23:37:00 [DEBUG   ] spawn_process: at 2018-11-15 23:37:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 23:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 23:37:00 [DEBUG   ] spawn_process: at 2018-11-15 23:37:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 23:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 23:37:00 [DEBUG   ] spawn_process: at 2018-11-15 23:37:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 23:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 23:37:00 [DEBUG   ] spawn_process: at 2018-11-15 23:37:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 23:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 23:37:00 [DEBUG   ] spawn_process: at 2018-11-15 23:37:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 23:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 23:37:00 [DEBUG   ] spawn_process: at 2018-11-15 23:37:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 23:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 23:37:00 [DEBUG   ] spawn_process: at 2018-11-15 23:37:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 23:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 23:37:00 [DEBUG   ] spawn_process: at 2018-11-15 23:37:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 23:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 23:37:00 [DEBUG   ] spawn_process: at 2018-11-15 23:37:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 23:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 23:37:00 [DEBUG   ] spawn_process: at 2018-11-15 23:37:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 23:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 23:37:00 [DEBUG   ] spawn_process: at 2018-11-15 23:37:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 23:37:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 23:37:00 [DEBUG   ] spawn_process: at 2018-11-15 23:37:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 23:37:16 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-15 23:37:32 [DEBUG   ] Got command BAM from MCS: ref #520287
2018-11-15 23:37:32 [INFO    ] Finished processing BAM request
2018-11-15 23:37:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:37:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520287   8 58437 85052025 A  ERROR'
2018-11-15 23:37:32 [DEBUG   ] Got command BAM from MCS: ref #520288
2018-11-15 23:37:32 [INFO    ] Finished processing BAM request
2018-11-15 23:37:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:37:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520288   8 58437 85052029 A  ERROR'
2018-11-15 23:37:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 23:37:32 [DEBUG   ] spawn_process: at 2018-11-15 23:37:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 23:37:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 23:37:32 [DEBUG   ] spawn_process: at 2018-11-15 23:37:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 23:37:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 23:37:32 [DEBUG   ] spawn_process: at 2018-11-15 23:37:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 23:37:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 23:37:32 [DEBUG   ] spawn_process: at 2018-11-15 23:37:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 23:37:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 23:37:32 [DEBUG   ] spawn_process: at 2018-11-15 23:37:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 23:37:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 23:37:32 [DEBUG   ] spawn_process: at 2018-11-15 23:37:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 23:37:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 23:37:32 [DEBUG   ] spawn_process: at 2018-11-15 23:37:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 23:37:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 23:37:32 [DEBUG   ] spawn_process: at 2018-11-15 23:37:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 23:37:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 23:37:32 [DEBUG   ] spawn_process: at 2018-11-15 23:37:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 23:37:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 23:37:32 [DEBUG   ] spawn_process: at 2018-11-15 23:37:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 23:37:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 23:37:32 [DEBUG   ] spawn_process: at 2018-11-15 23:37:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 23:37:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 23:37:32 [DEBUG   ] spawn_process: at 2018-11-15 23:37:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 23:37:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 23:37:32 [DEBUG   ] spawn_process: at 2018-11-15 23:37:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 23:37:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 23:37:32 [DEBUG   ] spawn_process: at 2018-11-15 23:37:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 23:37:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 23:37:32 [DEBUG   ] spawn_process: at 2018-11-15 23:37:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 23:37:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 23:37:32 [DEBUG   ] spawn_process: at 2018-11-15 23:37:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 23:37:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 23:37:32 [DEBUG   ] spawn_process: at 2018-11-15 23:37:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 23:37:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 23:37:32 [DEBUG   ] spawn_process: at 2018-11-15 23:37:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 23:37:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 23:37:32 [DEBUG   ] spawn_process: at 2018-11-15 23:37:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 23:37:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 23:37:32 [DEBUG   ] spawn_process: at 2018-11-15 23:37:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 23:37:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 23:37:32 [DEBUG   ] spawn_process: at 2018-11-15 23:37:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 23:37:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 23:37:32 [DEBUG   ] spawn_process: at 2018-11-15 23:37:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 23:37:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 23:37:32 [DEBUG   ] spawn_process: at 2018-11-15 23:37:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 23:37:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 23:37:32 [DEBUG   ] spawn_process: at 2018-11-15 23:37:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 23:37:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 23:37:32 [DEBUG   ] spawn_process: at 2018-11-15 23:37:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 23:37:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 23:37:32 [DEBUG   ] spawn_process: at 2018-11-15 23:37:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 23:37:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 23:37:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 23:37:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-15 23:37:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-11-15 23:37:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 23:37:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-15 23:37:59 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 23:37:59 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-15 23:37:59 [WARNING ] (13, 1, 'bot')
2018-11-15 23:37:59 [WARNING ] (13, 1, 'bot')
2018-11-15 23:37:59 [WARNING ] (13, 1, 'bot')
2018-11-15 23:37:59 [WARNING ] (13, 1, 'bot')
2018-11-15 23:37:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 23:37:59 [DEBUG   ] Finished updating board flags in 1.010 seconds
2018-11-15 23:38:04 [DEBUG   ] Got command BAM from MCS: ref #520290
2018-11-15 23:38:04 [INFO    ] Finished processing BAM request
2018-11-15 23:38:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:38:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520290   8 58437 85084029 A  ERROR'
2018-11-15 23:38:04 [DEBUG   ] Got command BAM from MCS: ref #520289
2018-11-15 23:38:04 [INFO    ] Finished processing BAM request
2018-11-15 23:38:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:38:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520289   8 58437 85084033 A  ERROR'
2018-11-15 23:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 23:38:04 [DEBUG   ] spawn_process: at 2018-11-15 23:38:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 23:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 23:38:04 [DEBUG   ] spawn_process: at 2018-11-15 23:38:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 23:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 23:38:04 [DEBUG   ] spawn_process: at 2018-11-15 23:38:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 23:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 23:38:04 [DEBUG   ] spawn_process: at 2018-11-15 23:38:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 23:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 23:38:04 [DEBUG   ] spawn_process: at 2018-11-15 23:38:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 23:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 23:38:04 [DEBUG   ] spawn_process: at 2018-11-15 23:38:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 23:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 23:38:04 [DEBUG   ] spawn_process: at 2018-11-15 23:38:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 23:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 23:38:04 [DEBUG   ] spawn_process: at 2018-11-15 23:38:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 23:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 23:38:04 [DEBUG   ] spawn_process: at 2018-11-15 23:38:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 23:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 23:38:04 [DEBUG   ] spawn_process: at 2018-11-15 23:38:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 23:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 23:38:04 [DEBUG   ] spawn_process: at 2018-11-15 23:38:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 23:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 23:38:04 [DEBUG   ] spawn_process: at 2018-11-15 23:38:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 23:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 23:38:04 [DEBUG   ] spawn_process: at 2018-11-15 23:38:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 23:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 23:38:04 [DEBUG   ] spawn_process: at 2018-11-15 23:38:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 23:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 23:38:04 [DEBUG   ] spawn_process: at 2018-11-15 23:38:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 23:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 23:38:04 [DEBUG   ] spawn_process: at 2018-11-15 23:38:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 23:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 23:38:04 [DEBUG   ] spawn_process: at 2018-11-15 23:38:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 23:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 23:38:04 [DEBUG   ] spawn_process: at 2018-11-15 23:38:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 23:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 23:38:04 [DEBUG   ] spawn_process: at 2018-11-15 23:38:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 23:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 23:38:04 [DEBUG   ] spawn_process: at 2018-11-15 23:38:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 23:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 23:38:04 [DEBUG   ] spawn_process: at 2018-11-15 23:38:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 23:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 23:38:04 [DEBUG   ] spawn_process: at 2018-11-15 23:38:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 23:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 23:38:04 [DEBUG   ] spawn_process: at 2018-11-15 23:38:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 23:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 23:38:04 [DEBUG   ] spawn_process: at 2018-11-15 23:38:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 23:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 23:38:04 [DEBUG   ] spawn_process: at 2018-11-15 23:38:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 23:38:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 23:38:04 [DEBUG   ] spawn_process: at 2018-11-15 23:38:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 23:38:16 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-15 23:38:26 [DEBUG   ] Got command RPT from MCS: ref #520293
2018-11-15 23:38:26 [DEBUG   ] summary = ERROR
2018-11-15 23:38:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520293  13 58437 85106881 A  ERRORERROR'
2018-11-15 23:38:27 [DEBUG   ] Got command RPT from MCS: ref #520294
2018-11-15 23:38:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 23:38:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520294  77 58437 85107373 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 23:38:27 [DEBUG   ] Got command RPT from MCS: ref #520296
2018-11-15 23:38:27 [DEBUG   ] summary = ERROR
2018-11-15 23:38:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520296  13 58437 85107481 A  ERRORERROR'
2018-11-15 23:38:27 [DEBUG   ] Got command RPT from MCS: ref #520297
2018-11-15 23:38:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 23:38:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520297  77 58437 85107685 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 23:38:27 [DEBUG   ] Got command RPT from MCS: ref #520299
2018-11-15 23:38:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 23:38:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520299  12 58437 85107889 A  ERRORB£ff'
2018-11-15 23:38:36 [DEBUG   ] Got command BAM from MCS: ref #520307
2018-11-15 23:38:36 [INFO    ] Finished processing BAM request
2018-11-15 23:38:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:38:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520307   8 58437 85116029 A  ERROR'
2018-11-15 23:38:36 [DEBUG   ] Got command BAM from MCS: ref #520308
2018-11-15 23:38:36 [INFO    ] Finished processing BAM request
2018-11-15 23:38:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:38:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520308   8 58437 85116033 A  ERROR'
2018-11-15 23:38:36 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 23:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 23:38:36 [DEBUG   ] spawn_process: at 2018-11-15 23:38:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 23:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 23:38:36 [DEBUG   ] spawn_process: at 2018-11-15 23:38:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 23:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 23:38:36 [DEBUG   ] spawn_process: at 2018-11-15 23:38:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 23:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 23:38:36 [DEBUG   ] spawn_process: at 2018-11-15 23:38:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 23:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 23:38:36 [DEBUG   ] spawn_process: at 2018-11-15 23:38:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 23:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 23:38:36 [DEBUG   ] spawn_process: at 2018-11-15 23:38:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 23:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 23:38:36 [DEBUG   ] spawn_process: at 2018-11-15 23:38:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 23:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 23:38:36 [DEBUG   ] spawn_process: at 2018-11-15 23:38:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 23:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 23:38:36 [DEBUG   ] spawn_process: at 2018-11-15 23:38:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 23:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 23:38:36 [DEBUG   ] spawn_process: at 2018-11-15 23:38:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 23:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 23:38:36 [DEBUG   ] spawn_process: at 2018-11-15 23:38:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 23:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 23:38:36 [DEBUG   ] spawn_process: at 2018-11-15 23:38:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 23:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 23:38:36 [DEBUG   ] spawn_process: at 2018-11-15 23:38:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 23:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 23:38:36 [DEBUG   ] spawn_process: at 2018-11-15 23:38:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 23:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 23:38:36 [DEBUG   ] spawn_process: at 2018-11-15 23:38:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 23:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 23:38:36 [DEBUG   ] spawn_process: at 2018-11-15 23:38:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 23:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 23:38:36 [DEBUG   ] spawn_process: at 2018-11-15 23:38:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 23:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 23:38:36 [DEBUG   ] spawn_process: at 2018-11-15 23:38:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 23:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 23:38:36 [DEBUG   ] spawn_process: at 2018-11-15 23:38:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 23:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 23:38:36 [DEBUG   ] spawn_process: at 2018-11-15 23:38:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 23:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 23:38:36 [DEBUG   ] spawn_process: at 2018-11-15 23:38:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 23:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 23:38:36 [DEBUG   ] spawn_process: at 2018-11-15 23:38:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 23:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 23:38:36 [DEBUG   ] spawn_process: at 2018-11-15 23:38:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 23:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 23:38:36 [DEBUG   ] spawn_process: at 2018-11-15 23:38:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 23:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 23:38:36 [DEBUG   ] spawn_process: at 2018-11-15 23:38:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 23:38:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 23:38:36 [DEBUG   ] spawn_process: at 2018-11-15 23:38:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 23:38:56 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-15 23:38:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 23:38:59 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 23:38:59 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-15 23:38:59 [WARNING ] (13, 1, 'bot')
2018-11-15 23:38:59 [WARNING ] (13, 1, 'bot')
2018-11-15 23:38:59 [WARNING ] (13, 1, 'bot')
2018-11-15 23:38:59 [WARNING ] (13, 1, 'bot')
2018-11-15 23:38:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 23:38:59 [DEBUG   ] Finished updating board flags in 0.993 seconds
2018-11-15 23:39:08 [DEBUG   ] Got command BAM from MCS: ref #520309
2018-11-15 23:39:08 [INFO    ] Finished processing BAM request
2018-11-15 23:39:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:39:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520309   8 58437 85148033 A  ERROR'
2018-11-15 23:39:08 [DEBUG   ] Got command BAM from MCS: ref #520310
2018-11-15 23:39:08 [INFO    ] Finished processing BAM request
2018-11-15 23:39:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:39:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520310   8 58437 85148037 A  ERROR'
2018-11-15 23:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 23:39:08 [DEBUG   ] spawn_process: at 2018-11-15 23:39:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 23:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 23:39:08 [DEBUG   ] spawn_process: at 2018-11-15 23:39:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 23:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 23:39:08 [DEBUG   ] spawn_process: at 2018-11-15 23:39:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 23:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 23:39:08 [DEBUG   ] spawn_process: at 2018-11-15 23:39:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 23:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 23:39:08 [DEBUG   ] spawn_process: at 2018-11-15 23:39:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 23:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 23:39:08 [DEBUG   ] spawn_process: at 2018-11-15 23:39:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 23:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 23:39:08 [DEBUG   ] spawn_process: at 2018-11-15 23:39:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 23:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 23:39:08 [DEBUG   ] spawn_process: at 2018-11-15 23:39:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 23:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 23:39:08 [DEBUG   ] spawn_process: at 2018-11-15 23:39:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 23:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 23:39:08 [DEBUG   ] spawn_process: at 2018-11-15 23:39:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 23:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 23:39:08 [DEBUG   ] spawn_process: at 2018-11-15 23:39:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 23:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 23:39:08 [DEBUG   ] spawn_process: at 2018-11-15 23:39:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 23:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 23:39:08 [DEBUG   ] spawn_process: at 2018-11-15 23:39:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 23:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 23:39:08 [DEBUG   ] spawn_process: at 2018-11-15 23:39:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 23:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 23:39:08 [DEBUG   ] spawn_process: at 2018-11-15 23:39:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 23:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 23:39:08 [DEBUG   ] spawn_process: at 2018-11-15 23:39:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 23:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 23:39:08 [DEBUG   ] spawn_process: at 2018-11-15 23:39:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 23:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 23:39:08 [DEBUG   ] spawn_process: at 2018-11-15 23:39:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 23:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 23:39:08 [DEBUG   ] spawn_process: at 2018-11-15 23:39:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 23:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 23:39:08 [DEBUG   ] spawn_process: at 2018-11-15 23:39:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 23:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 23:39:08 [DEBUG   ] spawn_process: at 2018-11-15 23:39:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 23:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 23:39:08 [DEBUG   ] spawn_process: at 2018-11-15 23:39:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 23:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 23:39:08 [DEBUG   ] spawn_process: at 2018-11-15 23:39:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 23:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 23:39:08 [DEBUG   ] spawn_process: at 2018-11-15 23:39:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 23:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 23:39:08 [DEBUG   ] spawn_process: at 2018-11-15 23:39:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 23:39:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 23:39:08 [DEBUG   ] spawn_process: at 2018-11-15 23:39:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 23:39:16 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-15 23:39:36 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-15 23:39:40 [DEBUG   ] Got command BAM from MCS: ref #520312
2018-11-15 23:39:40 [INFO    ] Finished processing BAM request
2018-11-15 23:39:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:39:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520312   8 58437 85180033 A  ERROR'
2018-11-15 23:39:40 [DEBUG   ] Got command BAM from MCS: ref #520311
2018-11-15 23:39:40 [INFO    ] Finished processing BAM request
2018-11-15 23:39:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:39:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520311   8 58437 85180037 A  ERROR'
2018-11-15 23:39:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 23:39:40 [DEBUG   ] spawn_process: at 2018-11-15 23:39:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 23:39:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 23:39:40 [DEBUG   ] spawn_process: at 2018-11-15 23:39:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 23:39:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 23:39:40 [DEBUG   ] spawn_process: at 2018-11-15 23:39:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 23:39:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 23:39:40 [DEBUG   ] spawn_process: at 2018-11-15 23:39:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 23:39:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 23:39:40 [DEBUG   ] spawn_process: at 2018-11-15 23:39:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 23:39:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 23:39:40 [DEBUG   ] spawn_process: at 2018-11-15 23:39:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 23:39:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 23:39:40 [DEBUG   ] spawn_process: at 2018-11-15 23:39:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 23:39:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 23:39:40 [DEBUG   ] spawn_process: at 2018-11-15 23:39:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 23:39:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 23:39:40 [DEBUG   ] spawn_process: at 2018-11-15 23:39:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 23:39:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 23:39:40 [DEBUG   ] spawn_process: at 2018-11-15 23:39:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 23:39:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 23:39:40 [DEBUG   ] spawn_process: at 2018-11-15 23:39:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 23:39:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 23:39:40 [DEBUG   ] spawn_process: at 2018-11-15 23:39:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 23:39:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 23:39:40 [DEBUG   ] spawn_process: at 2018-11-15 23:39:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 23:39:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 23:39:40 [DEBUG   ] spawn_process: at 2018-11-15 23:39:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 23:39:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 23:39:40 [DEBUG   ] spawn_process: at 2018-11-15 23:39:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 23:39:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 23:39:40 [DEBUG   ] spawn_process: at 2018-11-15 23:39:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 23:39:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 23:39:40 [DEBUG   ] spawn_process: at 2018-11-15 23:39:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 23:39:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 23:39:40 [DEBUG   ] spawn_process: at 2018-11-15 23:39:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 23:39:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 23:39:40 [DEBUG   ] spawn_process: at 2018-11-15 23:39:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 23:39:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 23:39:40 [DEBUG   ] spawn_process: at 2018-11-15 23:39:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 23:39:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 23:39:40 [DEBUG   ] spawn_process: at 2018-11-15 23:39:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 23:39:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 23:39:40 [DEBUG   ] spawn_process: at 2018-11-15 23:39:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 23:39:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 23:39:40 [DEBUG   ] spawn_process: at 2018-11-15 23:39:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 23:39:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 23:39:40 [DEBUG   ] spawn_process: at 2018-11-15 23:39:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 23:39:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 23:39:40 [DEBUG   ] spawn_process: at 2018-11-15 23:39:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 23:39:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 23:39:40 [DEBUG   ] spawn_process: at 2018-11-15 23:39:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 23:39:56 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-15 23:39:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 23:40:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 23:40:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 23:40:00 [WARNING ] (13, 1, 'bot')
2018-11-15 23:40:00 [WARNING ] (13, 1, 'bot')
2018-11-15 23:40:00 [WARNING ] (13, 1, 'bot')
2018-11-15 23:40:00 [WARNING ] (13, 1, 'bot')
2018-11-15 23:40:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 23:40:00 [DEBUG   ] Finished updating board flags in 1.815 seconds
2018-11-15 23:40:12 [DEBUG   ] Got command BAM from MCS: ref #520313
2018-11-15 23:40:12 [INFO    ] Finished processing BAM request
2018-11-15 23:40:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:40:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520313   8 58437 85212394 A  ERROR'
2018-11-15 23:40:12 [DEBUG   ] Got command BAM from MCS: ref #520314
2018-11-15 23:40:12 [INFO    ] Finished processing BAM request
2018-11-15 23:40:12 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:40:12 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520314   8 58437 85212398 A  ERROR'
2018-11-15 23:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 23:40:12 [DEBUG   ] spawn_process: at 2018-11-15 23:40:12 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 23:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 23:40:12 [DEBUG   ] spawn_process: at 2018-11-15 23:40:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 23:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 23:40:12 [DEBUG   ] spawn_process: at 2018-11-15 23:40:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 23:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 23:40:12 [DEBUG   ] spawn_process: at 2018-11-15 23:40:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 23:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 23:40:12 [DEBUG   ] spawn_process: at 2018-11-15 23:40:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 23:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 23:40:12 [DEBUG   ] spawn_process: at 2018-11-15 23:40:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 23:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 23:40:12 [DEBUG   ] spawn_process: at 2018-11-15 23:40:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 23:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 23:40:12 [DEBUG   ] spawn_process: at 2018-11-15 23:40:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 23:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 23:40:12 [DEBUG   ] spawn_process: at 2018-11-15 23:40:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 23:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 23:40:12 [DEBUG   ] spawn_process: at 2018-11-15 23:40:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 23:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 23:40:12 [DEBUG   ] spawn_process: at 2018-11-15 23:40:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 23:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 23:40:12 [DEBUG   ] spawn_process: at 2018-11-15 23:40:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 23:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 23:40:12 [DEBUG   ] spawn_process: at 2018-11-15 23:40:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 23:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 23:40:12 [DEBUG   ] spawn_process: at 2018-11-15 23:40:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 23:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 23:40:12 [DEBUG   ] spawn_process: at 2018-11-15 23:40:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 23:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 23:40:12 [DEBUG   ] spawn_process: at 2018-11-15 23:40:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 23:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 23:40:12 [DEBUG   ] spawn_process: at 2018-11-15 23:40:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 23:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 23:40:12 [DEBUG   ] spawn_process: at 2018-11-15 23:40:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 23:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 23:40:12 [DEBUG   ] spawn_process: at 2018-11-15 23:40:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 23:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 23:40:12 [DEBUG   ] spawn_process: at 2018-11-15 23:40:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 23:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 23:40:12 [DEBUG   ] spawn_process: at 2018-11-15 23:40:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 23:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 23:40:12 [DEBUG   ] spawn_process: at 2018-11-15 23:40:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 23:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 23:40:12 [DEBUG   ] spawn_process: at 2018-11-15 23:40:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 23:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 23:40:12 [DEBUG   ] spawn_process: at 2018-11-15 23:40:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 23:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 23:40:12 [DEBUG   ] spawn_process: at 2018-11-15 23:40:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 23:40:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 23:40:12 [DEBUG   ] spawn_process: at 2018-11-15 23:40:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 23:40:16 [DEBUG   ] Finished updating ant stats in 0.397 seconds
2018-11-15 23:40:37 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-15 23:40:44 [DEBUG   ] Got command BAM from MCS: ref #520315
2018-11-15 23:40:44 [INFO    ] Finished processing BAM request
2018-11-15 23:40:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:40:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520315   8 58437 85244034 A  ERROR'
2018-11-15 23:40:44 [DEBUG   ] Got command BAM from MCS: ref #520316
2018-11-15 23:40:44 [INFO    ] Finished processing BAM request
2018-11-15 23:40:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:40:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520316   8 58437 85244038 A  ERROR'
2018-11-15 23:40:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 23:40:44 [DEBUG   ] spawn_process: at 2018-11-15 23:40:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 23:40:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 23:40:44 [DEBUG   ] spawn_process: at 2018-11-15 23:40:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 23:40:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 23:40:44 [DEBUG   ] spawn_process: at 2018-11-15 23:40:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 23:40:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 23:40:44 [DEBUG   ] spawn_process: at 2018-11-15 23:40:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 23:40:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 23:40:44 [DEBUG   ] spawn_process: at 2018-11-15 23:40:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 23:40:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 23:40:44 [DEBUG   ] spawn_process: at 2018-11-15 23:40:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 23:40:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 23:40:44 [DEBUG   ] spawn_process: at 2018-11-15 23:40:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 23:40:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 23:40:44 [DEBUG   ] spawn_process: at 2018-11-15 23:40:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 23:40:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 23:40:44 [DEBUG   ] spawn_process: at 2018-11-15 23:40:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 23:40:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 23:40:44 [DEBUG   ] spawn_process: at 2018-11-15 23:40:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 23:40:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 23:40:44 [DEBUG   ] spawn_process: at 2018-11-15 23:40:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 23:40:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 23:40:44 [DEBUG   ] spawn_process: at 2018-11-15 23:40:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 23:40:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 23:40:44 [DEBUG   ] spawn_process: at 2018-11-15 23:40:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 23:40:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 23:40:44 [DEBUG   ] spawn_process: at 2018-11-15 23:40:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 23:40:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 23:40:44 [DEBUG   ] spawn_process: at 2018-11-15 23:40:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 23:40:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 23:40:44 [DEBUG   ] spawn_process: at 2018-11-15 23:40:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 23:40:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 23:40:44 [DEBUG   ] spawn_process: at 2018-11-15 23:40:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 23:40:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 23:40:44 [DEBUG   ] spawn_process: at 2018-11-15 23:40:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 23:40:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 23:40:44 [DEBUG   ] spawn_process: at 2018-11-15 23:40:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 23:40:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 23:40:44 [DEBUG   ] spawn_process: at 2018-11-15 23:40:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 23:40:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 23:40:44 [DEBUG   ] spawn_process: at 2018-11-15 23:40:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 23:40:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 23:40:44 [DEBUG   ] spawn_process: at 2018-11-15 23:40:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 23:40:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 23:40:44 [DEBUG   ] spawn_process: at 2018-11-15 23:40:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 23:40:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 23:40:44 [DEBUG   ] spawn_process: at 2018-11-15 23:40:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 23:40:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 23:40:44 [DEBUG   ] spawn_process: at 2018-11-15 23:40:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 23:40:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 23:40:44 [DEBUG   ] spawn_process: at 2018-11-15 23:40:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 23:40:45 [DEBUG   ] Got command RPT from MCS: ref #520317
2018-11-15 23:40:45 [DEBUG   ] summary = ERROR
2018-11-15 23:40:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520317  13 58437 85245238 A  ERRORERROR'
2018-11-15 23:40:45 [DEBUG   ] Got command RPT from MCS: ref #520318
2018-11-15 23:40:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 23:40:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520318  77 58437 85245238 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 23:40:57 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-15 23:40:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 23:40:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 23:40:59 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 23:40:59 [WARNING ] (13, 1, 'bot')
2018-11-15 23:40:59 [WARNING ] (13, 1, 'bot')
2018-11-15 23:40:59 [WARNING ] (13, 1, 'bot')
2018-11-15 23:40:59 [WARNING ] (13, 1, 'bot')
2018-11-15 23:40:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 23:40:59 [DEBUG   ] Finished updating board flags in 1.237 seconds
2018-11-15 23:41:16 [DEBUG   ] Got command BAM from MCS: ref #520335
2018-11-15 23:41:16 [INFO    ] Finished processing BAM request
2018-11-15 23:41:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:41:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520335   8 58437 85276034 A  ERROR'
2018-11-15 23:41:16 [DEBUG   ] Got command BAM from MCS: ref #520334
2018-11-15 23:41:16 [INFO    ] Finished processing BAM request
2018-11-15 23:41:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:41:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520334   8 58437 85276038 A  ERROR'
2018-11-15 23:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 23:41:16 [DEBUG   ] spawn_process: at 2018-11-15 23:41:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 23:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 23:41:16 [DEBUG   ] spawn_process: at 2018-11-15 23:41:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 23:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 23:41:16 [DEBUG   ] spawn_process: at 2018-11-15 23:41:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 23:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 23:41:16 [DEBUG   ] spawn_process: at 2018-11-15 23:41:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 23:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 23:41:16 [DEBUG   ] spawn_process: at 2018-11-15 23:41:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 23:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 23:41:16 [DEBUG   ] spawn_process: at 2018-11-15 23:41:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 23:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 23:41:16 [DEBUG   ] spawn_process: at 2018-11-15 23:41:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 23:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 23:41:16 [DEBUG   ] spawn_process: at 2018-11-15 23:41:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 23:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 23:41:16 [DEBUG   ] spawn_process: at 2018-11-15 23:41:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 23:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 23:41:16 [DEBUG   ] spawn_process: at 2018-11-15 23:41:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 23:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 23:41:16 [DEBUG   ] spawn_process: at 2018-11-15 23:41:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 23:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 23:41:16 [DEBUG   ] spawn_process: at 2018-11-15 23:41:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 23:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 23:41:16 [DEBUG   ] spawn_process: at 2018-11-15 23:41:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 23:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 23:41:16 [DEBUG   ] spawn_process: at 2018-11-15 23:41:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 23:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 23:41:16 [DEBUG   ] spawn_process: at 2018-11-15 23:41:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 23:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 23:41:16 [DEBUG   ] spawn_process: at 2018-11-15 23:41:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 23:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 23:41:16 [DEBUG   ] spawn_process: at 2018-11-15 23:41:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 23:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 23:41:16 [DEBUG   ] spawn_process: at 2018-11-15 23:41:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 23:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 23:41:16 [DEBUG   ] spawn_process: at 2018-11-15 23:41:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 23:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 23:41:16 [DEBUG   ] spawn_process: at 2018-11-15 23:41:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 23:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 23:41:16 [DEBUG   ] spawn_process: at 2018-11-15 23:41:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 23:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 23:41:16 [DEBUG   ] spawn_process: at 2018-11-15 23:41:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 23:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 23:41:16 [DEBUG   ] spawn_process: at 2018-11-15 23:41:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 23:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 23:41:16 [DEBUG   ] spawn_process: at 2018-11-15 23:41:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 23:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 23:41:16 [DEBUG   ] spawn_process: at 2018-11-15 23:41:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 23:41:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 23:41:16 [DEBUG   ] spawn_process: at 2018-11-15 23:41:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 23:41:17 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-15 23:41:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 23:41:48 [DEBUG   ] Got command BAM from MCS: ref #520340
2018-11-15 23:41:48 [INFO    ] Finished processing BAM request
2018-11-15 23:41:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:41:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520340   8 58437 85308029 A  ERROR'
2018-11-15 23:41:48 [DEBUG   ] Got command BAM from MCS: ref #520341
2018-11-15 23:41:48 [INFO    ] Finished processing BAM request
2018-11-15 23:41:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:41:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520341   8 58437 85308033 A  ERROR'
2018-11-15 23:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 23:41:48 [DEBUG   ] spawn_process: at 2018-11-15 23:41:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 23:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 23:41:48 [DEBUG   ] spawn_process: at 2018-11-15 23:41:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 23:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 23:41:48 [DEBUG   ] spawn_process: at 2018-11-15 23:41:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 23:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 23:41:48 [DEBUG   ] spawn_process: at 2018-11-15 23:41:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 23:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 23:41:48 [DEBUG   ] spawn_process: at 2018-11-15 23:41:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 23:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 23:41:48 [DEBUG   ] spawn_process: at 2018-11-15 23:41:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 23:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 23:41:48 [DEBUG   ] spawn_process: at 2018-11-15 23:41:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 23:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 23:41:48 [DEBUG   ] spawn_process: at 2018-11-15 23:41:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 23:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 23:41:48 [DEBUG   ] spawn_process: at 2018-11-15 23:41:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 23:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 23:41:48 [DEBUG   ] spawn_process: at 2018-11-15 23:41:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 23:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 23:41:48 [DEBUG   ] spawn_process: at 2018-11-15 23:41:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 23:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 23:41:48 [DEBUG   ] spawn_process: at 2018-11-15 23:41:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 23:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 23:41:48 [DEBUG   ] spawn_process: at 2018-11-15 23:41:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 23:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 23:41:48 [DEBUG   ] spawn_process: at 2018-11-15 23:41:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 23:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 23:41:48 [DEBUG   ] spawn_process: at 2018-11-15 23:41:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 23:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 23:41:48 [DEBUG   ] spawn_process: at 2018-11-15 23:41:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 23:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 23:41:48 [DEBUG   ] spawn_process: at 2018-11-15 23:41:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 23:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 23:41:48 [DEBUG   ] spawn_process: at 2018-11-15 23:41:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 23:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 23:41:48 [DEBUG   ] spawn_process: at 2018-11-15 23:41:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 23:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 23:41:48 [DEBUG   ] spawn_process: at 2018-11-15 23:41:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 23:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 23:41:48 [DEBUG   ] spawn_process: at 2018-11-15 23:41:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 23:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 23:41:48 [DEBUG   ] spawn_process: at 2018-11-15 23:41:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 23:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 23:41:48 [DEBUG   ] spawn_process: at 2018-11-15 23:41:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 23:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 23:41:48 [DEBUG   ] spawn_process: at 2018-11-15 23:41:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 23:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 23:41:48 [DEBUG   ] spawn_process: at 2018-11-15 23:41:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 23:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 23:41:48 [DEBUG   ] spawn_process: at 2018-11-15 23:41:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 23:41:57 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-15 23:41:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 23:41:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-15 23:41:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 23:41:59 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 23:41:59 [WARNING ] (13, 1, 'bot')
2018-11-15 23:41:59 [WARNING ] (13, 1, 'bot')
2018-11-15 23:41:59 [WARNING ] (13, 1, 'bot')
2018-11-15 23:41:59 [WARNING ] (13, 1, 'bot')
2018-11-15 23:41:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 23:41:59 [DEBUG   ] Finished updating board flags in 1.217 seconds
2018-11-15 23:42:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 23:42:20 [DEBUG   ] Got command BAM from MCS: ref #520342
2018-11-15 23:42:20 [INFO    ] Finished processing BAM request
2018-11-15 23:42:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:42:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520342   8 58437 85340029 A  ERROR'
2018-11-15 23:42:20 [DEBUG   ] Got command BAM from MCS: ref #520343
2018-11-15 23:42:20 [INFO    ] Finished processing BAM request
2018-11-15 23:42:20 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:42:20 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520343   8 58437 85340033 A  ERROR'
2018-11-15 23:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 23:42:20 [DEBUG   ] spawn_process: at 2018-11-15 23:42:20 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 23:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 23:42:20 [DEBUG   ] spawn_process: at 2018-11-15 23:42:20 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 23:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 23:42:20 [DEBUG   ] spawn_process: at 2018-11-15 23:42:20 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 23:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 23:42:20 [DEBUG   ] spawn_process: at 2018-11-15 23:42:20 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 23:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 23:42:20 [DEBUG   ] spawn_process: at 2018-11-15 23:42:20 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 23:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 23:42:20 [DEBUG   ] spawn_process: at 2018-11-15 23:42:20 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 23:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 23:42:20 [DEBUG   ] spawn_process: at 2018-11-15 23:42:20 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 23:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 23:42:20 [DEBUG   ] spawn_process: at 2018-11-15 23:42:20 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 23:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 23:42:20 [DEBUG   ] spawn_process: at 2018-11-15 23:42:20 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 23:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 23:42:20 [DEBUG   ] spawn_process: at 2018-11-15 23:42:20 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 23:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 23:42:20 [DEBUG   ] spawn_process: at 2018-11-15 23:42:20 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 23:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 23:42:20 [DEBUG   ] spawn_process: at 2018-11-15 23:42:20 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 23:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 23:42:20 [DEBUG   ] spawn_process: at 2018-11-15 23:42:20 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 23:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 23:42:20 [DEBUG   ] spawn_process: at 2018-11-15 23:42:20 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 23:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 23:42:20 [DEBUG   ] spawn_process: at 2018-11-15 23:42:20 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 23:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 23:42:20 [DEBUG   ] spawn_process: at 2018-11-15 23:42:20 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 23:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 23:42:20 [DEBUG   ] spawn_process: at 2018-11-15 23:42:20 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 23:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 23:42:20 [DEBUG   ] spawn_process: at 2018-11-15 23:42:20 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 23:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 23:42:20 [DEBUG   ] spawn_process: at 2018-11-15 23:42:20 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 23:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 23:42:20 [DEBUG   ] spawn_process: at 2018-11-15 23:42:20 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 23:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 23:42:20 [DEBUG   ] spawn_process: at 2018-11-15 23:42:20 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 23:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 23:42:20 [DEBUG   ] spawn_process: at 2018-11-15 23:42:20 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 23:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 23:42:20 [DEBUG   ] spawn_process: at 2018-11-15 23:42:20 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 23:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 23:42:20 [DEBUG   ] spawn_process: at 2018-11-15 23:42:20 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 23:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 23:42:20 [DEBUG   ] spawn_process: at 2018-11-15 23:42:20 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 23:42:20 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 23:42:20 [DEBUG   ] spawn_process: at 2018-11-15 23:42:20 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 23:42:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 23:42:51 [DEBUG   ] Got command BAM from MCS: ref #520344
2018-11-15 23:42:51 [INFO    ] Finished processing BAM request
2018-11-15 23:42:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:42:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520344   8 58437 85371033 A  ERROR'
2018-11-15 23:42:51 [DEBUG   ] Got command BAM from MCS: ref #520345
2018-11-15 23:42:51 [INFO    ] Finished processing BAM request
2018-11-15 23:42:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:42:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520345   8 58437 85371037 A  ERROR'
2018-11-15 23:42:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 23:42:51 [DEBUG   ] spawn_process: at 2018-11-15 23:42:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 23:42:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 23:42:51 [DEBUG   ] spawn_process: at 2018-11-15 23:42:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 23:42:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 23:42:51 [DEBUG   ] spawn_process: at 2018-11-15 23:42:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 23:42:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 23:42:51 [DEBUG   ] spawn_process: at 2018-11-15 23:42:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 23:42:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 23:42:51 [DEBUG   ] spawn_process: at 2018-11-15 23:42:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 23:42:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 23:42:51 [DEBUG   ] spawn_process: at 2018-11-15 23:42:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 23:42:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 23:42:51 [DEBUG   ] spawn_process: at 2018-11-15 23:42:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 23:42:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 23:42:51 [DEBUG   ] spawn_process: at 2018-11-15 23:42:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 23:42:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 23:42:51 [DEBUG   ] spawn_process: at 2018-11-15 23:42:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 23:42:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 23:42:51 [DEBUG   ] spawn_process: at 2018-11-15 23:42:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 23:42:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 23:42:51 [DEBUG   ] spawn_process: at 2018-11-15 23:42:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 23:42:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 23:42:51 [DEBUG   ] spawn_process: at 2018-11-15 23:42:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 23:42:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 23:42:51 [DEBUG   ] spawn_process: at 2018-11-15 23:42:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 23:42:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 23:42:51 [DEBUG   ] spawn_process: at 2018-11-15 23:42:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 23:42:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 23:42:51 [DEBUG   ] spawn_process: at 2018-11-15 23:42:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 23:42:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 23:42:51 [DEBUG   ] spawn_process: at 2018-11-15 23:42:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 23:42:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 23:42:51 [DEBUG   ] spawn_process: at 2018-11-15 23:42:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 23:42:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 23:42:51 [DEBUG   ] spawn_process: at 2018-11-15 23:42:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 23:42:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 23:42:51 [DEBUG   ] spawn_process: at 2018-11-15 23:42:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 23:42:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 23:42:51 [DEBUG   ] spawn_process: at 2018-11-15 23:42:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 23:42:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 23:42:51 [DEBUG   ] spawn_process: at 2018-11-15 23:42:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 23:42:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 23:42:51 [DEBUG   ] spawn_process: at 2018-11-15 23:42:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 23:42:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 23:42:51 [DEBUG   ] spawn_process: at 2018-11-15 23:42:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 23:42:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 23:42:51 [DEBUG   ] spawn_process: at 2018-11-15 23:42:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 23:42:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 23:42:51 [DEBUG   ] spawn_process: at 2018-11-15 23:42:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 23:42:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 23:42:51 [DEBUG   ] spawn_process: at 2018-11-15 23:42:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 23:42:57 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-15 23:42:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 23:42:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 23:42:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 23:42:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-15 23:42:59 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 23:42:59 [WARNING ] (13, 1, 'bot')
2018-11-15 23:42:59 [WARNING ] (13, 1, 'bot')
2018-11-15 23:42:59 [WARNING ] (13, 1, 'bot')
2018-11-15 23:42:59 [WARNING ] (13, 1, 'bot')
2018-11-15 23:42:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 23:42:59 [DEBUG   ] Finished updating board flags in 1.205 seconds
2018-11-15 23:43:17 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-15 23:43:22 [DEBUG   ] Got command BAM from MCS: ref #520347
2018-11-15 23:43:22 [INFO    ] Finished processing BAM request
2018-11-15 23:43:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:43:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520347   8 58437 85402033 A  ERROR'
2018-11-15 23:43:22 [DEBUG   ] Got command BAM from MCS: ref #520346
2018-11-15 23:43:22 [INFO    ] Finished processing BAM request
2018-11-15 23:43:22 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:43:22 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520346   8 58437 85402037 A  ERROR'
2018-11-15 23:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 23:43:22 [DEBUG   ] spawn_process: at 2018-11-15 23:43:22 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 23:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 23:43:22 [DEBUG   ] spawn_process: at 2018-11-15 23:43:22 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 23:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 23:43:22 [DEBUG   ] spawn_process: at 2018-11-15 23:43:22 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 23:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 23:43:22 [DEBUG   ] spawn_process: at 2018-11-15 23:43:22 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 23:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 23:43:22 [DEBUG   ] spawn_process: at 2018-11-15 23:43:22 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 23:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 23:43:22 [DEBUG   ] spawn_process: at 2018-11-15 23:43:22 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 23:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 23:43:22 [DEBUG   ] spawn_process: at 2018-11-15 23:43:22 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 23:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 23:43:22 [DEBUG   ] spawn_process: at 2018-11-15 23:43:22 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 23:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 23:43:22 [DEBUG   ] spawn_process: at 2018-11-15 23:43:22 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 23:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 23:43:22 [DEBUG   ] spawn_process: at 2018-11-15 23:43:22 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 23:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 23:43:22 [DEBUG   ] spawn_process: at 2018-11-15 23:43:22 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 23:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 23:43:22 [DEBUG   ] spawn_process: at 2018-11-15 23:43:22 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 23:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 23:43:22 [DEBUG   ] spawn_process: at 2018-11-15 23:43:22 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 23:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 23:43:22 [DEBUG   ] spawn_process: at 2018-11-15 23:43:22 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 23:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 23:43:22 [DEBUG   ] spawn_process: at 2018-11-15 23:43:22 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 23:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 23:43:22 [DEBUG   ] spawn_process: at 2018-11-15 23:43:22 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 23:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 23:43:22 [DEBUG   ] spawn_process: at 2018-11-15 23:43:22 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 23:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 23:43:22 [DEBUG   ] spawn_process: at 2018-11-15 23:43:22 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 23:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 23:43:22 [DEBUG   ] spawn_process: at 2018-11-15 23:43:22 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 23:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 23:43:22 [DEBUG   ] spawn_process: at 2018-11-15 23:43:22 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 23:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 23:43:22 [DEBUG   ] spawn_process: at 2018-11-15 23:43:22 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 23:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 23:43:22 [DEBUG   ] spawn_process: at 2018-11-15 23:43:22 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 23:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 23:43:22 [DEBUG   ] spawn_process: at 2018-11-15 23:43:22 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 23:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 23:43:22 [DEBUG   ] spawn_process: at 2018-11-15 23:43:22 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 23:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 23:43:22 [DEBUG   ] spawn_process: at 2018-11-15 23:43:22 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 23:43:22 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 23:43:22 [DEBUG   ] spawn_process: at 2018-11-15 23:43:22 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 23:43:26 [DEBUG   ] Got command RPT from MCS: ref #520348
2018-11-15 23:43:26 [DEBUG   ] summary = ERROR
2018-11-15 23:43:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520348  13 58437 85406969 A  ERRORERROR'
2018-11-15 23:43:27 [DEBUG   ] Got command RPT from MCS: ref #520349
2018-11-15 23:43:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 23:43:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520349  77 58437 85407173 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 23:43:27 [DEBUG   ] Got command RPT from MCS: ref #520350
2018-11-15 23:43:27 [DEBUG   ] summary = ERROR
2018-11-15 23:43:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520350  13 58437 85407365 A  ERRORERROR'
2018-11-15 23:43:27 [DEBUG   ] Got command RPT from MCS: ref #520351
2018-11-15 23:43:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 23:43:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520351  77 58437 85407569 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 23:43:27 [DEBUG   ] Got command RPT from MCS: ref #520352
2018-11-15 23:43:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 23:43:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520352  12 58437 85407773 A  ERRORB£ff'
2018-11-15 23:43:37 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-15 23:43:53 [DEBUG   ] Got command BAM from MCS: ref #520353
2018-11-15 23:43:53 [INFO    ] Finished processing BAM request
2018-11-15 23:43:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:43:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520353   8 58437 85433033 A  ERROR'
2018-11-15 23:43:53 [DEBUG   ] Got command BAM from MCS: ref #520354
2018-11-15 23:43:53 [INFO    ] Finished processing BAM request
2018-11-15 23:43:53 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:43:53 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520354   8 58437 85433037 A  ERROR'
2018-11-15 23:43:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 23:43:53 [DEBUG   ] spawn_process: at 2018-11-15 23:43:53 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 23:43:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 23:43:53 [DEBUG   ] spawn_process: at 2018-11-15 23:43:53 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 23:43:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 23:43:53 [DEBUG   ] spawn_process: at 2018-11-15 23:43:53 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 23:43:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 23:43:53 [DEBUG   ] spawn_process: at 2018-11-15 23:43:53 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 23:43:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 23:43:53 [DEBUG   ] spawn_process: at 2018-11-15 23:43:53 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 23:43:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 23:43:53 [DEBUG   ] spawn_process: at 2018-11-15 23:43:53 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 23:43:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 23:43:53 [DEBUG   ] spawn_process: at 2018-11-15 23:43:53 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 23:43:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 23:43:53 [DEBUG   ] spawn_process: at 2018-11-15 23:43:53 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 23:43:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 23:43:53 [DEBUG   ] spawn_process: at 2018-11-15 23:43:53 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 23:43:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 23:43:53 [DEBUG   ] spawn_process: at 2018-11-15 23:43:53 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 23:43:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 23:43:53 [DEBUG   ] spawn_process: at 2018-11-15 23:43:53 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 23:43:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 23:43:53 [DEBUG   ] spawn_process: at 2018-11-15 23:43:53 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 23:43:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 23:43:53 [DEBUG   ] spawn_process: at 2018-11-15 23:43:53 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 23:43:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 23:43:53 [DEBUG   ] spawn_process: at 2018-11-15 23:43:53 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 23:43:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 23:43:53 [DEBUG   ] spawn_process: at 2018-11-15 23:43:53 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 23:43:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 23:43:53 [DEBUG   ] spawn_process: at 2018-11-15 23:43:53 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 23:43:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 23:43:53 [DEBUG   ] spawn_process: at 2018-11-15 23:43:53 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 23:43:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 23:43:53 [DEBUG   ] spawn_process: at 2018-11-15 23:43:53 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 23:43:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 23:43:53 [DEBUG   ] spawn_process: at 2018-11-15 23:43:53 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 23:43:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 23:43:53 [DEBUG   ] spawn_process: at 2018-11-15 23:43:53 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 23:43:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 23:43:53 [DEBUG   ] spawn_process: at 2018-11-15 23:43:53 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 23:43:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 23:43:53 [DEBUG   ] spawn_process: at 2018-11-15 23:43:53 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 23:43:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 23:43:53 [DEBUG   ] spawn_process: at 2018-11-15 23:43:53 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 23:43:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 23:43:53 [DEBUG   ] spawn_process: at 2018-11-15 23:43:53 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 23:43:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 23:43:53 [DEBUG   ] spawn_process: at 2018-11-15 23:43:53 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 23:43:53 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 23:43:53 [DEBUG   ] spawn_process: at 2018-11-15 23:43:53 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 23:43:57 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 23:43:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 23:43:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 23:43:59 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 23:43:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 23:43:59 [WARNING ] (13, 1, 'bot')
2018-11-15 23:43:59 [WARNING ] (13, 1, 'bot')
2018-11-15 23:43:59 [WARNING ] (13, 1, 'bot')
2018-11-15 23:43:59 [WARNING ] (13, 1, 'bot')
2018-11-15 23:43:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 23:43:59 [DEBUG   ] Finished updating board flags in 1.177 seconds
2018-11-15 23:44:17 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-11-15 23:44:24 [DEBUG   ] Got command BAM from MCS: ref #520355
2018-11-15 23:44:24 [INFO    ] Finished processing BAM request
2018-11-15 23:44:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:44:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520355   8 58437 85464029 A  ERROR'
2018-11-15 23:44:24 [DEBUG   ] Got command BAM from MCS: ref #520356
2018-11-15 23:44:24 [INFO    ] Finished processing BAM request
2018-11-15 23:44:24 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:44:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520356   8 58437 85464033 A  ERROR'
2018-11-15 23:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 23:44:24 [DEBUG   ] spawn_process: at 2018-11-15 23:44:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 23:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 23:44:24 [DEBUG   ] spawn_process: at 2018-11-15 23:44:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 23:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 23:44:24 [DEBUG   ] spawn_process: at 2018-11-15 23:44:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 23:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 23:44:24 [DEBUG   ] spawn_process: at 2018-11-15 23:44:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 23:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 23:44:24 [DEBUG   ] spawn_process: at 2018-11-15 23:44:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 23:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 23:44:24 [DEBUG   ] spawn_process: at 2018-11-15 23:44:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 23:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 23:44:24 [DEBUG   ] spawn_process: at 2018-11-15 23:44:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 23:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 23:44:24 [DEBUG   ] spawn_process: at 2018-11-15 23:44:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 23:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 23:44:24 [DEBUG   ] spawn_process: at 2018-11-15 23:44:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 23:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 23:44:24 [DEBUG   ] spawn_process: at 2018-11-15 23:44:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 23:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 23:44:24 [DEBUG   ] spawn_process: at 2018-11-15 23:44:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 23:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 23:44:24 [DEBUG   ] spawn_process: at 2018-11-15 23:44:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 23:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 23:44:24 [DEBUG   ] spawn_process: at 2018-11-15 23:44:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 23:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 23:44:24 [DEBUG   ] spawn_process: at 2018-11-15 23:44:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 23:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 23:44:24 [DEBUG   ] spawn_process: at 2018-11-15 23:44:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 23:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 23:44:24 [DEBUG   ] spawn_process: at 2018-11-15 23:44:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 23:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 23:44:24 [DEBUG   ] spawn_process: at 2018-11-15 23:44:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 23:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 23:44:24 [DEBUG   ] spawn_process: at 2018-11-15 23:44:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 23:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 23:44:24 [DEBUG   ] spawn_process: at 2018-11-15 23:44:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 23:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 23:44:24 [DEBUG   ] spawn_process: at 2018-11-15 23:44:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 23:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 23:44:24 [DEBUG   ] spawn_process: at 2018-11-15 23:44:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 23:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 23:44:24 [DEBUG   ] spawn_process: at 2018-11-15 23:44:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 23:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 23:44:24 [DEBUG   ] spawn_process: at 2018-11-15 23:44:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 23:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 23:44:24 [DEBUG   ] spawn_process: at 2018-11-15 23:44:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 23:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 23:44:24 [DEBUG   ] spawn_process: at 2018-11-15 23:44:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 23:44:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 23:44:24 [DEBUG   ] spawn_process: at 2018-11-15 23:44:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 23:44:37 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-15 23:44:55 [DEBUG   ] Got command BAM from MCS: ref #520362
2018-11-15 23:44:55 [INFO    ] Finished processing BAM request
2018-11-15 23:44:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:44:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520362   8 58437 85495033 A  ERROR'
2018-11-15 23:44:55 [DEBUG   ] Got command BAM from MCS: ref #520361
2018-11-15 23:44:55 [INFO    ] Finished processing BAM request
2018-11-15 23:44:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:44:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520361   8 58437 85495037 A  ERROR'
2018-11-15 23:44:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 23:44:55 [DEBUG   ] spawn_process: at 2018-11-15 23:44:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 23:44:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 23:44:55 [DEBUG   ] spawn_process: at 2018-11-15 23:44:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 23:44:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 23:44:55 [DEBUG   ] spawn_process: at 2018-11-15 23:44:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 23:44:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 23:44:55 [DEBUG   ] spawn_process: at 2018-11-15 23:44:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 23:44:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 23:44:55 [DEBUG   ] spawn_process: at 2018-11-15 23:44:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 23:44:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 23:44:55 [DEBUG   ] spawn_process: at 2018-11-15 23:44:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 23:44:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 23:44:55 [DEBUG   ] spawn_process: at 2018-11-15 23:44:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 23:44:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 23:44:55 [DEBUG   ] spawn_process: at 2018-11-15 23:44:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 23:44:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 23:44:55 [DEBUG   ] spawn_process: at 2018-11-15 23:44:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 23:44:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 23:44:55 [DEBUG   ] spawn_process: at 2018-11-15 23:44:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 23:44:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 23:44:55 [DEBUG   ] spawn_process: at 2018-11-15 23:44:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 23:44:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 23:44:55 [DEBUG   ] spawn_process: at 2018-11-15 23:44:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 23:44:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 23:44:55 [DEBUG   ] spawn_process: at 2018-11-15 23:44:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 23:44:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 23:44:55 [DEBUG   ] spawn_process: at 2018-11-15 23:44:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 23:44:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 23:44:55 [DEBUG   ] spawn_process: at 2018-11-15 23:44:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 23:44:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 23:44:55 [DEBUG   ] spawn_process: at 2018-11-15 23:44:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 23:44:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 23:44:55 [DEBUG   ] spawn_process: at 2018-11-15 23:44:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 23:44:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 23:44:55 [DEBUG   ] spawn_process: at 2018-11-15 23:44:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 23:44:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 23:44:55 [DEBUG   ] spawn_process: at 2018-11-15 23:44:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 23:44:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 23:44:55 [DEBUG   ] spawn_process: at 2018-11-15 23:44:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 23:44:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 23:44:55 [DEBUG   ] spawn_process: at 2018-11-15 23:44:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 23:44:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 23:44:55 [DEBUG   ] spawn_process: at 2018-11-15 23:44:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 23:44:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 23:44:55 [DEBUG   ] spawn_process: at 2018-11-15 23:44:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 23:44:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 23:44:55 [DEBUG   ] spawn_process: at 2018-11-15 23:44:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 23:44:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 23:44:55 [DEBUG   ] spawn_process: at 2018-11-15 23:44:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 23:44:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 23:44:55 [DEBUG   ] spawn_process: at 2018-11-15 23:44:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 23:44:57 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-15 23:44:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 23:44:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 23:44:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2018-11-15 23:44:59 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 23:44:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 23:44:59 [WARNING ] (13, 1, 'bot')
2018-11-15 23:44:59 [WARNING ] (13, 1, 'bot')
2018-11-15 23:44:59 [WARNING ] (13, 1, 'bot')
2018-11-15 23:44:59 [WARNING ] (13, 1, 'bot')
2018-11-15 23:44:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 23:44:59 [DEBUG   ] Finished updating board flags in 1.015 seconds
2018-11-15 23:45:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 23:45:26 [DEBUG   ] Got command BAM from MCS: ref #520364
2018-11-15 23:45:26 [INFO    ] Finished processing BAM request
2018-11-15 23:45:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:45:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520364   8 58437 85526025 A  ERROR'
2018-11-15 23:45:26 [DEBUG   ] Got command BAM from MCS: ref #520363
2018-11-15 23:45:26 [INFO    ] Finished processing BAM request
2018-11-15 23:45:26 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:45:26 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520363   8 58437 85526029 A  ERROR'
2018-11-15 23:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 23:45:26 [DEBUG   ] spawn_process: at 2018-11-15 23:45:26 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 23:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 23:45:26 [DEBUG   ] spawn_process: at 2018-11-15 23:45:26 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 23:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 23:45:26 [DEBUG   ] spawn_process: at 2018-11-15 23:45:26 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 23:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 23:45:26 [DEBUG   ] spawn_process: at 2018-11-15 23:45:26 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 23:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 23:45:26 [DEBUG   ] spawn_process: at 2018-11-15 23:45:26 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 23:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 23:45:26 [DEBUG   ] spawn_process: at 2018-11-15 23:45:26 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 23:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 23:45:26 [DEBUG   ] spawn_process: at 2018-11-15 23:45:26 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 23:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 23:45:26 [DEBUG   ] spawn_process: at 2018-11-15 23:45:26 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 23:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 23:45:26 [DEBUG   ] spawn_process: at 2018-11-15 23:45:26 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 23:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 23:45:26 [DEBUG   ] spawn_process: at 2018-11-15 23:45:26 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 23:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 23:45:26 [DEBUG   ] spawn_process: at 2018-11-15 23:45:26 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 23:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 23:45:26 [DEBUG   ] spawn_process: at 2018-11-15 23:45:26 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 23:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 23:45:26 [DEBUG   ] spawn_process: at 2018-11-15 23:45:26 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 23:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 23:45:26 [DEBUG   ] spawn_process: at 2018-11-15 23:45:26 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 23:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 23:45:26 [DEBUG   ] spawn_process: at 2018-11-15 23:45:26 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 23:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 23:45:26 [DEBUG   ] spawn_process: at 2018-11-15 23:45:26 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 23:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 23:45:26 [DEBUG   ] spawn_process: at 2018-11-15 23:45:26 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 23:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 23:45:26 [DEBUG   ] spawn_process: at 2018-11-15 23:45:26 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 23:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 23:45:26 [DEBUG   ] spawn_process: at 2018-11-15 23:45:26 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 23:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 23:45:26 [DEBUG   ] spawn_process: at 2018-11-15 23:45:26 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 23:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 23:45:26 [DEBUG   ] spawn_process: at 2018-11-15 23:45:26 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 23:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 23:45:26 [DEBUG   ] spawn_process: at 2018-11-15 23:45:26 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 23:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 23:45:26 [DEBUG   ] spawn_process: at 2018-11-15 23:45:26 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 23:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 23:45:26 [DEBUG   ] spawn_process: at 2018-11-15 23:45:26 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 23:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 23:45:26 [DEBUG   ] spawn_process: at 2018-11-15 23:45:26 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 23:45:26 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 23:45:26 [DEBUG   ] spawn_process: at 2018-11-15 23:45:26 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 23:45:37 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-15 23:45:45 [DEBUG   ] Got command RPT from MCS: ref #520365
2018-11-15 23:45:45 [DEBUG   ] summary = ERROR
2018-11-15 23:45:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520365  13 58437 85545237 A  ERRORERROR'
2018-11-15 23:45:45 [DEBUG   ] Got command RPT from MCS: ref #520366
2018-11-15 23:45:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 23:45:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520366  77 58437 85545238 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 23:45:57 [DEBUG   ] Got command BAM from MCS: ref #520383
2018-11-15 23:45:57 [INFO    ] Finished processing BAM request
2018-11-15 23:45:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:45:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520383   8 58437 85557025 A  ERROR'
2018-11-15 23:45:57 [DEBUG   ] Got command BAM from MCS: ref #520382
2018-11-15 23:45:57 [INFO    ] Finished processing BAM request
2018-11-15 23:45:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:45:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520382   8 58437 85557029 A  ERROR'
2018-11-15 23:45:57 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-15 23:45:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 23:45:57 [DEBUG   ] spawn_process: at 2018-11-15 23:45:57 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 23:45:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 23:45:57 [DEBUG   ] spawn_process: at 2018-11-15 23:45:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 23:45:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 23:45:57 [DEBUG   ] spawn_process: at 2018-11-15 23:45:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 23:45:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 23:45:57 [DEBUG   ] spawn_process: at 2018-11-15 23:45:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 23:45:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 23:45:57 [DEBUG   ] spawn_process: at 2018-11-15 23:45:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 23:45:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 23:45:57 [DEBUG   ] spawn_process: at 2018-11-15 23:45:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 23:45:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 23:45:57 [DEBUG   ] spawn_process: at 2018-11-15 23:45:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 23:45:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 23:45:57 [DEBUG   ] spawn_process: at 2018-11-15 23:45:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 23:45:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 23:45:57 [DEBUG   ] spawn_process: at 2018-11-15 23:45:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 23:45:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 23:45:57 [DEBUG   ] spawn_process: at 2018-11-15 23:45:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 23:45:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 23:45:57 [DEBUG   ] spawn_process: at 2018-11-15 23:45:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 23:45:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 23:45:57 [DEBUG   ] spawn_process: at 2018-11-15 23:45:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 23:45:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 23:45:57 [DEBUG   ] spawn_process: at 2018-11-15 23:45:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 23:45:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 23:45:57 [DEBUG   ] spawn_process: at 2018-11-15 23:45:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 23:45:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 23:45:57 [DEBUG   ] spawn_process: at 2018-11-15 23:45:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 23:45:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 23:45:57 [DEBUG   ] spawn_process: at 2018-11-15 23:45:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 23:45:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 23:45:57 [DEBUG   ] spawn_process: at 2018-11-15 23:45:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 23:45:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 23:45:57 [DEBUG   ] spawn_process: at 2018-11-15 23:45:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 23:45:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 23:45:57 [DEBUG   ] spawn_process: at 2018-11-15 23:45:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 23:45:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 23:45:57 [DEBUG   ] spawn_process: at 2018-11-15 23:45:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 23:45:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 23:45:57 [DEBUG   ] spawn_process: at 2018-11-15 23:45:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 23:45:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 23:45:57 [DEBUG   ] spawn_process: at 2018-11-15 23:45:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 23:45:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 23:45:57 [DEBUG   ] spawn_process: at 2018-11-15 23:45:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 23:45:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 23:45:57 [DEBUG   ] spawn_process: at 2018-11-15 23:45:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 23:45:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 23:45:57 [DEBUG   ] spawn_process: at 2018-11-15 23:45:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 23:45:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 23:45:57 [DEBUG   ] spawn_process: at 2018-11-15 23:45:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 23:45:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-11-15 23:45:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 23:45:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-15 23:45:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2018-11-15 23:45:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 23:45:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 23:45:59 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 23:45:59 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-15 23:45:59 [WARNING ] (13, 1, 'bot')
2018-11-15 23:45:59 [WARNING ] (13, 1, 'bot')
2018-11-15 23:45:59 [WARNING ] (13, 1, 'bot')
2018-11-15 23:45:59 [WARNING ] (13, 1, 'bot')
2018-11-15 23:45:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 23:45:59 [DEBUG   ] Finished updating board flags in 0.985 seconds
2018-11-15 23:46:17 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-15 23:46:28 [DEBUG   ] Got command BAM from MCS: ref #520384
2018-11-15 23:46:28 [INFO    ] Finished processing BAM request
2018-11-15 23:46:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:46:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520384   8 58437 85588029 A  ERROR'
2018-11-15 23:46:28 [DEBUG   ] Got command BAM from MCS: ref #520385
2018-11-15 23:46:28 [INFO    ] Finished processing BAM request
2018-11-15 23:46:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:46:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520385   8 58437 85588033 A  ERROR'
2018-11-15 23:46:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 23:46:28 [DEBUG   ] spawn_process: at 2018-11-15 23:46:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 23:46:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 23:46:28 [DEBUG   ] spawn_process: at 2018-11-15 23:46:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 23:46:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 23:46:28 [DEBUG   ] spawn_process: at 2018-11-15 23:46:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 23:46:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 23:46:28 [DEBUG   ] spawn_process: at 2018-11-15 23:46:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 23:46:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 23:46:28 [DEBUG   ] spawn_process: at 2018-11-15 23:46:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 23:46:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 23:46:28 [DEBUG   ] spawn_process: at 2018-11-15 23:46:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 23:46:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 23:46:28 [DEBUG   ] spawn_process: at 2018-11-15 23:46:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 23:46:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 23:46:28 [DEBUG   ] spawn_process: at 2018-11-15 23:46:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 23:46:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 23:46:28 [DEBUG   ] spawn_process: at 2018-11-15 23:46:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 23:46:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 23:46:28 [DEBUG   ] spawn_process: at 2018-11-15 23:46:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 23:46:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 23:46:28 [DEBUG   ] spawn_process: at 2018-11-15 23:46:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 23:46:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 23:46:28 [DEBUG   ] spawn_process: at 2018-11-15 23:46:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 23:46:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 23:46:28 [DEBUG   ] spawn_process: at 2018-11-15 23:46:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 23:46:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 23:46:28 [DEBUG   ] spawn_process: at 2018-11-15 23:46:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 23:46:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 23:46:28 [DEBUG   ] spawn_process: at 2018-11-15 23:46:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 23:46:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 23:46:28 [DEBUG   ] spawn_process: at 2018-11-15 23:46:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 23:46:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 23:46:28 [DEBUG   ] spawn_process: at 2018-11-15 23:46:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 23:46:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 23:46:28 [DEBUG   ] spawn_process: at 2018-11-15 23:46:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 23:46:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 23:46:28 [DEBUG   ] spawn_process: at 2018-11-15 23:46:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 23:46:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 23:46:28 [DEBUG   ] spawn_process: at 2018-11-15 23:46:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 23:46:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 23:46:28 [DEBUG   ] spawn_process: at 2018-11-15 23:46:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 23:46:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 23:46:28 [DEBUG   ] spawn_process: at 2018-11-15 23:46:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 23:46:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 23:46:28 [DEBUG   ] spawn_process: at 2018-11-15 23:46:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 23:46:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 23:46:28 [DEBUG   ] spawn_process: at 2018-11-15 23:46:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 23:46:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 23:46:28 [DEBUG   ] spawn_process: at 2018-11-15 23:46:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 23:46:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 23:46:28 [DEBUG   ] spawn_process: at 2018-11-15 23:46:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 23:46:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 23:46:57 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-15 23:46:59 [DEBUG   ] Got command BAM from MCS: ref #520387
2018-11-15 23:46:59 [INFO    ] Finished processing BAM request
2018-11-15 23:46:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:46:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520387   8 58437 85619025 A  ERROR'
2018-11-15 23:46:59 [DEBUG   ] Got command BAM from MCS: ref #520386
2018-11-15 23:46:59 [INFO    ] Finished processing BAM request
2018-11-15 23:46:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:46:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520386   8 58437 85619029 A  ERROR'
2018-11-15 23:46:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 23:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 23:46:59 [DEBUG   ] spawn_process: at 2018-11-15 23:46:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 23:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 23:46:59 [DEBUG   ] spawn_process: at 2018-11-15 23:46:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 23:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 23:46:59 [DEBUG   ] spawn_process: at 2018-11-15 23:46:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 23:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 23:46:59 [DEBUG   ] spawn_process: at 2018-11-15 23:46:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 23:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 23:46:59 [DEBUG   ] spawn_process: at 2018-11-15 23:46:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 23:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 23:46:59 [DEBUG   ] spawn_process: at 2018-11-15 23:46:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 23:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 23:46:59 [DEBUG   ] spawn_process: at 2018-11-15 23:46:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 23:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 23:46:59 [DEBUG   ] spawn_process: at 2018-11-15 23:46:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 23:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 23:46:59 [DEBUG   ] spawn_process: at 2018-11-15 23:46:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 23:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 23:46:59 [DEBUG   ] spawn_process: at 2018-11-15 23:46:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 23:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 23:46:59 [DEBUG   ] spawn_process: at 2018-11-15 23:46:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 23:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 23:46:59 [DEBUG   ] spawn_process: at 2018-11-15 23:46:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 23:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 23:46:59 [DEBUG   ] spawn_process: at 2018-11-15 23:46:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 23:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 23:46:59 [DEBUG   ] spawn_process: at 2018-11-15 23:46:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 23:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 23:46:59 [DEBUG   ] spawn_process: at 2018-11-15 23:46:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 23:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 23:46:59 [DEBUG   ] spawn_process: at 2018-11-15 23:46:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 23:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 23:46:59 [DEBUG   ] spawn_process: at 2018-11-15 23:46:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 23:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 23:46:59 [DEBUG   ] spawn_process: at 2018-11-15 23:46:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 23:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 23:46:59 [DEBUG   ] spawn_process: at 2018-11-15 23:46:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 23:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 23:46:59 [DEBUG   ] spawn_process: at 2018-11-15 23:46:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 23:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 23:46:59 [DEBUG   ] spawn_process: at 2018-11-15 23:46:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 23:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 23:46:59 [DEBUG   ] spawn_process: at 2018-11-15 23:46:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 23:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 23:46:59 [DEBUG   ] spawn_process: at 2018-11-15 23:46:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 23:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 23:46:59 [DEBUG   ] spawn_process: at 2018-11-15 23:46:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 23:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 23:46:59 [DEBUG   ] spawn_process: at 2018-11-15 23:46:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 23:46:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 23:46:59 [DEBUG   ] spawn_process: at 2018-11-15 23:46:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 23:47:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 23:47:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 23:47:00 [WARNING ] (13, 1, 'bot')
2018-11-15 23:47:00 [WARNING ] (13, 1, 'bot')
2018-11-15 23:47:00 [WARNING ] (13, 1, 'bot')
2018-11-15 23:47:00 [WARNING ] (13, 1, 'bot')
2018-11-15 23:47:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 23:47:00 [DEBUG   ] Finished updating board flags in 1.374 seconds
2018-11-15 23:47:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 23:47:30 [DEBUG   ] Got command BAM from MCS: ref #520388
2018-11-15 23:47:30 [INFO    ] Finished processing BAM request
2018-11-15 23:47:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:47:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520388   8 58437 85650029 A  ERROR'
2018-11-15 23:47:30 [DEBUG   ] Got command BAM from MCS: ref #520389
2018-11-15 23:47:30 [INFO    ] Finished processing BAM request
2018-11-15 23:47:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:47:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520389   8 58437 85650033 A  ERROR'
2018-11-15 23:47:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 23:47:30 [DEBUG   ] spawn_process: at 2018-11-15 23:47:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 23:47:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 23:47:30 [DEBUG   ] spawn_process: at 2018-11-15 23:47:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 23:47:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 23:47:30 [DEBUG   ] spawn_process: at 2018-11-15 23:47:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 23:47:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 23:47:30 [DEBUG   ] spawn_process: at 2018-11-15 23:47:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 23:47:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 23:47:30 [DEBUG   ] spawn_process: at 2018-11-15 23:47:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 23:47:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 23:47:30 [DEBUG   ] spawn_process: at 2018-11-15 23:47:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 23:47:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 23:47:30 [DEBUG   ] spawn_process: at 2018-11-15 23:47:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 23:47:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 23:47:30 [DEBUG   ] spawn_process: at 2018-11-15 23:47:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 23:47:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 23:47:30 [DEBUG   ] spawn_process: at 2018-11-15 23:47:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 23:47:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 23:47:30 [DEBUG   ] spawn_process: at 2018-11-15 23:47:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 23:47:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 23:47:30 [DEBUG   ] spawn_process: at 2018-11-15 23:47:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 23:47:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 23:47:30 [DEBUG   ] spawn_process: at 2018-11-15 23:47:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 23:47:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 23:47:30 [DEBUG   ] spawn_process: at 2018-11-15 23:47:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 23:47:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 23:47:30 [DEBUG   ] spawn_process: at 2018-11-15 23:47:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 23:47:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 23:47:30 [DEBUG   ] spawn_process: at 2018-11-15 23:47:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 23:47:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 23:47:30 [DEBUG   ] spawn_process: at 2018-11-15 23:47:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 23:47:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 23:47:30 [DEBUG   ] spawn_process: at 2018-11-15 23:47:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 23:47:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 23:47:30 [DEBUG   ] spawn_process: at 2018-11-15 23:47:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 23:47:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 23:47:30 [DEBUG   ] spawn_process: at 2018-11-15 23:47:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 23:47:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 23:47:30 [DEBUG   ] spawn_process: at 2018-11-15 23:47:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 23:47:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 23:47:30 [DEBUG   ] spawn_process: at 2018-11-15 23:47:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 23:47:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 23:47:30 [DEBUG   ] spawn_process: at 2018-11-15 23:47:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 23:47:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 23:47:30 [DEBUG   ] spawn_process: at 2018-11-15 23:47:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 23:47:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 23:47:30 [DEBUG   ] spawn_process: at 2018-11-15 23:47:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 23:47:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 23:47:30 [DEBUG   ] spawn_process: at 2018-11-15 23:47:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 23:47:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 23:47:30 [DEBUG   ] spawn_process: at 2018-11-15 23:47:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 23:47:37 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-15 23:47:57 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-15 23:47:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 23:47:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 23:47:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 23:48:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 23:48:00 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-15 23:48:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 23:48:00 [WARNING ] (13, 1, 'bot')
2018-11-15 23:48:00 [WARNING ] (13, 1, 'bot')
2018-11-15 23:48:00 [WARNING ] (13, 1, 'bot')
2018-11-15 23:48:00 [WARNING ] (13, 1, 'bot')
2018-11-15 23:48:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 23:48:00 [DEBUG   ] Finished updating board flags in 1.280 seconds
2018-11-15 23:48:01 [DEBUG   ] Got command BAM from MCS: ref #520394
2018-11-15 23:48:01 [INFO    ] Finished processing BAM request
2018-11-15 23:48:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:48:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520394   8 58437 85681025 A  ERROR'
2018-11-15 23:48:01 [DEBUG   ] Got command BAM from MCS: ref #520395
2018-11-15 23:48:01 [INFO    ] Finished processing BAM request
2018-11-15 23:48:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:48:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520395   8 58437 85681029 A  ERROR'
2018-11-15 23:48:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 23:48:01 [DEBUG   ] spawn_process: at 2018-11-15 23:48:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 23:48:02 [DEBUG   ] spawn_process: at 2018-11-15 23:48:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 23:48:02 [DEBUG   ] spawn_process: at 2018-11-15 23:48:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 23:48:02 [DEBUG   ] spawn_process: at 2018-11-15 23:48:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 23:48:02 [DEBUG   ] spawn_process: at 2018-11-15 23:48:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 23:48:02 [DEBUG   ] spawn_process: at 2018-11-15 23:48:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 23:48:02 [DEBUG   ] spawn_process: at 2018-11-15 23:48:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 23:48:02 [DEBUG   ] spawn_process: at 2018-11-15 23:48:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 23:48:02 [DEBUG   ] spawn_process: at 2018-11-15 23:48:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 23:48:02 [DEBUG   ] spawn_process: at 2018-11-15 23:48:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 23:48:02 [DEBUG   ] spawn_process: at 2018-11-15 23:48:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 23:48:02 [DEBUG   ] spawn_process: at 2018-11-15 23:48:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 23:48:02 [DEBUG   ] spawn_process: at 2018-11-15 23:48:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 23:48:02 [DEBUG   ] spawn_process: at 2018-11-15 23:48:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 23:48:02 [DEBUG   ] spawn_process: at 2018-11-15 23:48:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 23:48:02 [DEBUG   ] spawn_process: at 2018-11-15 23:48:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 23:48:02 [DEBUG   ] spawn_process: at 2018-11-15 23:48:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 23:48:02 [DEBUG   ] spawn_process: at 2018-11-15 23:48:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 23:48:02 [DEBUG   ] spawn_process: at 2018-11-15 23:48:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 23:48:02 [DEBUG   ] spawn_process: at 2018-11-15 23:48:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 23:48:02 [DEBUG   ] spawn_process: at 2018-11-15 23:48:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 23:48:02 [DEBUG   ] spawn_process: at 2018-11-15 23:48:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 23:48:02 [DEBUG   ] spawn_process: at 2018-11-15 23:48:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 23:48:02 [DEBUG   ] spawn_process: at 2018-11-15 23:48:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 23:48:02 [DEBUG   ] spawn_process: at 2018-11-15 23:48:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 23:48:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 23:48:02 [DEBUG   ] spawn_process: at 2018-11-15 23:48:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 23:48:17 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-15 23:48:27 [DEBUG   ] Got command RPT from MCS: ref #520398
2018-11-15 23:48:27 [DEBUG   ] summary = ERROR
2018-11-15 23:48:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520398  13 58437 85707053 A  ERRORERROR'
2018-11-15 23:48:27 [DEBUG   ] Got command RPT from MCS: ref #520399
2018-11-15 23:48:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 23:48:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520399  77 58437 85707257 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 23:48:27 [DEBUG   ] Got command RPT from MCS: ref #520400
2018-11-15 23:48:27 [DEBUG   ] summary = ERROR
2018-11-15 23:48:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520400  13 58437 85707449 A  ERRORERROR'
2018-11-15 23:48:27 [DEBUG   ] Got command RPT from MCS: ref #520402
2018-11-15 23:48:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 23:48:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520402  77 58437 85707653 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 23:48:27 [DEBUG   ] Got command RPT from MCS: ref #520403
2018-11-15 23:48:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 23:48:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520403  12 58437 85707857 A  ERRORB£ff'
2018-11-15 23:48:32 [DEBUG   ] Got command BAM from MCS: ref #520408
2018-11-15 23:48:32 [INFO    ] Finished processing BAM request
2018-11-15 23:48:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:48:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520408   8 58437 85712025 A  ERROR'
2018-11-15 23:48:32 [DEBUG   ] Got command BAM from MCS: ref #520409
2018-11-15 23:48:32 [INFO    ] Finished processing BAM request
2018-11-15 23:48:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:48:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520409   8 58437 85712029 A  ERROR'
2018-11-15 23:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 23:48:32 [DEBUG   ] spawn_process: at 2018-11-15 23:48:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 23:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 23:48:32 [DEBUG   ] spawn_process: at 2018-11-15 23:48:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 23:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 23:48:32 [DEBUG   ] spawn_process: at 2018-11-15 23:48:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 23:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 23:48:32 [DEBUG   ] spawn_process: at 2018-11-15 23:48:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 23:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 23:48:32 [DEBUG   ] spawn_process: at 2018-11-15 23:48:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 23:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 23:48:32 [DEBUG   ] spawn_process: at 2018-11-15 23:48:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 23:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 23:48:32 [DEBUG   ] spawn_process: at 2018-11-15 23:48:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 23:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 23:48:32 [DEBUG   ] spawn_process: at 2018-11-15 23:48:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 23:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 23:48:32 [DEBUG   ] spawn_process: at 2018-11-15 23:48:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 23:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 23:48:32 [DEBUG   ] spawn_process: at 2018-11-15 23:48:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 23:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 23:48:32 [DEBUG   ] spawn_process: at 2018-11-15 23:48:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 23:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 23:48:32 [DEBUG   ] spawn_process: at 2018-11-15 23:48:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 23:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 23:48:32 [DEBUG   ] spawn_process: at 2018-11-15 23:48:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 23:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 23:48:32 [DEBUG   ] spawn_process: at 2018-11-15 23:48:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 23:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 23:48:32 [DEBUG   ] spawn_process: at 2018-11-15 23:48:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 23:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 23:48:32 [DEBUG   ] spawn_process: at 2018-11-15 23:48:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 23:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 23:48:32 [DEBUG   ] spawn_process: at 2018-11-15 23:48:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 23:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 23:48:32 [DEBUG   ] spawn_process: at 2018-11-15 23:48:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 23:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 23:48:32 [DEBUG   ] spawn_process: at 2018-11-15 23:48:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 23:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 23:48:32 [DEBUG   ] spawn_process: at 2018-11-15 23:48:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 23:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 23:48:32 [DEBUG   ] spawn_process: at 2018-11-15 23:48:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 23:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 23:48:32 [DEBUG   ] spawn_process: at 2018-11-15 23:48:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 23:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 23:48:32 [DEBUG   ] spawn_process: at 2018-11-15 23:48:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 23:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 23:48:32 [DEBUG   ] spawn_process: at 2018-11-15 23:48:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 23:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 23:48:32 [DEBUG   ] spawn_process: at 2018-11-15 23:48:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 23:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 23:48:32 [DEBUG   ] spawn_process: at 2018-11-15 23:48:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 23:48:37 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-15 23:48:57 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-15 23:48:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 23:48:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 23:49:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 23:49:00 [WARNING ] (13, 1, 'bot')
2018-11-15 23:49:00 [WARNING ] (13, 1, 'bot')
2018-11-15 23:49:00 [WARNING ] (13, 1, 'bot')
2018-11-15 23:49:00 [WARNING ] (13, 1, 'bot')
2018-11-15 23:49:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 23:49:00 [DEBUG   ] Finished updating board flags in 1.117 seconds
2018-11-15 23:49:03 [DEBUG   ] Got command BAM from MCS: ref #520411
2018-11-15 23:49:03 [INFO    ] Finished processing BAM request
2018-11-15 23:49:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:49:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520411   8 58437 85743037 A  ERROR'
2018-11-15 23:49:03 [DEBUG   ] Got command BAM from MCS: ref #520410
2018-11-15 23:49:03 [INFO    ] Finished processing BAM request
2018-11-15 23:49:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:49:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520410   8 58437 85743045 A  ERROR'
2018-11-15 23:49:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 23:49:03 [DEBUG   ] spawn_process: at 2018-11-15 23:49:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 23:49:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 23:49:03 [DEBUG   ] spawn_process: at 2018-11-15 23:49:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 23:49:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 23:49:03 [DEBUG   ] spawn_process: at 2018-11-15 23:49:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 23:49:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 23:49:03 [DEBUG   ] spawn_process: at 2018-11-15 23:49:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 23:49:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 23:49:03 [DEBUG   ] spawn_process: at 2018-11-15 23:49:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 23:49:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 23:49:03 [DEBUG   ] spawn_process: at 2018-11-15 23:49:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 23:49:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 23:49:03 [DEBUG   ] spawn_process: at 2018-11-15 23:49:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 23:49:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 23:49:03 [DEBUG   ] spawn_process: at 2018-11-15 23:49:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 23:49:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 23:49:03 [DEBUG   ] spawn_process: at 2018-11-15 23:49:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 23:49:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 23:49:03 [DEBUG   ] spawn_process: at 2018-11-15 23:49:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 23:49:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 23:49:03 [DEBUG   ] spawn_process: at 2018-11-15 23:49:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 23:49:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 23:49:03 [DEBUG   ] spawn_process: at 2018-11-15 23:49:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 23:49:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 23:49:03 [DEBUG   ] spawn_process: at 2018-11-15 23:49:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 23:49:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 23:49:03 [DEBUG   ] spawn_process: at 2018-11-15 23:49:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 23:49:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 23:49:03 [DEBUG   ] spawn_process: at 2018-11-15 23:49:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 23:49:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 23:49:03 [DEBUG   ] spawn_process: at 2018-11-15 23:49:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 23:49:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 23:49:03 [DEBUG   ] spawn_process: at 2018-11-15 23:49:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 23:49:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 23:49:03 [DEBUG   ] spawn_process: at 2018-11-15 23:49:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 23:49:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 23:49:03 [DEBUG   ] spawn_process: at 2018-11-15 23:49:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 23:49:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 23:49:03 [DEBUG   ] spawn_process: at 2018-11-15 23:49:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 23:49:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 23:49:03 [DEBUG   ] spawn_process: at 2018-11-15 23:49:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 23:49:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 23:49:03 [DEBUG   ] spawn_process: at 2018-11-15 23:49:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 23:49:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 23:49:03 [DEBUG   ] spawn_process: at 2018-11-15 23:49:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 23:49:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 23:49:03 [DEBUG   ] spawn_process: at 2018-11-15 23:49:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 23:49:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 23:49:03 [DEBUG   ] spawn_process: at 2018-11-15 23:49:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 23:49:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 23:49:03 [DEBUG   ] spawn_process: at 2018-11-15 23:49:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 23:49:17 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-15 23:49:34 [DEBUG   ] Got command BAM from MCS: ref #520412
2018-11-15 23:49:34 [INFO    ] Finished processing BAM request
2018-11-15 23:49:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:49:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520412   8 58437 85774037 A  ERROR'
2018-11-15 23:49:34 [DEBUG   ] Got command BAM from MCS: ref #520413
2018-11-15 23:49:34 [INFO    ] Finished processing BAM request
2018-11-15 23:49:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:49:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520413   8 58437 85774045 A  ERROR'
2018-11-15 23:49:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 23:49:34 [DEBUG   ] spawn_process: at 2018-11-15 23:49:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 23:49:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 23:49:34 [DEBUG   ] spawn_process: at 2018-11-15 23:49:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 23:49:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 23:49:34 [DEBUG   ] spawn_process: at 2018-11-15 23:49:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 23:49:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 23:49:34 [DEBUG   ] spawn_process: at 2018-11-15 23:49:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 23:49:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 23:49:34 [DEBUG   ] spawn_process: at 2018-11-15 23:49:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 23:49:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 23:49:34 [DEBUG   ] spawn_process: at 2018-11-15 23:49:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 23:49:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 23:49:34 [DEBUG   ] spawn_process: at 2018-11-15 23:49:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 23:49:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 23:49:34 [DEBUG   ] spawn_process: at 2018-11-15 23:49:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 23:49:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 23:49:34 [DEBUG   ] spawn_process: at 2018-11-15 23:49:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 23:49:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 23:49:34 [DEBUG   ] spawn_process: at 2018-11-15 23:49:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 23:49:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 23:49:34 [DEBUG   ] spawn_process: at 2018-11-15 23:49:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 23:49:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 23:49:34 [DEBUG   ] spawn_process: at 2018-11-15 23:49:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 23:49:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 23:49:34 [DEBUG   ] spawn_process: at 2018-11-15 23:49:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 23:49:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 23:49:34 [DEBUG   ] spawn_process: at 2018-11-15 23:49:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 23:49:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 23:49:34 [DEBUG   ] spawn_process: at 2018-11-15 23:49:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 23:49:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 23:49:34 [DEBUG   ] spawn_process: at 2018-11-15 23:49:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 23:49:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 23:49:34 [DEBUG   ] spawn_process: at 2018-11-15 23:49:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 23:49:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 23:49:34 [DEBUG   ] spawn_process: at 2018-11-15 23:49:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 23:49:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 23:49:34 [DEBUG   ] spawn_process: at 2018-11-15 23:49:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 23:49:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 23:49:34 [DEBUG   ] spawn_process: at 2018-11-15 23:49:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 23:49:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 23:49:34 [DEBUG   ] spawn_process: at 2018-11-15 23:49:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 23:49:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 23:49:34 [DEBUG   ] spawn_process: at 2018-11-15 23:49:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 23:49:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 23:49:34 [DEBUG   ] spawn_process: at 2018-11-15 23:49:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 23:49:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 23:49:34 [DEBUG   ] spawn_process: at 2018-11-15 23:49:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 23:49:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 23:49:34 [DEBUG   ] spawn_process: at 2018-11-15 23:49:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 23:49:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 23:49:34 [DEBUG   ] spawn_process: at 2018-11-15 23:49:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 23:49:37 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 23:49:57 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-15 23:49:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 23:49:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 23:50:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-15 23:50:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-11-15 23:50:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 23:50:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 23:50:00 [WARNING ] (13, 1, 'bot')
2018-11-15 23:50:00 [WARNING ] (13, 1, 'bot')
2018-11-15 23:50:00 [WARNING ] (13, 1, 'bot')
2018-11-15 23:50:00 [WARNING ] (13, 1, 'bot')
2018-11-15 23:50:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 23:50:00 [DEBUG   ] Finished updating board flags in 1.012 seconds
2018-11-15 23:50:05 [DEBUG   ] Got command BAM from MCS: ref #520415
2018-11-15 23:50:05 [INFO    ] Finished processing BAM request
2018-11-15 23:50:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:50:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520415   8 58437 85805029 A  ERROR'
2018-11-15 23:50:05 [DEBUG   ] Got command BAM from MCS: ref #520414
2018-11-15 23:50:05 [INFO    ] Finished processing BAM request
2018-11-15 23:50:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:50:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520414   8 58437 85805033 A  ERROR'
2018-11-15 23:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 23:50:05 [DEBUG   ] spawn_process: at 2018-11-15 23:50:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 23:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 23:50:05 [DEBUG   ] spawn_process: at 2018-11-15 23:50:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 23:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 23:50:05 [DEBUG   ] spawn_process: at 2018-11-15 23:50:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 23:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 23:50:05 [DEBUG   ] spawn_process: at 2018-11-15 23:50:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 23:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 23:50:05 [DEBUG   ] spawn_process: at 2018-11-15 23:50:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 23:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 23:50:05 [DEBUG   ] spawn_process: at 2018-11-15 23:50:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 23:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 23:50:05 [DEBUG   ] spawn_process: at 2018-11-15 23:50:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 23:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 23:50:05 [DEBUG   ] spawn_process: at 2018-11-15 23:50:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 23:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 23:50:05 [DEBUG   ] spawn_process: at 2018-11-15 23:50:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 23:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 23:50:05 [DEBUG   ] spawn_process: at 2018-11-15 23:50:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 23:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 23:50:05 [DEBUG   ] spawn_process: at 2018-11-15 23:50:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 23:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 23:50:05 [DEBUG   ] spawn_process: at 2018-11-15 23:50:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 23:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 23:50:05 [DEBUG   ] spawn_process: at 2018-11-15 23:50:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 23:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 23:50:05 [DEBUG   ] spawn_process: at 2018-11-15 23:50:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 23:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 23:50:05 [DEBUG   ] spawn_process: at 2018-11-15 23:50:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 23:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 23:50:05 [DEBUG   ] spawn_process: at 2018-11-15 23:50:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 23:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 23:50:05 [DEBUG   ] spawn_process: at 2018-11-15 23:50:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 23:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 23:50:05 [DEBUG   ] spawn_process: at 2018-11-15 23:50:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 23:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 23:50:05 [DEBUG   ] spawn_process: at 2018-11-15 23:50:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 23:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 23:50:05 [DEBUG   ] spawn_process: at 2018-11-15 23:50:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 23:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 23:50:05 [DEBUG   ] spawn_process: at 2018-11-15 23:50:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 23:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 23:50:05 [DEBUG   ] spawn_process: at 2018-11-15 23:50:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 23:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 23:50:05 [DEBUG   ] spawn_process: at 2018-11-15 23:50:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 23:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 23:50:05 [DEBUG   ] spawn_process: at 2018-11-15 23:50:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 23:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 23:50:05 [DEBUG   ] spawn_process: at 2018-11-15 23:50:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 23:50:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 23:50:05 [DEBUG   ] spawn_process: at 2018-11-15 23:50:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 23:50:17 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-15 23:50:36 [DEBUG   ] Got command BAM from MCS: ref #520421
2018-11-15 23:50:36 [INFO    ] Finished processing BAM request
2018-11-15 23:50:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:50:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520421   8 58437 85836033 A  ERROR'
2018-11-15 23:50:36 [DEBUG   ] Got command BAM from MCS: ref #520420
2018-11-15 23:50:36 [INFO    ] Finished processing BAM request
2018-11-15 23:50:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:50:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520420   8 58437 85836037 A  ERROR'
2018-11-15 23:50:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 23:50:36 [DEBUG   ] spawn_process: at 2018-11-15 23:50:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 23:50:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 23:50:36 [DEBUG   ] spawn_process: at 2018-11-15 23:50:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 23:50:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 23:50:36 [DEBUG   ] spawn_process: at 2018-11-15 23:50:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 23:50:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 23:50:36 [DEBUG   ] spawn_process: at 2018-11-15 23:50:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 23:50:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 23:50:36 [DEBUG   ] spawn_process: at 2018-11-15 23:50:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 23:50:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 23:50:36 [DEBUG   ] spawn_process: at 2018-11-15 23:50:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 23:50:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 23:50:36 [DEBUG   ] spawn_process: at 2018-11-15 23:50:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 23:50:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 23:50:36 [DEBUG   ] spawn_process: at 2018-11-15 23:50:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 23:50:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 23:50:36 [DEBUG   ] spawn_process: at 2018-11-15 23:50:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 23:50:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 23:50:36 [DEBUG   ] spawn_process: at 2018-11-15 23:50:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 23:50:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 23:50:36 [DEBUG   ] spawn_process: at 2018-11-15 23:50:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 23:50:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 23:50:36 [DEBUG   ] spawn_process: at 2018-11-15 23:50:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 23:50:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 23:50:36 [DEBUG   ] spawn_process: at 2018-11-15 23:50:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 23:50:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 23:50:36 [DEBUG   ] spawn_process: at 2018-11-15 23:50:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 23:50:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 23:50:36 [DEBUG   ] spawn_process: at 2018-11-15 23:50:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 23:50:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 23:50:36 [DEBUG   ] spawn_process: at 2018-11-15 23:50:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 23:50:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 23:50:36 [DEBUG   ] spawn_process: at 2018-11-15 23:50:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 23:50:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 23:50:36 [DEBUG   ] spawn_process: at 2018-11-15 23:50:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 23:50:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 23:50:36 [DEBUG   ] spawn_process: at 2018-11-15 23:50:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 23:50:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 23:50:36 [DEBUG   ] spawn_process: at 2018-11-15 23:50:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 23:50:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 23:50:36 [DEBUG   ] spawn_process: at 2018-11-15 23:50:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 23:50:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 23:50:36 [DEBUG   ] spawn_process: at 2018-11-15 23:50:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 23:50:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 23:50:36 [DEBUG   ] spawn_process: at 2018-11-15 23:50:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 23:50:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 23:50:36 [DEBUG   ] spawn_process: at 2018-11-15 23:50:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 23:50:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 23:50:36 [DEBUG   ] spawn_process: at 2018-11-15 23:50:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 23:50:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 23:50:36 [DEBUG   ] spawn_process: at 2018-11-15 23:50:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 23:50:37 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-15 23:50:45 [DEBUG   ] Got command RPT from MCS: ref #520422
2018-11-15 23:50:45 [DEBUG   ] summary = ERROR
2018-11-15 23:50:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520422  13 58437 85845245 A  ERRORERROR'
2018-11-15 23:50:45 [DEBUG   ] Got command RPT from MCS: ref #520423
2018-11-15 23:50:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 23:50:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520423  77 58437 85845246 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 23:50:58 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-15 23:50:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 23:51:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-11-15 23:51:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-11-15 23:51:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 23:51:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 23:51:00 [WARNING ] (13, 1, 'bot')
2018-11-15 23:51:00 [WARNING ] (13, 1, 'bot')
2018-11-15 23:51:00 [WARNING ] (13, 1, 'bot')
2018-11-15 23:51:00 [WARNING ] (13, 1, 'bot')
2018-11-15 23:51:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 23:51:00 [DEBUG   ] Finished updating board flags in 0.995 seconds
2018-11-15 23:51:07 [DEBUG   ] Got command BAM from MCS: ref #520439
2018-11-15 23:51:07 [INFO    ] Finished processing BAM request
2018-11-15 23:51:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:51:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520439   8 58437 85867033 A  ERROR'
2018-11-15 23:51:07 [DEBUG   ] Got command BAM from MCS: ref #520440
2018-11-15 23:51:07 [INFO    ] Finished processing BAM request
2018-11-15 23:51:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:51:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520440   8 58437 85867037 A  ERROR'
2018-11-15 23:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 23:51:07 [DEBUG   ] spawn_process: at 2018-11-15 23:51:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 23:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 23:51:07 [DEBUG   ] spawn_process: at 2018-11-15 23:51:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 23:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 23:51:07 [DEBUG   ] spawn_process: at 2018-11-15 23:51:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 23:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 23:51:07 [DEBUG   ] spawn_process: at 2018-11-15 23:51:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 23:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 23:51:07 [DEBUG   ] spawn_process: at 2018-11-15 23:51:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 23:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 23:51:07 [DEBUG   ] spawn_process: at 2018-11-15 23:51:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 23:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 23:51:07 [DEBUG   ] spawn_process: at 2018-11-15 23:51:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 23:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 23:51:07 [DEBUG   ] spawn_process: at 2018-11-15 23:51:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 23:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 23:51:07 [DEBUG   ] spawn_process: at 2018-11-15 23:51:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 23:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 23:51:07 [DEBUG   ] spawn_process: at 2018-11-15 23:51:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 23:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 23:51:07 [DEBUG   ] spawn_process: at 2018-11-15 23:51:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 23:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 23:51:07 [DEBUG   ] spawn_process: at 2018-11-15 23:51:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 23:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 23:51:07 [DEBUG   ] spawn_process: at 2018-11-15 23:51:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 23:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 23:51:07 [DEBUG   ] spawn_process: at 2018-11-15 23:51:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 23:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 23:51:07 [DEBUG   ] spawn_process: at 2018-11-15 23:51:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 23:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 23:51:07 [DEBUG   ] spawn_process: at 2018-11-15 23:51:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 23:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 23:51:07 [DEBUG   ] spawn_process: at 2018-11-15 23:51:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 23:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 23:51:07 [DEBUG   ] spawn_process: at 2018-11-15 23:51:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 23:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 23:51:07 [DEBUG   ] spawn_process: at 2018-11-15 23:51:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 23:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 23:51:07 [DEBUG   ] spawn_process: at 2018-11-15 23:51:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 23:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 23:51:07 [DEBUG   ] spawn_process: at 2018-11-15 23:51:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 23:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 23:51:07 [DEBUG   ] spawn_process: at 2018-11-15 23:51:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 23:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 23:51:07 [DEBUG   ] spawn_process: at 2018-11-15 23:51:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 23:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 23:51:07 [DEBUG   ] spawn_process: at 2018-11-15 23:51:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 23:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 23:51:07 [DEBUG   ] spawn_process: at 2018-11-15 23:51:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 23:51:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 23:51:07 [DEBUG   ] spawn_process: at 2018-11-15 23:51:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 23:51:18 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-15 23:51:38 [DEBUG   ] Got command BAM from MCS: ref #520441
2018-11-15 23:51:38 [INFO    ] Finished processing BAM request
2018-11-15 23:51:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:51:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520441   8 58437 85898033 A  ERROR'
2018-11-15 23:51:38 [DEBUG   ] Got command BAM from MCS: ref #520442
2018-11-15 23:51:38 [INFO    ] Finished processing BAM request
2018-11-15 23:51:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:51:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520442   8 58437 85898037 A  ERROR'
2018-11-15 23:51:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 23:51:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 23:51:38 [DEBUG   ] spawn_process: at 2018-11-15 23:51:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 23:51:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 23:51:38 [DEBUG   ] spawn_process: at 2018-11-15 23:51:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 23:51:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 23:51:38 [DEBUG   ] spawn_process: at 2018-11-15 23:51:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 23:51:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 23:51:38 [DEBUG   ] spawn_process: at 2018-11-15 23:51:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 23:51:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 23:51:38 [DEBUG   ] spawn_process: at 2018-11-15 23:51:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 23:51:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 23:51:38 [DEBUG   ] spawn_process: at 2018-11-15 23:51:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 23:51:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 23:51:38 [DEBUG   ] spawn_process: at 2018-11-15 23:51:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 23:51:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 23:51:38 [DEBUG   ] spawn_process: at 2018-11-15 23:51:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 23:51:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 23:51:38 [DEBUG   ] spawn_process: at 2018-11-15 23:51:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 23:51:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 23:51:38 [DEBUG   ] spawn_process: at 2018-11-15 23:51:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 23:51:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 23:51:38 [DEBUG   ] spawn_process: at 2018-11-15 23:51:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 23:51:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 23:51:38 [DEBUG   ] spawn_process: at 2018-11-15 23:51:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 23:51:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 23:51:38 [DEBUG   ] spawn_process: at 2018-11-15 23:51:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 23:51:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 23:51:38 [DEBUG   ] spawn_process: at 2018-11-15 23:51:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 23:51:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 23:51:38 [DEBUG   ] spawn_process: at 2018-11-15 23:51:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 23:51:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 23:51:38 [DEBUG   ] spawn_process: at 2018-11-15 23:51:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 23:51:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 23:51:38 [DEBUG   ] spawn_process: at 2018-11-15 23:51:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 23:51:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 23:51:38 [DEBUG   ] spawn_process: at 2018-11-15 23:51:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 23:51:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 23:51:38 [DEBUG   ] spawn_process: at 2018-11-15 23:51:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 23:51:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 23:51:38 [DEBUG   ] spawn_process: at 2018-11-15 23:51:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 23:51:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 23:51:38 [DEBUG   ] spawn_process: at 2018-11-15 23:51:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 23:51:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 23:51:38 [DEBUG   ] spawn_process: at 2018-11-15 23:51:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 23:51:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 23:51:38 [DEBUG   ] spawn_process: at 2018-11-15 23:51:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 23:51:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 23:51:38 [DEBUG   ] spawn_process: at 2018-11-15 23:51:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 23:51:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 23:51:38 [DEBUG   ] spawn_process: at 2018-11-15 23:51:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 23:51:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 23:51:38 [DEBUG   ] spawn_process: at 2018-11-15 23:51:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 23:51:58 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-15 23:52:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-15 23:52:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 23:52:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 23:52:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-15 23:52:01 [WARNING ] (13, 1, 'bot')
2018-11-15 23:52:01 [WARNING ] (13, 1, 'bot')
2018-11-15 23:52:01 [WARNING ] (13, 1, 'bot')
2018-11-15 23:52:01 [WARNING ] (13, 1, 'bot')
2018-11-15 23:52:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 23:52:01 [DEBUG   ] Finished updating board flags in 1.804 seconds
2018-11-15 23:52:09 [DEBUG   ] Got command BAM from MCS: ref #520444
2018-11-15 23:52:09 [INFO    ] Finished processing BAM request
2018-11-15 23:52:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:52:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520444   8 58437 85929029 A  ERROR'
2018-11-15 23:52:09 [DEBUG   ] Got command BAM from MCS: ref #520443
2018-11-15 23:52:09 [INFO    ] Finished processing BAM request
2018-11-15 23:52:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:52:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520443   8 58437 85929033 A  ERROR'
2018-11-15 23:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 23:52:09 [DEBUG   ] spawn_process: at 2018-11-15 23:52:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 23:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 23:52:09 [DEBUG   ] spawn_process: at 2018-11-15 23:52:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 23:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 23:52:09 [DEBUG   ] spawn_process: at 2018-11-15 23:52:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 23:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 23:52:09 [DEBUG   ] spawn_process: at 2018-11-15 23:52:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 23:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 23:52:09 [DEBUG   ] spawn_process: at 2018-11-15 23:52:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 23:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 23:52:09 [DEBUG   ] spawn_process: at 2018-11-15 23:52:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 23:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 23:52:09 [DEBUG   ] spawn_process: at 2018-11-15 23:52:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 23:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 23:52:09 [DEBUG   ] spawn_process: at 2018-11-15 23:52:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 23:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 23:52:09 [DEBUG   ] spawn_process: at 2018-11-15 23:52:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 23:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 23:52:09 [DEBUG   ] spawn_process: at 2018-11-15 23:52:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 23:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 23:52:09 [DEBUG   ] spawn_process: at 2018-11-15 23:52:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 23:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 23:52:09 [DEBUG   ] spawn_process: at 2018-11-15 23:52:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 23:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 23:52:09 [DEBUG   ] spawn_process: at 2018-11-15 23:52:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 23:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 23:52:09 [DEBUG   ] spawn_process: at 2018-11-15 23:52:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 23:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 23:52:09 [DEBUG   ] spawn_process: at 2018-11-15 23:52:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 23:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 23:52:09 [DEBUG   ] spawn_process: at 2018-11-15 23:52:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 23:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 23:52:09 [DEBUG   ] spawn_process: at 2018-11-15 23:52:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 23:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 23:52:09 [DEBUG   ] spawn_process: at 2018-11-15 23:52:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 23:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 23:52:09 [DEBUG   ] spawn_process: at 2018-11-15 23:52:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 23:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 23:52:09 [DEBUG   ] spawn_process: at 2018-11-15 23:52:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 23:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 23:52:09 [DEBUG   ] spawn_process: at 2018-11-15 23:52:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 23:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 23:52:09 [DEBUG   ] spawn_process: at 2018-11-15 23:52:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 23:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 23:52:09 [DEBUG   ] spawn_process: at 2018-11-15 23:52:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 23:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 23:52:09 [DEBUG   ] spawn_process: at 2018-11-15 23:52:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 23:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 23:52:09 [DEBUG   ] spawn_process: at 2018-11-15 23:52:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 23:52:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 23:52:09 [DEBUG   ] spawn_process: at 2018-11-15 23:52:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 23:52:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 23:52:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 23:52:40 [DEBUG   ] Got command BAM from MCS: ref #520446
2018-11-15 23:52:40 [INFO    ] Finished processing BAM request
2018-11-15 23:52:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520446   8 58437 85960033 A  ERROR'
2018-11-15 23:52:40 [DEBUG   ] Got command BAM from MCS: ref #520445
2018-11-15 23:52:40 [INFO    ] Finished processing BAM request
2018-11-15 23:52:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:52:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520445   8 58437 85960037 A  ERROR'
2018-11-15 23:52:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 23:52:40 [DEBUG   ] spawn_process: at 2018-11-15 23:52:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 23:52:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 23:52:40 [DEBUG   ] spawn_process: at 2018-11-15 23:52:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 23:52:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 23:52:40 [DEBUG   ] spawn_process: at 2018-11-15 23:52:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 23:52:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 23:52:40 [DEBUG   ] spawn_process: at 2018-11-15 23:52:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 23:52:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 23:52:40 [DEBUG   ] spawn_process: at 2018-11-15 23:52:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 23:52:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 23:52:40 [DEBUG   ] spawn_process: at 2018-11-15 23:52:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 23:52:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 23:52:40 [DEBUG   ] spawn_process: at 2018-11-15 23:52:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 23:52:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 23:52:40 [DEBUG   ] spawn_process: at 2018-11-15 23:52:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 23:52:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 23:52:40 [DEBUG   ] spawn_process: at 2018-11-15 23:52:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 23:52:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 23:52:40 [DEBUG   ] spawn_process: at 2018-11-15 23:52:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 23:52:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 23:52:40 [DEBUG   ] spawn_process: at 2018-11-15 23:52:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 23:52:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 23:52:40 [DEBUG   ] spawn_process: at 2018-11-15 23:52:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 23:52:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 23:52:40 [DEBUG   ] spawn_process: at 2018-11-15 23:52:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 23:52:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 23:52:40 [DEBUG   ] spawn_process: at 2018-11-15 23:52:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 23:52:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 23:52:40 [DEBUG   ] spawn_process: at 2018-11-15 23:52:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 23:52:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 23:52:40 [DEBUG   ] spawn_process: at 2018-11-15 23:52:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 23:52:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 23:52:40 [DEBUG   ] spawn_process: at 2018-11-15 23:52:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 23:52:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 23:52:40 [DEBUG   ] spawn_process: at 2018-11-15 23:52:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 23:52:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 23:52:40 [DEBUG   ] spawn_process: at 2018-11-15 23:52:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 23:52:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 23:52:40 [DEBUG   ] spawn_process: at 2018-11-15 23:52:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 23:52:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 23:52:40 [DEBUG   ] spawn_process: at 2018-11-15 23:52:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 23:52:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 23:52:40 [DEBUG   ] spawn_process: at 2018-11-15 23:52:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 23:52:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 23:52:40 [DEBUG   ] spawn_process: at 2018-11-15 23:52:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 23:52:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 23:52:40 [DEBUG   ] spawn_process: at 2018-11-15 23:52:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 23:52:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 23:52:40 [DEBUG   ] spawn_process: at 2018-11-15 23:52:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 23:52:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 23:52:40 [DEBUG   ] spawn_process: at 2018-11-15 23:52:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 23:52:58 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-15 23:53:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 23:53:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 23:53:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 23:53:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-11-15 23:53:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 23:53:00 [WARNING ] (13, 1, 'bot')
2018-11-15 23:53:00 [WARNING ] (13, 1, 'bot')
2018-11-15 23:53:00 [WARNING ] (13, 1, 'bot')
2018-11-15 23:53:00 [WARNING ] (13, 1, 'bot')
2018-11-15 23:53:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 23:53:00 [DEBUG   ] Finished updating board flags in 1.237 seconds
2018-11-15 23:53:11 [DEBUG   ] Got command BAM from MCS: ref #520448
2018-11-15 23:53:11 [INFO    ] Finished processing BAM request
2018-11-15 23:53:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:53:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520448   8 58437 85991033 A  ERROR'
2018-11-15 23:53:11 [DEBUG   ] Got command BAM from MCS: ref #520447
2018-11-15 23:53:11 [INFO    ] Finished processing BAM request
2018-11-15 23:53:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:53:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520447   8 58437 85991037 A  ERROR'
2018-11-15 23:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 23:53:11 [DEBUG   ] spawn_process: at 2018-11-15 23:53:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 23:53:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 23:53:12 [DEBUG   ] spawn_process: at 2018-11-15 23:53:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 23:53:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 23:53:12 [DEBUG   ] spawn_process: at 2018-11-15 23:53:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 23:53:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 23:53:12 [DEBUG   ] spawn_process: at 2018-11-15 23:53:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 23:53:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 23:53:12 [DEBUG   ] spawn_process: at 2018-11-15 23:53:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 23:53:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 23:53:12 [DEBUG   ] spawn_process: at 2018-11-15 23:53:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 23:53:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 23:53:12 [DEBUG   ] spawn_process: at 2018-11-15 23:53:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 23:53:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 23:53:12 [DEBUG   ] spawn_process: at 2018-11-15 23:53:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 23:53:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 23:53:12 [DEBUG   ] spawn_process: at 2018-11-15 23:53:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 23:53:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 23:53:12 [DEBUG   ] spawn_process: at 2018-11-15 23:53:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 23:53:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 23:53:12 [DEBUG   ] spawn_process: at 2018-11-15 23:53:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 23:53:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 23:53:12 [DEBUG   ] spawn_process: at 2018-11-15 23:53:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 23:53:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 23:53:12 [DEBUG   ] spawn_process: at 2018-11-15 23:53:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 23:53:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 23:53:12 [DEBUG   ] spawn_process: at 2018-11-15 23:53:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 23:53:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 23:53:12 [DEBUG   ] spawn_process: at 2018-11-15 23:53:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 23:53:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 23:53:12 [DEBUG   ] spawn_process: at 2018-11-15 23:53:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 23:53:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 23:53:12 [DEBUG   ] spawn_process: at 2018-11-15 23:53:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 23:53:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 23:53:12 [DEBUG   ] spawn_process: at 2018-11-15 23:53:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 23:53:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 23:53:12 [DEBUG   ] spawn_process: at 2018-11-15 23:53:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 23:53:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 23:53:12 [DEBUG   ] spawn_process: at 2018-11-15 23:53:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 23:53:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 23:53:12 [DEBUG   ] spawn_process: at 2018-11-15 23:53:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 23:53:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 23:53:12 [DEBUG   ] spawn_process: at 2018-11-15 23:53:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 23:53:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 23:53:12 [DEBUG   ] spawn_process: at 2018-11-15 23:53:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 23:53:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 23:53:12 [DEBUG   ] spawn_process: at 2018-11-15 23:53:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 23:53:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 23:53:12 [DEBUG   ] spawn_process: at 2018-11-15 23:53:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 23:53:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 23:53:12 [DEBUG   ] spawn_process: at 2018-11-15 23:53:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 23:53:18 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-15 23:53:27 [DEBUG   ] Got command RPT from MCS: ref #520449
2018-11-15 23:53:27 [DEBUG   ] summary = ERROR
2018-11-15 23:53:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520449  13 58437 86007141 A  ERRORERROR'
2018-11-15 23:53:27 [DEBUG   ] Got command RPT from MCS: ref #520450
2018-11-15 23:53:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 23:53:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520450  77 58437 86007345 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 23:53:27 [DEBUG   ] Got command RPT from MCS: ref #520451
2018-11-15 23:53:27 [DEBUG   ] summary = ERROR
2018-11-15 23:53:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520451  13 58437 86007537 A  ERRORERROR'
2018-11-15 23:53:27 [DEBUG   ] Got command RPT from MCS: ref #520452
2018-11-15 23:53:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 23:53:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520452  77 58437 86007741 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 23:53:27 [DEBUG   ] Got command RPT from MCS: ref #520453
2018-11-15 23:53:27 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 23:53:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520453  12 58437 86007945 A  ERRORB£ff'
2018-11-15 23:53:38 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 23:53:42 [DEBUG   ] Got command BAM from MCS: ref #520458
2018-11-15 23:53:42 [INFO    ] Finished processing BAM request
2018-11-15 23:53:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:53:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520458   8 58437 86022025 A  ERROR'
2018-11-15 23:53:42 [DEBUG   ] Got command BAM from MCS: ref #520459
2018-11-15 23:53:42 [INFO    ] Finished processing BAM request
2018-11-15 23:53:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:53:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520459   8 58437 86022029 A  ERROR'
2018-11-15 23:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 23:53:42 [DEBUG   ] spawn_process: at 2018-11-15 23:53:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 23:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 23:53:42 [DEBUG   ] spawn_process: at 2018-11-15 23:53:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 23:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 23:53:42 [DEBUG   ] spawn_process: at 2018-11-15 23:53:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 23:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 23:53:42 [DEBUG   ] spawn_process: at 2018-11-15 23:53:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 23:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 23:53:42 [DEBUG   ] spawn_process: at 2018-11-15 23:53:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 23:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 23:53:42 [DEBUG   ] spawn_process: at 2018-11-15 23:53:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 23:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 23:53:42 [DEBUG   ] spawn_process: at 2018-11-15 23:53:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 23:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 23:53:42 [DEBUG   ] spawn_process: at 2018-11-15 23:53:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 23:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 23:53:42 [DEBUG   ] spawn_process: at 2018-11-15 23:53:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 23:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 23:53:42 [DEBUG   ] spawn_process: at 2018-11-15 23:53:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 23:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 23:53:42 [DEBUG   ] spawn_process: at 2018-11-15 23:53:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 23:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 23:53:42 [DEBUG   ] spawn_process: at 2018-11-15 23:53:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 23:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 23:53:42 [DEBUG   ] spawn_process: at 2018-11-15 23:53:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 23:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 23:53:42 [DEBUG   ] spawn_process: at 2018-11-15 23:53:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 23:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 23:53:42 [DEBUG   ] spawn_process: at 2018-11-15 23:53:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 23:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 23:53:42 [DEBUG   ] spawn_process: at 2018-11-15 23:53:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 23:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 23:53:42 [DEBUG   ] spawn_process: at 2018-11-15 23:53:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 23:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 23:53:42 [DEBUG   ] spawn_process: at 2018-11-15 23:53:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 23:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 23:53:42 [DEBUG   ] spawn_process: at 2018-11-15 23:53:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 23:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 23:53:42 [DEBUG   ] spawn_process: at 2018-11-15 23:53:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 23:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 23:53:42 [DEBUG   ] spawn_process: at 2018-11-15 23:53:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 23:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 23:53:42 [DEBUG   ] spawn_process: at 2018-11-15 23:53:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 23:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 23:53:42 [DEBUG   ] spawn_process: at 2018-11-15 23:53:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 23:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 23:53:42 [DEBUG   ] spawn_process: at 2018-11-15 23:53:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 23:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 23:53:42 [DEBUG   ] spawn_process: at 2018-11-15 23:53:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 23:53:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 23:53:42 [DEBUG   ] spawn_process: at 2018-11-15 23:53:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 23:53:58 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-15 23:54:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 23:54:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 23:54:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 23:54:00 [WARNING ] (13, 1, 'bot')
2018-11-15 23:54:00 [WARNING ] (13, 1, 'bot')
2018-11-15 23:54:00 [WARNING ] (13, 1, 'bot')
2018-11-15 23:54:00 [WARNING ] (13, 1, 'bot')
2018-11-15 23:54:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 23:54:00 [DEBUG   ] Finished updating board flags in 1.228 seconds
2018-11-15 23:54:13 [DEBUG   ] Got command BAM from MCS: ref #520461
2018-11-15 23:54:13 [INFO    ] Finished processing BAM request
2018-11-15 23:54:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:54:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520461   8 58437 86053033 A  ERROR'
2018-11-15 23:54:13 [DEBUG   ] Got command BAM from MCS: ref #520460
2018-11-15 23:54:13 [INFO    ] Finished processing BAM request
2018-11-15 23:54:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:54:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520460   8 58437 86053037 A  ERROR'
2018-11-15 23:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 23:54:13 [DEBUG   ] spawn_process: at 2018-11-15 23:54:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 23:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 23:54:13 [DEBUG   ] spawn_process: at 2018-11-15 23:54:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 23:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 23:54:13 [DEBUG   ] spawn_process: at 2018-11-15 23:54:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 23:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 23:54:13 [DEBUG   ] spawn_process: at 2018-11-15 23:54:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 23:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 23:54:13 [DEBUG   ] spawn_process: at 2018-11-15 23:54:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 23:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 23:54:13 [DEBUG   ] spawn_process: at 2018-11-15 23:54:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 23:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 23:54:13 [DEBUG   ] spawn_process: at 2018-11-15 23:54:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 23:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 23:54:13 [DEBUG   ] spawn_process: at 2018-11-15 23:54:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 23:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 23:54:13 [DEBUG   ] spawn_process: at 2018-11-15 23:54:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 23:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 23:54:13 [DEBUG   ] spawn_process: at 2018-11-15 23:54:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 23:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 23:54:13 [DEBUG   ] spawn_process: at 2018-11-15 23:54:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 23:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 23:54:13 [DEBUG   ] spawn_process: at 2018-11-15 23:54:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 23:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 23:54:13 [DEBUG   ] spawn_process: at 2018-11-15 23:54:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 23:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 23:54:13 [DEBUG   ] spawn_process: at 2018-11-15 23:54:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 23:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 23:54:13 [DEBUG   ] spawn_process: at 2018-11-15 23:54:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 23:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 23:54:13 [DEBUG   ] spawn_process: at 2018-11-15 23:54:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 23:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 23:54:13 [DEBUG   ] spawn_process: at 2018-11-15 23:54:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 23:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 23:54:13 [DEBUG   ] spawn_process: at 2018-11-15 23:54:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 23:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 23:54:13 [DEBUG   ] spawn_process: at 2018-11-15 23:54:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 23:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 23:54:13 [DEBUG   ] spawn_process: at 2018-11-15 23:54:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 23:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 23:54:13 [DEBUG   ] spawn_process: at 2018-11-15 23:54:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 23:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 23:54:13 [DEBUG   ] spawn_process: at 2018-11-15 23:54:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 23:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 23:54:13 [DEBUG   ] spawn_process: at 2018-11-15 23:54:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 23:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 23:54:13 [DEBUG   ] spawn_process: at 2018-11-15 23:54:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 23:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 23:54:13 [DEBUG   ] spawn_process: at 2018-11-15 23:54:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 23:54:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 23:54:13 [DEBUG   ] spawn_process: at 2018-11-15 23:54:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 23:54:18 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 23:54:38 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-15 23:54:44 [DEBUG   ] Got command BAM from MCS: ref #520463
2018-11-15 23:54:44 [INFO    ] Finished processing BAM request
2018-11-15 23:54:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:54:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520463   8 58437 86084033 A  ERROR'
2018-11-15 23:54:44 [DEBUG   ] Got command BAM from MCS: ref #520462
2018-11-15 23:54:44 [INFO    ] Finished processing BAM request
2018-11-15 23:54:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:54:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520462   8 58437 86084037 A  ERROR'
2018-11-15 23:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 23:54:44 [DEBUG   ] spawn_process: at 2018-11-15 23:54:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 23:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 23:54:44 [DEBUG   ] spawn_process: at 2018-11-15 23:54:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 23:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 23:54:44 [DEBUG   ] spawn_process: at 2018-11-15 23:54:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 23:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 23:54:44 [DEBUG   ] spawn_process: at 2018-11-15 23:54:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 23:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 23:54:44 [DEBUG   ] spawn_process: at 2018-11-15 23:54:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 23:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 23:54:44 [DEBUG   ] spawn_process: at 2018-11-15 23:54:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 23:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 23:54:44 [DEBUG   ] spawn_process: at 2018-11-15 23:54:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 23:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 23:54:44 [DEBUG   ] spawn_process: at 2018-11-15 23:54:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 23:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 23:54:44 [DEBUG   ] spawn_process: at 2018-11-15 23:54:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 23:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 23:54:44 [DEBUG   ] spawn_process: at 2018-11-15 23:54:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 23:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 23:54:44 [DEBUG   ] spawn_process: at 2018-11-15 23:54:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 23:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 23:54:44 [DEBUG   ] spawn_process: at 2018-11-15 23:54:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 23:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 23:54:44 [DEBUG   ] spawn_process: at 2018-11-15 23:54:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 23:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 23:54:44 [DEBUG   ] spawn_process: at 2018-11-15 23:54:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 23:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 23:54:44 [DEBUG   ] spawn_process: at 2018-11-15 23:54:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 23:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 23:54:44 [DEBUG   ] spawn_process: at 2018-11-15 23:54:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 23:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 23:54:44 [DEBUG   ] spawn_process: at 2018-11-15 23:54:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 23:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 23:54:44 [DEBUG   ] spawn_process: at 2018-11-15 23:54:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 23:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 23:54:44 [DEBUG   ] spawn_process: at 2018-11-15 23:54:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 23:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 23:54:44 [DEBUG   ] spawn_process: at 2018-11-15 23:54:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 23:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 23:54:44 [DEBUG   ] spawn_process: at 2018-11-15 23:54:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 23:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 23:54:44 [DEBUG   ] spawn_process: at 2018-11-15 23:54:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 23:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 23:54:44 [DEBUG   ] spawn_process: at 2018-11-15 23:54:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 23:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 23:54:44 [DEBUG   ] spawn_process: at 2018-11-15 23:54:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 23:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 23:54:44 [DEBUG   ] spawn_process: at 2018-11-15 23:54:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 23:54:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 23:54:44 [DEBUG   ] spawn_process: at 2018-11-15 23:54:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 23:54:58 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-15 23:55:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-15 23:55:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 23:55:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-11-15 23:55:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 23:55:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 23:55:00 [WARNING ] (13, 1, 'bot')
2018-11-15 23:55:00 [WARNING ] (13, 1, 'bot')
2018-11-15 23:55:00 [WARNING ] (13, 1, 'bot')
2018-11-15 23:55:00 [WARNING ] (13, 1, 'bot')
2018-11-15 23:55:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 23:55:00 [DEBUG   ] Finished updating board flags in 1.189 seconds
2018-11-15 23:55:15 [DEBUG   ] Got command BAM from MCS: ref #520465
2018-11-15 23:55:15 [INFO    ] Finished processing BAM request
2018-11-15 23:55:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:55:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520465   8 58437 86115033 A  ERROR'
2018-11-15 23:55:15 [DEBUG   ] Got command BAM from MCS: ref #520464
2018-11-15 23:55:15 [INFO    ] Finished processing BAM request
2018-11-15 23:55:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:55:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520464   8 58437 86115037 A  ERROR'
2018-11-15 23:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 23:55:15 [DEBUG   ] spawn_process: at 2018-11-15 23:55:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 23:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 23:55:15 [DEBUG   ] spawn_process: at 2018-11-15 23:55:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 23:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 23:55:15 [DEBUG   ] spawn_process: at 2018-11-15 23:55:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 23:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 23:55:15 [DEBUG   ] spawn_process: at 2018-11-15 23:55:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 23:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 23:55:15 [DEBUG   ] spawn_process: at 2018-11-15 23:55:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 23:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 23:55:15 [DEBUG   ] spawn_process: at 2018-11-15 23:55:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 23:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 23:55:15 [DEBUG   ] spawn_process: at 2018-11-15 23:55:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 23:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 23:55:15 [DEBUG   ] spawn_process: at 2018-11-15 23:55:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 23:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 23:55:15 [DEBUG   ] spawn_process: at 2018-11-15 23:55:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 23:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 23:55:15 [DEBUG   ] spawn_process: at 2018-11-15 23:55:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 23:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 23:55:15 [DEBUG   ] spawn_process: at 2018-11-15 23:55:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 23:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 23:55:15 [DEBUG   ] spawn_process: at 2018-11-15 23:55:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 23:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 23:55:15 [DEBUG   ] spawn_process: at 2018-11-15 23:55:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 23:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 23:55:15 [DEBUG   ] spawn_process: at 2018-11-15 23:55:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 23:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 23:55:15 [DEBUG   ] spawn_process: at 2018-11-15 23:55:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 23:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 23:55:15 [DEBUG   ] spawn_process: at 2018-11-15 23:55:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 23:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 23:55:15 [DEBUG   ] spawn_process: at 2018-11-15 23:55:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 23:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 23:55:15 [DEBUG   ] spawn_process: at 2018-11-15 23:55:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 23:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 23:55:15 [DEBUG   ] spawn_process: at 2018-11-15 23:55:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 23:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 23:55:15 [DEBUG   ] spawn_process: at 2018-11-15 23:55:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 23:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 23:55:15 [DEBUG   ] spawn_process: at 2018-11-15 23:55:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 23:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 23:55:15 [DEBUG   ] spawn_process: at 2018-11-15 23:55:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 23:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 23:55:15 [DEBUG   ] spawn_process: at 2018-11-15 23:55:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 23:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 23:55:15 [DEBUG   ] spawn_process: at 2018-11-15 23:55:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 23:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 23:55:15 [DEBUG   ] spawn_process: at 2018-11-15 23:55:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 23:55:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 23:55:15 [DEBUG   ] spawn_process: at 2018-11-15 23:55:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 23:55:18 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-11-15 23:55:38 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-15 23:55:45 [DEBUG   ] Got command RPT from MCS: ref #520468
2018-11-15 23:55:45 [DEBUG   ] summary = ERROR
2018-11-15 23:55:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520468  13 58437 86145241 A  ERRORERROR'
2018-11-15 23:55:45 [DEBUG   ] Got command RPT from MCS: ref #520469
2018-11-15 23:55:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 23:55:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520469  77 58437 86145242 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 23:55:46 [DEBUG   ] Got command BAM from MCS: ref #520467
2018-11-15 23:55:46 [INFO    ] Finished processing BAM request
2018-11-15 23:55:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:55:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520467   8 58437 86146025 A  ERROR'
2018-11-15 23:55:46 [DEBUG   ] Got command BAM from MCS: ref #520466
2018-11-15 23:55:46 [INFO    ] Finished processing BAM request
2018-11-15 23:55:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:55:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520466   8 58437 86146029 A  ERROR'
2018-11-15 23:55:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 23:55:46 [DEBUG   ] spawn_process: at 2018-11-15 23:55:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 23:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 23:55:47 [DEBUG   ] spawn_process: at 2018-11-15 23:55:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 23:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 23:55:47 [DEBUG   ] spawn_process: at 2018-11-15 23:55:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 23:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 23:55:47 [DEBUG   ] spawn_process: at 2018-11-15 23:55:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 23:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 23:55:47 [DEBUG   ] spawn_process: at 2018-11-15 23:55:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 23:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 23:55:47 [DEBUG   ] spawn_process: at 2018-11-15 23:55:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 23:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 23:55:47 [DEBUG   ] spawn_process: at 2018-11-15 23:55:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 23:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 23:55:47 [DEBUG   ] spawn_process: at 2018-11-15 23:55:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 23:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 23:55:47 [DEBUG   ] spawn_process: at 2018-11-15 23:55:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 23:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 23:55:47 [DEBUG   ] spawn_process: at 2018-11-15 23:55:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 23:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 23:55:47 [DEBUG   ] spawn_process: at 2018-11-15 23:55:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 23:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 23:55:47 [DEBUG   ] spawn_process: at 2018-11-15 23:55:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 23:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 23:55:47 [DEBUG   ] spawn_process: at 2018-11-15 23:55:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 23:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 23:55:47 [DEBUG   ] spawn_process: at 2018-11-15 23:55:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 23:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 23:55:47 [DEBUG   ] spawn_process: at 2018-11-15 23:55:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 23:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 23:55:47 [DEBUG   ] spawn_process: at 2018-11-15 23:55:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 23:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 23:55:47 [DEBUG   ] spawn_process: at 2018-11-15 23:55:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 23:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 23:55:47 [DEBUG   ] spawn_process: at 2018-11-15 23:55:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 23:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 23:55:47 [DEBUG   ] spawn_process: at 2018-11-15 23:55:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 23:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 23:55:47 [DEBUG   ] spawn_process: at 2018-11-15 23:55:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 23:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 23:55:47 [DEBUG   ] spawn_process: at 2018-11-15 23:55:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 23:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 23:55:47 [DEBUG   ] spawn_process: at 2018-11-15 23:55:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 23:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 23:55:47 [DEBUG   ] spawn_process: at 2018-11-15 23:55:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 23:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 23:55:47 [DEBUG   ] spawn_process: at 2018-11-15 23:55:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 23:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 23:55:47 [DEBUG   ] spawn_process: at 2018-11-15 23:55:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 23:55:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 23:55:47 [DEBUG   ] spawn_process: at 2018-11-15 23:55:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 23:55:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-15 23:56:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-15 23:56:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-15 23:56:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 23:56:00 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-15 23:56:00 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-15 23:56:00 [WARNING ] (13, 1, 'bot')
2018-11-15 23:56:00 [WARNING ] (13, 1, 'bot')
2018-11-15 23:56:00 [WARNING ] (13, 1, 'bot')
2018-11-15 23:56:00 [WARNING ] (13, 1, 'bot')
2018-11-15 23:56:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 23:56:00 [DEBUG   ] Finished updating board flags in 1.009 seconds
2018-11-15 23:56:17 [DEBUG   ] Got command BAM from MCS: ref #520486
2018-11-15 23:56:17 [INFO    ] Finished processing BAM request
2018-11-15 23:56:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:56:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520486   8 58437 86177033 A  ERROR'
2018-11-15 23:56:17 [DEBUG   ] Got command BAM from MCS: ref #520485
2018-11-15 23:56:17 [INFO    ] Finished processing BAM request
2018-11-15 23:56:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:56:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520485   8 58437 86177037 A  ERROR'
2018-11-15 23:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-15 23:56:17 [DEBUG   ] spawn_process: at 2018-11-15 23:56:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-15 23:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-15 23:56:17 [DEBUG   ] spawn_process: at 2018-11-15 23:56:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-15 23:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-15 23:56:17 [DEBUG   ] spawn_process: at 2018-11-15 23:56:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-15 23:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-15 23:56:17 [DEBUG   ] spawn_process: at 2018-11-15 23:56:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-15 23:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-15 23:56:17 [DEBUG   ] spawn_process: at 2018-11-15 23:56:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-15 23:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-15 23:56:17 [DEBUG   ] spawn_process: at 2018-11-15 23:56:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-15 23:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-15 23:56:17 [DEBUG   ] spawn_process: at 2018-11-15 23:56:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-15 23:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-15 23:56:17 [DEBUG   ] spawn_process: at 2018-11-15 23:56:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-15 23:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-15 23:56:17 [DEBUG   ] spawn_process: at 2018-11-15 23:56:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-15 23:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-15 23:56:17 [DEBUG   ] spawn_process: at 2018-11-15 23:56:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-15 23:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-15 23:56:17 [DEBUG   ] spawn_process: at 2018-11-15 23:56:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-15 23:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-15 23:56:17 [DEBUG   ] spawn_process: at 2018-11-15 23:56:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-15 23:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-15 23:56:17 [DEBUG   ] spawn_process: at 2018-11-15 23:56:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-15 23:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-15 23:56:17 [DEBUG   ] spawn_process: at 2018-11-15 23:56:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-15 23:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-15 23:56:17 [DEBUG   ] spawn_process: at 2018-11-15 23:56:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-15 23:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-15 23:56:17 [DEBUG   ] spawn_process: at 2018-11-15 23:56:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-15 23:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-15 23:56:17 [DEBUG   ] spawn_process: at 2018-11-15 23:56:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-15 23:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-15 23:56:17 [DEBUG   ] spawn_process: at 2018-11-15 23:56:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-15 23:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-15 23:56:17 [DEBUG   ] spawn_process: at 2018-11-15 23:56:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-15 23:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-15 23:56:17 [DEBUG   ] spawn_process: at 2018-11-15 23:56:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-15 23:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-15 23:56:17 [DEBUG   ] spawn_process: at 2018-11-15 23:56:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-15 23:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-15 23:56:17 [DEBUG   ] spawn_process: at 2018-11-15 23:56:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-15 23:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-15 23:56:17 [DEBUG   ] spawn_process: at 2018-11-15 23:56:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-15 23:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-15 23:56:17 [DEBUG   ] spawn_process: at 2018-11-15 23:56:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-15 23:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-15 23:56:17 [DEBUG   ] spawn_process: at 2018-11-15 23:56:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-15 23:56:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-15 23:56:17 [DEBUG   ] spawn_process: at 2018-11-15 23:56:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-15 23:56:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 23:56:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-15 23:56:48 [DEBUG   ] Got command BAM from MCS: ref #520492
2018-11-15 23:56:48 [INFO    ] Finished processing BAM request
2018-11-15 23:56:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:56:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520492   8 58437 86208025 A  ERROR'
2018-11-15 23:56:48 [DEBUG   ] Got command BAM from MCS: ref #520491
2018-11-15 23:56:48 [INFO    ] Finished processing BAM request
2018-11-15 23:56:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:56:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520491   8 58437 86208029 A  ERROR'
2018-11-15 23:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 23:56:48 [DEBUG   ] spawn_process: at 2018-11-15 23:56:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 23:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 23:56:48 [DEBUG   ] spawn_process: at 2018-11-15 23:56:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 23:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 23:56:48 [DEBUG   ] spawn_process: at 2018-11-15 23:56:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 23:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 23:56:48 [DEBUG   ] spawn_process: at 2018-11-15 23:56:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 23:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 23:56:48 [DEBUG   ] spawn_process: at 2018-11-15 23:56:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 23:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 23:56:48 [DEBUG   ] spawn_process: at 2018-11-15 23:56:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 23:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 23:56:48 [DEBUG   ] spawn_process: at 2018-11-15 23:56:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 23:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 23:56:48 [DEBUG   ] spawn_process: at 2018-11-15 23:56:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 23:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 23:56:48 [DEBUG   ] spawn_process: at 2018-11-15 23:56:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 23:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 23:56:48 [DEBUG   ] spawn_process: at 2018-11-15 23:56:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 23:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 23:56:48 [DEBUG   ] spawn_process: at 2018-11-15 23:56:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 23:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 23:56:48 [DEBUG   ] spawn_process: at 2018-11-15 23:56:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 23:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 23:56:48 [DEBUG   ] spawn_process: at 2018-11-15 23:56:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 23:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 23:56:48 [DEBUG   ] spawn_process: at 2018-11-15 23:56:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 23:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 23:56:48 [DEBUG   ] spawn_process: at 2018-11-15 23:56:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 23:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 23:56:48 [DEBUG   ] spawn_process: at 2018-11-15 23:56:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 23:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 23:56:48 [DEBUG   ] spawn_process: at 2018-11-15 23:56:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 23:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 23:56:48 [DEBUG   ] spawn_process: at 2018-11-15 23:56:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 23:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 23:56:48 [DEBUG   ] spawn_process: at 2018-11-15 23:56:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 23:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 23:56:48 [DEBUG   ] spawn_process: at 2018-11-15 23:56:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 23:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 23:56:48 [DEBUG   ] spawn_process: at 2018-11-15 23:56:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 23:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 23:56:48 [DEBUG   ] spawn_process: at 2018-11-15 23:56:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 23:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 23:56:48 [DEBUG   ] spawn_process: at 2018-11-15 23:56:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 23:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 23:56:48 [DEBUG   ] spawn_process: at 2018-11-15 23:56:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 23:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 23:56:48 [DEBUG   ] spawn_process: at 2018-11-15 23:56:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 23:56:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 23:56:48 [DEBUG   ] spawn_process: at 2018-11-15 23:56:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 23:56:58 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-15 23:57:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 23:57:00 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 23:57:00 [WARNING ] (13, 1, 'bot')
2018-11-15 23:57:00 [WARNING ] (13, 1, 'bot')
2018-11-15 23:57:00 [WARNING ] (13, 1, 'bot')
2018-11-15 23:57:00 [WARNING ] (13, 1, 'bot')
2018-11-15 23:57:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 23:57:00 [DEBUG   ] Finished updating board flags in 1.000 seconds
2018-11-15 23:57:18 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-15 23:57:19 [DEBUG   ] Got command BAM from MCS: ref #520494
2018-11-15 23:57:19 [INFO    ] Finished processing BAM request
2018-11-15 23:57:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:57:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520494   8 58437 86239025 A  ERROR'
2018-11-15 23:57:19 [DEBUG   ] Got command BAM from MCS: ref #520493
2018-11-15 23:57:19 [INFO    ] Finished processing BAM request
2018-11-15 23:57:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:57:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520493   8 58437 86239029 A  ERROR'
2018-11-15 23:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 23:57:19 [DEBUG   ] spawn_process: at 2018-11-15 23:57:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 23:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 23:57:19 [DEBUG   ] spawn_process: at 2018-11-15 23:57:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 23:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 23:57:19 [DEBUG   ] spawn_process: at 2018-11-15 23:57:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 23:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 23:57:19 [DEBUG   ] spawn_process: at 2018-11-15 23:57:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 23:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 23:57:19 [DEBUG   ] spawn_process: at 2018-11-15 23:57:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 23:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 23:57:19 [DEBUG   ] spawn_process: at 2018-11-15 23:57:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 23:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 23:57:19 [DEBUG   ] spawn_process: at 2018-11-15 23:57:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 23:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 23:57:19 [DEBUG   ] spawn_process: at 2018-11-15 23:57:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 23:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 23:57:19 [DEBUG   ] spawn_process: at 2018-11-15 23:57:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 23:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 23:57:19 [DEBUG   ] spawn_process: at 2018-11-15 23:57:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 23:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 23:57:19 [DEBUG   ] spawn_process: at 2018-11-15 23:57:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 23:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 23:57:19 [DEBUG   ] spawn_process: at 2018-11-15 23:57:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 23:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 23:57:19 [DEBUG   ] spawn_process: at 2018-11-15 23:57:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 23:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 23:57:19 [DEBUG   ] spawn_process: at 2018-11-15 23:57:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 23:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 23:57:19 [DEBUG   ] spawn_process: at 2018-11-15 23:57:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 23:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 23:57:19 [DEBUG   ] spawn_process: at 2018-11-15 23:57:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 23:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 23:57:19 [DEBUG   ] spawn_process: at 2018-11-15 23:57:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 23:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 23:57:19 [DEBUG   ] spawn_process: at 2018-11-15 23:57:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 23:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 23:57:19 [DEBUG   ] spawn_process: at 2018-11-15 23:57:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 23:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 23:57:19 [DEBUG   ] spawn_process: at 2018-11-15 23:57:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 23:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 23:57:19 [DEBUG   ] spawn_process: at 2018-11-15 23:57:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 23:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 23:57:19 [DEBUG   ] spawn_process: at 2018-11-15 23:57:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 23:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 23:57:19 [DEBUG   ] spawn_process: at 2018-11-15 23:57:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 23:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 23:57:19 [DEBUG   ] spawn_process: at 2018-11-15 23:57:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 23:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 23:57:19 [DEBUG   ] spawn_process: at 2018-11-15 23:57:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 23:57:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 23:57:19 [DEBUG   ] spawn_process: at 2018-11-15 23:57:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 23:57:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 23:57:50 [DEBUG   ] Got command BAM from MCS: ref #520496
2018-11-15 23:57:50 [INFO    ] Finished processing BAM request
2018-11-15 23:57:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:57:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520496   8 58437 86270029 A  ERROR'
2018-11-15 23:57:50 [DEBUG   ] Got command BAM from MCS: ref #520495
2018-11-15 23:57:50 [INFO    ] Finished processing BAM request
2018-11-15 23:57:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:57:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520495   8 58437 86270033 A  ERROR'
2018-11-15 23:57:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 23:57:50 [DEBUG   ] spawn_process: at 2018-11-15 23:57:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 23:57:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 23:57:50 [DEBUG   ] spawn_process: at 2018-11-15 23:57:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 23:57:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 23:57:50 [DEBUG   ] spawn_process: at 2018-11-15 23:57:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 23:57:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 23:57:50 [DEBUG   ] spawn_process: at 2018-11-15 23:57:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 23:57:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 23:57:50 [DEBUG   ] spawn_process: at 2018-11-15 23:57:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 23:57:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 23:57:50 [DEBUG   ] spawn_process: at 2018-11-15 23:57:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 23:57:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 23:57:50 [DEBUG   ] spawn_process: at 2018-11-15 23:57:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 23:57:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 23:57:50 [DEBUG   ] spawn_process: at 2018-11-15 23:57:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 23:57:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 23:57:50 [DEBUG   ] spawn_process: at 2018-11-15 23:57:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 23:57:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 23:57:50 [DEBUG   ] spawn_process: at 2018-11-15 23:57:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 23:57:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 23:57:50 [DEBUG   ] spawn_process: at 2018-11-15 23:57:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 23:57:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 23:57:50 [DEBUG   ] spawn_process: at 2018-11-15 23:57:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 23:57:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 23:57:50 [DEBUG   ] spawn_process: at 2018-11-15 23:57:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 23:57:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 23:57:50 [DEBUG   ] spawn_process: at 2018-11-15 23:57:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 23:57:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 23:57:50 [DEBUG   ] spawn_process: at 2018-11-15 23:57:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 23:57:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 23:57:50 [DEBUG   ] spawn_process: at 2018-11-15 23:57:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 23:57:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 23:57:50 [DEBUG   ] spawn_process: at 2018-11-15 23:57:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 23:57:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 23:57:50 [DEBUG   ] spawn_process: at 2018-11-15 23:57:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 23:57:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 23:57:50 [DEBUG   ] spawn_process: at 2018-11-15 23:57:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 23:57:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 23:57:50 [DEBUG   ] spawn_process: at 2018-11-15 23:57:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 23:57:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 23:57:50 [DEBUG   ] spawn_process: at 2018-11-15 23:57:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 23:57:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 23:57:50 [DEBUG   ] spawn_process: at 2018-11-15 23:57:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 23:57:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 23:57:50 [DEBUG   ] spawn_process: at 2018-11-15 23:57:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 23:57:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 23:57:50 [DEBUG   ] spawn_process: at 2018-11-15 23:57:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 23:57:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 23:57:50 [DEBUG   ] spawn_process: at 2018-11-15 23:57:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 23:57:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 23:57:50 [DEBUG   ] spawn_process: at 2018-11-15 23:57:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 23:57:58 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-15 23:58:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-11-15 23:58:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 23:58:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 23:58:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-15 23:58:01 [WARNING ] (13, 1, 'bot')
2018-11-15 23:58:01 [WARNING ] (13, 1, 'bot')
2018-11-15 23:58:01 [WARNING ] (13, 1, 'bot')
2018-11-15 23:58:01 [WARNING ] (13, 1, 'bot')
2018-11-15 23:58:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 23:58:01 [DEBUG   ] Finished updating board flags in 1.348 seconds
2018-11-15 23:58:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 23:58:21 [DEBUG   ] Got command BAM from MCS: ref #520499
2018-11-15 23:58:21 [INFO    ] Finished processing BAM request
2018-11-15 23:58:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:58:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520499   8 58437 86301033 A  ERROR'
2018-11-15 23:58:21 [DEBUG   ] Got command BAM from MCS: ref #520500
2018-11-15 23:58:21 [INFO    ] Finished processing BAM request
2018-11-15 23:58:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:58:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520500   8 58437 86301037 A  ERROR'
2018-11-15 23:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-15 23:58:21 [DEBUG   ] spawn_process: at 2018-11-15 23:58:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-15 23:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-15 23:58:21 [DEBUG   ] spawn_process: at 2018-11-15 23:58:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-15 23:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-15 23:58:21 [DEBUG   ] spawn_process: at 2018-11-15 23:58:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-15 23:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-15 23:58:21 [DEBUG   ] spawn_process: at 2018-11-15 23:58:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-15 23:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-15 23:58:21 [DEBUG   ] spawn_process: at 2018-11-15 23:58:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-15 23:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-15 23:58:21 [DEBUG   ] spawn_process: at 2018-11-15 23:58:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-15 23:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-15 23:58:21 [DEBUG   ] spawn_process: at 2018-11-15 23:58:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-15 23:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-15 23:58:21 [DEBUG   ] spawn_process: at 2018-11-15 23:58:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-15 23:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-15 23:58:21 [DEBUG   ] spawn_process: at 2018-11-15 23:58:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-15 23:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-15 23:58:21 [DEBUG   ] spawn_process: at 2018-11-15 23:58:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-15 23:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-15 23:58:21 [DEBUG   ] spawn_process: at 2018-11-15 23:58:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-15 23:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-15 23:58:21 [DEBUG   ] spawn_process: at 2018-11-15 23:58:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-15 23:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-15 23:58:21 [DEBUG   ] spawn_process: at 2018-11-15 23:58:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-15 23:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-15 23:58:21 [DEBUG   ] spawn_process: at 2018-11-15 23:58:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-15 23:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-15 23:58:21 [DEBUG   ] spawn_process: at 2018-11-15 23:58:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-15 23:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-15 23:58:21 [DEBUG   ] spawn_process: at 2018-11-15 23:58:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-15 23:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-15 23:58:21 [DEBUG   ] spawn_process: at 2018-11-15 23:58:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-15 23:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-15 23:58:21 [DEBUG   ] spawn_process: at 2018-11-15 23:58:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-15 23:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-15 23:58:21 [DEBUG   ] spawn_process: at 2018-11-15 23:58:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-15 23:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-15 23:58:21 [DEBUG   ] spawn_process: at 2018-11-15 23:58:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-15 23:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-15 23:58:21 [DEBUG   ] spawn_process: at 2018-11-15 23:58:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-15 23:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-15 23:58:21 [DEBUG   ] spawn_process: at 2018-11-15 23:58:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-15 23:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-15 23:58:21 [DEBUG   ] spawn_process: at 2018-11-15 23:58:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-15 23:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-15 23:58:21 [DEBUG   ] spawn_process: at 2018-11-15 23:58:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-15 23:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-15 23:58:21 [DEBUG   ] spawn_process: at 2018-11-15 23:58:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-15 23:58:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-15 23:58:21 [DEBUG   ] spawn_process: at 2018-11-15 23:58:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-15 23:58:27 [DEBUG   ] Got command RPT from MCS: ref #520501
2018-11-15 23:58:27 [DEBUG   ] summary = ERROR
2018-11-15 23:58:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520501  13 58437 86307229 A  ERRORERROR'
2018-11-15 23:58:27 [DEBUG   ] Got command RPT from MCS: ref #520502
2018-11-15 23:58:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 23:58:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520502  77 58437 86307433 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 23:58:27 [DEBUG   ] Got command RPT from MCS: ref #520503
2018-11-15 23:58:27 [DEBUG   ] summary = ERROR
2018-11-15 23:58:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520503  13 58437 86307625 A  ERRORERROR'
2018-11-15 23:58:27 [DEBUG   ] Got command RPT from MCS: ref #520505
2018-11-15 23:58:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-15 23:58:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520505  77 58437 86307829 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-15 23:58:28 [DEBUG   ] Got command RPT from MCS: ref #520506
2018-11-15 23:58:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-15 23:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520506  12 58437 86308033 A  ERRORB£ff'
2018-11-15 23:58:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-15 23:58:52 [DEBUG   ] Got command BAM from MCS: ref #520512
2018-11-15 23:58:52 [INFO    ] Finished processing BAM request
2018-11-15 23:58:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:58:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520512   8 58437 86332025 A  ERROR'
2018-11-15 23:58:52 [DEBUG   ] Got command BAM from MCS: ref #520511
2018-11-15 23:58:52 [INFO    ] Finished processing BAM request
2018-11-15 23:58:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:58:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520511   8 58437 86332029 A  ERROR'
2018-11-15 23:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-15 23:58:52 [DEBUG   ] spawn_process: at 2018-11-15 23:58:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-15 23:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-15 23:58:52 [DEBUG   ] spawn_process: at 2018-11-15 23:58:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-15 23:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-15 23:58:52 [DEBUG   ] spawn_process: at 2018-11-15 23:58:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-15 23:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-15 23:58:52 [DEBUG   ] spawn_process: at 2018-11-15 23:58:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-15 23:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-15 23:58:52 [DEBUG   ] spawn_process: at 2018-11-15 23:58:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-15 23:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-15 23:58:52 [DEBUG   ] spawn_process: at 2018-11-15 23:58:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-15 23:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-15 23:58:52 [DEBUG   ] spawn_process: at 2018-11-15 23:58:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-15 23:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-15 23:58:52 [DEBUG   ] spawn_process: at 2018-11-15 23:58:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-15 23:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-15 23:58:52 [DEBUG   ] spawn_process: at 2018-11-15 23:58:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-15 23:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-15 23:58:52 [DEBUG   ] spawn_process: at 2018-11-15 23:58:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-15 23:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-15 23:58:52 [DEBUG   ] spawn_process: at 2018-11-15 23:58:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-15 23:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-15 23:58:52 [DEBUG   ] spawn_process: at 2018-11-15 23:58:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-15 23:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-15 23:58:52 [DEBUG   ] spawn_process: at 2018-11-15 23:58:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-15 23:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-15 23:58:52 [DEBUG   ] spawn_process: at 2018-11-15 23:58:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-15 23:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-15 23:58:52 [DEBUG   ] spawn_process: at 2018-11-15 23:58:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-15 23:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-15 23:58:52 [DEBUG   ] spawn_process: at 2018-11-15 23:58:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-15 23:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-15 23:58:52 [DEBUG   ] spawn_process: at 2018-11-15 23:58:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-15 23:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-15 23:58:52 [DEBUG   ] spawn_process: at 2018-11-15 23:58:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-15 23:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-15 23:58:52 [DEBUG   ] spawn_process: at 2018-11-15 23:58:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-15 23:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-15 23:58:52 [DEBUG   ] spawn_process: at 2018-11-15 23:58:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-15 23:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-15 23:58:52 [DEBUG   ] spawn_process: at 2018-11-15 23:58:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-15 23:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-15 23:58:52 [DEBUG   ] spawn_process: at 2018-11-15 23:58:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-15 23:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-15 23:58:52 [DEBUG   ] spawn_process: at 2018-11-15 23:58:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-15 23:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-15 23:58:52 [DEBUG   ] spawn_process: at 2018-11-15 23:58:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-15 23:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-15 23:58:52 [DEBUG   ] spawn_process: at 2018-11-15 23:58:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-15 23:58:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-15 23:58:52 [DEBUG   ] spawn_process: at 2018-11-15 23:58:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-15 23:58:58 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-15 23:59:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-15 23:59:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-15 23:59:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-15 23:59:01 [WARNING ] (13, 1, 'bot')
2018-11-15 23:59:01 [WARNING ] (13, 1, 'bot')
2018-11-15 23:59:01 [WARNING ] (13, 1, 'bot')
2018-11-15 23:59:01 [WARNING ] (13, 1, 'bot')
2018-11-15 23:59:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-15 23:59:01 [DEBUG   ] Finished updating board flags in 1.208 seconds
2018-11-15 23:59:18 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-15 23:59:23 [DEBUG   ] Got command BAM from MCS: ref #520514
2018-11-15 23:59:23 [INFO    ] Finished processing BAM request
2018-11-15 23:59:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:59:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520514   8 58437 86363029 A  ERROR'
2018-11-15 23:59:23 [DEBUG   ] Got command BAM from MCS: ref #520513
2018-11-15 23:59:23 [INFO    ] Finished processing BAM request
2018-11-15 23:59:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:59:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520513   8 58437 86363033 A  ERROR'
2018-11-15 23:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-15 23:59:23 [DEBUG   ] spawn_process: at 2018-11-15 23:59:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-15 23:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-15 23:59:23 [DEBUG   ] spawn_process: at 2018-11-15 23:59:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-15 23:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-15 23:59:23 [DEBUG   ] spawn_process: at 2018-11-15 23:59:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-15 23:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-15 23:59:23 [DEBUG   ] spawn_process: at 2018-11-15 23:59:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-15 23:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-15 23:59:23 [DEBUG   ] spawn_process: at 2018-11-15 23:59:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-15 23:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-15 23:59:23 [DEBUG   ] spawn_process: at 2018-11-15 23:59:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-15 23:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-15 23:59:23 [DEBUG   ] spawn_process: at 2018-11-15 23:59:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-15 23:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-15 23:59:23 [DEBUG   ] spawn_process: at 2018-11-15 23:59:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-15 23:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-15 23:59:23 [DEBUG   ] spawn_process: at 2018-11-15 23:59:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-15 23:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-15 23:59:23 [DEBUG   ] spawn_process: at 2018-11-15 23:59:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-15 23:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-15 23:59:23 [DEBUG   ] spawn_process: at 2018-11-15 23:59:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-15 23:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-15 23:59:23 [DEBUG   ] spawn_process: at 2018-11-15 23:59:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-15 23:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-15 23:59:23 [DEBUG   ] spawn_process: at 2018-11-15 23:59:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-15 23:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-15 23:59:23 [DEBUG   ] spawn_process: at 2018-11-15 23:59:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-15 23:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-15 23:59:23 [DEBUG   ] spawn_process: at 2018-11-15 23:59:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-15 23:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-15 23:59:23 [DEBUG   ] spawn_process: at 2018-11-15 23:59:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-15 23:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-15 23:59:23 [DEBUG   ] spawn_process: at 2018-11-15 23:59:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-15 23:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-15 23:59:23 [DEBUG   ] spawn_process: at 2018-11-15 23:59:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-15 23:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-15 23:59:23 [DEBUG   ] spawn_process: at 2018-11-15 23:59:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-15 23:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-15 23:59:23 [DEBUG   ] spawn_process: at 2018-11-15 23:59:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-15 23:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-15 23:59:23 [DEBUG   ] spawn_process: at 2018-11-15 23:59:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-15 23:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-15 23:59:23 [DEBUG   ] spawn_process: at 2018-11-15 23:59:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-15 23:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-15 23:59:23 [DEBUG   ] spawn_process: at 2018-11-15 23:59:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-15 23:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-15 23:59:23 [DEBUG   ] spawn_process: at 2018-11-15 23:59:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-15 23:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-15 23:59:23 [DEBUG   ] spawn_process: at 2018-11-15 23:59:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-15 23:59:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-15 23:59:23 [DEBUG   ] spawn_process: at 2018-11-15 23:59:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-15 23:59:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-15 23:59:54 [DEBUG   ] Got command BAM from MCS: ref #520519
2018-11-15 23:59:54 [INFO    ] Finished processing BAM request
2018-11-15 23:59:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:59:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520519   8 58437 86394025 A  ERROR'
2018-11-15 23:59:54 [DEBUG   ] Got command BAM from MCS: ref #520520
2018-11-15 23:59:54 [INFO    ] Finished processing BAM request
2018-11-15 23:59:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-15 23:59:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520520   8 58437 86394029 A  ERROR'
2018-11-15 23:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-15 23:59:54 [DEBUG   ] spawn_process: at 2018-11-15 23:59:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-15 23:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-15 23:59:54 [DEBUG   ] spawn_process: at 2018-11-15 23:59:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-15 23:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-15 23:59:54 [DEBUG   ] spawn_process: at 2018-11-15 23:59:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-15 23:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-15 23:59:54 [DEBUG   ] spawn_process: at 2018-11-15 23:59:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-15 23:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-15 23:59:54 [DEBUG   ] spawn_process: at 2018-11-15 23:59:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-15 23:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-15 23:59:54 [DEBUG   ] spawn_process: at 2018-11-15 23:59:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-15 23:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-15 23:59:54 [DEBUG   ] spawn_process: at 2018-11-15 23:59:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-15 23:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-15 23:59:54 [DEBUG   ] spawn_process: at 2018-11-15 23:59:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-15 23:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-15 23:59:54 [DEBUG   ] spawn_process: at 2018-11-15 23:59:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-15 23:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-15 23:59:54 [DEBUG   ] spawn_process: at 2018-11-15 23:59:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-15 23:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-15 23:59:54 [DEBUG   ] spawn_process: at 2018-11-15 23:59:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-15 23:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-15 23:59:54 [DEBUG   ] spawn_process: at 2018-11-15 23:59:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-15 23:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-15 23:59:54 [DEBUG   ] spawn_process: at 2018-11-15 23:59:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-15 23:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-15 23:59:54 [DEBUG   ] spawn_process: at 2018-11-15 23:59:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-15 23:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-15 23:59:54 [DEBUG   ] spawn_process: at 2018-11-15 23:59:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-15 23:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-15 23:59:54 [DEBUG   ] spawn_process: at 2018-11-15 23:59:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-15 23:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-15 23:59:54 [DEBUG   ] spawn_process: at 2018-11-15 23:59:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-15 23:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-15 23:59:54 [DEBUG   ] spawn_process: at 2018-11-15 23:59:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-15 23:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-15 23:59:54 [DEBUG   ] spawn_process: at 2018-11-15 23:59:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-15 23:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-15 23:59:54 [DEBUG   ] spawn_process: at 2018-11-15 23:59:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-15 23:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-15 23:59:54 [DEBUG   ] spawn_process: at 2018-11-15 23:59:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-15 23:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-15 23:59:54 [DEBUG   ] spawn_process: at 2018-11-15 23:59:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-15 23:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-15 23:59:54 [DEBUG   ] spawn_process: at 2018-11-15 23:59:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-15 23:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-15 23:59:54 [DEBUG   ] spawn_process: at 2018-11-15 23:59:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-15 23:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-15 23:59:54 [DEBUG   ] spawn_process: at 2018-11-15 23:59:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-15 23:59:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-15 23:59:54 [DEBUG   ] spawn_process: at 2018-11-15 23:59:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-15 23:59:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 00:00:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 00:00:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-16 00:00:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-16 00:00:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-16 00:00:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:00:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-16 00:00:01 [WARNING ] (13, 1, 'bot')
2018-11-16 00:00:01 [WARNING ] (13, 1, 'bot')
2018-11-16 00:00:01 [WARNING ] (13, 1, 'bot')
2018-11-16 00:00:01 [WARNING ] (13, 1, 'bot')
2018-11-16 00:00:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:00:01 [DEBUG   ] Finished updating board flags in 1.196 seconds
2018-11-16 00:00:18 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-11-16 00:00:25 [DEBUG   ] Got command BAM from MCS: ref #520522
2018-11-16 00:00:25 [INFO    ] Finished processing BAM request
2018-11-16 00:00:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:00:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520522   8 58438    25025 A  ERROR'
2018-11-16 00:00:25 [DEBUG   ] Got command BAM from MCS: ref #520521
2018-11-16 00:00:25 [INFO    ] Finished processing BAM request
2018-11-16 00:00:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:00:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520521   8 58438    25029 A  ERROR'
2018-11-16 00:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-16 00:00:25 [DEBUG   ] spawn_process: at 2018-11-16 00:00:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-16 00:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-16 00:00:25 [DEBUG   ] spawn_process: at 2018-11-16 00:00:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-16 00:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-16 00:00:25 [DEBUG   ] spawn_process: at 2018-11-16 00:00:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-16 00:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-16 00:00:25 [DEBUG   ] spawn_process: at 2018-11-16 00:00:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-16 00:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-16 00:00:25 [DEBUG   ] spawn_process: at 2018-11-16 00:00:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-16 00:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-16 00:00:25 [DEBUG   ] spawn_process: at 2018-11-16 00:00:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-16 00:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-16 00:00:25 [DEBUG   ] spawn_process: at 2018-11-16 00:00:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-16 00:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-16 00:00:25 [DEBUG   ] spawn_process: at 2018-11-16 00:00:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-16 00:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-16 00:00:25 [DEBUG   ] spawn_process: at 2018-11-16 00:00:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-16 00:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-16 00:00:25 [DEBUG   ] spawn_process: at 2018-11-16 00:00:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-16 00:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-16 00:00:25 [DEBUG   ] spawn_process: at 2018-11-16 00:00:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-16 00:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-16 00:00:25 [DEBUG   ] spawn_process: at 2018-11-16 00:00:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-16 00:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-16 00:00:25 [DEBUG   ] spawn_process: at 2018-11-16 00:00:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-16 00:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-16 00:00:25 [DEBUG   ] spawn_process: at 2018-11-16 00:00:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-16 00:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-16 00:00:25 [DEBUG   ] spawn_process: at 2018-11-16 00:00:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-16 00:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-16 00:00:25 [DEBUG   ] spawn_process: at 2018-11-16 00:00:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-16 00:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-16 00:00:25 [DEBUG   ] spawn_process: at 2018-11-16 00:00:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-16 00:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-16 00:00:25 [DEBUG   ] spawn_process: at 2018-11-16 00:00:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-16 00:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-16 00:00:25 [DEBUG   ] spawn_process: at 2018-11-16 00:00:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-16 00:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-16 00:00:25 [DEBUG   ] spawn_process: at 2018-11-16 00:00:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-16 00:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-16 00:00:25 [DEBUG   ] spawn_process: at 2018-11-16 00:00:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-16 00:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-16 00:00:25 [DEBUG   ] spawn_process: at 2018-11-16 00:00:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-16 00:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-16 00:00:25 [DEBUG   ] spawn_process: at 2018-11-16 00:00:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-16 00:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-16 00:00:25 [DEBUG   ] spawn_process: at 2018-11-16 00:00:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-16 00:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-16 00:00:25 [DEBUG   ] spawn_process: at 2018-11-16 00:00:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-16 00:00:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-16 00:00:25 [DEBUG   ] spawn_process: at 2018-11-16 00:00:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-16 00:00:38 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 00:00:45 [DEBUG   ] Got command RPT from MCS: ref #520523
2018-11-16 00:00:45 [DEBUG   ] summary = ERROR
2018-11-16 00:00:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520523  13 58438    45237 A  ERRORERROR'
2018-11-16 00:00:45 [DEBUG   ] Got command RPT from MCS: ref #520524
2018-11-16 00:00:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 00:00:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520524  77 58438    45238 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 00:00:56 [DEBUG   ] Got command BAM from MCS: ref #520541
2018-11-16 00:00:56 [INFO    ] Finished processing BAM request
2018-11-16 00:00:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:00:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520541   8 58438    56029 A  ERROR'
2018-11-16 00:00:56 [DEBUG   ] Got command BAM from MCS: ref #520540
2018-11-16 00:00:56 [INFO    ] Finished processing BAM request
2018-11-16 00:00:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:00:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520540   8 58438    56037 A  ERROR'
2018-11-16 00:00:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-16 00:00:56 [DEBUG   ] spawn_process: at 2018-11-16 00:00:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-16 00:00:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-16 00:00:57 [DEBUG   ] spawn_process: at 2018-11-16 00:00:57 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-16 00:00:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-16 00:00:57 [DEBUG   ] spawn_process: at 2018-11-16 00:00:57 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-16 00:00:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-16 00:00:57 [DEBUG   ] spawn_process: at 2018-11-16 00:00:57 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-16 00:00:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-16 00:00:57 [DEBUG   ] spawn_process: at 2018-11-16 00:00:57 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-16 00:00:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-16 00:00:57 [DEBUG   ] spawn_process: at 2018-11-16 00:00:57 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-16 00:00:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-16 00:00:57 [DEBUG   ] spawn_process: at 2018-11-16 00:00:57 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-16 00:00:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-16 00:00:57 [DEBUG   ] spawn_process: at 2018-11-16 00:00:57 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-16 00:00:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-16 00:00:57 [DEBUG   ] spawn_process: at 2018-11-16 00:00:57 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-16 00:00:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-16 00:00:57 [DEBUG   ] spawn_process: at 2018-11-16 00:00:57 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-16 00:00:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-16 00:00:57 [DEBUG   ] spawn_process: at 2018-11-16 00:00:57 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-16 00:00:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-16 00:00:57 [DEBUG   ] spawn_process: at 2018-11-16 00:00:57 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-16 00:00:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-16 00:00:57 [DEBUG   ] spawn_process: at 2018-11-16 00:00:57 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-16 00:00:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-16 00:00:57 [DEBUG   ] spawn_process: at 2018-11-16 00:00:57 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-16 00:00:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-16 00:00:57 [DEBUG   ] spawn_process: at 2018-11-16 00:00:57 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-16 00:00:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-16 00:00:57 [DEBUG   ] spawn_process: at 2018-11-16 00:00:57 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-16 00:00:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-16 00:00:57 [DEBUG   ] spawn_process: at 2018-11-16 00:00:57 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-16 00:00:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-16 00:00:57 [DEBUG   ] spawn_process: at 2018-11-16 00:00:57 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-16 00:00:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-16 00:00:57 [DEBUG   ] spawn_process: at 2018-11-16 00:00:57 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-16 00:00:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-16 00:00:57 [DEBUG   ] spawn_process: at 2018-11-16 00:00:57 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-16 00:00:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-16 00:00:57 [DEBUG   ] spawn_process: at 2018-11-16 00:00:57 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-16 00:00:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-16 00:00:57 [DEBUG   ] spawn_process: at 2018-11-16 00:00:57 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-16 00:00:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-16 00:00:57 [DEBUG   ] spawn_process: at 2018-11-16 00:00:57 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-16 00:00:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-16 00:00:57 [DEBUG   ] spawn_process: at 2018-11-16 00:00:57 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-16 00:00:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-16 00:00:57 [DEBUG   ] spawn_process: at 2018-11-16 00:00:57 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-16 00:00:57 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-16 00:00:57 [DEBUG   ] spawn_process: at 2018-11-16 00:00:57 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-16 00:00:58 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 00:01:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-11-16 00:01:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:01:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-16 00:01:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-16 00:01:01 [WARNING ] (13, 1, 'bot')
2018-11-16 00:01:01 [WARNING ] (13, 1, 'bot')
2018-11-16 00:01:01 [WARNING ] (13, 1, 'bot')
2018-11-16 00:01:01 [WARNING ] (13, 1, 'bot')
2018-11-16 00:01:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:01:01 [DEBUG   ] Finished updating board flags in 1.013 seconds
2018-11-16 00:01:18 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-16 00:01:27 [DEBUG   ] Got command BAM from MCS: ref #520543
2018-11-16 00:01:27 [INFO    ] Finished processing BAM request
2018-11-16 00:01:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:01:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520543   8 58438    87025 A  ERROR'
2018-11-16 00:01:27 [DEBUG   ] Got command BAM from MCS: ref #520542
2018-11-16 00:01:27 [INFO    ] Finished processing BAM request
2018-11-16 00:01:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:01:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520542   8 58438    87029 A  ERROR'
2018-11-16 00:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-16 00:01:27 [DEBUG   ] spawn_process: at 2018-11-16 00:01:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-16 00:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-16 00:01:27 [DEBUG   ] spawn_process: at 2018-11-16 00:01:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-16 00:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-16 00:01:27 [DEBUG   ] spawn_process: at 2018-11-16 00:01:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-16 00:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-16 00:01:27 [DEBUG   ] spawn_process: at 2018-11-16 00:01:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-16 00:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-16 00:01:27 [DEBUG   ] spawn_process: at 2018-11-16 00:01:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-16 00:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-16 00:01:27 [DEBUG   ] spawn_process: at 2018-11-16 00:01:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-16 00:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-16 00:01:27 [DEBUG   ] spawn_process: at 2018-11-16 00:01:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-16 00:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-16 00:01:27 [DEBUG   ] spawn_process: at 2018-11-16 00:01:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-16 00:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-16 00:01:27 [DEBUG   ] spawn_process: at 2018-11-16 00:01:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-16 00:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-16 00:01:27 [DEBUG   ] spawn_process: at 2018-11-16 00:01:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-16 00:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-16 00:01:27 [DEBUG   ] spawn_process: at 2018-11-16 00:01:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-16 00:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-16 00:01:27 [DEBUG   ] spawn_process: at 2018-11-16 00:01:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-16 00:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-16 00:01:27 [DEBUG   ] spawn_process: at 2018-11-16 00:01:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-16 00:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-16 00:01:27 [DEBUG   ] spawn_process: at 2018-11-16 00:01:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-16 00:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-16 00:01:27 [DEBUG   ] spawn_process: at 2018-11-16 00:01:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-16 00:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-16 00:01:27 [DEBUG   ] spawn_process: at 2018-11-16 00:01:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-16 00:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-16 00:01:27 [DEBUG   ] spawn_process: at 2018-11-16 00:01:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-16 00:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-16 00:01:27 [DEBUG   ] spawn_process: at 2018-11-16 00:01:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-16 00:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-16 00:01:27 [DEBUG   ] spawn_process: at 2018-11-16 00:01:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-16 00:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-16 00:01:27 [DEBUG   ] spawn_process: at 2018-11-16 00:01:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-16 00:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-16 00:01:27 [DEBUG   ] spawn_process: at 2018-11-16 00:01:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-16 00:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-16 00:01:27 [DEBUG   ] spawn_process: at 2018-11-16 00:01:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-16 00:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-16 00:01:27 [DEBUG   ] spawn_process: at 2018-11-16 00:01:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-16 00:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-16 00:01:27 [DEBUG   ] spawn_process: at 2018-11-16 00:01:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-16 00:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-16 00:01:27 [DEBUG   ] spawn_process: at 2018-11-16 00:01:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-16 00:01:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-16 00:01:27 [DEBUG   ] spawn_process: at 2018-11-16 00:01:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-16 00:01:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 00:01:58 [DEBUG   ] Got command BAM from MCS: ref #520544
2018-11-16 00:01:58 [INFO    ] Finished processing BAM request
2018-11-16 00:01:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:01:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520544   8 58438   118029 A  ERROR'
2018-11-16 00:01:58 [DEBUG   ] Got command BAM from MCS: ref #520545
2018-11-16 00:01:58 [INFO    ] Finished processing BAM request
2018-11-16 00:01:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:01:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520545   8 58438   118033 A  ERROR'
2018-11-16 00:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-16 00:01:58 [DEBUG   ] spawn_process: at 2018-11-16 00:01:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-16 00:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-16 00:01:58 [DEBUG   ] spawn_process: at 2018-11-16 00:01:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-16 00:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-16 00:01:58 [DEBUG   ] spawn_process: at 2018-11-16 00:01:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-16 00:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-16 00:01:58 [DEBUG   ] spawn_process: at 2018-11-16 00:01:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-16 00:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-16 00:01:58 [DEBUG   ] spawn_process: at 2018-11-16 00:01:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-16 00:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-16 00:01:58 [DEBUG   ] spawn_process: at 2018-11-16 00:01:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-16 00:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-16 00:01:58 [DEBUG   ] spawn_process: at 2018-11-16 00:01:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-16 00:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-16 00:01:58 [DEBUG   ] spawn_process: at 2018-11-16 00:01:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-16 00:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-16 00:01:58 [DEBUG   ] spawn_process: at 2018-11-16 00:01:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-16 00:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-16 00:01:58 [DEBUG   ] spawn_process: at 2018-11-16 00:01:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-16 00:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-16 00:01:58 [DEBUG   ] spawn_process: at 2018-11-16 00:01:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-16 00:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-16 00:01:58 [DEBUG   ] spawn_process: at 2018-11-16 00:01:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-16 00:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-16 00:01:58 [DEBUG   ] spawn_process: at 2018-11-16 00:01:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-16 00:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-16 00:01:58 [DEBUG   ] spawn_process: at 2018-11-16 00:01:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-16 00:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-16 00:01:58 [DEBUG   ] spawn_process: at 2018-11-16 00:01:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-16 00:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-16 00:01:58 [DEBUG   ] spawn_process: at 2018-11-16 00:01:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-16 00:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-16 00:01:58 [DEBUG   ] spawn_process: at 2018-11-16 00:01:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-16 00:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-16 00:01:58 [DEBUG   ] spawn_process: at 2018-11-16 00:01:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-16 00:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-16 00:01:58 [DEBUG   ] spawn_process: at 2018-11-16 00:01:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-16 00:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-16 00:01:58 [DEBUG   ] spawn_process: at 2018-11-16 00:01:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-16 00:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-16 00:01:58 [DEBUG   ] spawn_process: at 2018-11-16 00:01:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-16 00:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-16 00:01:58 [DEBUG   ] spawn_process: at 2018-11-16 00:01:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-16 00:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-16 00:01:58 [DEBUG   ] spawn_process: at 2018-11-16 00:01:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-16 00:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-16 00:01:58 [DEBUG   ] spawn_process: at 2018-11-16 00:01:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-16 00:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-16 00:01:58 [DEBUG   ] spawn_process: at 2018-11-16 00:01:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-16 00:01:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-16 00:01:58 [DEBUG   ] spawn_process: at 2018-11-16 00:01:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-16 00:01:59 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 00:02:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-16 00:02:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:02:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-16 00:02:01 [WARNING ] (13, 1, 'bot')
2018-11-16 00:02:01 [WARNING ] (13, 1, 'bot')
2018-11-16 00:02:01 [WARNING ] (13, 1, 'bot')
2018-11-16 00:02:01 [WARNING ] (13, 1, 'bot')
2018-11-16 00:02:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:02:01 [DEBUG   ] Finished updating board flags in 0.995 seconds
2018-11-16 00:02:19 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-11-16 00:02:29 [DEBUG   ] Got command BAM from MCS: ref #520546
2018-11-16 00:02:29 [INFO    ] Finished processing BAM request
2018-11-16 00:02:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:02:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520546   8 58438   149025 A  ERROR'
2018-11-16 00:02:29 [DEBUG   ] Got command BAM from MCS: ref #520547
2018-11-16 00:02:29 [INFO    ] Finished processing BAM request
2018-11-16 00:02:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:02:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520547   8 58438   149029 A  ERROR'
2018-11-16 00:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-16 00:02:29 [DEBUG   ] spawn_process: at 2018-11-16 00:02:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-16 00:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-16 00:02:29 [DEBUG   ] spawn_process: at 2018-11-16 00:02:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-16 00:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-16 00:02:29 [DEBUG   ] spawn_process: at 2018-11-16 00:02:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-16 00:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-16 00:02:29 [DEBUG   ] spawn_process: at 2018-11-16 00:02:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-16 00:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-16 00:02:29 [DEBUG   ] spawn_process: at 2018-11-16 00:02:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-16 00:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-16 00:02:29 [DEBUG   ] spawn_process: at 2018-11-16 00:02:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-16 00:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-16 00:02:29 [DEBUG   ] spawn_process: at 2018-11-16 00:02:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-16 00:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-16 00:02:29 [DEBUG   ] spawn_process: at 2018-11-16 00:02:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-16 00:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-16 00:02:29 [DEBUG   ] spawn_process: at 2018-11-16 00:02:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-16 00:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-16 00:02:29 [DEBUG   ] spawn_process: at 2018-11-16 00:02:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-16 00:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-16 00:02:29 [DEBUG   ] spawn_process: at 2018-11-16 00:02:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-16 00:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-16 00:02:29 [DEBUG   ] spawn_process: at 2018-11-16 00:02:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-16 00:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-16 00:02:29 [DEBUG   ] spawn_process: at 2018-11-16 00:02:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-16 00:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-16 00:02:29 [DEBUG   ] spawn_process: at 2018-11-16 00:02:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-16 00:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-16 00:02:29 [DEBUG   ] spawn_process: at 2018-11-16 00:02:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-16 00:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-16 00:02:29 [DEBUG   ] spawn_process: at 2018-11-16 00:02:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-16 00:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-16 00:02:29 [DEBUG   ] spawn_process: at 2018-11-16 00:02:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-16 00:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-16 00:02:29 [DEBUG   ] spawn_process: at 2018-11-16 00:02:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-16 00:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-16 00:02:29 [DEBUG   ] spawn_process: at 2018-11-16 00:02:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-16 00:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-16 00:02:29 [DEBUG   ] spawn_process: at 2018-11-16 00:02:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-16 00:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-16 00:02:29 [DEBUG   ] spawn_process: at 2018-11-16 00:02:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-16 00:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-16 00:02:29 [DEBUG   ] spawn_process: at 2018-11-16 00:02:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-16 00:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-16 00:02:29 [DEBUG   ] spawn_process: at 2018-11-16 00:02:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-16 00:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-16 00:02:29 [DEBUG   ] spawn_process: at 2018-11-16 00:02:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-16 00:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-16 00:02:29 [DEBUG   ] spawn_process: at 2018-11-16 00:02:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-16 00:02:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-16 00:02:29 [DEBUG   ] spawn_process: at 2018-11-16 00:02:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-16 00:02:39 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-16 00:02:59 [DEBUG   ] Got command BAM from MCS: ref #520552
2018-11-16 00:02:59 [INFO    ] Finished processing BAM request
2018-11-16 00:02:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:02:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520552   8 58438   179029 A  ERROR'
2018-11-16 00:02:59 [DEBUG   ] Got command BAM from MCS: ref #520553
2018-11-16 00:02:59 [INFO    ] Finished processing BAM request
2018-11-16 00:02:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:02:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520553   8 58438   179033 A  ERROR'
2018-11-16 00:02:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 00:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-16 00:02:59 [DEBUG   ] spawn_process: at 2018-11-16 00:02:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-16 00:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-16 00:02:59 [DEBUG   ] spawn_process: at 2018-11-16 00:02:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-16 00:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-16 00:02:59 [DEBUG   ] spawn_process: at 2018-11-16 00:02:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-16 00:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-16 00:02:59 [DEBUG   ] spawn_process: at 2018-11-16 00:02:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-16 00:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-16 00:02:59 [DEBUG   ] spawn_process: at 2018-11-16 00:02:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-16 00:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-16 00:02:59 [DEBUG   ] spawn_process: at 2018-11-16 00:02:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-16 00:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-16 00:02:59 [DEBUG   ] spawn_process: at 2018-11-16 00:02:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-16 00:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-16 00:02:59 [DEBUG   ] spawn_process: at 2018-11-16 00:02:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-16 00:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-16 00:02:59 [DEBUG   ] spawn_process: at 2018-11-16 00:02:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-16 00:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-16 00:02:59 [DEBUG   ] spawn_process: at 2018-11-16 00:02:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-16 00:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-16 00:02:59 [DEBUG   ] spawn_process: at 2018-11-16 00:02:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-16 00:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-16 00:02:59 [DEBUG   ] spawn_process: at 2018-11-16 00:02:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-16 00:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-16 00:02:59 [DEBUG   ] spawn_process: at 2018-11-16 00:02:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-16 00:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-16 00:02:59 [DEBUG   ] spawn_process: at 2018-11-16 00:02:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-16 00:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-16 00:02:59 [DEBUG   ] spawn_process: at 2018-11-16 00:02:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-16 00:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-16 00:02:59 [DEBUG   ] spawn_process: at 2018-11-16 00:02:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-16 00:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-16 00:02:59 [DEBUG   ] spawn_process: at 2018-11-16 00:02:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-16 00:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-16 00:02:59 [DEBUG   ] spawn_process: at 2018-11-16 00:02:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-16 00:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-16 00:02:59 [DEBUG   ] spawn_process: at 2018-11-16 00:02:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-16 00:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-16 00:02:59 [DEBUG   ] spawn_process: at 2018-11-16 00:02:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-16 00:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-16 00:02:59 [DEBUG   ] spawn_process: at 2018-11-16 00:02:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-16 00:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-16 00:02:59 [DEBUG   ] spawn_process: at 2018-11-16 00:02:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-16 00:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-16 00:02:59 [DEBUG   ] spawn_process: at 2018-11-16 00:02:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-16 00:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-16 00:02:59 [DEBUG   ] spawn_process: at 2018-11-16 00:02:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-16 00:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-16 00:02:59 [DEBUG   ] spawn_process: at 2018-11-16 00:02:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-16 00:02:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-16 00:02:59 [DEBUG   ] spawn_process: at 2018-11-16 00:02:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-16 00:03:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 00:03:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:03:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-16 00:03:01 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-16 00:03:01 [WARNING ] (13, 1, 'bot')
2018-11-16 00:03:01 [WARNING ] (13, 1, 'bot')
2018-11-16 00:03:01 [WARNING ] (13, 1, 'bot')
2018-11-16 00:03:01 [WARNING ] (13, 1, 'bot')
2018-11-16 00:03:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:03:01 [DEBUG   ] Finished updating board flags in 1.254 seconds
2018-11-16 00:03:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 00:03:27 [DEBUG   ] Got command RPT from MCS: ref #520554
2018-11-16 00:03:27 [DEBUG   ] summary = ERROR
2018-11-16 00:03:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520554  13 58438   207317 A  ERRORERROR'
2018-11-16 00:03:27 [DEBUG   ] Got command RPT from MCS: ref #520555
2018-11-16 00:03:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 00:03:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520555  77 58438   207509 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 00:03:27 [DEBUG   ] Got command RPT from MCS: ref #520556
2018-11-16 00:03:27 [DEBUG   ] summary = ERROR
2018-11-16 00:03:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520556  13 58438   207713 A  ERRORERROR'
2018-11-16 00:03:27 [DEBUG   ] Got command RPT from MCS: ref #520557
2018-11-16 00:03:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 00:03:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520557  77 58438   207917 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 00:03:28 [DEBUG   ] Got command RPT from MCS: ref #520560
2018-11-16 00:03:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 00:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520560  12 58438   208121 A  ERRORB£ff'
2018-11-16 00:03:29 [DEBUG   ] Got command BAM from MCS: ref #520559
2018-11-16 00:03:29 [INFO    ] Finished processing BAM request
2018-11-16 00:03:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:03:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520559   8 58438   209025 A  ERROR'
2018-11-16 00:03:29 [DEBUG   ] Got command BAM from MCS: ref #520558
2018-11-16 00:03:29 [INFO    ] Finished processing BAM request
2018-11-16 00:03:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:03:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520558   8 58438   209029 A  ERROR'
2018-11-16 00:03:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-16 00:03:29 [DEBUG   ] spawn_process: at 2018-11-16 00:03:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-16 00:03:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-16 00:03:29 [DEBUG   ] spawn_process: at 2018-11-16 00:03:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-16 00:03:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-16 00:03:29 [DEBUG   ] spawn_process: at 2018-11-16 00:03:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-16 00:03:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-16 00:03:29 [DEBUG   ] spawn_process: at 2018-11-16 00:03:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-16 00:03:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-16 00:03:29 [DEBUG   ] spawn_process: at 2018-11-16 00:03:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-16 00:03:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-16 00:03:29 [DEBUG   ] spawn_process: at 2018-11-16 00:03:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-16 00:03:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-16 00:03:29 [DEBUG   ] spawn_process: at 2018-11-16 00:03:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-16 00:03:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-16 00:03:29 [DEBUG   ] spawn_process: at 2018-11-16 00:03:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-16 00:03:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-16 00:03:29 [DEBUG   ] spawn_process: at 2018-11-16 00:03:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-16 00:03:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-16 00:03:29 [DEBUG   ] spawn_process: at 2018-11-16 00:03:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-16 00:03:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-16 00:03:29 [DEBUG   ] spawn_process: at 2018-11-16 00:03:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-16 00:03:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-16 00:03:29 [DEBUG   ] spawn_process: at 2018-11-16 00:03:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-16 00:03:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-16 00:03:29 [DEBUG   ] spawn_process: at 2018-11-16 00:03:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-16 00:03:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-16 00:03:29 [DEBUG   ] spawn_process: at 2018-11-16 00:03:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-16 00:03:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-16 00:03:29 [DEBUG   ] spawn_process: at 2018-11-16 00:03:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-16 00:03:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-16 00:03:29 [DEBUG   ] spawn_process: at 2018-11-16 00:03:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-16 00:03:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-16 00:03:29 [DEBUG   ] spawn_process: at 2018-11-16 00:03:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-16 00:03:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-16 00:03:29 [DEBUG   ] spawn_process: at 2018-11-16 00:03:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-16 00:03:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-16 00:03:29 [DEBUG   ] spawn_process: at 2018-11-16 00:03:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-16 00:03:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-16 00:03:29 [DEBUG   ] spawn_process: at 2018-11-16 00:03:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-16 00:03:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-16 00:03:29 [DEBUG   ] spawn_process: at 2018-11-16 00:03:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-16 00:03:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-16 00:03:29 [DEBUG   ] spawn_process: at 2018-11-16 00:03:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-16 00:03:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-16 00:03:29 [DEBUG   ] spawn_process: at 2018-11-16 00:03:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-16 00:03:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-16 00:03:29 [DEBUG   ] spawn_process: at 2018-11-16 00:03:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-16 00:03:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-16 00:03:29 [DEBUG   ] spawn_process: at 2018-11-16 00:03:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-16 00:03:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-16 00:03:29 [DEBUG   ] spawn_process: at 2018-11-16 00:03:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-16 00:03:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 00:03:59 [DEBUG   ] Got command BAM from MCS: ref #520561
2018-11-16 00:03:59 [INFO    ] Finished processing BAM request
2018-11-16 00:03:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:03:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520561   8 58438   239029 A  ERROR'
2018-11-16 00:03:59 [DEBUG   ] Got command BAM from MCS: ref #520562
2018-11-16 00:03:59 [INFO    ] Finished processing BAM request
2018-11-16 00:03:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:03:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520562   8 58438   239033 A  ERROR'
2018-11-16 00:03:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 00:03:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-16 00:03:59 [DEBUG   ] spawn_process: at 2018-11-16 00:03:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-16 00:03:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-16 00:03:59 [DEBUG   ] spawn_process: at 2018-11-16 00:03:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-16 00:03:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-16 00:03:59 [DEBUG   ] spawn_process: at 2018-11-16 00:03:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-16 00:03:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-16 00:03:59 [DEBUG   ] spawn_process: at 2018-11-16 00:03:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-16 00:03:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-16 00:03:59 [DEBUG   ] spawn_process: at 2018-11-16 00:03:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-16 00:03:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-16 00:03:59 [DEBUG   ] spawn_process: at 2018-11-16 00:03:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-16 00:03:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-16 00:03:59 [DEBUG   ] spawn_process: at 2018-11-16 00:03:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-16 00:03:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-16 00:03:59 [DEBUG   ] spawn_process: at 2018-11-16 00:03:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-16 00:03:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-16 00:03:59 [DEBUG   ] spawn_process: at 2018-11-16 00:03:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-16 00:03:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-16 00:03:59 [DEBUG   ] spawn_process: at 2018-11-16 00:03:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-16 00:03:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-16 00:03:59 [DEBUG   ] spawn_process: at 2018-11-16 00:03:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-16 00:03:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-16 00:03:59 [DEBUG   ] spawn_process: at 2018-11-16 00:03:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-16 00:03:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-16 00:03:59 [DEBUG   ] spawn_process: at 2018-11-16 00:03:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-16 00:03:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-16 00:03:59 [DEBUG   ] spawn_process: at 2018-11-16 00:03:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-16 00:03:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-16 00:03:59 [DEBUG   ] spawn_process: at 2018-11-16 00:03:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-16 00:03:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-16 00:03:59 [DEBUG   ] spawn_process: at 2018-11-16 00:03:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-16 00:03:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-16 00:03:59 [DEBUG   ] spawn_process: at 2018-11-16 00:03:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-16 00:03:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-16 00:03:59 [DEBUG   ] spawn_process: at 2018-11-16 00:03:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-16 00:03:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-16 00:03:59 [DEBUG   ] spawn_process: at 2018-11-16 00:03:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-16 00:03:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-16 00:03:59 [DEBUG   ] spawn_process: at 2018-11-16 00:03:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-16 00:03:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-16 00:03:59 [DEBUG   ] spawn_process: at 2018-11-16 00:03:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-16 00:03:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-16 00:03:59 [DEBUG   ] spawn_process: at 2018-11-16 00:03:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-16 00:03:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-16 00:03:59 [DEBUG   ] spawn_process: at 2018-11-16 00:03:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-16 00:03:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-16 00:03:59 [DEBUG   ] spawn_process: at 2018-11-16 00:03:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-16 00:03:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-16 00:03:59 [DEBUG   ] spawn_process: at 2018-11-16 00:03:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-16 00:03:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-16 00:03:59 [DEBUG   ] spawn_process: at 2018-11-16 00:03:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-16 00:04:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:04:01 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-16 00:04:01 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-16 00:04:01 [WARNING ] (13, 1, 'bot')
2018-11-16 00:04:01 [WARNING ] (13, 1, 'bot')
2018-11-16 00:04:01 [WARNING ] (13, 1, 'bot')
2018-11-16 00:04:01 [WARNING ] (13, 1, 'bot')
2018-11-16 00:04:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:04:01 [DEBUG   ] Finished updating board flags in 1.194 seconds
2018-11-16 00:04:19 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-16 00:04:29 [DEBUG   ] Got command BAM from MCS: ref #520563
2018-11-16 00:04:29 [INFO    ] Finished processing BAM request
2018-11-16 00:04:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:04:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520563   8 58438   269029 A  ERROR'
2018-11-16 00:04:29 [DEBUG   ] Got command BAM from MCS: ref #520564
2018-11-16 00:04:29 [INFO    ] Finished processing BAM request
2018-11-16 00:04:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:04:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520564   8 58438   269033 A  ERROR'
2018-11-16 00:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-16 00:04:29 [DEBUG   ] spawn_process: at 2018-11-16 00:04:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-16 00:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-16 00:04:29 [DEBUG   ] spawn_process: at 2018-11-16 00:04:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-16 00:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-16 00:04:29 [DEBUG   ] spawn_process: at 2018-11-16 00:04:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-16 00:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-16 00:04:29 [DEBUG   ] spawn_process: at 2018-11-16 00:04:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-16 00:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-16 00:04:29 [DEBUG   ] spawn_process: at 2018-11-16 00:04:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-16 00:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-16 00:04:29 [DEBUG   ] spawn_process: at 2018-11-16 00:04:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-16 00:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-16 00:04:29 [DEBUG   ] spawn_process: at 2018-11-16 00:04:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-16 00:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-16 00:04:29 [DEBUG   ] spawn_process: at 2018-11-16 00:04:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-16 00:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-16 00:04:29 [DEBUG   ] spawn_process: at 2018-11-16 00:04:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-16 00:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-16 00:04:29 [DEBUG   ] spawn_process: at 2018-11-16 00:04:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-16 00:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-16 00:04:29 [DEBUG   ] spawn_process: at 2018-11-16 00:04:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-16 00:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-16 00:04:29 [DEBUG   ] spawn_process: at 2018-11-16 00:04:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-16 00:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-16 00:04:29 [DEBUG   ] spawn_process: at 2018-11-16 00:04:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-16 00:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-16 00:04:29 [DEBUG   ] spawn_process: at 2018-11-16 00:04:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-16 00:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-16 00:04:29 [DEBUG   ] spawn_process: at 2018-11-16 00:04:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-16 00:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-16 00:04:29 [DEBUG   ] spawn_process: at 2018-11-16 00:04:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-16 00:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-16 00:04:29 [DEBUG   ] spawn_process: at 2018-11-16 00:04:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-16 00:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-16 00:04:29 [DEBUG   ] spawn_process: at 2018-11-16 00:04:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-16 00:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-16 00:04:29 [DEBUG   ] spawn_process: at 2018-11-16 00:04:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-16 00:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-16 00:04:29 [DEBUG   ] spawn_process: at 2018-11-16 00:04:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-16 00:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-16 00:04:29 [DEBUG   ] spawn_process: at 2018-11-16 00:04:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-16 00:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-16 00:04:29 [DEBUG   ] spawn_process: at 2018-11-16 00:04:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-16 00:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-16 00:04:29 [DEBUG   ] spawn_process: at 2018-11-16 00:04:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-16 00:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-16 00:04:29 [DEBUG   ] spawn_process: at 2018-11-16 00:04:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-16 00:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-16 00:04:29 [DEBUG   ] spawn_process: at 2018-11-16 00:04:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-16 00:04:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-16 00:04:29 [DEBUG   ] spawn_process: at 2018-11-16 00:04:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-16 00:04:39 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-16 00:04:59 [DEBUG   ] Got command BAM from MCS: ref #520566
2018-11-16 00:04:59 [INFO    ] Finished processing BAM request
2018-11-16 00:04:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:04:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520566   8 58438   299025 A  ERROR'
2018-11-16 00:04:59 [DEBUG   ] Got command BAM from MCS: ref #520565
2018-11-16 00:04:59 [INFO    ] Finished processing BAM request
2018-11-16 00:04:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:04:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520565   8 58438   299029 A  ERROR'
2018-11-16 00:04:59 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 00:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-16 00:04:59 [DEBUG   ] spawn_process: at 2018-11-16 00:04:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-16 00:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-16 00:04:59 [DEBUG   ] spawn_process: at 2018-11-16 00:04:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-16 00:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-16 00:04:59 [DEBUG   ] spawn_process: at 2018-11-16 00:04:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-16 00:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-16 00:04:59 [DEBUG   ] spawn_process: at 2018-11-16 00:04:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-16 00:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-16 00:04:59 [DEBUG   ] spawn_process: at 2018-11-16 00:04:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-16 00:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-16 00:04:59 [DEBUG   ] spawn_process: at 2018-11-16 00:04:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-16 00:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-16 00:04:59 [DEBUG   ] spawn_process: at 2018-11-16 00:04:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-16 00:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-16 00:04:59 [DEBUG   ] spawn_process: at 2018-11-16 00:04:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-16 00:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-16 00:04:59 [DEBUG   ] spawn_process: at 2018-11-16 00:04:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-16 00:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-16 00:04:59 [DEBUG   ] spawn_process: at 2018-11-16 00:04:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-16 00:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-16 00:04:59 [DEBUG   ] spawn_process: at 2018-11-16 00:04:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-16 00:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-16 00:04:59 [DEBUG   ] spawn_process: at 2018-11-16 00:04:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-16 00:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-16 00:04:59 [DEBUG   ] spawn_process: at 2018-11-16 00:04:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-16 00:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-16 00:04:59 [DEBUG   ] spawn_process: at 2018-11-16 00:04:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-16 00:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-16 00:04:59 [DEBUG   ] spawn_process: at 2018-11-16 00:04:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-16 00:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-16 00:04:59 [DEBUG   ] spawn_process: at 2018-11-16 00:04:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-16 00:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-16 00:04:59 [DEBUG   ] spawn_process: at 2018-11-16 00:04:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-16 00:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-16 00:04:59 [DEBUG   ] spawn_process: at 2018-11-16 00:04:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-16 00:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-16 00:04:59 [DEBUG   ] spawn_process: at 2018-11-16 00:04:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-16 00:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-16 00:04:59 [DEBUG   ] spawn_process: at 2018-11-16 00:04:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-16 00:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-16 00:04:59 [DEBUG   ] spawn_process: at 2018-11-16 00:04:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-16 00:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-16 00:04:59 [DEBUG   ] spawn_process: at 2018-11-16 00:04:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-16 00:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-16 00:04:59 [DEBUG   ] spawn_process: at 2018-11-16 00:04:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-16 00:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-16 00:04:59 [DEBUG   ] spawn_process: at 2018-11-16 00:04:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-16 00:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-16 00:04:59 [DEBUG   ] spawn_process: at 2018-11-16 00:04:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-16 00:04:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-16 00:04:59 [DEBUG   ] spawn_process: at 2018-11-16 00:04:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-16 00:05:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-16 00:05:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-16 00:05:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:05:02 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-16 00:05:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-16 00:05:02 [WARNING ] (13, 1, 'bot')
2018-11-16 00:05:02 [WARNING ] (13, 1, 'bot')
2018-11-16 00:05:02 [WARNING ] (13, 1, 'bot')
2018-11-16 00:05:02 [WARNING ] (13, 1, 'bot')
2018-11-16 00:05:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:05:02 [DEBUG   ] Finished updating board flags in 1.555 seconds
2018-11-16 00:05:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 00:05:29 [DEBUG   ] Got command BAM from MCS: ref #520567
2018-11-16 00:05:29 [INFO    ] Finished processing BAM request
2018-11-16 00:05:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:05:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520567   8 58438   329029 A  ERROR'
2018-11-16 00:05:29 [DEBUG   ] Got command BAM from MCS: ref #520568
2018-11-16 00:05:29 [INFO    ] Finished processing BAM request
2018-11-16 00:05:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:05:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520568   8 58438   329033 A  ERROR'
2018-11-16 00:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-16 00:05:29 [DEBUG   ] spawn_process: at 2018-11-16 00:05:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-16 00:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-16 00:05:29 [DEBUG   ] spawn_process: at 2018-11-16 00:05:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-16 00:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-16 00:05:29 [DEBUG   ] spawn_process: at 2018-11-16 00:05:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-16 00:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-16 00:05:29 [DEBUG   ] spawn_process: at 2018-11-16 00:05:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-16 00:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-16 00:05:29 [DEBUG   ] spawn_process: at 2018-11-16 00:05:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-16 00:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-16 00:05:29 [DEBUG   ] spawn_process: at 2018-11-16 00:05:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-16 00:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-16 00:05:29 [DEBUG   ] spawn_process: at 2018-11-16 00:05:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-16 00:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-16 00:05:29 [DEBUG   ] spawn_process: at 2018-11-16 00:05:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-16 00:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-16 00:05:29 [DEBUG   ] spawn_process: at 2018-11-16 00:05:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-16 00:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-16 00:05:29 [DEBUG   ] spawn_process: at 2018-11-16 00:05:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-16 00:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-16 00:05:29 [DEBUG   ] spawn_process: at 2018-11-16 00:05:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-16 00:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-16 00:05:29 [DEBUG   ] spawn_process: at 2018-11-16 00:05:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-16 00:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-16 00:05:29 [DEBUG   ] spawn_process: at 2018-11-16 00:05:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-16 00:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-16 00:05:29 [DEBUG   ] spawn_process: at 2018-11-16 00:05:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-16 00:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-16 00:05:29 [DEBUG   ] spawn_process: at 2018-11-16 00:05:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-16 00:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-16 00:05:29 [DEBUG   ] spawn_process: at 2018-11-16 00:05:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-16 00:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-16 00:05:29 [DEBUG   ] spawn_process: at 2018-11-16 00:05:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-16 00:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-16 00:05:29 [DEBUG   ] spawn_process: at 2018-11-16 00:05:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-16 00:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-16 00:05:29 [DEBUG   ] spawn_process: at 2018-11-16 00:05:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-16 00:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-16 00:05:29 [DEBUG   ] spawn_process: at 2018-11-16 00:05:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-16 00:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-16 00:05:29 [DEBUG   ] spawn_process: at 2018-11-16 00:05:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-16 00:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-16 00:05:29 [DEBUG   ] spawn_process: at 2018-11-16 00:05:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-16 00:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-16 00:05:29 [DEBUG   ] spawn_process: at 2018-11-16 00:05:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-16 00:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-16 00:05:29 [DEBUG   ] spawn_process: at 2018-11-16 00:05:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-16 00:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-16 00:05:29 [DEBUG   ] spawn_process: at 2018-11-16 00:05:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-16 00:05:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-16 00:05:29 [DEBUG   ] spawn_process: at 2018-11-16 00:05:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-16 00:05:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 00:05:45 [DEBUG   ] Got command RPT from MCS: ref #520573
2018-11-16 00:05:45 [DEBUG   ] summary = ERROR
2018-11-16 00:05:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520573  13 58438   345241 A  ERRORERROR'
2018-11-16 00:05:45 [DEBUG   ] Got command RPT from MCS: ref #520574
2018-11-16 00:05:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 00:05:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520574  77 58438   345242 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 00:05:59 [DEBUG   ] Got command BAM from MCS: ref #520591
2018-11-16 00:05:59 [INFO    ] Finished processing BAM request
2018-11-16 00:05:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:05:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520591   8 58438   359033 A  ERROR'
2018-11-16 00:05:59 [DEBUG   ] Got command BAM from MCS: ref #520590
2018-11-16 00:05:59 [INFO    ] Finished processing BAM request
2018-11-16 00:05:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:05:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520590   8 58438   359037 A  ERROR'
2018-11-16 00:05:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 00:05:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-16 00:05:59 [DEBUG   ] spawn_process: at 2018-11-16 00:05:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-16 00:05:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-16 00:05:59 [DEBUG   ] spawn_process: at 2018-11-16 00:05:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-16 00:05:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-16 00:05:59 [DEBUG   ] spawn_process: at 2018-11-16 00:05:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-16 00:05:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-16 00:05:59 [DEBUG   ] spawn_process: at 2018-11-16 00:05:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-16 00:05:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-16 00:05:59 [DEBUG   ] spawn_process: at 2018-11-16 00:05:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-16 00:05:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-16 00:05:59 [DEBUG   ] spawn_process: at 2018-11-16 00:05:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-16 00:05:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-16 00:05:59 [DEBUG   ] spawn_process: at 2018-11-16 00:05:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-16 00:05:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-16 00:05:59 [DEBUG   ] spawn_process: at 2018-11-16 00:05:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-16 00:05:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-16 00:05:59 [DEBUG   ] spawn_process: at 2018-11-16 00:05:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-16 00:05:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-16 00:05:59 [DEBUG   ] spawn_process: at 2018-11-16 00:05:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-16 00:05:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-16 00:05:59 [DEBUG   ] spawn_process: at 2018-11-16 00:05:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-16 00:05:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-16 00:05:59 [DEBUG   ] spawn_process: at 2018-11-16 00:05:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-16 00:05:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-16 00:05:59 [DEBUG   ] spawn_process: at 2018-11-16 00:05:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-16 00:05:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-16 00:05:59 [DEBUG   ] spawn_process: at 2018-11-16 00:05:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-16 00:05:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-16 00:05:59 [DEBUG   ] spawn_process: at 2018-11-16 00:05:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-16 00:05:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-16 00:05:59 [DEBUG   ] spawn_process: at 2018-11-16 00:05:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-16 00:05:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-16 00:05:59 [DEBUG   ] spawn_process: at 2018-11-16 00:05:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-16 00:05:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-16 00:05:59 [DEBUG   ] spawn_process: at 2018-11-16 00:05:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-16 00:05:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-16 00:05:59 [DEBUG   ] spawn_process: at 2018-11-16 00:05:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-16 00:05:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-16 00:05:59 [DEBUG   ] spawn_process: at 2018-11-16 00:05:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-16 00:05:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-16 00:05:59 [DEBUG   ] spawn_process: at 2018-11-16 00:05:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-16 00:05:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-16 00:05:59 [DEBUG   ] spawn_process: at 2018-11-16 00:05:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-16 00:05:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-16 00:05:59 [DEBUG   ] spawn_process: at 2018-11-16 00:05:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-16 00:05:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-16 00:05:59 [DEBUG   ] spawn_process: at 2018-11-16 00:05:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-16 00:05:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-16 00:05:59 [DEBUG   ] spawn_process: at 2018-11-16 00:05:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-16 00:05:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-16 00:05:59 [DEBUG   ] spawn_process: at 2018-11-16 00:05:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-16 00:06:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-16 00:06:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:06:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 00:06:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-16 00:06:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-16 00:06:02 [WARNING ] (13, 1, 'bot')
2018-11-16 00:06:02 [WARNING ] (13, 1, 'bot')
2018-11-16 00:06:02 [WARNING ] (13, 1, 'bot')
2018-11-16 00:06:02 [WARNING ] (13, 1, 'bot')
2018-11-16 00:06:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:06:02 [DEBUG   ] Finished updating board flags in 1.416 seconds
2018-11-16 00:06:19 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-16 00:06:29 [DEBUG   ] Got command BAM from MCS: ref #520592
2018-11-16 00:06:29 [INFO    ] Finished processing BAM request
2018-11-16 00:06:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:06:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520592   8 58438   389033 A  ERROR'
2018-11-16 00:06:29 [DEBUG   ] Got command BAM from MCS: ref #520593
2018-11-16 00:06:29 [INFO    ] Finished processing BAM request
2018-11-16 00:06:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:06:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520593   8 58438   389037 A  ERROR'
2018-11-16 00:06:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-16 00:06:29 [DEBUG   ] spawn_process: at 2018-11-16 00:06:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-16 00:06:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-16 00:06:29 [DEBUG   ] spawn_process: at 2018-11-16 00:06:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-16 00:06:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-16 00:06:29 [DEBUG   ] spawn_process: at 2018-11-16 00:06:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-16 00:06:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-16 00:06:29 [DEBUG   ] spawn_process: at 2018-11-16 00:06:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-16 00:06:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-16 00:06:29 [DEBUG   ] spawn_process: at 2018-11-16 00:06:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-16 00:06:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-16 00:06:29 [DEBUG   ] spawn_process: at 2018-11-16 00:06:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-16 00:06:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-16 00:06:29 [DEBUG   ] spawn_process: at 2018-11-16 00:06:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-16 00:06:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-16 00:06:29 [DEBUG   ] spawn_process: at 2018-11-16 00:06:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-16 00:06:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-16 00:06:29 [DEBUG   ] spawn_process: at 2018-11-16 00:06:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-16 00:06:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-16 00:06:29 [DEBUG   ] spawn_process: at 2018-11-16 00:06:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-16 00:06:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-16 00:06:29 [DEBUG   ] spawn_process: at 2018-11-16 00:06:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-16 00:06:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-16 00:06:29 [DEBUG   ] spawn_process: at 2018-11-16 00:06:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-16 00:06:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-16 00:06:29 [DEBUG   ] spawn_process: at 2018-11-16 00:06:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-16 00:06:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-16 00:06:29 [DEBUG   ] spawn_process: at 2018-11-16 00:06:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-16 00:06:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-16 00:06:29 [DEBUG   ] spawn_process: at 2018-11-16 00:06:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-16 00:06:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-16 00:06:29 [DEBUG   ] spawn_process: at 2018-11-16 00:06:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-16 00:06:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-16 00:06:29 [DEBUG   ] spawn_process: at 2018-11-16 00:06:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-16 00:06:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-16 00:06:29 [DEBUG   ] spawn_process: at 2018-11-16 00:06:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-16 00:06:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-16 00:06:29 [DEBUG   ] spawn_process: at 2018-11-16 00:06:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-16 00:06:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-16 00:06:29 [DEBUG   ] spawn_process: at 2018-11-16 00:06:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-16 00:06:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-16 00:06:29 [DEBUG   ] spawn_process: at 2018-11-16 00:06:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-16 00:06:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-16 00:06:29 [DEBUG   ] spawn_process: at 2018-11-16 00:06:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-16 00:06:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-16 00:06:29 [DEBUG   ] spawn_process: at 2018-11-16 00:06:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-16 00:06:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-16 00:06:29 [DEBUG   ] spawn_process: at 2018-11-16 00:06:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-16 00:06:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-16 00:06:29 [DEBUG   ] spawn_process: at 2018-11-16 00:06:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-16 00:06:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-16 00:06:29 [DEBUG   ] spawn_process: at 2018-11-16 00:06:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-16 00:06:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 00:06:59 [DEBUG   ] Got command BAM from MCS: ref #520595
2018-11-16 00:06:59 [INFO    ] Finished processing BAM request
2018-11-16 00:06:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:06:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520595   8 58438   419029 A  ERROR'
2018-11-16 00:06:59 [DEBUG   ] Got command BAM from MCS: ref #520594
2018-11-16 00:06:59 [INFO    ] Finished processing BAM request
2018-11-16 00:06:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:06:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520594   8 58438   419033 A  ERROR'
2018-11-16 00:06:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 00:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-16 00:06:59 [DEBUG   ] spawn_process: at 2018-11-16 00:06:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-16 00:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-16 00:06:59 [DEBUG   ] spawn_process: at 2018-11-16 00:06:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-16 00:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-16 00:06:59 [DEBUG   ] spawn_process: at 2018-11-16 00:06:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-16 00:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-16 00:06:59 [DEBUG   ] spawn_process: at 2018-11-16 00:06:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-16 00:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-16 00:06:59 [DEBUG   ] spawn_process: at 2018-11-16 00:06:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-16 00:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-16 00:06:59 [DEBUG   ] spawn_process: at 2018-11-16 00:06:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-16 00:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-16 00:06:59 [DEBUG   ] spawn_process: at 2018-11-16 00:06:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-16 00:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-16 00:06:59 [DEBUG   ] spawn_process: at 2018-11-16 00:06:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-16 00:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-16 00:06:59 [DEBUG   ] spawn_process: at 2018-11-16 00:06:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-16 00:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-16 00:06:59 [DEBUG   ] spawn_process: at 2018-11-16 00:06:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-16 00:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-16 00:06:59 [DEBUG   ] spawn_process: at 2018-11-16 00:06:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-16 00:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-16 00:06:59 [DEBUG   ] spawn_process: at 2018-11-16 00:06:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-16 00:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-16 00:06:59 [DEBUG   ] spawn_process: at 2018-11-16 00:06:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-16 00:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-16 00:06:59 [DEBUG   ] spawn_process: at 2018-11-16 00:06:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-16 00:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-16 00:06:59 [DEBUG   ] spawn_process: at 2018-11-16 00:06:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-16 00:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-16 00:06:59 [DEBUG   ] spawn_process: at 2018-11-16 00:06:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-16 00:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-16 00:06:59 [DEBUG   ] spawn_process: at 2018-11-16 00:06:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-16 00:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-16 00:06:59 [DEBUG   ] spawn_process: at 2018-11-16 00:06:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-16 00:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-16 00:06:59 [DEBUG   ] spawn_process: at 2018-11-16 00:06:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-16 00:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-16 00:06:59 [DEBUG   ] spawn_process: at 2018-11-16 00:06:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-16 00:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-16 00:06:59 [DEBUG   ] spawn_process: at 2018-11-16 00:06:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-16 00:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-16 00:06:59 [DEBUG   ] spawn_process: at 2018-11-16 00:06:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-16 00:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-16 00:06:59 [DEBUG   ] spawn_process: at 2018-11-16 00:06:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-16 00:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-16 00:06:59 [DEBUG   ] spawn_process: at 2018-11-16 00:06:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-16 00:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-16 00:06:59 [DEBUG   ] spawn_process: at 2018-11-16 00:06:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-16 00:06:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-16 00:06:59 [DEBUG   ] spawn_process: at 2018-11-16 00:06:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-16 00:07:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 00:07:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:07:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-16 00:07:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-16 00:07:02 [WARNING ] (13, 1, 'bot')
2018-11-16 00:07:02 [WARNING ] (13, 1, 'bot')
2018-11-16 00:07:02 [WARNING ] (13, 1, 'bot')
2018-11-16 00:07:02 [WARNING ] (13, 1, 'bot')
2018-11-16 00:07:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:07:02 [DEBUG   ] Finished updating board flags in 1.389 seconds
2018-11-16 00:07:19 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-16 00:07:29 [DEBUG   ] Got command BAM from MCS: ref #520596
2018-11-16 00:07:29 [INFO    ] Finished processing BAM request
2018-11-16 00:07:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:07:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520596   8 58438   449033 A  ERROR'
2018-11-16 00:07:29 [DEBUG   ] Got command BAM from MCS: ref #520597
2018-11-16 00:07:29 [INFO    ] Finished processing BAM request
2018-11-16 00:07:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:07:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520597   8 58438   449037 A  ERROR'
2018-11-16 00:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-16 00:07:29 [DEBUG   ] spawn_process: at 2018-11-16 00:07:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-16 00:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-16 00:07:29 [DEBUG   ] spawn_process: at 2018-11-16 00:07:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-16 00:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-16 00:07:29 [DEBUG   ] spawn_process: at 2018-11-16 00:07:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-16 00:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-16 00:07:29 [DEBUG   ] spawn_process: at 2018-11-16 00:07:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-16 00:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-16 00:07:29 [DEBUG   ] spawn_process: at 2018-11-16 00:07:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-16 00:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-16 00:07:29 [DEBUG   ] spawn_process: at 2018-11-16 00:07:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-16 00:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-16 00:07:29 [DEBUG   ] spawn_process: at 2018-11-16 00:07:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-16 00:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-16 00:07:29 [DEBUG   ] spawn_process: at 2018-11-16 00:07:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-16 00:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-16 00:07:29 [DEBUG   ] spawn_process: at 2018-11-16 00:07:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-16 00:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-16 00:07:29 [DEBUG   ] spawn_process: at 2018-11-16 00:07:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-16 00:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-16 00:07:29 [DEBUG   ] spawn_process: at 2018-11-16 00:07:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-16 00:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-16 00:07:29 [DEBUG   ] spawn_process: at 2018-11-16 00:07:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-16 00:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-16 00:07:29 [DEBUG   ] spawn_process: at 2018-11-16 00:07:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-16 00:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-16 00:07:29 [DEBUG   ] spawn_process: at 2018-11-16 00:07:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-16 00:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-16 00:07:29 [DEBUG   ] spawn_process: at 2018-11-16 00:07:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-16 00:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-16 00:07:29 [DEBUG   ] spawn_process: at 2018-11-16 00:07:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-16 00:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-16 00:07:29 [DEBUG   ] spawn_process: at 2018-11-16 00:07:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-16 00:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-16 00:07:29 [DEBUG   ] spawn_process: at 2018-11-16 00:07:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-16 00:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-16 00:07:29 [DEBUG   ] spawn_process: at 2018-11-16 00:07:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-16 00:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-16 00:07:29 [DEBUG   ] spawn_process: at 2018-11-16 00:07:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-16 00:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-16 00:07:29 [DEBUG   ] spawn_process: at 2018-11-16 00:07:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-16 00:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-16 00:07:29 [DEBUG   ] spawn_process: at 2018-11-16 00:07:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-16 00:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-16 00:07:29 [DEBUG   ] spawn_process: at 2018-11-16 00:07:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-16 00:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-16 00:07:29 [DEBUG   ] spawn_process: at 2018-11-16 00:07:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-16 00:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-16 00:07:29 [DEBUG   ] spawn_process: at 2018-11-16 00:07:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-16 00:07:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-16 00:07:29 [DEBUG   ] spawn_process: at 2018-11-16 00:07:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-16 00:07:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 00:07:59 [DEBUG   ] Got command BAM from MCS: ref #520599
2018-11-16 00:07:59 [INFO    ] Finished processing BAM request
2018-11-16 00:07:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:07:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520599   8 58438   479029 A  ERROR'
2018-11-16 00:07:59 [DEBUG   ] Got command BAM from MCS: ref #520598
2018-11-16 00:07:59 [INFO    ] Finished processing BAM request
2018-11-16 00:07:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:07:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520598   8 58438   479033 A  ERROR'
2018-11-16 00:07:59 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-16 00:07:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-16 00:07:59 [DEBUG   ] spawn_process: at 2018-11-16 00:07:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-16 00:07:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-16 00:07:59 [DEBUG   ] spawn_process: at 2018-11-16 00:07:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-16 00:07:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-16 00:07:59 [DEBUG   ] spawn_process: at 2018-11-16 00:07:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-16 00:07:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-16 00:07:59 [DEBUG   ] spawn_process: at 2018-11-16 00:07:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-16 00:07:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-16 00:07:59 [DEBUG   ] spawn_process: at 2018-11-16 00:07:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-16 00:07:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-16 00:07:59 [DEBUG   ] spawn_process: at 2018-11-16 00:07:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-16 00:07:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-16 00:07:59 [DEBUG   ] spawn_process: at 2018-11-16 00:07:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-16 00:07:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-16 00:07:59 [DEBUG   ] spawn_process: at 2018-11-16 00:07:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-16 00:07:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-16 00:07:59 [DEBUG   ] spawn_process: at 2018-11-16 00:07:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-16 00:07:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-16 00:07:59 [DEBUG   ] spawn_process: at 2018-11-16 00:07:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-16 00:07:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-16 00:07:59 [DEBUG   ] spawn_process: at 2018-11-16 00:07:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-16 00:07:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-16 00:07:59 [DEBUG   ] spawn_process: at 2018-11-16 00:07:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-16 00:07:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-16 00:07:59 [DEBUG   ] spawn_process: at 2018-11-16 00:07:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-16 00:07:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-16 00:07:59 [DEBUG   ] spawn_process: at 2018-11-16 00:07:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-16 00:07:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-16 00:07:59 [DEBUG   ] spawn_process: at 2018-11-16 00:07:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-16 00:07:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-16 00:07:59 [DEBUG   ] spawn_process: at 2018-11-16 00:07:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-16 00:07:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-16 00:07:59 [DEBUG   ] spawn_process: at 2018-11-16 00:07:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-16 00:07:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-16 00:07:59 [DEBUG   ] spawn_process: at 2018-11-16 00:07:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-16 00:07:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-16 00:07:59 [DEBUG   ] spawn_process: at 2018-11-16 00:07:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-16 00:07:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-16 00:07:59 [DEBUG   ] spawn_process: at 2018-11-16 00:07:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-16 00:07:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-16 00:07:59 [DEBUG   ] spawn_process: at 2018-11-16 00:07:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-16 00:07:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-16 00:07:59 [DEBUG   ] spawn_process: at 2018-11-16 00:07:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-16 00:07:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-16 00:07:59 [DEBUG   ] spawn_process: at 2018-11-16 00:07:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-16 00:07:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-16 00:07:59 [DEBUG   ] spawn_process: at 2018-11-16 00:07:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-16 00:07:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-16 00:07:59 [DEBUG   ] spawn_process: at 2018-11-16 00:07:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-16 00:07:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-16 00:07:59 [DEBUG   ] spawn_process: at 2018-11-16 00:07:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-16 00:08:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 00:08:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:08:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-16 00:08:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-11-16 00:08:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-16 00:08:02 [WARNING ] (13, 1, 'bot')
2018-11-16 00:08:02 [WARNING ] (13, 1, 'bot')
2018-11-16 00:08:02 [WARNING ] (13, 1, 'bot')
2018-11-16 00:08:02 [WARNING ] (13, 1, 'bot')
2018-11-16 00:08:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:08:02 [DEBUG   ] Finished updating board flags in 1.197 seconds
2018-11-16 00:08:19 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 00:08:27 [DEBUG   ] Got command RPT from MCS: ref #520602
2018-11-16 00:08:27 [DEBUG   ] summary = ERROR
2018-11-16 00:08:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520602  13 58438   507397 A  ERRORERROR'
2018-11-16 00:08:27 [DEBUG   ] Got command RPT from MCS: ref #520603
2018-11-16 00:08:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 00:08:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520603  77 58438   507601 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 00:08:27 [DEBUG   ] Got command RPT from MCS: ref #520604
2018-11-16 00:08:27 [DEBUG   ] summary = ERROR
2018-11-16 00:08:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520604  13 58438   507805 A  ERRORERROR'
2018-11-16 00:08:27 [DEBUG   ] Got command RPT from MCS: ref #520606
2018-11-16 00:08:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 00:08:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520606  77 58438   507997 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 00:08:28 [DEBUG   ] Got command RPT from MCS: ref #520609
2018-11-16 00:08:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 00:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520609  12 58438   508201 A  ERRORB£ff'
2018-11-16 00:08:29 [DEBUG   ] Got command BAM from MCS: ref #520607
2018-11-16 00:08:29 [INFO    ] Finished processing BAM request
2018-11-16 00:08:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:08:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520607   8 58438   509033 A  ERROR'
2018-11-16 00:08:29 [DEBUG   ] Got command BAM from MCS: ref #520608
2018-11-16 00:08:29 [INFO    ] Finished processing BAM request
2018-11-16 00:08:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:08:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520608   8 58438   509037 A  ERROR'
2018-11-16 00:08:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-16 00:08:29 [DEBUG   ] spawn_process: at 2018-11-16 00:08:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-16 00:08:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-16 00:08:29 [DEBUG   ] spawn_process: at 2018-11-16 00:08:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-16 00:08:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-16 00:08:29 [DEBUG   ] spawn_process: at 2018-11-16 00:08:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-16 00:08:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-16 00:08:29 [DEBUG   ] spawn_process: at 2018-11-16 00:08:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-16 00:08:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-16 00:08:29 [DEBUG   ] spawn_process: at 2018-11-16 00:08:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-16 00:08:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-16 00:08:29 [DEBUG   ] spawn_process: at 2018-11-16 00:08:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-16 00:08:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-16 00:08:29 [DEBUG   ] spawn_process: at 2018-11-16 00:08:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-16 00:08:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-16 00:08:29 [DEBUG   ] spawn_process: at 2018-11-16 00:08:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-16 00:08:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-16 00:08:29 [DEBUG   ] spawn_process: at 2018-11-16 00:08:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-16 00:08:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-16 00:08:29 [DEBUG   ] spawn_process: at 2018-11-16 00:08:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-16 00:08:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-16 00:08:29 [DEBUG   ] spawn_process: at 2018-11-16 00:08:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-16 00:08:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-16 00:08:29 [DEBUG   ] spawn_process: at 2018-11-16 00:08:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-16 00:08:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-16 00:08:29 [DEBUG   ] spawn_process: at 2018-11-16 00:08:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-16 00:08:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-16 00:08:29 [DEBUG   ] spawn_process: at 2018-11-16 00:08:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-16 00:08:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-16 00:08:29 [DEBUG   ] spawn_process: at 2018-11-16 00:08:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-16 00:08:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-16 00:08:29 [DEBUG   ] spawn_process: at 2018-11-16 00:08:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-16 00:08:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-16 00:08:29 [DEBUG   ] spawn_process: at 2018-11-16 00:08:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-16 00:08:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-16 00:08:29 [DEBUG   ] spawn_process: at 2018-11-16 00:08:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-16 00:08:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-16 00:08:29 [DEBUG   ] spawn_process: at 2018-11-16 00:08:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-16 00:08:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-16 00:08:29 [DEBUG   ] spawn_process: at 2018-11-16 00:08:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-16 00:08:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-16 00:08:29 [DEBUG   ] spawn_process: at 2018-11-16 00:08:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-16 00:08:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-16 00:08:29 [DEBUG   ] spawn_process: at 2018-11-16 00:08:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-16 00:08:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-16 00:08:29 [DEBUG   ] spawn_process: at 2018-11-16 00:08:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-16 00:08:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-16 00:08:29 [DEBUG   ] spawn_process: at 2018-11-16 00:08:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-16 00:08:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-16 00:08:29 [DEBUG   ] spawn_process: at 2018-11-16 00:08:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-16 00:08:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-16 00:08:29 [DEBUG   ] spawn_process: at 2018-11-16 00:08:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-16 00:08:39 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-16 00:08:59 [DEBUG   ] Got command BAM from MCS: ref #520618
2018-11-16 00:08:59 [INFO    ] Finished processing BAM request
2018-11-16 00:08:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:08:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520618   8 58438   539029 A  ERROR'
2018-11-16 00:08:59 [DEBUG   ] Got command BAM from MCS: ref #520619
2018-11-16 00:08:59 [INFO    ] Finished processing BAM request
2018-11-16 00:08:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:08:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520619   8 58438   539033 A  ERROR'
2018-11-16 00:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-16 00:08:59 [DEBUG   ] spawn_process: at 2018-11-16 00:08:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-16 00:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-16 00:08:59 [DEBUG   ] spawn_process: at 2018-11-16 00:08:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-16 00:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-16 00:08:59 [DEBUG   ] spawn_process: at 2018-11-16 00:08:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-16 00:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-16 00:08:59 [DEBUG   ] spawn_process: at 2018-11-16 00:08:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-16 00:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-16 00:08:59 [DEBUG   ] spawn_process: at 2018-11-16 00:08:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-16 00:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-16 00:08:59 [DEBUG   ] spawn_process: at 2018-11-16 00:08:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-16 00:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-16 00:08:59 [DEBUG   ] spawn_process: at 2018-11-16 00:08:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-16 00:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-16 00:08:59 [DEBUG   ] spawn_process: at 2018-11-16 00:08:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-16 00:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-16 00:08:59 [DEBUG   ] spawn_process: at 2018-11-16 00:08:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-16 00:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-16 00:08:59 [DEBUG   ] spawn_process: at 2018-11-16 00:08:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-16 00:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-16 00:08:59 [DEBUG   ] spawn_process: at 2018-11-16 00:08:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-16 00:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-16 00:08:59 [DEBUG   ] spawn_process: at 2018-11-16 00:08:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-16 00:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-16 00:08:59 [DEBUG   ] spawn_process: at 2018-11-16 00:08:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-16 00:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-16 00:08:59 [DEBUG   ] spawn_process: at 2018-11-16 00:08:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-16 00:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-16 00:08:59 [DEBUG   ] spawn_process: at 2018-11-16 00:08:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-16 00:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-16 00:08:59 [DEBUG   ] spawn_process: at 2018-11-16 00:08:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-16 00:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-16 00:08:59 [DEBUG   ] spawn_process: at 2018-11-16 00:08:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-16 00:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-16 00:08:59 [DEBUG   ] spawn_process: at 2018-11-16 00:08:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-16 00:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-16 00:08:59 [DEBUG   ] spawn_process: at 2018-11-16 00:08:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-16 00:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-16 00:08:59 [DEBUG   ] spawn_process: at 2018-11-16 00:08:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-16 00:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-16 00:08:59 [DEBUG   ] spawn_process: at 2018-11-16 00:08:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-16 00:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-16 00:08:59 [DEBUG   ] spawn_process: at 2018-11-16 00:08:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-16 00:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-16 00:08:59 [DEBUG   ] spawn_process: at 2018-11-16 00:08:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-16 00:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-16 00:08:59 [DEBUG   ] spawn_process: at 2018-11-16 00:08:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-16 00:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-16 00:08:59 [DEBUG   ] spawn_process: at 2018-11-16 00:08:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-16 00:08:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-16 00:08:59 [DEBUG   ] spawn_process: at 2018-11-16 00:08:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-16 00:09:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 00:09:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 00:09:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-16 00:09:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:09:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-16 00:09:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-16 00:09:02 [WARNING ] (13, 1, 'bot')
2018-11-16 00:09:02 [WARNING ] (13, 1, 'bot')
2018-11-16 00:09:02 [WARNING ] (13, 1, 'bot')
2018-11-16 00:09:02 [WARNING ] (13, 1, 'bot')
2018-11-16 00:09:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:09:02 [DEBUG   ] Finished updating board flags in 1.011 seconds
2018-11-16 00:09:20 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-16 00:09:29 [DEBUG   ] Got command BAM from MCS: ref #520621
2018-11-16 00:09:29 [INFO    ] Finished processing BAM request
2018-11-16 00:09:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:09:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520621   8 58438   569029 A  ERROR'
2018-11-16 00:09:29 [DEBUG   ] Got command BAM from MCS: ref #520620
2018-11-16 00:09:29 [INFO    ] Finished processing BAM request
2018-11-16 00:09:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:09:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520620   8 58438   569033 A  ERROR'
2018-11-16 00:09:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-16 00:09:29 [DEBUG   ] spawn_process: at 2018-11-16 00:09:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-16 00:09:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-16 00:09:29 [DEBUG   ] spawn_process: at 2018-11-16 00:09:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-16 00:09:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-16 00:09:29 [DEBUG   ] spawn_process: at 2018-11-16 00:09:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-16 00:09:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-16 00:09:29 [DEBUG   ] spawn_process: at 2018-11-16 00:09:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-16 00:09:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-16 00:09:29 [DEBUG   ] spawn_process: at 2018-11-16 00:09:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-16 00:09:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-16 00:09:29 [DEBUG   ] spawn_process: at 2018-11-16 00:09:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-16 00:09:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-16 00:09:29 [DEBUG   ] spawn_process: at 2018-11-16 00:09:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-16 00:09:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-16 00:09:29 [DEBUG   ] spawn_process: at 2018-11-16 00:09:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-16 00:09:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-16 00:09:29 [DEBUG   ] spawn_process: at 2018-11-16 00:09:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-16 00:09:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-16 00:09:29 [DEBUG   ] spawn_process: at 2018-11-16 00:09:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-16 00:09:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-16 00:09:29 [DEBUG   ] spawn_process: at 2018-11-16 00:09:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-16 00:09:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-16 00:09:29 [DEBUG   ] spawn_process: at 2018-11-16 00:09:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-16 00:09:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-16 00:09:29 [DEBUG   ] spawn_process: at 2018-11-16 00:09:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-16 00:09:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-16 00:09:29 [DEBUG   ] spawn_process: at 2018-11-16 00:09:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-16 00:09:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-16 00:09:29 [DEBUG   ] spawn_process: at 2018-11-16 00:09:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-16 00:09:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-16 00:09:29 [DEBUG   ] spawn_process: at 2018-11-16 00:09:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-16 00:09:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-16 00:09:29 [DEBUG   ] spawn_process: at 2018-11-16 00:09:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-16 00:09:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-16 00:09:29 [DEBUG   ] spawn_process: at 2018-11-16 00:09:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-16 00:09:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-16 00:09:29 [DEBUG   ] spawn_process: at 2018-11-16 00:09:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-16 00:09:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-16 00:09:29 [DEBUG   ] spawn_process: at 2018-11-16 00:09:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-16 00:09:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-16 00:09:29 [DEBUG   ] spawn_process: at 2018-11-16 00:09:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-16 00:09:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-16 00:09:29 [DEBUG   ] spawn_process: at 2018-11-16 00:09:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-16 00:09:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-16 00:09:29 [DEBUG   ] spawn_process: at 2018-11-16 00:09:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-16 00:09:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-16 00:09:29 [DEBUG   ] spawn_process: at 2018-11-16 00:09:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-16 00:09:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-16 00:09:29 [DEBUG   ] spawn_process: at 2018-11-16 00:09:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-16 00:09:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-16 00:09:29 [DEBUG   ] spawn_process: at 2018-11-16 00:09:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-16 00:09:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 00:09:59 [DEBUG   ] Got command BAM from MCS: ref #520623
2018-11-16 00:09:59 [INFO    ] Finished processing BAM request
2018-11-16 00:09:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:09:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520623   8 58438   599029 A  ERROR'
2018-11-16 00:09:59 [DEBUG   ] Got command BAM from MCS: ref #520622
2018-11-16 00:09:59 [INFO    ] Finished processing BAM request
2018-11-16 00:09:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:09:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520622   8 58438   599033 A  ERROR'
2018-11-16 00:09:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-16 00:09:59 [DEBUG   ] spawn_process: at 2018-11-16 00:09:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-16 00:09:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-16 00:09:59 [DEBUG   ] spawn_process: at 2018-11-16 00:09:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-16 00:09:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-16 00:09:59 [DEBUG   ] spawn_process: at 2018-11-16 00:09:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-16 00:09:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-16 00:09:59 [DEBUG   ] spawn_process: at 2018-11-16 00:09:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-16 00:09:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-16 00:09:59 [DEBUG   ] spawn_process: at 2018-11-16 00:09:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-16 00:09:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-16 00:09:59 [DEBUG   ] spawn_process: at 2018-11-16 00:09:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-16 00:09:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-16 00:09:59 [DEBUG   ] spawn_process: at 2018-11-16 00:09:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-16 00:09:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-16 00:09:59 [DEBUG   ] spawn_process: at 2018-11-16 00:09:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-16 00:09:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-16 00:09:59 [DEBUG   ] spawn_process: at 2018-11-16 00:09:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-16 00:09:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-16 00:09:59 [DEBUG   ] spawn_process: at 2018-11-16 00:09:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-16 00:09:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-16 00:09:59 [DEBUG   ] spawn_process: at 2018-11-16 00:09:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-16 00:09:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-16 00:09:59 [DEBUG   ] spawn_process: at 2018-11-16 00:09:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-16 00:09:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-16 00:09:59 [DEBUG   ] spawn_process: at 2018-11-16 00:09:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-16 00:09:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-16 00:09:59 [DEBUG   ] spawn_process: at 2018-11-16 00:09:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-16 00:09:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-16 00:09:59 [DEBUG   ] spawn_process: at 2018-11-16 00:09:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-16 00:09:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-16 00:09:59 [DEBUG   ] spawn_process: at 2018-11-16 00:09:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-16 00:09:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-16 00:09:59 [DEBUG   ] spawn_process: at 2018-11-16 00:09:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-16 00:09:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-16 00:09:59 [DEBUG   ] spawn_process: at 2018-11-16 00:09:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-16 00:09:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-16 00:09:59 [DEBUG   ] spawn_process: at 2018-11-16 00:09:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-16 00:09:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-16 00:09:59 [DEBUG   ] spawn_process: at 2018-11-16 00:09:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-16 00:09:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-16 00:09:59 [DEBUG   ] spawn_process: at 2018-11-16 00:09:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-16 00:09:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-16 00:09:59 [DEBUG   ] spawn_process: at 2018-11-16 00:09:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-16 00:09:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-16 00:09:59 [DEBUG   ] spawn_process: at 2018-11-16 00:09:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-16 00:09:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-16 00:09:59 [DEBUG   ] spawn_process: at 2018-11-16 00:09:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-16 00:09:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-16 00:09:59 [DEBUG   ] spawn_process: at 2018-11-16 00:09:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-16 00:09:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-16 00:09:59 [DEBUG   ] spawn_process: at 2018-11-16 00:09:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-16 00:10:00 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 00:10:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 00:10:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-16 00:10:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:10:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-16 00:10:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-16 00:10:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 00:10:02 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-16 00:10:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-16 00:10:02 [WARNING ] (13, 1, 'bot')
2018-11-16 00:10:02 [WARNING ] (13, 1, 'bot')
2018-11-16 00:10:02 [WARNING ] (13, 1, 'bot')
2018-11-16 00:10:02 [WARNING ] (13, 1, 'bot')
2018-11-16 00:10:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:10:02 [DEBUG   ] Finished updating board flags in 1.010 seconds
2018-11-16 00:10:20 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-11-16 00:10:29 [DEBUG   ] Got command BAM from MCS: ref #520625
2018-11-16 00:10:29 [INFO    ] Finished processing BAM request
2018-11-16 00:10:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:10:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520625   8 58438   629033 A  ERROR'
2018-11-16 00:10:29 [DEBUG   ] Got command BAM from MCS: ref #520624
2018-11-16 00:10:29 [INFO    ] Finished processing BAM request
2018-11-16 00:10:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:10:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520624   8 58438   629037 A  ERROR'
2018-11-16 00:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-16 00:10:29 [DEBUG   ] spawn_process: at 2018-11-16 00:10:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-16 00:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-16 00:10:29 [DEBUG   ] spawn_process: at 2018-11-16 00:10:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-16 00:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-16 00:10:29 [DEBUG   ] spawn_process: at 2018-11-16 00:10:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-16 00:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-16 00:10:29 [DEBUG   ] spawn_process: at 2018-11-16 00:10:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-16 00:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-16 00:10:29 [DEBUG   ] spawn_process: at 2018-11-16 00:10:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-16 00:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-16 00:10:29 [DEBUG   ] spawn_process: at 2018-11-16 00:10:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-16 00:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-16 00:10:29 [DEBUG   ] spawn_process: at 2018-11-16 00:10:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-16 00:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-16 00:10:29 [DEBUG   ] spawn_process: at 2018-11-16 00:10:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-16 00:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-16 00:10:29 [DEBUG   ] spawn_process: at 2018-11-16 00:10:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-16 00:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-16 00:10:29 [DEBUG   ] spawn_process: at 2018-11-16 00:10:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-16 00:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-16 00:10:29 [DEBUG   ] spawn_process: at 2018-11-16 00:10:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-16 00:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-16 00:10:29 [DEBUG   ] spawn_process: at 2018-11-16 00:10:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-16 00:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-16 00:10:29 [DEBUG   ] spawn_process: at 2018-11-16 00:10:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-16 00:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-16 00:10:29 [DEBUG   ] spawn_process: at 2018-11-16 00:10:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-16 00:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-16 00:10:29 [DEBUG   ] spawn_process: at 2018-11-16 00:10:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-16 00:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-16 00:10:29 [DEBUG   ] spawn_process: at 2018-11-16 00:10:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-16 00:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-16 00:10:29 [DEBUG   ] spawn_process: at 2018-11-16 00:10:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-16 00:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-16 00:10:29 [DEBUG   ] spawn_process: at 2018-11-16 00:10:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-16 00:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-16 00:10:29 [DEBUG   ] spawn_process: at 2018-11-16 00:10:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-16 00:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-16 00:10:29 [DEBUG   ] spawn_process: at 2018-11-16 00:10:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-16 00:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-16 00:10:29 [DEBUG   ] spawn_process: at 2018-11-16 00:10:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-16 00:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-16 00:10:29 [DEBUG   ] spawn_process: at 2018-11-16 00:10:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-16 00:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-16 00:10:29 [DEBUG   ] spawn_process: at 2018-11-16 00:10:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-16 00:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-16 00:10:29 [DEBUG   ] spawn_process: at 2018-11-16 00:10:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-16 00:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-16 00:10:29 [DEBUG   ] spawn_process: at 2018-11-16 00:10:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-16 00:10:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-16 00:10:29 [DEBUG   ] spawn_process: at 2018-11-16 00:10:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-16 00:10:40 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-11-16 00:10:45 [DEBUG   ] Got command RPT from MCS: ref #520626
2018-11-16 00:10:45 [DEBUG   ] summary = ERROR
2018-11-16 00:10:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520626  13 58438   645249 A  ERRORERROR'
2018-11-16 00:10:45 [DEBUG   ] Got command RPT from MCS: ref #520627
2018-11-16 00:10:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 00:10:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520627  77 58438   645250 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 00:10:59 [DEBUG   ] Got command BAM from MCS: ref #520643
2018-11-16 00:10:59 [INFO    ] Finished processing BAM request
2018-11-16 00:10:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:10:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520643   8 58438   659029 A  ERROR'
2018-11-16 00:10:59 [DEBUG   ] Got command BAM from MCS: ref #520644
2018-11-16 00:10:59 [INFO    ] Finished processing BAM request
2018-11-16 00:10:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:10:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520644   8 58438   659033 A  ERROR'
2018-11-16 00:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-16 00:10:59 [DEBUG   ] spawn_process: at 2018-11-16 00:10:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-16 00:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-16 00:10:59 [DEBUG   ] spawn_process: at 2018-11-16 00:10:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-16 00:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-16 00:10:59 [DEBUG   ] spawn_process: at 2018-11-16 00:10:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-16 00:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-16 00:10:59 [DEBUG   ] spawn_process: at 2018-11-16 00:10:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-16 00:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-16 00:10:59 [DEBUG   ] spawn_process: at 2018-11-16 00:10:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-16 00:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-16 00:10:59 [DEBUG   ] spawn_process: at 2018-11-16 00:10:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-16 00:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-16 00:10:59 [DEBUG   ] spawn_process: at 2018-11-16 00:10:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-16 00:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-16 00:10:59 [DEBUG   ] spawn_process: at 2018-11-16 00:10:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-16 00:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-16 00:10:59 [DEBUG   ] spawn_process: at 2018-11-16 00:10:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-16 00:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-16 00:10:59 [DEBUG   ] spawn_process: at 2018-11-16 00:10:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-16 00:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-16 00:10:59 [DEBUG   ] spawn_process: at 2018-11-16 00:10:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-16 00:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-16 00:10:59 [DEBUG   ] spawn_process: at 2018-11-16 00:10:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-16 00:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-16 00:10:59 [DEBUG   ] spawn_process: at 2018-11-16 00:10:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-16 00:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-16 00:10:59 [DEBUG   ] spawn_process: at 2018-11-16 00:10:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-16 00:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-16 00:10:59 [DEBUG   ] spawn_process: at 2018-11-16 00:10:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-16 00:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-16 00:10:59 [DEBUG   ] spawn_process: at 2018-11-16 00:10:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-16 00:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-16 00:10:59 [DEBUG   ] spawn_process: at 2018-11-16 00:10:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-16 00:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-16 00:10:59 [DEBUG   ] spawn_process: at 2018-11-16 00:10:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-16 00:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-16 00:10:59 [DEBUG   ] spawn_process: at 2018-11-16 00:10:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-16 00:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-16 00:10:59 [DEBUG   ] spawn_process: at 2018-11-16 00:10:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-16 00:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-16 00:10:59 [DEBUG   ] spawn_process: at 2018-11-16 00:10:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-16 00:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-16 00:10:59 [DEBUG   ] spawn_process: at 2018-11-16 00:10:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-16 00:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-16 00:10:59 [DEBUG   ] spawn_process: at 2018-11-16 00:10:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-16 00:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-16 00:10:59 [DEBUG   ] spawn_process: at 2018-11-16 00:10:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-16 00:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-16 00:10:59 [DEBUG   ] spawn_process: at 2018-11-16 00:10:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-16 00:10:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-16 00:10:59 [DEBUG   ] spawn_process: at 2018-11-16 00:10:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-16 00:11:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 00:11:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-16 00:11:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:11:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-11-16 00:11:02 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-16 00:11:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-16 00:11:02 [WARNING ] (13, 1, 'bot')
2018-11-16 00:11:02 [WARNING ] (13, 1, 'bot')
2018-11-16 00:11:02 [WARNING ] (13, 1, 'bot')
2018-11-16 00:11:02 [WARNING ] (13, 1, 'bot')
2018-11-16 00:11:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:11:02 [DEBUG   ] Finished updating board flags in 0.984 seconds
2018-11-16 00:11:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 00:11:29 [DEBUG   ] Got command BAM from MCS: ref #520645
2018-11-16 00:11:29 [INFO    ] Finished processing BAM request
2018-11-16 00:11:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:11:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520645   8 58438   689033 A  ERROR'
2018-11-16 00:11:29 [DEBUG   ] Got command BAM from MCS: ref #520646
2018-11-16 00:11:29 [INFO    ] Finished processing BAM request
2018-11-16 00:11:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:11:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520646   8 58438   689037 A  ERROR'
2018-11-16 00:11:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-16 00:11:29 [DEBUG   ] spawn_process: at 2018-11-16 00:11:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-16 00:11:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-16 00:11:29 [DEBUG   ] spawn_process: at 2018-11-16 00:11:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-16 00:11:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-16 00:11:29 [DEBUG   ] spawn_process: at 2018-11-16 00:11:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-16 00:11:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-16 00:11:29 [DEBUG   ] spawn_process: at 2018-11-16 00:11:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-16 00:11:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-16 00:11:29 [DEBUG   ] spawn_process: at 2018-11-16 00:11:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-16 00:11:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-16 00:11:29 [DEBUG   ] spawn_process: at 2018-11-16 00:11:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-16 00:11:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-16 00:11:29 [DEBUG   ] spawn_process: at 2018-11-16 00:11:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-16 00:11:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-16 00:11:29 [DEBUG   ] spawn_process: at 2018-11-16 00:11:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-16 00:11:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-16 00:11:29 [DEBUG   ] spawn_process: at 2018-11-16 00:11:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-16 00:11:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-16 00:11:29 [DEBUG   ] spawn_process: at 2018-11-16 00:11:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-16 00:11:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-16 00:11:29 [DEBUG   ] spawn_process: at 2018-11-16 00:11:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-16 00:11:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-16 00:11:29 [DEBUG   ] spawn_process: at 2018-11-16 00:11:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-16 00:11:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-16 00:11:29 [DEBUG   ] spawn_process: at 2018-11-16 00:11:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-16 00:11:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-16 00:11:29 [DEBUG   ] spawn_process: at 2018-11-16 00:11:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-16 00:11:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-16 00:11:29 [DEBUG   ] spawn_process: at 2018-11-16 00:11:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-16 00:11:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-16 00:11:29 [DEBUG   ] spawn_process: at 2018-11-16 00:11:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-16 00:11:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-16 00:11:29 [DEBUG   ] spawn_process: at 2018-11-16 00:11:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-16 00:11:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-16 00:11:29 [DEBUG   ] spawn_process: at 2018-11-16 00:11:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-16 00:11:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-16 00:11:29 [DEBUG   ] spawn_process: at 2018-11-16 00:11:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-16 00:11:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-16 00:11:29 [DEBUG   ] spawn_process: at 2018-11-16 00:11:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-16 00:11:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-16 00:11:29 [DEBUG   ] spawn_process: at 2018-11-16 00:11:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-16 00:11:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-16 00:11:29 [DEBUG   ] spawn_process: at 2018-11-16 00:11:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-16 00:11:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-16 00:11:29 [DEBUG   ] spawn_process: at 2018-11-16 00:11:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-16 00:11:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-16 00:11:29 [DEBUG   ] spawn_process: at 2018-11-16 00:11:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-16 00:11:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-16 00:11:29 [DEBUG   ] spawn_process: at 2018-11-16 00:11:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-16 00:11:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-16 00:11:29 [DEBUG   ] spawn_process: at 2018-11-16 00:11:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-16 00:11:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 00:11:59 [DEBUG   ] Got command BAM from MCS: ref #520651
2018-11-16 00:11:59 [INFO    ] Finished processing BAM request
2018-11-16 00:11:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:11:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520651   8 58438   719033 A  ERROR'
2018-11-16 00:11:59 [DEBUG   ] Got command BAM from MCS: ref #520652
2018-11-16 00:11:59 [INFO    ] Finished processing BAM request
2018-11-16 00:11:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:11:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520652   8 58438   719037 A  ERROR'
2018-11-16 00:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-16 00:11:59 [DEBUG   ] spawn_process: at 2018-11-16 00:11:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-16 00:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-16 00:11:59 [DEBUG   ] spawn_process: at 2018-11-16 00:11:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-16 00:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-16 00:11:59 [DEBUG   ] spawn_process: at 2018-11-16 00:11:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-16 00:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-16 00:11:59 [DEBUG   ] spawn_process: at 2018-11-16 00:11:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-16 00:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-16 00:11:59 [DEBUG   ] spawn_process: at 2018-11-16 00:11:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-16 00:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-16 00:11:59 [DEBUG   ] spawn_process: at 2018-11-16 00:11:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-16 00:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-16 00:11:59 [DEBUG   ] spawn_process: at 2018-11-16 00:11:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-16 00:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-16 00:11:59 [DEBUG   ] spawn_process: at 2018-11-16 00:11:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-16 00:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-16 00:11:59 [DEBUG   ] spawn_process: at 2018-11-16 00:11:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-16 00:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-16 00:11:59 [DEBUG   ] spawn_process: at 2018-11-16 00:11:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-16 00:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-16 00:11:59 [DEBUG   ] spawn_process: at 2018-11-16 00:11:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-16 00:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-16 00:11:59 [DEBUG   ] spawn_process: at 2018-11-16 00:11:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-16 00:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-16 00:11:59 [DEBUG   ] spawn_process: at 2018-11-16 00:11:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-16 00:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-16 00:11:59 [DEBUG   ] spawn_process: at 2018-11-16 00:11:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-16 00:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-16 00:11:59 [DEBUG   ] spawn_process: at 2018-11-16 00:11:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-16 00:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-16 00:11:59 [DEBUG   ] spawn_process: at 2018-11-16 00:11:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-16 00:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-16 00:11:59 [DEBUG   ] spawn_process: at 2018-11-16 00:11:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-16 00:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-16 00:11:59 [DEBUG   ] spawn_process: at 2018-11-16 00:11:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-16 00:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-16 00:11:59 [DEBUG   ] spawn_process: at 2018-11-16 00:11:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-16 00:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-16 00:11:59 [DEBUG   ] spawn_process: at 2018-11-16 00:11:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-16 00:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-16 00:11:59 [DEBUG   ] spawn_process: at 2018-11-16 00:11:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-16 00:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-16 00:11:59 [DEBUG   ] spawn_process: at 2018-11-16 00:11:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-16 00:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-16 00:11:59 [DEBUG   ] spawn_process: at 2018-11-16 00:11:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-16 00:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-16 00:11:59 [DEBUG   ] spawn_process: at 2018-11-16 00:11:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-16 00:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-16 00:11:59 [DEBUG   ] spawn_process: at 2018-11-16 00:11:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-16 00:11:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-16 00:11:59 [DEBUG   ] spawn_process: at 2018-11-16 00:11:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-16 00:12:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 00:12:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 00:12:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-16 00:12:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:12:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-11-16 00:12:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-16 00:12:03 [WARNING ] (13, 1, 'bot')
2018-11-16 00:12:03 [WARNING ] (13, 1, 'bot')
2018-11-16 00:12:03 [WARNING ] (13, 1, 'bot')
2018-11-16 00:12:03 [WARNING ] (13, 1, 'bot')
2018-11-16 00:12:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:12:03 [DEBUG   ] Finished updating board flags in 1.806 seconds
2018-11-16 00:12:20 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-16 00:12:29 [DEBUG   ] Got command BAM from MCS: ref #520653
2018-11-16 00:12:29 [INFO    ] Finished processing BAM request
2018-11-16 00:12:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:12:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520653   8 58438   749033 A  ERROR'
2018-11-16 00:12:29 [DEBUG   ] Got command BAM from MCS: ref #520654
2018-11-16 00:12:29 [INFO    ] Finished processing BAM request
2018-11-16 00:12:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:12:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520654   8 58438   749037 A  ERROR'
2018-11-16 00:12:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-16 00:12:29 [DEBUG   ] spawn_process: at 2018-11-16 00:12:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-16 00:12:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-16 00:12:29 [DEBUG   ] spawn_process: at 2018-11-16 00:12:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-16 00:12:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-16 00:12:29 [DEBUG   ] spawn_process: at 2018-11-16 00:12:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-16 00:12:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-16 00:12:29 [DEBUG   ] spawn_process: at 2018-11-16 00:12:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-16 00:12:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-16 00:12:29 [DEBUG   ] spawn_process: at 2018-11-16 00:12:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-16 00:12:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-16 00:12:29 [DEBUG   ] spawn_process: at 2018-11-16 00:12:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-16 00:12:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-16 00:12:29 [DEBUG   ] spawn_process: at 2018-11-16 00:12:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-16 00:12:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-16 00:12:29 [DEBUG   ] spawn_process: at 2018-11-16 00:12:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-16 00:12:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-16 00:12:29 [DEBUG   ] spawn_process: at 2018-11-16 00:12:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-16 00:12:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-16 00:12:29 [DEBUG   ] spawn_process: at 2018-11-16 00:12:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-16 00:12:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-16 00:12:29 [DEBUG   ] spawn_process: at 2018-11-16 00:12:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-16 00:12:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-16 00:12:29 [DEBUG   ] spawn_process: at 2018-11-16 00:12:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-16 00:12:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-16 00:12:29 [DEBUG   ] spawn_process: at 2018-11-16 00:12:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-16 00:12:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-16 00:12:29 [DEBUG   ] spawn_process: at 2018-11-16 00:12:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-16 00:12:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-16 00:12:29 [DEBUG   ] spawn_process: at 2018-11-16 00:12:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-16 00:12:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-16 00:12:29 [DEBUG   ] spawn_process: at 2018-11-16 00:12:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-16 00:12:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-16 00:12:29 [DEBUG   ] spawn_process: at 2018-11-16 00:12:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-16 00:12:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-16 00:12:29 [DEBUG   ] spawn_process: at 2018-11-16 00:12:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-16 00:12:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-16 00:12:29 [DEBUG   ] spawn_process: at 2018-11-16 00:12:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-16 00:12:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-16 00:12:29 [DEBUG   ] spawn_process: at 2018-11-16 00:12:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-16 00:12:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-16 00:12:29 [DEBUG   ] spawn_process: at 2018-11-16 00:12:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-16 00:12:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-16 00:12:29 [DEBUG   ] spawn_process: at 2018-11-16 00:12:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-16 00:12:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-16 00:12:29 [DEBUG   ] spawn_process: at 2018-11-16 00:12:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-16 00:12:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-16 00:12:29 [DEBUG   ] spawn_process: at 2018-11-16 00:12:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-16 00:12:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-16 00:12:29 [DEBUG   ] spawn_process: at 2018-11-16 00:12:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-16 00:12:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-16 00:12:29 [DEBUG   ] spawn_process: at 2018-11-16 00:12:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-16 00:12:40 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-16 00:12:59 [DEBUG   ] Got command BAM from MCS: ref #520656
2018-11-16 00:12:59 [INFO    ] Finished processing BAM request
2018-11-16 00:12:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:12:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520656   8 58438   779029 A  ERROR'
2018-11-16 00:12:59 [DEBUG   ] Got command BAM from MCS: ref #520655
2018-11-16 00:12:59 [INFO    ] Finished processing BAM request
2018-11-16 00:12:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:12:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520655   8 58438   779033 A  ERROR'
2018-11-16 00:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-16 00:12:59 [DEBUG   ] spawn_process: at 2018-11-16 00:12:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-16 00:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-16 00:12:59 [DEBUG   ] spawn_process: at 2018-11-16 00:12:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-16 00:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-16 00:12:59 [DEBUG   ] spawn_process: at 2018-11-16 00:12:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-16 00:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-16 00:12:59 [DEBUG   ] spawn_process: at 2018-11-16 00:12:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-16 00:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-16 00:12:59 [DEBUG   ] spawn_process: at 2018-11-16 00:12:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-16 00:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-16 00:12:59 [DEBUG   ] spawn_process: at 2018-11-16 00:12:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-16 00:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-16 00:12:59 [DEBUG   ] spawn_process: at 2018-11-16 00:12:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-16 00:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-16 00:12:59 [DEBUG   ] spawn_process: at 2018-11-16 00:12:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-16 00:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-16 00:12:59 [DEBUG   ] spawn_process: at 2018-11-16 00:12:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-16 00:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-16 00:12:59 [DEBUG   ] spawn_process: at 2018-11-16 00:12:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-16 00:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-16 00:12:59 [DEBUG   ] spawn_process: at 2018-11-16 00:12:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-16 00:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-16 00:12:59 [DEBUG   ] spawn_process: at 2018-11-16 00:12:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-16 00:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-16 00:12:59 [DEBUG   ] spawn_process: at 2018-11-16 00:12:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-16 00:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-16 00:12:59 [DEBUG   ] spawn_process: at 2018-11-16 00:12:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-16 00:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-16 00:12:59 [DEBUG   ] spawn_process: at 2018-11-16 00:12:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-16 00:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-16 00:12:59 [DEBUG   ] spawn_process: at 2018-11-16 00:12:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-16 00:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-16 00:12:59 [DEBUG   ] spawn_process: at 2018-11-16 00:12:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-16 00:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-16 00:12:59 [DEBUG   ] spawn_process: at 2018-11-16 00:12:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-16 00:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-16 00:12:59 [DEBUG   ] spawn_process: at 2018-11-16 00:12:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-16 00:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-16 00:12:59 [DEBUG   ] spawn_process: at 2018-11-16 00:12:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-16 00:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-16 00:12:59 [DEBUG   ] spawn_process: at 2018-11-16 00:12:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-16 00:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-16 00:12:59 [DEBUG   ] spawn_process: at 2018-11-16 00:12:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-16 00:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-16 00:12:59 [DEBUG   ] spawn_process: at 2018-11-16 00:12:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-16 00:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-16 00:12:59 [DEBUG   ] spawn_process: at 2018-11-16 00:12:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-16 00:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-16 00:12:59 [DEBUG   ] spawn_process: at 2018-11-16 00:12:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-16 00:12:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-16 00:12:59 [DEBUG   ] spawn_process: at 2018-11-16 00:12:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-16 00:13:01 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 00:13:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:13:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 00:13:02 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-16 00:13:02 [WARNING ] (13, 1, 'bot')
2018-11-16 00:13:02 [WARNING ] (13, 1, 'bot')
2018-11-16 00:13:02 [WARNING ] (13, 1, 'bot')
2018-11-16 00:13:02 [WARNING ] (13, 1, 'bot')
2018-11-16 00:13:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:13:02 [DEBUG   ] Finished updating board flags in 1.242 seconds
2018-11-16 00:13:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 00:13:27 [DEBUG   ] Got command RPT from MCS: ref #520657
2018-11-16 00:13:27 [DEBUG   ] summary = ERROR
2018-11-16 00:13:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520657  13 58438   807485 A  ERRORERROR'
2018-11-16 00:13:27 [DEBUG   ] Got command RPT from MCS: ref #520658
2018-11-16 00:13:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 00:13:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520658  77 58438   807681 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 00:13:27 [DEBUG   ] Got command RPT from MCS: ref #520659
2018-11-16 00:13:27 [DEBUG   ] summary = ERROR
2018-11-16 00:13:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520659  13 58438   807885 A  ERRORERROR'
2018-11-16 00:13:28 [DEBUG   ] Got command RPT from MCS: ref #520662
2018-11-16 00:13:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 00:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520662  77 58438   808089 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 00:13:28 [DEBUG   ] Got command RPT from MCS: ref #520663
2018-11-16 00:13:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 00:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520663  12 58438   808281 A  ERRORB£ff'
2018-11-16 00:13:29 [DEBUG   ] Got command BAM from MCS: ref #520661
2018-11-16 00:13:29 [INFO    ] Finished processing BAM request
2018-11-16 00:13:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:13:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520661   8 58438   809029 A  ERROR'
2018-11-16 00:13:29 [DEBUG   ] Got command BAM from MCS: ref #520660
2018-11-16 00:13:29 [INFO    ] Finished processing BAM request
2018-11-16 00:13:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:13:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520660   8 58438   809033 A  ERROR'
2018-11-16 00:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-16 00:13:29 [DEBUG   ] spawn_process: at 2018-11-16 00:13:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-16 00:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-16 00:13:29 [DEBUG   ] spawn_process: at 2018-11-16 00:13:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-16 00:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-16 00:13:29 [DEBUG   ] spawn_process: at 2018-11-16 00:13:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-16 00:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-16 00:13:29 [DEBUG   ] spawn_process: at 2018-11-16 00:13:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-16 00:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-16 00:13:29 [DEBUG   ] spawn_process: at 2018-11-16 00:13:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-16 00:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-16 00:13:29 [DEBUG   ] spawn_process: at 2018-11-16 00:13:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-16 00:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-16 00:13:29 [DEBUG   ] spawn_process: at 2018-11-16 00:13:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-16 00:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-16 00:13:29 [DEBUG   ] spawn_process: at 2018-11-16 00:13:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-16 00:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-16 00:13:29 [DEBUG   ] spawn_process: at 2018-11-16 00:13:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-16 00:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-16 00:13:29 [DEBUG   ] spawn_process: at 2018-11-16 00:13:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-16 00:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-16 00:13:29 [DEBUG   ] spawn_process: at 2018-11-16 00:13:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-16 00:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-16 00:13:29 [DEBUG   ] spawn_process: at 2018-11-16 00:13:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-16 00:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-16 00:13:29 [DEBUG   ] spawn_process: at 2018-11-16 00:13:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-16 00:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-16 00:13:29 [DEBUG   ] spawn_process: at 2018-11-16 00:13:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-16 00:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-16 00:13:29 [DEBUG   ] spawn_process: at 2018-11-16 00:13:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-16 00:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-16 00:13:29 [DEBUG   ] spawn_process: at 2018-11-16 00:13:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-16 00:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-16 00:13:29 [DEBUG   ] spawn_process: at 2018-11-16 00:13:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-16 00:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-16 00:13:29 [DEBUG   ] spawn_process: at 2018-11-16 00:13:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-16 00:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-16 00:13:29 [DEBUG   ] spawn_process: at 2018-11-16 00:13:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-16 00:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-16 00:13:29 [DEBUG   ] spawn_process: at 2018-11-16 00:13:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-16 00:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-16 00:13:29 [DEBUG   ] spawn_process: at 2018-11-16 00:13:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-16 00:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-16 00:13:29 [DEBUG   ] spawn_process: at 2018-11-16 00:13:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-16 00:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-16 00:13:29 [DEBUG   ] spawn_process: at 2018-11-16 00:13:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-16 00:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-16 00:13:29 [DEBUG   ] spawn_process: at 2018-11-16 00:13:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-16 00:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-16 00:13:29 [DEBUG   ] spawn_process: at 2018-11-16 00:13:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-16 00:13:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-16 00:13:29 [DEBUG   ] spawn_process: at 2018-11-16 00:13:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-16 00:13:41 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 00:13:59 [DEBUG   ] Got command BAM from MCS: ref #520665
2018-11-16 00:13:59 [INFO    ] Finished processing BAM request
2018-11-16 00:13:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:13:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520665   8 58438   839029 A  ERROR'
2018-11-16 00:13:59 [DEBUG   ] Got command BAM from MCS: ref #520664
2018-11-16 00:13:59 [INFO    ] Finished processing BAM request
2018-11-16 00:13:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:13:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520664   8 58438   839033 A  ERROR'
2018-11-16 00:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-16 00:13:59 [DEBUG   ] spawn_process: at 2018-11-16 00:13:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-16 00:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-16 00:13:59 [DEBUG   ] spawn_process: at 2018-11-16 00:13:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-16 00:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-16 00:13:59 [DEBUG   ] spawn_process: at 2018-11-16 00:13:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-16 00:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-16 00:13:59 [DEBUG   ] spawn_process: at 2018-11-16 00:13:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-16 00:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-16 00:13:59 [DEBUG   ] spawn_process: at 2018-11-16 00:13:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-16 00:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-16 00:13:59 [DEBUG   ] spawn_process: at 2018-11-16 00:13:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-16 00:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-16 00:13:59 [DEBUG   ] spawn_process: at 2018-11-16 00:13:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-16 00:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-16 00:13:59 [DEBUG   ] spawn_process: at 2018-11-16 00:13:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-16 00:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-16 00:13:59 [DEBUG   ] spawn_process: at 2018-11-16 00:13:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-16 00:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-16 00:13:59 [DEBUG   ] spawn_process: at 2018-11-16 00:13:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-16 00:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-16 00:13:59 [DEBUG   ] spawn_process: at 2018-11-16 00:13:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-16 00:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-16 00:13:59 [DEBUG   ] spawn_process: at 2018-11-16 00:13:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-16 00:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-16 00:13:59 [DEBUG   ] spawn_process: at 2018-11-16 00:13:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-16 00:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-16 00:13:59 [DEBUG   ] spawn_process: at 2018-11-16 00:13:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-16 00:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-16 00:13:59 [DEBUG   ] spawn_process: at 2018-11-16 00:13:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-16 00:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-16 00:13:59 [DEBUG   ] spawn_process: at 2018-11-16 00:13:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-16 00:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-16 00:13:59 [DEBUG   ] spawn_process: at 2018-11-16 00:13:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-16 00:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-16 00:13:59 [DEBUG   ] spawn_process: at 2018-11-16 00:13:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-16 00:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-16 00:13:59 [DEBUG   ] spawn_process: at 2018-11-16 00:13:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-16 00:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-16 00:13:59 [DEBUG   ] spawn_process: at 2018-11-16 00:13:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-16 00:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-16 00:13:59 [DEBUG   ] spawn_process: at 2018-11-16 00:13:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-16 00:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-16 00:13:59 [DEBUG   ] spawn_process: at 2018-11-16 00:13:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-16 00:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-16 00:13:59 [DEBUG   ] spawn_process: at 2018-11-16 00:13:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-16 00:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-16 00:13:59 [DEBUG   ] spawn_process: at 2018-11-16 00:13:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-16 00:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-16 00:13:59 [DEBUG   ] spawn_process: at 2018-11-16 00:13:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-16 00:13:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-16 00:13:59 [DEBUG   ] spawn_process: at 2018-11-16 00:13:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-16 00:14:01 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 00:14:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-16 00:14:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:14:02 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-16 00:14:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-16 00:14:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-16 00:14:02 [WARNING ] (13, 1, 'bot')
2018-11-16 00:14:02 [WARNING ] (13, 1, 'bot')
2018-11-16 00:14:02 [WARNING ] (13, 1, 'bot')
2018-11-16 00:14:02 [WARNING ] (13, 1, 'bot')
2018-11-16 00:14:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:14:02 [DEBUG   ] Finished updating board flags in 1.269 seconds
2018-11-16 00:14:21 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-16 00:14:29 [DEBUG   ] Got command BAM from MCS: ref #520667
2018-11-16 00:14:29 [INFO    ] Finished processing BAM request
2018-11-16 00:14:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:14:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520667   8 58438   869025 A  ERROR'
2018-11-16 00:14:29 [DEBUG   ] Got command BAM from MCS: ref #520666
2018-11-16 00:14:29 [INFO    ] Finished processing BAM request
2018-11-16 00:14:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:14:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520666   8 58438   869029 A  ERROR'
2018-11-16 00:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-16 00:14:29 [DEBUG   ] spawn_process: at 2018-11-16 00:14:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-16 00:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-16 00:14:29 [DEBUG   ] spawn_process: at 2018-11-16 00:14:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-16 00:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-16 00:14:29 [DEBUG   ] spawn_process: at 2018-11-16 00:14:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-16 00:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-16 00:14:29 [DEBUG   ] spawn_process: at 2018-11-16 00:14:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-16 00:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-16 00:14:29 [DEBUG   ] spawn_process: at 2018-11-16 00:14:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-16 00:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-16 00:14:29 [DEBUG   ] spawn_process: at 2018-11-16 00:14:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-16 00:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-16 00:14:29 [DEBUG   ] spawn_process: at 2018-11-16 00:14:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-16 00:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-16 00:14:29 [DEBUG   ] spawn_process: at 2018-11-16 00:14:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-16 00:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-16 00:14:29 [DEBUG   ] spawn_process: at 2018-11-16 00:14:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-16 00:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-16 00:14:29 [DEBUG   ] spawn_process: at 2018-11-16 00:14:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-16 00:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-16 00:14:29 [DEBUG   ] spawn_process: at 2018-11-16 00:14:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-16 00:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-16 00:14:29 [DEBUG   ] spawn_process: at 2018-11-16 00:14:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-16 00:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-16 00:14:29 [DEBUG   ] spawn_process: at 2018-11-16 00:14:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-16 00:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-16 00:14:29 [DEBUG   ] spawn_process: at 2018-11-16 00:14:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-16 00:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-16 00:14:29 [DEBUG   ] spawn_process: at 2018-11-16 00:14:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-16 00:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-16 00:14:29 [DEBUG   ] spawn_process: at 2018-11-16 00:14:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-16 00:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-16 00:14:29 [DEBUG   ] spawn_process: at 2018-11-16 00:14:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-16 00:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-16 00:14:29 [DEBUG   ] spawn_process: at 2018-11-16 00:14:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-16 00:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-16 00:14:29 [DEBUG   ] spawn_process: at 2018-11-16 00:14:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-16 00:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-16 00:14:29 [DEBUG   ] spawn_process: at 2018-11-16 00:14:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-16 00:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-16 00:14:29 [DEBUG   ] spawn_process: at 2018-11-16 00:14:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-16 00:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-16 00:14:29 [DEBUG   ] spawn_process: at 2018-11-16 00:14:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-16 00:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-16 00:14:29 [DEBUG   ] spawn_process: at 2018-11-16 00:14:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-16 00:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-16 00:14:29 [DEBUG   ] spawn_process: at 2018-11-16 00:14:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-16 00:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-16 00:14:29 [DEBUG   ] spawn_process: at 2018-11-16 00:14:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-16 00:14:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-16 00:14:29 [DEBUG   ] spawn_process: at 2018-11-16 00:14:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-16 00:14:41 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-16 00:14:59 [DEBUG   ] Got command BAM from MCS: ref #520672
2018-11-16 00:14:59 [INFO    ] Finished processing BAM request
2018-11-16 00:14:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:14:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520672   8 58438   899029 A  ERROR'
2018-11-16 00:14:59 [DEBUG   ] Got command BAM from MCS: ref #520673
2018-11-16 00:14:59 [INFO    ] Finished processing BAM request
2018-11-16 00:14:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:14:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520673   8 58438   899033 A  ERROR'
2018-11-16 00:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-16 00:14:59 [DEBUG   ] spawn_process: at 2018-11-16 00:14:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-16 00:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-16 00:14:59 [DEBUG   ] spawn_process: at 2018-11-16 00:14:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-16 00:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-16 00:14:59 [DEBUG   ] spawn_process: at 2018-11-16 00:14:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-16 00:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-16 00:14:59 [DEBUG   ] spawn_process: at 2018-11-16 00:14:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-16 00:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-16 00:14:59 [DEBUG   ] spawn_process: at 2018-11-16 00:14:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-16 00:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-16 00:14:59 [DEBUG   ] spawn_process: at 2018-11-16 00:14:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-16 00:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-16 00:14:59 [DEBUG   ] spawn_process: at 2018-11-16 00:14:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-16 00:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-16 00:14:59 [DEBUG   ] spawn_process: at 2018-11-16 00:14:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-16 00:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-16 00:14:59 [DEBUG   ] spawn_process: at 2018-11-16 00:14:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-16 00:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-16 00:14:59 [DEBUG   ] spawn_process: at 2018-11-16 00:14:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-16 00:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-16 00:14:59 [DEBUG   ] spawn_process: at 2018-11-16 00:14:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-16 00:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-16 00:14:59 [DEBUG   ] spawn_process: at 2018-11-16 00:14:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-16 00:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-16 00:14:59 [DEBUG   ] spawn_process: at 2018-11-16 00:14:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-16 00:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-16 00:14:59 [DEBUG   ] spawn_process: at 2018-11-16 00:14:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-16 00:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-16 00:14:59 [DEBUG   ] spawn_process: at 2018-11-16 00:14:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-16 00:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-16 00:14:59 [DEBUG   ] spawn_process: at 2018-11-16 00:14:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-16 00:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-16 00:14:59 [DEBUG   ] spawn_process: at 2018-11-16 00:14:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-16 00:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-16 00:14:59 [DEBUG   ] spawn_process: at 2018-11-16 00:14:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-16 00:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-16 00:14:59 [DEBUG   ] spawn_process: at 2018-11-16 00:14:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-16 00:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-16 00:14:59 [DEBUG   ] spawn_process: at 2018-11-16 00:14:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-16 00:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-16 00:14:59 [DEBUG   ] spawn_process: at 2018-11-16 00:14:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-16 00:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-16 00:14:59 [DEBUG   ] spawn_process: at 2018-11-16 00:14:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-16 00:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-16 00:14:59 [DEBUG   ] spawn_process: at 2018-11-16 00:14:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-16 00:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-16 00:14:59 [DEBUG   ] spawn_process: at 2018-11-16 00:14:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-16 00:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-16 00:14:59 [DEBUG   ] spawn_process: at 2018-11-16 00:14:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-16 00:14:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-16 00:14:59 [DEBUG   ] spawn_process: at 2018-11-16 00:14:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-16 00:15:01 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 00:15:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 00:15:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-16 00:15:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:15:02 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-16 00:15:02 [WARNING ] (13, 1, 'bot')
2018-11-16 00:15:02 [WARNING ] (13, 1, 'bot')
2018-11-16 00:15:02 [WARNING ] (13, 1, 'bot')
2018-11-16 00:15:02 [WARNING ] (13, 1, 'bot')
2018-11-16 00:15:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:15:02 [DEBUG   ] Finished updating board flags in 1.211 seconds
2018-11-16 00:15:21 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 00:15:29 [DEBUG   ] Got command BAM from MCS: ref #520674
2018-11-16 00:15:29 [INFO    ] Finished processing BAM request
2018-11-16 00:15:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:15:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520674   8 58438   929029 A  ERROR'
2018-11-16 00:15:29 [DEBUG   ] Got command BAM from MCS: ref #520675
2018-11-16 00:15:29 [INFO    ] Finished processing BAM request
2018-11-16 00:15:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:15:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520675   8 58438   929033 A  ERROR'
2018-11-16 00:15:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-16 00:15:29 [DEBUG   ] spawn_process: at 2018-11-16 00:15:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-16 00:15:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-16 00:15:29 [DEBUG   ] spawn_process: at 2018-11-16 00:15:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-16 00:15:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-16 00:15:29 [DEBUG   ] spawn_process: at 2018-11-16 00:15:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-16 00:15:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-16 00:15:29 [DEBUG   ] spawn_process: at 2018-11-16 00:15:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-16 00:15:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-16 00:15:29 [DEBUG   ] spawn_process: at 2018-11-16 00:15:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-16 00:15:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-16 00:15:29 [DEBUG   ] spawn_process: at 2018-11-16 00:15:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-16 00:15:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-16 00:15:29 [DEBUG   ] spawn_process: at 2018-11-16 00:15:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-16 00:15:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-16 00:15:29 [DEBUG   ] spawn_process: at 2018-11-16 00:15:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-16 00:15:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-16 00:15:29 [DEBUG   ] spawn_process: at 2018-11-16 00:15:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-16 00:15:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-16 00:15:29 [DEBUG   ] spawn_process: at 2018-11-16 00:15:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-16 00:15:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-16 00:15:29 [DEBUG   ] spawn_process: at 2018-11-16 00:15:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-16 00:15:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-16 00:15:29 [DEBUG   ] spawn_process: at 2018-11-16 00:15:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-16 00:15:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-16 00:15:29 [DEBUG   ] spawn_process: at 2018-11-16 00:15:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-16 00:15:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-16 00:15:29 [DEBUG   ] spawn_process: at 2018-11-16 00:15:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-16 00:15:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-16 00:15:29 [DEBUG   ] spawn_process: at 2018-11-16 00:15:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-16 00:15:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-16 00:15:29 [DEBUG   ] spawn_process: at 2018-11-16 00:15:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-16 00:15:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-16 00:15:29 [DEBUG   ] spawn_process: at 2018-11-16 00:15:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-16 00:15:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-16 00:15:29 [DEBUG   ] spawn_process: at 2018-11-16 00:15:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-16 00:15:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-16 00:15:29 [DEBUG   ] spawn_process: at 2018-11-16 00:15:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-16 00:15:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-16 00:15:29 [DEBUG   ] spawn_process: at 2018-11-16 00:15:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-16 00:15:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-16 00:15:29 [DEBUG   ] spawn_process: at 2018-11-16 00:15:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-16 00:15:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-16 00:15:29 [DEBUG   ] spawn_process: at 2018-11-16 00:15:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-16 00:15:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-16 00:15:29 [DEBUG   ] spawn_process: at 2018-11-16 00:15:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-16 00:15:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-16 00:15:29 [DEBUG   ] spawn_process: at 2018-11-16 00:15:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-16 00:15:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-16 00:15:29 [DEBUG   ] spawn_process: at 2018-11-16 00:15:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-16 00:15:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-16 00:15:29 [DEBUG   ] spawn_process: at 2018-11-16 00:15:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-16 00:15:41 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-16 00:15:45 [DEBUG   ] Got command RPT from MCS: ref #520676
2018-11-16 00:15:45 [DEBUG   ] summary = ERROR
2018-11-16 00:15:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520676  13 58438   945249 A  ERRORERROR'
2018-11-16 00:15:45 [DEBUG   ] Got command RPT from MCS: ref #520677
2018-11-16 00:15:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 00:15:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520677  77 58438   945250 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 00:15:59 [DEBUG   ] Got command BAM from MCS: ref #520694
2018-11-16 00:15:59 [INFO    ] Finished processing BAM request
2018-11-16 00:15:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:15:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520694   8 58438   959029 A  ERROR'
2018-11-16 00:15:59 [DEBUG   ] Got command BAM from MCS: ref #520693
2018-11-16 00:15:59 [INFO    ] Finished processing BAM request
2018-11-16 00:15:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:15:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520693   8 58438   959033 A  ERROR'
2018-11-16 00:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-16 00:15:59 [DEBUG   ] spawn_process: at 2018-11-16 00:15:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-16 00:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-16 00:15:59 [DEBUG   ] spawn_process: at 2018-11-16 00:15:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-16 00:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-16 00:15:59 [DEBUG   ] spawn_process: at 2018-11-16 00:15:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-16 00:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-16 00:15:59 [DEBUG   ] spawn_process: at 2018-11-16 00:15:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-16 00:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-16 00:15:59 [DEBUG   ] spawn_process: at 2018-11-16 00:15:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-16 00:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-16 00:15:59 [DEBUG   ] spawn_process: at 2018-11-16 00:15:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-16 00:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-16 00:15:59 [DEBUG   ] spawn_process: at 2018-11-16 00:15:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-16 00:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-16 00:15:59 [DEBUG   ] spawn_process: at 2018-11-16 00:15:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-16 00:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-16 00:15:59 [DEBUG   ] spawn_process: at 2018-11-16 00:15:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-16 00:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-16 00:15:59 [DEBUG   ] spawn_process: at 2018-11-16 00:15:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-16 00:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-16 00:15:59 [DEBUG   ] spawn_process: at 2018-11-16 00:15:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-16 00:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-16 00:15:59 [DEBUG   ] spawn_process: at 2018-11-16 00:15:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-16 00:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-16 00:15:59 [DEBUG   ] spawn_process: at 2018-11-16 00:15:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-16 00:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-16 00:15:59 [DEBUG   ] spawn_process: at 2018-11-16 00:15:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-16 00:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-16 00:15:59 [DEBUG   ] spawn_process: at 2018-11-16 00:15:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-16 00:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-16 00:15:59 [DEBUG   ] spawn_process: at 2018-11-16 00:15:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-16 00:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-16 00:15:59 [DEBUG   ] spawn_process: at 2018-11-16 00:15:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-16 00:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-16 00:15:59 [DEBUG   ] spawn_process: at 2018-11-16 00:15:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-16 00:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-16 00:15:59 [DEBUG   ] spawn_process: at 2018-11-16 00:15:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-16 00:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-16 00:15:59 [DEBUG   ] spawn_process: at 2018-11-16 00:15:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-16 00:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-16 00:15:59 [DEBUG   ] spawn_process: at 2018-11-16 00:15:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-16 00:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-16 00:15:59 [DEBUG   ] spawn_process: at 2018-11-16 00:15:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-16 00:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-16 00:15:59 [DEBUG   ] spawn_process: at 2018-11-16 00:15:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-16 00:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-16 00:15:59 [DEBUG   ] spawn_process: at 2018-11-16 00:15:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-16 00:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-16 00:15:59 [DEBUG   ] spawn_process: at 2018-11-16 00:15:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-16 00:15:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-16 00:15:59 [DEBUG   ] spawn_process: at 2018-11-16 00:15:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-16 00:16:01 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 00:16:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-16 00:16:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-11-16 00:16:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:16:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 00:16:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-11-16 00:16:02 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-16 00:16:02 [WARNING ] (13, 1, 'bot')
2018-11-16 00:16:02 [WARNING ] (13, 1, 'bot')
2018-11-16 00:16:02 [WARNING ] (13, 1, 'bot')
2018-11-16 00:16:02 [WARNING ] (13, 1, 'bot')
2018-11-16 00:16:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:16:02 [DEBUG   ] Finished updating board flags in 1.143 seconds
2018-11-16 00:16:21 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-16 00:16:29 [DEBUG   ] Got command BAM from MCS: ref #520695
2018-11-16 00:16:29 [INFO    ] Finished processing BAM request
2018-11-16 00:16:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:16:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520695   8 58438   989033 A  ERROR'
2018-11-16 00:16:29 [DEBUG   ] Got command BAM from MCS: ref #520696
2018-11-16 00:16:29 [INFO    ] Finished processing BAM request
2018-11-16 00:16:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:16:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520696   8 58438   989037 A  ERROR'
2018-11-16 00:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-16 00:16:29 [DEBUG   ] spawn_process: at 2018-11-16 00:16:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-16 00:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-16 00:16:29 [DEBUG   ] spawn_process: at 2018-11-16 00:16:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-16 00:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-16 00:16:29 [DEBUG   ] spawn_process: at 2018-11-16 00:16:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-16 00:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-16 00:16:29 [DEBUG   ] spawn_process: at 2018-11-16 00:16:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-16 00:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-16 00:16:29 [DEBUG   ] spawn_process: at 2018-11-16 00:16:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-16 00:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-16 00:16:29 [DEBUG   ] spawn_process: at 2018-11-16 00:16:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-16 00:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-16 00:16:29 [DEBUG   ] spawn_process: at 2018-11-16 00:16:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-16 00:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-16 00:16:29 [DEBUG   ] spawn_process: at 2018-11-16 00:16:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-16 00:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-16 00:16:29 [DEBUG   ] spawn_process: at 2018-11-16 00:16:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-16 00:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-16 00:16:29 [DEBUG   ] spawn_process: at 2018-11-16 00:16:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-16 00:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-16 00:16:29 [DEBUG   ] spawn_process: at 2018-11-16 00:16:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-16 00:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-16 00:16:29 [DEBUG   ] spawn_process: at 2018-11-16 00:16:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-16 00:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-16 00:16:29 [DEBUG   ] spawn_process: at 2018-11-16 00:16:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-16 00:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-16 00:16:29 [DEBUG   ] spawn_process: at 2018-11-16 00:16:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-16 00:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-16 00:16:29 [DEBUG   ] spawn_process: at 2018-11-16 00:16:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-16 00:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-16 00:16:29 [DEBUG   ] spawn_process: at 2018-11-16 00:16:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-16 00:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-16 00:16:29 [DEBUG   ] spawn_process: at 2018-11-16 00:16:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-16 00:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-16 00:16:29 [DEBUG   ] spawn_process: at 2018-11-16 00:16:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-16 00:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-16 00:16:29 [DEBUG   ] spawn_process: at 2018-11-16 00:16:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-16 00:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-16 00:16:29 [DEBUG   ] spawn_process: at 2018-11-16 00:16:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-16 00:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-16 00:16:29 [DEBUG   ] spawn_process: at 2018-11-16 00:16:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-16 00:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-16 00:16:29 [DEBUG   ] spawn_process: at 2018-11-16 00:16:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-16 00:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-16 00:16:29 [DEBUG   ] spawn_process: at 2018-11-16 00:16:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-16 00:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-16 00:16:29 [DEBUG   ] spawn_process: at 2018-11-16 00:16:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-16 00:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-16 00:16:29 [DEBUG   ] spawn_process: at 2018-11-16 00:16:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-16 00:16:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-16 00:16:29 [DEBUG   ] spawn_process: at 2018-11-16 00:16:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-16 00:16:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 00:16:59 [DEBUG   ] Got command BAM from MCS: ref #520697
2018-11-16 00:16:59 [INFO    ] Finished processing BAM request
2018-11-16 00:16:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:16:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520697   8 58438  1019025 A  ERROR'
2018-11-16 00:16:59 [DEBUG   ] Got command BAM from MCS: ref #520698
2018-11-16 00:16:59 [INFO    ] Finished processing BAM request
2018-11-16 00:16:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:16:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520698   8 58438  1019029 A  ERROR'
2018-11-16 00:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-16 00:16:59 [DEBUG   ] spawn_process: at 2018-11-16 00:16:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-16 00:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-16 00:16:59 [DEBUG   ] spawn_process: at 2018-11-16 00:16:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-16 00:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-16 00:16:59 [DEBUG   ] spawn_process: at 2018-11-16 00:16:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-16 00:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-16 00:16:59 [DEBUG   ] spawn_process: at 2018-11-16 00:16:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-16 00:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-16 00:16:59 [DEBUG   ] spawn_process: at 2018-11-16 00:16:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-16 00:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-16 00:16:59 [DEBUG   ] spawn_process: at 2018-11-16 00:16:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-16 00:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-16 00:16:59 [DEBUG   ] spawn_process: at 2018-11-16 00:16:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-16 00:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-16 00:16:59 [DEBUG   ] spawn_process: at 2018-11-16 00:16:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-16 00:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-16 00:16:59 [DEBUG   ] spawn_process: at 2018-11-16 00:16:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-16 00:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-16 00:16:59 [DEBUG   ] spawn_process: at 2018-11-16 00:16:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-16 00:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-16 00:16:59 [DEBUG   ] spawn_process: at 2018-11-16 00:16:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-16 00:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-16 00:16:59 [DEBUG   ] spawn_process: at 2018-11-16 00:16:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-16 00:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-16 00:16:59 [DEBUG   ] spawn_process: at 2018-11-16 00:16:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-16 00:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-16 00:16:59 [DEBUG   ] spawn_process: at 2018-11-16 00:16:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-16 00:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-16 00:16:59 [DEBUG   ] spawn_process: at 2018-11-16 00:16:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-16 00:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-16 00:16:59 [DEBUG   ] spawn_process: at 2018-11-16 00:16:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-16 00:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-16 00:16:59 [DEBUG   ] spawn_process: at 2018-11-16 00:16:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-16 00:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-16 00:16:59 [DEBUG   ] spawn_process: at 2018-11-16 00:16:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-16 00:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-16 00:16:59 [DEBUG   ] spawn_process: at 2018-11-16 00:16:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-16 00:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-16 00:16:59 [DEBUG   ] spawn_process: at 2018-11-16 00:16:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-16 00:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-16 00:16:59 [DEBUG   ] spawn_process: at 2018-11-16 00:16:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-16 00:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-16 00:16:59 [DEBUG   ] spawn_process: at 2018-11-16 00:16:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-16 00:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-16 00:16:59 [DEBUG   ] spawn_process: at 2018-11-16 00:16:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-16 00:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-16 00:16:59 [DEBUG   ] spawn_process: at 2018-11-16 00:16:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-16 00:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-16 00:16:59 [DEBUG   ] spawn_process: at 2018-11-16 00:16:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-16 00:16:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-16 00:16:59 [DEBUG   ] spawn_process: at 2018-11-16 00:16:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-16 00:17:01 [DEBUG   ] Finished updating ant stats in 1.047 seconds
2018-11-16 00:17:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:17:02 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-16 00:17:02 [WARNING ] (13, 1, 'bot')
2018-11-16 00:17:02 [WARNING ] (13, 1, 'bot')
2018-11-16 00:17:02 [WARNING ] (13, 1, 'bot')
2018-11-16 00:17:02 [WARNING ] (13, 1, 'bot')
2018-11-16 00:17:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:17:02 [DEBUG   ] Finished updating board flags in 1.028 seconds
2018-11-16 00:17:21 [DEBUG   ] Finished updating ant stats in 0.958 seconds
2018-11-16 00:17:29 [DEBUG   ] Got command BAM from MCS: ref #520699
2018-11-16 00:17:29 [INFO    ] Finished processing BAM request
2018-11-16 00:17:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:17:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520699   8 58438  1049033 A  ERROR'
2018-11-16 00:17:29 [DEBUG   ] Got command BAM from MCS: ref #520700
2018-11-16 00:17:29 [INFO    ] Finished processing BAM request
2018-11-16 00:17:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:17:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520700   8 58438  1049037 A  ERROR'
2018-11-16 00:17:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-16 00:17:29 [DEBUG   ] spawn_process: at 2018-11-16 00:17:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-16 00:17:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-16 00:17:29 [DEBUG   ] spawn_process: at 2018-11-16 00:17:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-16 00:17:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-16 00:17:29 [DEBUG   ] spawn_process: at 2018-11-16 00:17:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-16 00:17:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-16 00:17:29 [DEBUG   ] spawn_process: at 2018-11-16 00:17:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-16 00:17:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-16 00:17:29 [DEBUG   ] spawn_process: at 2018-11-16 00:17:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-16 00:17:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-16 00:17:29 [DEBUG   ] spawn_process: at 2018-11-16 00:17:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-16 00:17:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-16 00:17:29 [DEBUG   ] spawn_process: at 2018-11-16 00:17:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-16 00:17:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-16 00:17:29 [DEBUG   ] spawn_process: at 2018-11-16 00:17:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-16 00:17:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-16 00:17:29 [DEBUG   ] spawn_process: at 2018-11-16 00:17:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-16 00:17:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-16 00:17:29 [DEBUG   ] spawn_process: at 2018-11-16 00:17:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-16 00:17:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-16 00:17:29 [DEBUG   ] spawn_process: at 2018-11-16 00:17:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-16 00:17:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-16 00:17:29 [DEBUG   ] spawn_process: at 2018-11-16 00:17:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-16 00:17:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-16 00:17:29 [DEBUG   ] spawn_process: at 2018-11-16 00:17:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-16 00:17:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-16 00:17:29 [DEBUG   ] spawn_process: at 2018-11-16 00:17:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-16 00:17:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-16 00:17:29 [DEBUG   ] spawn_process: at 2018-11-16 00:17:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-16 00:17:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-16 00:17:29 [DEBUG   ] spawn_process: at 2018-11-16 00:17:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-16 00:17:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-16 00:17:29 [DEBUG   ] spawn_process: at 2018-11-16 00:17:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-16 00:17:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-16 00:17:29 [DEBUG   ] spawn_process: at 2018-11-16 00:17:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-16 00:17:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-16 00:17:29 [DEBUG   ] spawn_process: at 2018-11-16 00:17:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-16 00:17:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-16 00:17:29 [DEBUG   ] spawn_process: at 2018-11-16 00:17:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-16 00:17:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-16 00:17:29 [DEBUG   ] spawn_process: at 2018-11-16 00:17:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-16 00:17:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-16 00:17:29 [DEBUG   ] spawn_process: at 2018-11-16 00:17:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-16 00:17:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-16 00:17:29 [DEBUG   ] spawn_process: at 2018-11-16 00:17:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-16 00:17:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-16 00:17:29 [DEBUG   ] spawn_process: at 2018-11-16 00:17:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-16 00:17:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-16 00:17:29 [DEBUG   ] spawn_process: at 2018-11-16 00:17:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-16 00:17:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-16 00:17:29 [DEBUG   ] spawn_process: at 2018-11-16 00:17:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-16 00:17:41 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 00:17:59 [DEBUG   ] Got command BAM from MCS: ref #520705
2018-11-16 00:17:59 [INFO    ] Finished processing BAM request
2018-11-16 00:17:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:17:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520705   8 58438  1079029 A  ERROR'
2018-11-16 00:17:59 [DEBUG   ] Got command BAM from MCS: ref #520706
2018-11-16 00:17:59 [INFO    ] Finished processing BAM request
2018-11-16 00:17:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:17:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520706   8 58438  1079033 A  ERROR'
2018-11-16 00:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-16 00:17:59 [DEBUG   ] spawn_process: at 2018-11-16 00:17:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-16 00:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-16 00:17:59 [DEBUG   ] spawn_process: at 2018-11-16 00:17:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-16 00:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-16 00:17:59 [DEBUG   ] spawn_process: at 2018-11-16 00:17:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-16 00:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-16 00:17:59 [DEBUG   ] spawn_process: at 2018-11-16 00:17:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-16 00:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-16 00:17:59 [DEBUG   ] spawn_process: at 2018-11-16 00:17:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-16 00:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-16 00:17:59 [DEBUG   ] spawn_process: at 2018-11-16 00:17:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-16 00:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-16 00:17:59 [DEBUG   ] spawn_process: at 2018-11-16 00:17:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-16 00:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-16 00:17:59 [DEBUG   ] spawn_process: at 2018-11-16 00:17:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-16 00:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-16 00:17:59 [DEBUG   ] spawn_process: at 2018-11-16 00:17:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-16 00:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-16 00:17:59 [DEBUG   ] spawn_process: at 2018-11-16 00:17:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-16 00:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-16 00:17:59 [DEBUG   ] spawn_process: at 2018-11-16 00:17:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-16 00:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-16 00:17:59 [DEBUG   ] spawn_process: at 2018-11-16 00:17:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-16 00:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-16 00:17:59 [DEBUG   ] spawn_process: at 2018-11-16 00:17:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-16 00:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-16 00:17:59 [DEBUG   ] spawn_process: at 2018-11-16 00:17:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-16 00:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-16 00:17:59 [DEBUG   ] spawn_process: at 2018-11-16 00:17:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-16 00:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-16 00:17:59 [DEBUG   ] spawn_process: at 2018-11-16 00:17:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-16 00:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-16 00:17:59 [DEBUG   ] spawn_process: at 2018-11-16 00:17:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-16 00:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-16 00:17:59 [DEBUG   ] spawn_process: at 2018-11-16 00:17:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-16 00:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-16 00:17:59 [DEBUG   ] spawn_process: at 2018-11-16 00:17:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-16 00:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-16 00:17:59 [DEBUG   ] spawn_process: at 2018-11-16 00:17:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-16 00:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-16 00:17:59 [DEBUG   ] spawn_process: at 2018-11-16 00:17:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-16 00:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-16 00:17:59 [DEBUG   ] spawn_process: at 2018-11-16 00:17:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-16 00:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-16 00:17:59 [DEBUG   ] spawn_process: at 2018-11-16 00:17:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-16 00:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-16 00:17:59 [DEBUG   ] spawn_process: at 2018-11-16 00:17:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-16 00:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-16 00:17:59 [DEBUG   ] spawn_process: at 2018-11-16 00:17:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-16 00:17:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-16 00:17:59 [DEBUG   ] spawn_process: at 2018-11-16 00:17:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-16 00:18:01 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 00:18:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-16 00:18:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-16 00:18:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:18:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 00:18:02 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-16 00:18:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-16 00:18:02 [WARNING ] (13, 1, 'bot')
2018-11-16 00:18:02 [WARNING ] (13, 1, 'bot')
2018-11-16 00:18:02 [WARNING ] (13, 1, 'bot')
2018-11-16 00:18:02 [WARNING ] (13, 1, 'bot')
2018-11-16 00:18:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:18:02 [DEBUG   ] Finished updating board flags in 0.967 seconds
2018-11-16 00:18:21 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 00:18:27 [DEBUG   ] Got command RPT from MCS: ref #520709
2018-11-16 00:18:27 [DEBUG   ] summary = ERROR
2018-11-16 00:18:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520709  13 58438  1107565 A  ERRORERROR'
2018-11-16 00:18:27 [DEBUG   ] Got command RPT from MCS: ref #520710
2018-11-16 00:18:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 00:18:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520710  77 58438  1107769 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 00:18:27 [DEBUG   ] Got command RPT from MCS: ref #520711
2018-11-16 00:18:27 [DEBUG   ] summary = ERROR
2018-11-16 00:18:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520711  13 58438  1107973 A  ERRORERROR'
2018-11-16 00:18:28 [DEBUG   ] Got command RPT from MCS: ref #520715
2018-11-16 00:18:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 00:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520715  77 58438  1108177 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 00:18:28 [DEBUG   ] Got command RPT from MCS: ref #520716
2018-11-16 00:18:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 00:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520716  12 58438  1108369 A  ERRORB¢ff'
2018-11-16 00:18:29 [DEBUG   ] Got command BAM from MCS: ref #520713
2018-11-16 00:18:29 [INFO    ] Finished processing BAM request
2018-11-16 00:18:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:18:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520713   8 58438  1109033 A  ERROR'
2018-11-16 00:18:29 [DEBUG   ] Got command BAM from MCS: ref #520712
2018-11-16 00:18:29 [INFO    ] Finished processing BAM request
2018-11-16 00:18:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:18:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520712   8 58438  1109037 A  ERROR'
2018-11-16 00:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-16 00:18:29 [DEBUG   ] spawn_process: at 2018-11-16 00:18:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-16 00:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-16 00:18:29 [DEBUG   ] spawn_process: at 2018-11-16 00:18:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-16 00:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-16 00:18:29 [DEBUG   ] spawn_process: at 2018-11-16 00:18:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-16 00:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-16 00:18:29 [DEBUG   ] spawn_process: at 2018-11-16 00:18:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-16 00:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-16 00:18:29 [DEBUG   ] spawn_process: at 2018-11-16 00:18:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-16 00:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-16 00:18:29 [DEBUG   ] spawn_process: at 2018-11-16 00:18:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-16 00:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-16 00:18:29 [DEBUG   ] spawn_process: at 2018-11-16 00:18:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-16 00:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-16 00:18:29 [DEBUG   ] spawn_process: at 2018-11-16 00:18:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-16 00:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-16 00:18:29 [DEBUG   ] spawn_process: at 2018-11-16 00:18:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-16 00:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-16 00:18:29 [DEBUG   ] spawn_process: at 2018-11-16 00:18:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-16 00:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-16 00:18:29 [DEBUG   ] spawn_process: at 2018-11-16 00:18:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-16 00:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-16 00:18:29 [DEBUG   ] spawn_process: at 2018-11-16 00:18:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-16 00:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-16 00:18:29 [DEBUG   ] spawn_process: at 2018-11-16 00:18:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-16 00:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-16 00:18:29 [DEBUG   ] spawn_process: at 2018-11-16 00:18:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-16 00:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-16 00:18:29 [DEBUG   ] spawn_process: at 2018-11-16 00:18:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-16 00:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-16 00:18:29 [DEBUG   ] spawn_process: at 2018-11-16 00:18:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-16 00:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-16 00:18:29 [DEBUG   ] spawn_process: at 2018-11-16 00:18:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-16 00:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-16 00:18:29 [DEBUG   ] spawn_process: at 2018-11-16 00:18:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-16 00:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-16 00:18:29 [DEBUG   ] spawn_process: at 2018-11-16 00:18:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-16 00:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-16 00:18:29 [DEBUG   ] spawn_process: at 2018-11-16 00:18:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-16 00:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-16 00:18:29 [DEBUG   ] spawn_process: at 2018-11-16 00:18:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-16 00:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-16 00:18:29 [DEBUG   ] spawn_process: at 2018-11-16 00:18:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-16 00:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-16 00:18:29 [DEBUG   ] spawn_process: at 2018-11-16 00:18:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-16 00:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-16 00:18:29 [DEBUG   ] spawn_process: at 2018-11-16 00:18:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-16 00:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-16 00:18:29 [DEBUG   ] spawn_process: at 2018-11-16 00:18:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-16 00:18:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-16 00:18:29 [DEBUG   ] spawn_process: at 2018-11-16 00:18:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-16 00:18:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 00:18:59 [DEBUG   ] Got command BAM from MCS: ref #520721
2018-11-16 00:18:59 [INFO    ] Finished processing BAM request
2018-11-16 00:18:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:18:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520721   8 58438  1139029 A  ERROR'
2018-11-16 00:18:59 [DEBUG   ] Got command BAM from MCS: ref #520722
2018-11-16 00:18:59 [INFO    ] Finished processing BAM request
2018-11-16 00:18:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:18:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520722   8 58438  1139033 A  ERROR'
2018-11-16 00:18:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-16 00:18:59 [DEBUG   ] spawn_process: at 2018-11-16 00:18:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-16 00:18:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-16 00:18:59 [DEBUG   ] spawn_process: at 2018-11-16 00:18:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-16 00:18:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-16 00:18:59 [DEBUG   ] spawn_process: at 2018-11-16 00:18:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-16 00:18:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-16 00:18:59 [DEBUG   ] spawn_process: at 2018-11-16 00:18:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-16 00:18:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-16 00:18:59 [DEBUG   ] spawn_process: at 2018-11-16 00:18:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-16 00:18:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-16 00:18:59 [DEBUG   ] spawn_process: at 2018-11-16 00:18:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-16 00:18:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-16 00:18:59 [DEBUG   ] spawn_process: at 2018-11-16 00:18:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-16 00:18:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-16 00:18:59 [DEBUG   ] spawn_process: at 2018-11-16 00:18:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-16 00:18:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-16 00:18:59 [DEBUG   ] spawn_process: at 2018-11-16 00:18:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-16 00:18:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-16 00:18:59 [DEBUG   ] spawn_process: at 2018-11-16 00:18:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-16 00:18:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-16 00:18:59 [DEBUG   ] spawn_process: at 2018-11-16 00:18:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-16 00:18:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-16 00:18:59 [DEBUG   ] spawn_process: at 2018-11-16 00:18:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-16 00:18:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-16 00:18:59 [DEBUG   ] spawn_process: at 2018-11-16 00:18:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-16 00:18:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-16 00:18:59 [DEBUG   ] spawn_process: at 2018-11-16 00:18:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-16 00:18:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-16 00:18:59 [DEBUG   ] spawn_process: at 2018-11-16 00:18:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-16 00:18:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-16 00:18:59 [DEBUG   ] spawn_process: at 2018-11-16 00:18:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-16 00:18:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-16 00:18:59 [DEBUG   ] spawn_process: at 2018-11-16 00:18:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-16 00:18:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-16 00:18:59 [DEBUG   ] spawn_process: at 2018-11-16 00:18:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-16 00:18:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-16 00:18:59 [DEBUG   ] spawn_process: at 2018-11-16 00:18:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-16 00:18:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-16 00:18:59 [DEBUG   ] spawn_process: at 2018-11-16 00:18:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-16 00:18:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-16 00:18:59 [DEBUG   ] spawn_process: at 2018-11-16 00:18:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-16 00:18:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-16 00:18:59 [DEBUG   ] spawn_process: at 2018-11-16 00:18:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-16 00:18:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-16 00:18:59 [DEBUG   ] spawn_process: at 2018-11-16 00:18:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-16 00:18:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-16 00:18:59 [DEBUG   ] spawn_process: at 2018-11-16 00:18:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-16 00:18:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-16 00:18:59 [DEBUG   ] spawn_process: at 2018-11-16 00:18:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-16 00:18:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-16 00:18:59 [DEBUG   ] spawn_process: at 2018-11-16 00:18:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-16 00:19:01 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 00:19:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 00:19:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-16 00:19:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:19:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-16 00:19:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 00:19:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-16 00:19:03 [WARNING ] (13, 1, 'bot')
2018-11-16 00:19:03 [WARNING ] (13, 1, 'bot')
2018-11-16 00:19:03 [WARNING ] (13, 1, 'bot')
2018-11-16 00:19:03 [WARNING ] (13, 1, 'bot')
2018-11-16 00:19:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:19:03 [DEBUG   ] Finished updating board flags in 1.371 seconds
2018-11-16 00:19:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 00:19:29 [DEBUG   ] Got command BAM from MCS: ref #520724
2018-11-16 00:19:29 [INFO    ] Finished processing BAM request
2018-11-16 00:19:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:19:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520724   8 58438  1169029 A  ERROR'
2018-11-16 00:19:29 [DEBUG   ] Got command BAM from MCS: ref #520723
2018-11-16 00:19:29 [INFO    ] Finished processing BAM request
2018-11-16 00:19:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:19:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520723   8 58438  1169033 A  ERROR'
2018-11-16 00:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-16 00:19:29 [DEBUG   ] spawn_process: at 2018-11-16 00:19:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-16 00:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-16 00:19:29 [DEBUG   ] spawn_process: at 2018-11-16 00:19:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-16 00:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-16 00:19:29 [DEBUG   ] spawn_process: at 2018-11-16 00:19:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-16 00:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-16 00:19:29 [DEBUG   ] spawn_process: at 2018-11-16 00:19:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-16 00:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-16 00:19:29 [DEBUG   ] spawn_process: at 2018-11-16 00:19:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-16 00:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-16 00:19:29 [DEBUG   ] spawn_process: at 2018-11-16 00:19:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-16 00:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-16 00:19:29 [DEBUG   ] spawn_process: at 2018-11-16 00:19:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-16 00:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-16 00:19:29 [DEBUG   ] spawn_process: at 2018-11-16 00:19:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-16 00:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-16 00:19:29 [DEBUG   ] spawn_process: at 2018-11-16 00:19:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-16 00:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-16 00:19:29 [DEBUG   ] spawn_process: at 2018-11-16 00:19:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-16 00:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-16 00:19:29 [DEBUG   ] spawn_process: at 2018-11-16 00:19:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-16 00:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-16 00:19:29 [DEBUG   ] spawn_process: at 2018-11-16 00:19:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-16 00:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-16 00:19:29 [DEBUG   ] spawn_process: at 2018-11-16 00:19:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-16 00:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-16 00:19:29 [DEBUG   ] spawn_process: at 2018-11-16 00:19:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-16 00:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-16 00:19:29 [DEBUG   ] spawn_process: at 2018-11-16 00:19:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-16 00:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-16 00:19:29 [DEBUG   ] spawn_process: at 2018-11-16 00:19:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-16 00:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-16 00:19:29 [DEBUG   ] spawn_process: at 2018-11-16 00:19:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-16 00:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-16 00:19:29 [DEBUG   ] spawn_process: at 2018-11-16 00:19:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-16 00:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-16 00:19:29 [DEBUG   ] spawn_process: at 2018-11-16 00:19:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-16 00:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-16 00:19:29 [DEBUG   ] spawn_process: at 2018-11-16 00:19:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-16 00:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-16 00:19:29 [DEBUG   ] spawn_process: at 2018-11-16 00:19:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-16 00:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-16 00:19:29 [DEBUG   ] spawn_process: at 2018-11-16 00:19:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-16 00:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-16 00:19:29 [DEBUG   ] spawn_process: at 2018-11-16 00:19:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-16 00:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-16 00:19:29 [DEBUG   ] spawn_process: at 2018-11-16 00:19:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-16 00:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-16 00:19:29 [DEBUG   ] spawn_process: at 2018-11-16 00:19:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-16 00:19:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-16 00:19:29 [DEBUG   ] spawn_process: at 2018-11-16 00:19:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-16 00:19:41 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 00:19:59 [DEBUG   ] Got command BAM from MCS: ref #520725
2018-11-16 00:19:59 [INFO    ] Finished processing BAM request
2018-11-16 00:19:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:19:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520725   8 58438  1199033 A  ERROR'
2018-11-16 00:19:59 [DEBUG   ] Got command BAM from MCS: ref #520726
2018-11-16 00:19:59 [INFO    ] Finished processing BAM request
2018-11-16 00:19:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:19:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520726   8 58438  1199037 A  ERROR'
2018-11-16 00:19:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-16 00:19:59 [DEBUG   ] spawn_process: at 2018-11-16 00:19:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-16 00:19:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-16 00:19:59 [DEBUG   ] spawn_process: at 2018-11-16 00:19:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-16 00:19:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-16 00:19:59 [DEBUG   ] spawn_process: at 2018-11-16 00:19:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-16 00:19:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-16 00:19:59 [DEBUG   ] spawn_process: at 2018-11-16 00:19:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-16 00:19:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-16 00:19:59 [DEBUG   ] spawn_process: at 2018-11-16 00:19:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-16 00:19:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-16 00:19:59 [DEBUG   ] spawn_process: at 2018-11-16 00:19:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-16 00:19:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-16 00:19:59 [DEBUG   ] spawn_process: at 2018-11-16 00:19:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-16 00:19:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-16 00:19:59 [DEBUG   ] spawn_process: at 2018-11-16 00:19:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-16 00:19:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-16 00:19:59 [DEBUG   ] spawn_process: at 2018-11-16 00:19:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-16 00:19:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-16 00:19:59 [DEBUG   ] spawn_process: at 2018-11-16 00:19:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-16 00:19:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-16 00:19:59 [DEBUG   ] spawn_process: at 2018-11-16 00:19:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-16 00:19:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-16 00:19:59 [DEBUG   ] spawn_process: at 2018-11-16 00:19:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-16 00:19:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-16 00:19:59 [DEBUG   ] spawn_process: at 2018-11-16 00:19:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-16 00:19:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-16 00:19:59 [DEBUG   ] spawn_process: at 2018-11-16 00:19:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-16 00:19:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-16 00:19:59 [DEBUG   ] spawn_process: at 2018-11-16 00:19:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-16 00:19:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-16 00:19:59 [DEBUG   ] spawn_process: at 2018-11-16 00:19:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-16 00:19:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-16 00:19:59 [DEBUG   ] spawn_process: at 2018-11-16 00:19:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-16 00:19:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-16 00:19:59 [DEBUG   ] spawn_process: at 2018-11-16 00:19:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-16 00:19:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-16 00:19:59 [DEBUG   ] spawn_process: at 2018-11-16 00:19:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-16 00:19:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-16 00:19:59 [DEBUG   ] spawn_process: at 2018-11-16 00:19:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-16 00:19:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-16 00:19:59 [DEBUG   ] spawn_process: at 2018-11-16 00:19:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-16 00:19:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-16 00:19:59 [DEBUG   ] spawn_process: at 2018-11-16 00:19:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-16 00:19:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-16 00:19:59 [DEBUG   ] spawn_process: at 2018-11-16 00:19:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-16 00:19:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-16 00:19:59 [DEBUG   ] spawn_process: at 2018-11-16 00:19:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-16 00:19:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-16 00:19:59 [DEBUG   ] spawn_process: at 2018-11-16 00:19:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-16 00:19:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-16 00:19:59 [DEBUG   ] spawn_process: at 2018-11-16 00:19:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-16 00:20:01 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 00:20:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:20:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 00:20:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-16 00:20:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-16 00:20:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-16 00:20:03 [WARNING ] (13, 1, 'bot')
2018-11-16 00:20:03 [WARNING ] (13, 1, 'bot')
2018-11-16 00:20:03 [WARNING ] (13, 1, 'bot')
2018-11-16 00:20:03 [WARNING ] (13, 1, 'bot')
2018-11-16 00:20:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:20:03 [DEBUG   ] Finished updating board flags in 1.189 seconds
2018-11-16 00:20:21 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 00:20:29 [DEBUG   ] Got command BAM from MCS: ref #520728
2018-11-16 00:20:29 [INFO    ] Finished processing BAM request
2018-11-16 00:20:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:20:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520728   8 58438  1229033 A  ERROR'
2018-11-16 00:20:29 [DEBUG   ] Got command BAM from MCS: ref #520727
2018-11-16 00:20:29 [INFO    ] Finished processing BAM request
2018-11-16 00:20:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:20:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520727   8 58438  1229037 A  ERROR'
2018-11-16 00:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-16 00:20:29 [DEBUG   ] spawn_process: at 2018-11-16 00:20:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-16 00:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-16 00:20:29 [DEBUG   ] spawn_process: at 2018-11-16 00:20:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-16 00:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-16 00:20:29 [DEBUG   ] spawn_process: at 2018-11-16 00:20:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-16 00:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-16 00:20:29 [DEBUG   ] spawn_process: at 2018-11-16 00:20:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-16 00:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-16 00:20:29 [DEBUG   ] spawn_process: at 2018-11-16 00:20:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-16 00:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-16 00:20:29 [DEBUG   ] spawn_process: at 2018-11-16 00:20:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-16 00:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-16 00:20:29 [DEBUG   ] spawn_process: at 2018-11-16 00:20:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-16 00:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-16 00:20:29 [DEBUG   ] spawn_process: at 2018-11-16 00:20:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-16 00:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-16 00:20:29 [DEBUG   ] spawn_process: at 2018-11-16 00:20:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-16 00:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-16 00:20:29 [DEBUG   ] spawn_process: at 2018-11-16 00:20:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-16 00:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-16 00:20:29 [DEBUG   ] spawn_process: at 2018-11-16 00:20:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-16 00:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-16 00:20:29 [DEBUG   ] spawn_process: at 2018-11-16 00:20:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-16 00:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-16 00:20:29 [DEBUG   ] spawn_process: at 2018-11-16 00:20:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-16 00:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-16 00:20:29 [DEBUG   ] spawn_process: at 2018-11-16 00:20:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-16 00:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-16 00:20:29 [DEBUG   ] spawn_process: at 2018-11-16 00:20:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-16 00:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-16 00:20:29 [DEBUG   ] spawn_process: at 2018-11-16 00:20:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-16 00:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-16 00:20:29 [DEBUG   ] spawn_process: at 2018-11-16 00:20:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-16 00:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-16 00:20:29 [DEBUG   ] spawn_process: at 2018-11-16 00:20:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-16 00:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-16 00:20:29 [DEBUG   ] spawn_process: at 2018-11-16 00:20:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-16 00:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-16 00:20:29 [DEBUG   ] spawn_process: at 2018-11-16 00:20:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-16 00:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-16 00:20:29 [DEBUG   ] spawn_process: at 2018-11-16 00:20:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-16 00:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-16 00:20:29 [DEBUG   ] spawn_process: at 2018-11-16 00:20:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-16 00:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-16 00:20:29 [DEBUG   ] spawn_process: at 2018-11-16 00:20:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-16 00:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-16 00:20:29 [DEBUG   ] spawn_process: at 2018-11-16 00:20:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-16 00:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-16 00:20:29 [DEBUG   ] spawn_process: at 2018-11-16 00:20:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-16 00:20:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-16 00:20:29 [DEBUG   ] spawn_process: at 2018-11-16 00:20:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-16 00:20:41 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 00:20:45 [DEBUG   ] Got command RPT from MCS: ref #520733
2018-11-16 00:20:45 [DEBUG   ] summary = ERROR
2018-11-16 00:20:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520733  13 58438  1245245 A  ERRORERROR'
2018-11-16 00:20:45 [DEBUG   ] Got command RPT from MCS: ref #520734
2018-11-16 00:20:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 00:20:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520734  77 58438  1245246 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 00:20:59 [DEBUG   ] Got command BAM from MCS: ref #520751
2018-11-16 00:20:59 [INFO    ] Finished processing BAM request
2018-11-16 00:20:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:20:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520751   8 58438  1259029 A  ERROR'
2018-11-16 00:20:59 [DEBUG   ] Got command BAM from MCS: ref #520750
2018-11-16 00:20:59 [INFO    ] Finished processing BAM request
2018-11-16 00:20:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:20:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520750   8 58438  1259033 A  ERROR'
2018-11-16 00:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-16 00:20:59 [DEBUG   ] spawn_process: at 2018-11-16 00:20:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-16 00:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-16 00:20:59 [DEBUG   ] spawn_process: at 2018-11-16 00:20:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-16 00:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-16 00:20:59 [DEBUG   ] spawn_process: at 2018-11-16 00:20:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-16 00:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-16 00:20:59 [DEBUG   ] spawn_process: at 2018-11-16 00:20:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-16 00:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-16 00:20:59 [DEBUG   ] spawn_process: at 2018-11-16 00:20:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-16 00:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-16 00:20:59 [DEBUG   ] spawn_process: at 2018-11-16 00:20:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-16 00:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-16 00:20:59 [DEBUG   ] spawn_process: at 2018-11-16 00:20:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-16 00:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-16 00:20:59 [DEBUG   ] spawn_process: at 2018-11-16 00:20:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-16 00:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-16 00:20:59 [DEBUG   ] spawn_process: at 2018-11-16 00:20:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-16 00:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-16 00:20:59 [DEBUG   ] spawn_process: at 2018-11-16 00:20:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-16 00:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-16 00:20:59 [DEBUG   ] spawn_process: at 2018-11-16 00:20:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-16 00:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-16 00:20:59 [DEBUG   ] spawn_process: at 2018-11-16 00:20:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-16 00:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-16 00:20:59 [DEBUG   ] spawn_process: at 2018-11-16 00:20:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-16 00:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-16 00:20:59 [DEBUG   ] spawn_process: at 2018-11-16 00:20:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-16 00:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-16 00:20:59 [DEBUG   ] spawn_process: at 2018-11-16 00:20:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-16 00:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-16 00:20:59 [DEBUG   ] spawn_process: at 2018-11-16 00:20:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-16 00:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-16 00:20:59 [DEBUG   ] spawn_process: at 2018-11-16 00:20:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-16 00:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-16 00:20:59 [DEBUG   ] spawn_process: at 2018-11-16 00:20:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-16 00:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-16 00:20:59 [DEBUG   ] spawn_process: at 2018-11-16 00:20:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-16 00:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-16 00:20:59 [DEBUG   ] spawn_process: at 2018-11-16 00:20:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-16 00:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-16 00:20:59 [DEBUG   ] spawn_process: at 2018-11-16 00:20:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-16 00:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-16 00:20:59 [DEBUG   ] spawn_process: at 2018-11-16 00:20:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-16 00:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-16 00:20:59 [DEBUG   ] spawn_process: at 2018-11-16 00:20:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-16 00:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-16 00:20:59 [DEBUG   ] spawn_process: at 2018-11-16 00:20:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-16 00:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-16 00:20:59 [DEBUG   ] spawn_process: at 2018-11-16 00:20:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-16 00:20:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-16 00:20:59 [DEBUG   ] spawn_process: at 2018-11-16 00:20:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-16 00:21:01 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 00:21:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-11-16 00:21:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:21:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-16 00:21:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-16 00:21:03 [WARNING ] (13, 1, 'bot')
2018-11-16 00:21:03 [WARNING ] (13, 1, 'bot')
2018-11-16 00:21:03 [WARNING ] (13, 1, 'bot')
2018-11-16 00:21:03 [WARNING ] (13, 1, 'bot')
2018-11-16 00:21:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:21:03 [DEBUG   ] Finished updating board flags in 1.014 seconds
2018-11-16 00:21:21 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-16 00:21:29 [DEBUG   ] Got command BAM from MCS: ref #520752
2018-11-16 00:21:29 [INFO    ] Finished processing BAM request
2018-11-16 00:21:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:21:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520752   8 58438  1289029 A  ERROR'
2018-11-16 00:21:29 [DEBUG   ] Got command BAM from MCS: ref #520753
2018-11-16 00:21:29 [INFO    ] Finished processing BAM request
2018-11-16 00:21:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:21:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520753   8 58438  1289033 A  ERROR'
2018-11-16 00:21:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-16 00:21:29 [DEBUG   ] spawn_process: at 2018-11-16 00:21:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-16 00:21:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-16 00:21:29 [DEBUG   ] spawn_process: at 2018-11-16 00:21:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-16 00:21:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-16 00:21:29 [DEBUG   ] spawn_process: at 2018-11-16 00:21:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-16 00:21:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-16 00:21:29 [DEBUG   ] spawn_process: at 2018-11-16 00:21:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-16 00:21:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-16 00:21:29 [DEBUG   ] spawn_process: at 2018-11-16 00:21:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-16 00:21:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-16 00:21:29 [DEBUG   ] spawn_process: at 2018-11-16 00:21:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-16 00:21:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-16 00:21:29 [DEBUG   ] spawn_process: at 2018-11-16 00:21:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-16 00:21:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-16 00:21:29 [DEBUG   ] spawn_process: at 2018-11-16 00:21:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-16 00:21:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-16 00:21:29 [DEBUG   ] spawn_process: at 2018-11-16 00:21:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-16 00:21:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-16 00:21:29 [DEBUG   ] spawn_process: at 2018-11-16 00:21:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-16 00:21:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-16 00:21:29 [DEBUG   ] spawn_process: at 2018-11-16 00:21:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-16 00:21:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-16 00:21:29 [DEBUG   ] spawn_process: at 2018-11-16 00:21:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-16 00:21:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-16 00:21:29 [DEBUG   ] spawn_process: at 2018-11-16 00:21:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-16 00:21:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-16 00:21:29 [DEBUG   ] spawn_process: at 2018-11-16 00:21:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-16 00:21:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-16 00:21:29 [DEBUG   ] spawn_process: at 2018-11-16 00:21:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-16 00:21:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-16 00:21:29 [DEBUG   ] spawn_process: at 2018-11-16 00:21:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-16 00:21:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-16 00:21:29 [DEBUG   ] spawn_process: at 2018-11-16 00:21:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-16 00:21:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-16 00:21:29 [DEBUG   ] spawn_process: at 2018-11-16 00:21:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-16 00:21:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-16 00:21:29 [DEBUG   ] spawn_process: at 2018-11-16 00:21:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-16 00:21:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-16 00:21:29 [DEBUG   ] spawn_process: at 2018-11-16 00:21:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-16 00:21:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-16 00:21:29 [DEBUG   ] spawn_process: at 2018-11-16 00:21:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-16 00:21:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-16 00:21:29 [DEBUG   ] spawn_process: at 2018-11-16 00:21:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-16 00:21:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-16 00:21:29 [DEBUG   ] spawn_process: at 2018-11-16 00:21:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-16 00:21:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-16 00:21:29 [DEBUG   ] spawn_process: at 2018-11-16 00:21:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-16 00:21:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-16 00:21:29 [DEBUG   ] spawn_process: at 2018-11-16 00:21:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-16 00:21:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-16 00:21:29 [DEBUG   ] spawn_process: at 2018-11-16 00:21:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-16 00:21:41 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-16 00:21:59 [DEBUG   ] Got command BAM from MCS: ref #520755
2018-11-16 00:21:59 [INFO    ] Finished processing BAM request
2018-11-16 00:21:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:21:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520755   8 58438  1319025 A  ERROR'
2018-11-16 00:21:59 [DEBUG   ] Got command BAM from MCS: ref #520754
2018-11-16 00:21:59 [INFO    ] Finished processing BAM request
2018-11-16 00:21:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:21:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520754   8 58438  1319029 A  ERROR'
2018-11-16 00:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-16 00:21:59 [DEBUG   ] spawn_process: at 2018-11-16 00:21:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-16 00:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-16 00:21:59 [DEBUG   ] spawn_process: at 2018-11-16 00:21:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-16 00:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-16 00:21:59 [DEBUG   ] spawn_process: at 2018-11-16 00:21:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-16 00:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-16 00:21:59 [DEBUG   ] spawn_process: at 2018-11-16 00:21:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-16 00:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-16 00:21:59 [DEBUG   ] spawn_process: at 2018-11-16 00:21:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-16 00:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-16 00:21:59 [DEBUG   ] spawn_process: at 2018-11-16 00:21:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-16 00:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-16 00:21:59 [DEBUG   ] spawn_process: at 2018-11-16 00:21:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-16 00:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-16 00:21:59 [DEBUG   ] spawn_process: at 2018-11-16 00:21:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-16 00:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-16 00:21:59 [DEBUG   ] spawn_process: at 2018-11-16 00:21:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-16 00:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-16 00:21:59 [DEBUG   ] spawn_process: at 2018-11-16 00:21:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-16 00:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-16 00:21:59 [DEBUG   ] spawn_process: at 2018-11-16 00:21:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-16 00:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-16 00:21:59 [DEBUG   ] spawn_process: at 2018-11-16 00:21:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-16 00:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-16 00:21:59 [DEBUG   ] spawn_process: at 2018-11-16 00:21:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-16 00:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-16 00:21:59 [DEBUG   ] spawn_process: at 2018-11-16 00:21:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-16 00:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-16 00:21:59 [DEBUG   ] spawn_process: at 2018-11-16 00:21:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-16 00:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-16 00:21:59 [DEBUG   ] spawn_process: at 2018-11-16 00:21:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-16 00:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-16 00:21:59 [DEBUG   ] spawn_process: at 2018-11-16 00:21:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-16 00:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-16 00:21:59 [DEBUG   ] spawn_process: at 2018-11-16 00:21:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-16 00:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-16 00:21:59 [DEBUG   ] spawn_process: at 2018-11-16 00:21:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-16 00:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-16 00:21:59 [DEBUG   ] spawn_process: at 2018-11-16 00:21:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-16 00:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-16 00:21:59 [DEBUG   ] spawn_process: at 2018-11-16 00:21:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-16 00:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-16 00:21:59 [DEBUG   ] spawn_process: at 2018-11-16 00:21:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-16 00:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-16 00:21:59 [DEBUG   ] spawn_process: at 2018-11-16 00:21:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-16 00:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-16 00:21:59 [DEBUG   ] spawn_process: at 2018-11-16 00:21:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-16 00:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-16 00:21:59 [DEBUG   ] spawn_process: at 2018-11-16 00:21:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-16 00:21:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-16 00:21:59 [DEBUG   ] spawn_process: at 2018-11-16 00:21:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-16 00:22:01 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 00:22:02 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-16 00:22:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:22:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 00:22:03 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-16 00:22:03 [WARNING ] (13, 1, 'bot')
2018-11-16 00:22:03 [WARNING ] (13, 1, 'bot')
2018-11-16 00:22:03 [WARNING ] (13, 1, 'bot')
2018-11-16 00:22:03 [WARNING ] (13, 1, 'bot')
2018-11-16 00:22:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:22:03 [DEBUG   ] Finished updating board flags in 0.993 seconds
2018-11-16 00:22:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 00:22:29 [DEBUG   ] Got command BAM from MCS: ref #520756
2018-11-16 00:22:29 [INFO    ] Finished processing BAM request
2018-11-16 00:22:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:22:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520756   8 58438  1349033 A  ERROR'
2018-11-16 00:22:29 [DEBUG   ] Got command BAM from MCS: ref #520757
2018-11-16 00:22:29 [INFO    ] Finished processing BAM request
2018-11-16 00:22:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:22:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520757   8 58438  1349037 A  ERROR'
2018-11-16 00:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-16 00:22:29 [DEBUG   ] spawn_process: at 2018-11-16 00:22:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-16 00:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-16 00:22:29 [DEBUG   ] spawn_process: at 2018-11-16 00:22:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-16 00:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-16 00:22:29 [DEBUG   ] spawn_process: at 2018-11-16 00:22:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-16 00:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-16 00:22:29 [DEBUG   ] spawn_process: at 2018-11-16 00:22:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-16 00:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-16 00:22:29 [DEBUG   ] spawn_process: at 2018-11-16 00:22:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-16 00:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-16 00:22:29 [DEBUG   ] spawn_process: at 2018-11-16 00:22:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-16 00:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-16 00:22:29 [DEBUG   ] spawn_process: at 2018-11-16 00:22:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-16 00:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-16 00:22:29 [DEBUG   ] spawn_process: at 2018-11-16 00:22:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-16 00:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-16 00:22:29 [DEBUG   ] spawn_process: at 2018-11-16 00:22:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-16 00:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-16 00:22:29 [DEBUG   ] spawn_process: at 2018-11-16 00:22:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-16 00:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-16 00:22:29 [DEBUG   ] spawn_process: at 2018-11-16 00:22:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-16 00:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-16 00:22:29 [DEBUG   ] spawn_process: at 2018-11-16 00:22:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-16 00:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-16 00:22:29 [DEBUG   ] spawn_process: at 2018-11-16 00:22:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-16 00:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-16 00:22:29 [DEBUG   ] spawn_process: at 2018-11-16 00:22:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-16 00:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-16 00:22:29 [DEBUG   ] spawn_process: at 2018-11-16 00:22:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-16 00:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-16 00:22:29 [DEBUG   ] spawn_process: at 2018-11-16 00:22:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-16 00:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-16 00:22:29 [DEBUG   ] spawn_process: at 2018-11-16 00:22:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-16 00:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-16 00:22:29 [DEBUG   ] spawn_process: at 2018-11-16 00:22:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-16 00:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-16 00:22:29 [DEBUG   ] spawn_process: at 2018-11-16 00:22:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-16 00:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-16 00:22:29 [DEBUG   ] spawn_process: at 2018-11-16 00:22:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-16 00:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-16 00:22:29 [DEBUG   ] spawn_process: at 2018-11-16 00:22:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-16 00:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-16 00:22:29 [DEBUG   ] spawn_process: at 2018-11-16 00:22:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-16 00:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-16 00:22:29 [DEBUG   ] spawn_process: at 2018-11-16 00:22:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-16 00:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-16 00:22:29 [DEBUG   ] spawn_process: at 2018-11-16 00:22:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-16 00:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-16 00:22:29 [DEBUG   ] spawn_process: at 2018-11-16 00:22:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-16 00:22:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-16 00:22:29 [DEBUG   ] spawn_process: at 2018-11-16 00:22:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-16 00:22:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 00:22:59 [DEBUG   ] Got command BAM from MCS: ref #520758
2018-11-16 00:22:59 [INFO    ] Finished processing BAM request
2018-11-16 00:22:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:22:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520758   8 58438  1379033 A  ERROR'
2018-11-16 00:22:59 [DEBUG   ] Got command BAM from MCS: ref #520759
2018-11-16 00:22:59 [INFO    ] Finished processing BAM request
2018-11-16 00:22:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:22:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520759   8 58438  1379037 A  ERROR'
2018-11-16 00:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-16 00:22:59 [DEBUG   ] spawn_process: at 2018-11-16 00:22:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-16 00:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-16 00:22:59 [DEBUG   ] spawn_process: at 2018-11-16 00:22:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-16 00:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-16 00:22:59 [DEBUG   ] spawn_process: at 2018-11-16 00:22:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-16 00:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-16 00:22:59 [DEBUG   ] spawn_process: at 2018-11-16 00:22:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-16 00:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-16 00:22:59 [DEBUG   ] spawn_process: at 2018-11-16 00:22:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-16 00:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-16 00:22:59 [DEBUG   ] spawn_process: at 2018-11-16 00:22:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-16 00:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-16 00:22:59 [DEBUG   ] spawn_process: at 2018-11-16 00:22:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-16 00:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-16 00:22:59 [DEBUG   ] spawn_process: at 2018-11-16 00:22:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-16 00:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-16 00:22:59 [DEBUG   ] spawn_process: at 2018-11-16 00:22:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-16 00:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-16 00:22:59 [DEBUG   ] spawn_process: at 2018-11-16 00:22:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-16 00:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-16 00:22:59 [DEBUG   ] spawn_process: at 2018-11-16 00:22:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-16 00:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-16 00:22:59 [DEBUG   ] spawn_process: at 2018-11-16 00:22:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-16 00:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-16 00:22:59 [DEBUG   ] spawn_process: at 2018-11-16 00:22:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-16 00:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-16 00:22:59 [DEBUG   ] spawn_process: at 2018-11-16 00:22:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-16 00:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-16 00:22:59 [DEBUG   ] spawn_process: at 2018-11-16 00:22:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-16 00:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-16 00:22:59 [DEBUG   ] spawn_process: at 2018-11-16 00:22:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-16 00:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-16 00:22:59 [DEBUG   ] spawn_process: at 2018-11-16 00:22:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-16 00:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-16 00:22:59 [DEBUG   ] spawn_process: at 2018-11-16 00:22:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-16 00:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-16 00:22:59 [DEBUG   ] spawn_process: at 2018-11-16 00:22:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-16 00:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-16 00:22:59 [DEBUG   ] spawn_process: at 2018-11-16 00:22:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-16 00:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-16 00:22:59 [DEBUG   ] spawn_process: at 2018-11-16 00:22:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-16 00:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-16 00:22:59 [DEBUG   ] spawn_process: at 2018-11-16 00:22:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-16 00:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-16 00:22:59 [DEBUG   ] spawn_process: at 2018-11-16 00:22:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-16 00:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-16 00:22:59 [DEBUG   ] spawn_process: at 2018-11-16 00:22:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-16 00:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-16 00:22:59 [DEBUG   ] spawn_process: at 2018-11-16 00:22:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-16 00:22:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-16 00:22:59 [DEBUG   ] spawn_process: at 2018-11-16 00:22:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-16 00:23:01 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-16 00:23:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 00:23:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-16 00:23:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:23:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 00:23:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-16 00:23:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-16 00:23:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-16 00:23:04 [WARNING ] (13, 1, 'bot')
2018-11-16 00:23:04 [WARNING ] (13, 1, 'bot')
2018-11-16 00:23:04 [WARNING ] (13, 1, 'bot')
2018-11-16 00:23:04 [WARNING ] (13, 1, 'bot')
2018-11-16 00:23:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:23:04 [DEBUG   ] Finished updating board flags in 1.803 seconds
2018-11-16 00:23:21 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-16 00:23:27 [DEBUG   ] Got command RPT from MCS: ref #520760
2018-11-16 00:23:27 [DEBUG   ] summary = ERROR
2018-11-16 00:23:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520760  13 58438  1407657 A  ERRORERROR'
2018-11-16 00:23:27 [DEBUG   ] Got command RPT from MCS: ref #520761
2018-11-16 00:23:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 00:23:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520761  77 58438  1407850 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 00:23:28 [DEBUG   ] Got command RPT from MCS: ref #520764
2018-11-16 00:23:28 [DEBUG   ] summary = ERROR
2018-11-16 00:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520764  13 58438  1408053 A  ERRORERROR'
2018-11-16 00:23:28 [DEBUG   ] Got command RPT from MCS: ref #520765
2018-11-16 00:23:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 00:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520765  77 58438  1408257 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 00:23:28 [DEBUG   ] Got command RPT from MCS: ref #520766
2018-11-16 00:23:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 00:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520766  12 58438  1408461 A  ERRORB¢ff'
2018-11-16 00:23:29 [DEBUG   ] Got command BAM from MCS: ref #520763
2018-11-16 00:23:29 [INFO    ] Finished processing BAM request
2018-11-16 00:23:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:23:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520763   8 58438  1409029 A  ERROR'
2018-11-16 00:23:29 [DEBUG   ] Got command BAM from MCS: ref #520762
2018-11-16 00:23:29 [INFO    ] Finished processing BAM request
2018-11-16 00:23:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:23:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520762   8 58438  1409033 A  ERROR'
2018-11-16 00:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-16 00:23:29 [DEBUG   ] spawn_process: at 2018-11-16 00:23:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-16 00:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-16 00:23:29 [DEBUG   ] spawn_process: at 2018-11-16 00:23:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-16 00:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-16 00:23:29 [DEBUG   ] spawn_process: at 2018-11-16 00:23:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-16 00:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-16 00:23:29 [DEBUG   ] spawn_process: at 2018-11-16 00:23:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-16 00:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-16 00:23:29 [DEBUG   ] spawn_process: at 2018-11-16 00:23:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-16 00:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-16 00:23:29 [DEBUG   ] spawn_process: at 2018-11-16 00:23:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-16 00:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-16 00:23:29 [DEBUG   ] spawn_process: at 2018-11-16 00:23:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-16 00:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-16 00:23:29 [DEBUG   ] spawn_process: at 2018-11-16 00:23:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-16 00:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-16 00:23:29 [DEBUG   ] spawn_process: at 2018-11-16 00:23:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-16 00:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-16 00:23:29 [DEBUG   ] spawn_process: at 2018-11-16 00:23:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-16 00:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-16 00:23:29 [DEBUG   ] spawn_process: at 2018-11-16 00:23:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-16 00:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-16 00:23:29 [DEBUG   ] spawn_process: at 2018-11-16 00:23:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-16 00:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-16 00:23:29 [DEBUG   ] spawn_process: at 2018-11-16 00:23:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-16 00:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-16 00:23:29 [DEBUG   ] spawn_process: at 2018-11-16 00:23:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-16 00:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-16 00:23:29 [DEBUG   ] spawn_process: at 2018-11-16 00:23:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-16 00:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-16 00:23:29 [DEBUG   ] spawn_process: at 2018-11-16 00:23:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-16 00:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-16 00:23:29 [DEBUG   ] spawn_process: at 2018-11-16 00:23:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-16 00:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-16 00:23:29 [DEBUG   ] spawn_process: at 2018-11-16 00:23:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-16 00:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-16 00:23:29 [DEBUG   ] spawn_process: at 2018-11-16 00:23:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-16 00:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-16 00:23:29 [DEBUG   ] spawn_process: at 2018-11-16 00:23:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-16 00:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-16 00:23:29 [DEBUG   ] spawn_process: at 2018-11-16 00:23:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-16 00:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-16 00:23:29 [DEBUG   ] spawn_process: at 2018-11-16 00:23:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-16 00:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-16 00:23:29 [DEBUG   ] spawn_process: at 2018-11-16 00:23:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-16 00:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-16 00:23:29 [DEBUG   ] spawn_process: at 2018-11-16 00:23:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-16 00:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-16 00:23:29 [DEBUG   ] spawn_process: at 2018-11-16 00:23:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-16 00:23:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-16 00:23:29 [DEBUG   ] spawn_process: at 2018-11-16 00:23:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-16 00:23:41 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-16 00:23:59 [DEBUG   ] Got command BAM from MCS: ref #520772
2018-11-16 00:23:59 [INFO    ] Finished processing BAM request
2018-11-16 00:23:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:23:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520772   8 58438  1439029 A  ERROR'
2018-11-16 00:23:59 [DEBUG   ] Got command BAM from MCS: ref #520771
2018-11-16 00:23:59 [INFO    ] Finished processing BAM request
2018-11-16 00:23:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:23:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520771   8 58438  1439033 A  ERROR'
2018-11-16 00:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-16 00:23:59 [DEBUG   ] spawn_process: at 2018-11-16 00:23:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-16 00:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-16 00:23:59 [DEBUG   ] spawn_process: at 2018-11-16 00:23:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-16 00:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-16 00:23:59 [DEBUG   ] spawn_process: at 2018-11-16 00:23:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-16 00:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-16 00:23:59 [DEBUG   ] spawn_process: at 2018-11-16 00:23:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-16 00:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-16 00:23:59 [DEBUG   ] spawn_process: at 2018-11-16 00:23:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-16 00:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-16 00:23:59 [DEBUG   ] spawn_process: at 2018-11-16 00:23:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-16 00:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-16 00:23:59 [DEBUG   ] spawn_process: at 2018-11-16 00:23:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-16 00:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-16 00:23:59 [DEBUG   ] spawn_process: at 2018-11-16 00:23:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-16 00:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-16 00:23:59 [DEBUG   ] spawn_process: at 2018-11-16 00:23:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-16 00:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-16 00:23:59 [DEBUG   ] spawn_process: at 2018-11-16 00:23:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-16 00:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-16 00:23:59 [DEBUG   ] spawn_process: at 2018-11-16 00:23:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-16 00:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-16 00:23:59 [DEBUG   ] spawn_process: at 2018-11-16 00:23:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-16 00:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-16 00:23:59 [DEBUG   ] spawn_process: at 2018-11-16 00:23:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-16 00:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-16 00:23:59 [DEBUG   ] spawn_process: at 2018-11-16 00:23:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-16 00:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-16 00:23:59 [DEBUG   ] spawn_process: at 2018-11-16 00:23:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-16 00:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-16 00:23:59 [DEBUG   ] spawn_process: at 2018-11-16 00:23:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-16 00:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-16 00:23:59 [DEBUG   ] spawn_process: at 2018-11-16 00:23:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-16 00:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-16 00:23:59 [DEBUG   ] spawn_process: at 2018-11-16 00:23:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-16 00:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-16 00:23:59 [DEBUG   ] spawn_process: at 2018-11-16 00:23:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-16 00:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-16 00:23:59 [DEBUG   ] spawn_process: at 2018-11-16 00:23:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-16 00:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-16 00:23:59 [DEBUG   ] spawn_process: at 2018-11-16 00:23:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-16 00:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-16 00:23:59 [DEBUG   ] spawn_process: at 2018-11-16 00:23:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-16 00:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-16 00:23:59 [DEBUG   ] spawn_process: at 2018-11-16 00:23:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-16 00:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-16 00:23:59 [DEBUG   ] spawn_process: at 2018-11-16 00:23:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-16 00:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-16 00:23:59 [DEBUG   ] spawn_process: at 2018-11-16 00:23:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-16 00:23:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-16 00:23:59 [DEBUG   ] spawn_process: at 2018-11-16 00:23:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-16 00:24:01 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-16 00:24:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-11-16 00:24:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:24:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-16 00:24:03 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-16 00:24:03 [WARNING ] (13, 1, 'bot')
2018-11-16 00:24:03 [WARNING ] (13, 1, 'bot')
2018-11-16 00:24:03 [WARNING ] (13, 1, 'bot')
2018-11-16 00:24:03 [WARNING ] (13, 1, 'bot')
2018-11-16 00:24:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:24:03 [DEBUG   ] Finished updating board flags in 1.237 seconds
2018-11-16 00:24:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 00:24:29 [DEBUG   ] Got command BAM from MCS: ref #520773
2018-11-16 00:24:29 [INFO    ] Finished processing BAM request
2018-11-16 00:24:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:24:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520773   8 58438  1469025 A  ERROR'
2018-11-16 00:24:29 [DEBUG   ] Got command BAM from MCS: ref #520774
2018-11-16 00:24:29 [INFO    ] Finished processing BAM request
2018-11-16 00:24:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:24:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520774   8 58438  1469029 A  ERROR'
2018-11-16 00:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-16 00:24:29 [DEBUG   ] spawn_process: at 2018-11-16 00:24:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-16 00:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-16 00:24:29 [DEBUG   ] spawn_process: at 2018-11-16 00:24:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-16 00:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-16 00:24:29 [DEBUG   ] spawn_process: at 2018-11-16 00:24:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-16 00:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-16 00:24:29 [DEBUG   ] spawn_process: at 2018-11-16 00:24:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-16 00:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-16 00:24:29 [DEBUG   ] spawn_process: at 2018-11-16 00:24:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-16 00:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-16 00:24:29 [DEBUG   ] spawn_process: at 2018-11-16 00:24:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-16 00:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-16 00:24:29 [DEBUG   ] spawn_process: at 2018-11-16 00:24:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-16 00:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-16 00:24:29 [DEBUG   ] spawn_process: at 2018-11-16 00:24:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-16 00:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-16 00:24:29 [DEBUG   ] spawn_process: at 2018-11-16 00:24:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-16 00:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-16 00:24:29 [DEBUG   ] spawn_process: at 2018-11-16 00:24:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-16 00:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-16 00:24:29 [DEBUG   ] spawn_process: at 2018-11-16 00:24:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-16 00:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-16 00:24:29 [DEBUG   ] spawn_process: at 2018-11-16 00:24:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-16 00:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-16 00:24:29 [DEBUG   ] spawn_process: at 2018-11-16 00:24:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-16 00:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-16 00:24:29 [DEBUG   ] spawn_process: at 2018-11-16 00:24:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-16 00:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-16 00:24:29 [DEBUG   ] spawn_process: at 2018-11-16 00:24:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-16 00:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-16 00:24:29 [DEBUG   ] spawn_process: at 2018-11-16 00:24:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-16 00:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-16 00:24:29 [DEBUG   ] spawn_process: at 2018-11-16 00:24:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-16 00:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-16 00:24:29 [DEBUG   ] spawn_process: at 2018-11-16 00:24:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-16 00:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-16 00:24:29 [DEBUG   ] spawn_process: at 2018-11-16 00:24:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-16 00:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-16 00:24:29 [DEBUG   ] spawn_process: at 2018-11-16 00:24:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-16 00:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-16 00:24:29 [DEBUG   ] spawn_process: at 2018-11-16 00:24:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-16 00:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-16 00:24:29 [DEBUG   ] spawn_process: at 2018-11-16 00:24:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-16 00:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-16 00:24:29 [DEBUG   ] spawn_process: at 2018-11-16 00:24:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-16 00:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-16 00:24:29 [DEBUG   ] spawn_process: at 2018-11-16 00:24:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-16 00:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-16 00:24:29 [DEBUG   ] spawn_process: at 2018-11-16 00:24:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-16 00:24:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-16 00:24:29 [DEBUG   ] spawn_process: at 2018-11-16 00:24:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-16 00:24:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 00:24:59 [DEBUG   ] Got command BAM from MCS: ref #520775
2018-11-16 00:24:59 [INFO    ] Finished processing BAM request
2018-11-16 00:24:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:24:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520775   8 58438  1499025 A  ERROR'
2018-11-16 00:24:59 [DEBUG   ] Got command BAM from MCS: ref #520776
2018-11-16 00:24:59 [INFO    ] Finished processing BAM request
2018-11-16 00:24:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:24:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520776   8 58438  1499029 A  ERROR'
2018-11-16 00:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-16 00:24:59 [DEBUG   ] spawn_process: at 2018-11-16 00:24:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-16 00:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-16 00:24:59 [DEBUG   ] spawn_process: at 2018-11-16 00:24:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-16 00:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-16 00:24:59 [DEBUG   ] spawn_process: at 2018-11-16 00:24:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-16 00:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-16 00:24:59 [DEBUG   ] spawn_process: at 2018-11-16 00:24:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-16 00:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-16 00:24:59 [DEBUG   ] spawn_process: at 2018-11-16 00:24:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-16 00:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-16 00:24:59 [DEBUG   ] spawn_process: at 2018-11-16 00:24:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-16 00:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-16 00:24:59 [DEBUG   ] spawn_process: at 2018-11-16 00:24:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-16 00:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-16 00:24:59 [DEBUG   ] spawn_process: at 2018-11-16 00:24:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-16 00:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-16 00:24:59 [DEBUG   ] spawn_process: at 2018-11-16 00:24:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-16 00:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-16 00:24:59 [DEBUG   ] spawn_process: at 2018-11-16 00:24:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-16 00:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-16 00:24:59 [DEBUG   ] spawn_process: at 2018-11-16 00:24:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-16 00:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-16 00:24:59 [DEBUG   ] spawn_process: at 2018-11-16 00:24:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-16 00:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-16 00:24:59 [DEBUG   ] spawn_process: at 2018-11-16 00:24:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-16 00:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-16 00:24:59 [DEBUG   ] spawn_process: at 2018-11-16 00:24:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-16 00:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-16 00:24:59 [DEBUG   ] spawn_process: at 2018-11-16 00:24:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-16 00:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-16 00:24:59 [DEBUG   ] spawn_process: at 2018-11-16 00:24:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-16 00:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-16 00:24:59 [DEBUG   ] spawn_process: at 2018-11-16 00:24:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-16 00:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-16 00:24:59 [DEBUG   ] spawn_process: at 2018-11-16 00:24:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-16 00:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-16 00:24:59 [DEBUG   ] spawn_process: at 2018-11-16 00:24:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-16 00:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-16 00:24:59 [DEBUG   ] spawn_process: at 2018-11-16 00:24:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-16 00:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-16 00:24:59 [DEBUG   ] spawn_process: at 2018-11-16 00:24:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-16 00:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-16 00:24:59 [DEBUG   ] spawn_process: at 2018-11-16 00:24:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-16 00:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-16 00:24:59 [DEBUG   ] spawn_process: at 2018-11-16 00:24:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-16 00:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-16 00:24:59 [DEBUG   ] spawn_process: at 2018-11-16 00:24:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-16 00:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-16 00:24:59 [DEBUG   ] spawn_process: at 2018-11-16 00:24:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-16 00:24:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-16 00:24:59 [DEBUG   ] spawn_process: at 2018-11-16 00:24:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-16 00:25:01 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-16 00:25:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:25:03 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-16 00:25:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-16 00:25:03 [WARNING ] (13, 1, 'bot')
2018-11-16 00:25:03 [WARNING ] (13, 1, 'bot')
2018-11-16 00:25:03 [WARNING ] (13, 1, 'bot')
2018-11-16 00:25:03 [WARNING ] (13, 1, 'bot')
2018-11-16 00:25:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:25:03 [DEBUG   ] Finished updating board flags in 1.289 seconds
2018-11-16 00:25:21 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-16 00:25:29 [DEBUG   ] Got command BAM from MCS: ref #520777
2018-11-16 00:25:29 [INFO    ] Finished processing BAM request
2018-11-16 00:25:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:25:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520777   8 58438  1529025 A  ERROR'
2018-11-16 00:25:29 [DEBUG   ] Got command BAM from MCS: ref #520778
2018-11-16 00:25:29 [INFO    ] Finished processing BAM request
2018-11-16 00:25:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:25:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520778   8 58438  1529029 A  ERROR'
2018-11-16 00:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-16 00:25:29 [DEBUG   ] spawn_process: at 2018-11-16 00:25:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-16 00:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-16 00:25:29 [DEBUG   ] spawn_process: at 2018-11-16 00:25:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-16 00:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-16 00:25:29 [DEBUG   ] spawn_process: at 2018-11-16 00:25:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-16 00:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-16 00:25:29 [DEBUG   ] spawn_process: at 2018-11-16 00:25:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-16 00:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-16 00:25:29 [DEBUG   ] spawn_process: at 2018-11-16 00:25:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-16 00:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-16 00:25:29 [DEBUG   ] spawn_process: at 2018-11-16 00:25:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-16 00:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-16 00:25:29 [DEBUG   ] spawn_process: at 2018-11-16 00:25:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-16 00:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-16 00:25:29 [DEBUG   ] spawn_process: at 2018-11-16 00:25:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-16 00:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-16 00:25:29 [DEBUG   ] spawn_process: at 2018-11-16 00:25:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-16 00:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-16 00:25:29 [DEBUG   ] spawn_process: at 2018-11-16 00:25:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-16 00:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-16 00:25:29 [DEBUG   ] spawn_process: at 2018-11-16 00:25:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-16 00:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-16 00:25:29 [DEBUG   ] spawn_process: at 2018-11-16 00:25:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-16 00:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-16 00:25:29 [DEBUG   ] spawn_process: at 2018-11-16 00:25:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-16 00:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-16 00:25:29 [DEBUG   ] spawn_process: at 2018-11-16 00:25:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-16 00:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-16 00:25:29 [DEBUG   ] spawn_process: at 2018-11-16 00:25:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-16 00:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-16 00:25:29 [DEBUG   ] spawn_process: at 2018-11-16 00:25:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-16 00:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-16 00:25:29 [DEBUG   ] spawn_process: at 2018-11-16 00:25:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-16 00:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-16 00:25:29 [DEBUG   ] spawn_process: at 2018-11-16 00:25:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-16 00:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-16 00:25:29 [DEBUG   ] spawn_process: at 2018-11-16 00:25:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-16 00:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-16 00:25:29 [DEBUG   ] spawn_process: at 2018-11-16 00:25:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-16 00:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-16 00:25:29 [DEBUG   ] spawn_process: at 2018-11-16 00:25:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-16 00:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-16 00:25:29 [DEBUG   ] spawn_process: at 2018-11-16 00:25:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-16 00:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-16 00:25:29 [DEBUG   ] spawn_process: at 2018-11-16 00:25:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-16 00:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-16 00:25:29 [DEBUG   ] spawn_process: at 2018-11-16 00:25:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-16 00:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-16 00:25:29 [DEBUG   ] spawn_process: at 2018-11-16 00:25:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-16 00:25:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-16 00:25:29 [DEBUG   ] spawn_process: at 2018-11-16 00:25:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-16 00:25:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 00:25:45 [DEBUG   ] Got command RPT from MCS: ref #520779
2018-11-16 00:25:45 [DEBUG   ] summary = ERROR
2018-11-16 00:25:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520779  13 58438  1545253 A  ERRORERROR'
2018-11-16 00:25:45 [DEBUG   ] Got command RPT from MCS: ref #520780
2018-11-16 00:25:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 00:25:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520780  77 58438  1545254 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 00:25:59 [DEBUG   ] Got command BAM from MCS: ref #520797
2018-11-16 00:25:59 [INFO    ] Finished processing BAM request
2018-11-16 00:25:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:25:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520797   8 58438  1559025 A  ERROR'
2018-11-16 00:25:59 [DEBUG   ] Got command BAM from MCS: ref #520796
2018-11-16 00:25:59 [INFO    ] Finished processing BAM request
2018-11-16 00:25:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:25:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520796   8 58438  1559029 A  ERROR'
2018-11-16 00:25:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-16 00:25:59 [DEBUG   ] spawn_process: at 2018-11-16 00:25:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-16 00:25:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-16 00:25:59 [DEBUG   ] spawn_process: at 2018-11-16 00:25:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-16 00:25:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-16 00:25:59 [DEBUG   ] spawn_process: at 2018-11-16 00:25:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-16 00:25:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-16 00:25:59 [DEBUG   ] spawn_process: at 2018-11-16 00:25:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-16 00:25:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-16 00:25:59 [DEBUG   ] spawn_process: at 2018-11-16 00:25:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-16 00:25:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-16 00:25:59 [DEBUG   ] spawn_process: at 2018-11-16 00:25:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-16 00:25:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-16 00:25:59 [DEBUG   ] spawn_process: at 2018-11-16 00:25:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-16 00:25:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-16 00:25:59 [DEBUG   ] spawn_process: at 2018-11-16 00:25:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-16 00:25:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-16 00:25:59 [DEBUG   ] spawn_process: at 2018-11-16 00:25:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-16 00:25:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-16 00:25:59 [DEBUG   ] spawn_process: at 2018-11-16 00:25:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-16 00:25:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-16 00:25:59 [DEBUG   ] spawn_process: at 2018-11-16 00:25:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-16 00:25:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-16 00:25:59 [DEBUG   ] spawn_process: at 2018-11-16 00:25:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-16 00:25:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-16 00:25:59 [DEBUG   ] spawn_process: at 2018-11-16 00:25:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-16 00:25:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-16 00:25:59 [DEBUG   ] spawn_process: at 2018-11-16 00:25:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-16 00:25:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-16 00:25:59 [DEBUG   ] spawn_process: at 2018-11-16 00:25:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-16 00:25:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-16 00:25:59 [DEBUG   ] spawn_process: at 2018-11-16 00:25:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-16 00:25:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-16 00:25:59 [DEBUG   ] spawn_process: at 2018-11-16 00:25:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-16 00:25:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-16 00:25:59 [DEBUG   ] spawn_process: at 2018-11-16 00:25:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-16 00:25:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-16 00:25:59 [DEBUG   ] spawn_process: at 2018-11-16 00:25:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-16 00:25:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-16 00:25:59 [DEBUG   ] spawn_process: at 2018-11-16 00:25:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-16 00:25:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-16 00:25:59 [DEBUG   ] spawn_process: at 2018-11-16 00:25:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-16 00:25:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-16 00:25:59 [DEBUG   ] spawn_process: at 2018-11-16 00:25:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-16 00:25:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-16 00:25:59 [DEBUG   ] spawn_process: at 2018-11-16 00:25:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-16 00:25:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-16 00:25:59 [DEBUG   ] spawn_process: at 2018-11-16 00:25:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-16 00:25:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-16 00:25:59 [DEBUG   ] spawn_process: at 2018-11-16 00:25:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-16 00:25:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-16 00:25:59 [DEBUG   ] spawn_process: at 2018-11-16 00:25:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-16 00:26:01 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 00:26:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:26:03 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-16 00:26:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-16 00:26:03 [WARNING ] (13, 1, 'bot')
2018-11-16 00:26:03 [WARNING ] (13, 1, 'bot')
2018-11-16 00:26:03 [WARNING ] (13, 1, 'bot')
2018-11-16 00:26:03 [WARNING ] (13, 1, 'bot')
2018-11-16 00:26:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:26:03 [DEBUG   ] Finished updating board flags in 1.107 seconds
2018-11-16 00:26:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 00:26:29 [DEBUG   ] Got command BAM from MCS: ref #520799
2018-11-16 00:26:29 [INFO    ] Finished processing BAM request
2018-11-16 00:26:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:26:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520799   8 58438  1589025 A  ERROR'
2018-11-16 00:26:29 [DEBUG   ] Got command BAM from MCS: ref #520798
2018-11-16 00:26:29 [INFO    ] Finished processing BAM request
2018-11-16 00:26:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:26:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520798   8 58438  1589029 A  ERROR'
2018-11-16 00:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-16 00:26:29 [DEBUG   ] spawn_process: at 2018-11-16 00:26:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-16 00:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-16 00:26:29 [DEBUG   ] spawn_process: at 2018-11-16 00:26:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-16 00:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-16 00:26:29 [DEBUG   ] spawn_process: at 2018-11-16 00:26:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-16 00:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-16 00:26:29 [DEBUG   ] spawn_process: at 2018-11-16 00:26:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-16 00:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-16 00:26:29 [DEBUG   ] spawn_process: at 2018-11-16 00:26:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-16 00:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-16 00:26:29 [DEBUG   ] spawn_process: at 2018-11-16 00:26:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-16 00:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-16 00:26:29 [DEBUG   ] spawn_process: at 2018-11-16 00:26:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-16 00:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-16 00:26:29 [DEBUG   ] spawn_process: at 2018-11-16 00:26:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-16 00:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-16 00:26:29 [DEBUG   ] spawn_process: at 2018-11-16 00:26:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-16 00:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-16 00:26:29 [DEBUG   ] spawn_process: at 2018-11-16 00:26:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-16 00:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-16 00:26:29 [DEBUG   ] spawn_process: at 2018-11-16 00:26:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-16 00:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-16 00:26:29 [DEBUG   ] spawn_process: at 2018-11-16 00:26:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-16 00:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-16 00:26:29 [DEBUG   ] spawn_process: at 2018-11-16 00:26:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-16 00:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-16 00:26:29 [DEBUG   ] spawn_process: at 2018-11-16 00:26:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-16 00:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-16 00:26:29 [DEBUG   ] spawn_process: at 2018-11-16 00:26:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-16 00:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-16 00:26:29 [DEBUG   ] spawn_process: at 2018-11-16 00:26:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-16 00:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-16 00:26:29 [DEBUG   ] spawn_process: at 2018-11-16 00:26:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-16 00:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-16 00:26:29 [DEBUG   ] spawn_process: at 2018-11-16 00:26:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-16 00:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-16 00:26:29 [DEBUG   ] spawn_process: at 2018-11-16 00:26:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-16 00:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-16 00:26:29 [DEBUG   ] spawn_process: at 2018-11-16 00:26:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-16 00:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-16 00:26:29 [DEBUG   ] spawn_process: at 2018-11-16 00:26:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-16 00:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-16 00:26:29 [DEBUG   ] spawn_process: at 2018-11-16 00:26:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-16 00:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-16 00:26:29 [DEBUG   ] spawn_process: at 2018-11-16 00:26:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-16 00:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-16 00:26:29 [DEBUG   ] spawn_process: at 2018-11-16 00:26:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-16 00:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-16 00:26:29 [DEBUG   ] spawn_process: at 2018-11-16 00:26:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-16 00:26:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-16 00:26:29 [DEBUG   ] spawn_process: at 2018-11-16 00:26:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-16 00:26:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 00:26:59 [DEBUG   ] Got command BAM from MCS: ref #520805
2018-11-16 00:26:59 [INFO    ] Finished processing BAM request
2018-11-16 00:26:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:26:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520805   8 58438  1619025 A  ERROR'
2018-11-16 00:26:59 [DEBUG   ] Got command BAM from MCS: ref #520804
2018-11-16 00:26:59 [INFO    ] Finished processing BAM request
2018-11-16 00:26:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:26:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520804   8 58438  1619029 A  ERROR'
2018-11-16 00:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-16 00:26:59 [DEBUG   ] spawn_process: at 2018-11-16 00:26:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-16 00:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-16 00:26:59 [DEBUG   ] spawn_process: at 2018-11-16 00:26:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-16 00:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-16 00:26:59 [DEBUG   ] spawn_process: at 2018-11-16 00:26:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-16 00:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-16 00:26:59 [DEBUG   ] spawn_process: at 2018-11-16 00:26:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-16 00:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-16 00:26:59 [DEBUG   ] spawn_process: at 2018-11-16 00:26:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-16 00:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-16 00:26:59 [DEBUG   ] spawn_process: at 2018-11-16 00:26:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-16 00:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-16 00:26:59 [DEBUG   ] spawn_process: at 2018-11-16 00:26:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-16 00:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-16 00:26:59 [DEBUG   ] spawn_process: at 2018-11-16 00:26:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-16 00:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-16 00:26:59 [DEBUG   ] spawn_process: at 2018-11-16 00:26:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-16 00:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-16 00:26:59 [DEBUG   ] spawn_process: at 2018-11-16 00:26:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-16 00:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-16 00:26:59 [DEBUG   ] spawn_process: at 2018-11-16 00:26:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-16 00:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-16 00:26:59 [DEBUG   ] spawn_process: at 2018-11-16 00:26:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-16 00:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-16 00:26:59 [DEBUG   ] spawn_process: at 2018-11-16 00:26:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-16 00:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-16 00:26:59 [DEBUG   ] spawn_process: at 2018-11-16 00:26:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-16 00:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-16 00:26:59 [DEBUG   ] spawn_process: at 2018-11-16 00:26:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-16 00:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-16 00:26:59 [DEBUG   ] spawn_process: at 2018-11-16 00:26:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-16 00:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-16 00:26:59 [DEBUG   ] spawn_process: at 2018-11-16 00:26:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-16 00:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-16 00:26:59 [DEBUG   ] spawn_process: at 2018-11-16 00:26:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-16 00:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-16 00:26:59 [DEBUG   ] spawn_process: at 2018-11-16 00:26:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-16 00:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-16 00:26:59 [DEBUG   ] spawn_process: at 2018-11-16 00:26:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-16 00:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-16 00:26:59 [DEBUG   ] spawn_process: at 2018-11-16 00:26:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-16 00:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-16 00:26:59 [DEBUG   ] spawn_process: at 2018-11-16 00:26:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-16 00:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-16 00:26:59 [DEBUG   ] spawn_process: at 2018-11-16 00:26:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-16 00:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-16 00:26:59 [DEBUG   ] spawn_process: at 2018-11-16 00:26:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-16 00:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-16 00:26:59 [DEBUG   ] spawn_process: at 2018-11-16 00:26:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-16 00:26:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-16 00:26:59 [DEBUG   ] spawn_process: at 2018-11-16 00:26:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-16 00:27:01 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 00:27:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 00:27:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:27:03 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-16 00:27:03 [WARNING ] (13, 1, 'bot')
2018-11-16 00:27:03 [WARNING ] (13, 1, 'bot')
2018-11-16 00:27:03 [WARNING ] (13, 1, 'bot')
2018-11-16 00:27:03 [WARNING ] (13, 1, 'bot')
2018-11-16 00:27:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:27:03 [DEBUG   ] Finished updating board flags in 1.040 seconds
2018-11-16 00:27:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 00:27:29 [DEBUG   ] Got command BAM from MCS: ref #520807
2018-11-16 00:27:29 [INFO    ] Finished processing BAM request
2018-11-16 00:27:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:27:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520807   8 58438  1649033 A  ERROR'
2018-11-16 00:27:29 [DEBUG   ] Got command BAM from MCS: ref #520806
2018-11-16 00:27:29 [INFO    ] Finished processing BAM request
2018-11-16 00:27:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:27:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520806   8 58438  1649037 A  ERROR'
2018-11-16 00:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-16 00:27:29 [DEBUG   ] spawn_process: at 2018-11-16 00:27:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-16 00:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-16 00:27:29 [DEBUG   ] spawn_process: at 2018-11-16 00:27:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-16 00:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-16 00:27:29 [DEBUG   ] spawn_process: at 2018-11-16 00:27:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-16 00:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-16 00:27:29 [DEBUG   ] spawn_process: at 2018-11-16 00:27:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-16 00:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-16 00:27:29 [DEBUG   ] spawn_process: at 2018-11-16 00:27:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-16 00:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-16 00:27:29 [DEBUG   ] spawn_process: at 2018-11-16 00:27:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-16 00:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-16 00:27:29 [DEBUG   ] spawn_process: at 2018-11-16 00:27:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-16 00:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-16 00:27:29 [DEBUG   ] spawn_process: at 2018-11-16 00:27:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-16 00:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-16 00:27:29 [DEBUG   ] spawn_process: at 2018-11-16 00:27:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-16 00:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-16 00:27:29 [DEBUG   ] spawn_process: at 2018-11-16 00:27:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-16 00:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-16 00:27:29 [DEBUG   ] spawn_process: at 2018-11-16 00:27:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-16 00:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-16 00:27:29 [DEBUG   ] spawn_process: at 2018-11-16 00:27:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-16 00:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-16 00:27:29 [DEBUG   ] spawn_process: at 2018-11-16 00:27:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-16 00:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-16 00:27:29 [DEBUG   ] spawn_process: at 2018-11-16 00:27:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-16 00:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-16 00:27:29 [DEBUG   ] spawn_process: at 2018-11-16 00:27:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-16 00:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-16 00:27:29 [DEBUG   ] spawn_process: at 2018-11-16 00:27:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-16 00:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-16 00:27:29 [DEBUG   ] spawn_process: at 2018-11-16 00:27:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-16 00:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-16 00:27:29 [DEBUG   ] spawn_process: at 2018-11-16 00:27:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-16 00:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-16 00:27:29 [DEBUG   ] spawn_process: at 2018-11-16 00:27:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-16 00:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-16 00:27:29 [DEBUG   ] spawn_process: at 2018-11-16 00:27:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-16 00:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-16 00:27:29 [DEBUG   ] spawn_process: at 2018-11-16 00:27:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-16 00:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-16 00:27:29 [DEBUG   ] spawn_process: at 2018-11-16 00:27:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-16 00:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-16 00:27:29 [DEBUG   ] spawn_process: at 2018-11-16 00:27:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-16 00:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-16 00:27:29 [DEBUG   ] spawn_process: at 2018-11-16 00:27:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-16 00:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-16 00:27:29 [DEBUG   ] spawn_process: at 2018-11-16 00:27:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-16 00:27:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-16 00:27:29 [DEBUG   ] spawn_process: at 2018-11-16 00:27:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-16 00:27:41 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-16 00:27:59 [DEBUG   ] Got command BAM from MCS: ref #520808
2018-11-16 00:27:59 [INFO    ] Finished processing BAM request
2018-11-16 00:27:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:27:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520808   8 58438  1679029 A  ERROR'
2018-11-16 00:27:59 [DEBUG   ] Got command BAM from MCS: ref #520809
2018-11-16 00:27:59 [INFO    ] Finished processing BAM request
2018-11-16 00:27:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:27:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520809   8 58438  1679033 A  ERROR'
2018-11-16 00:27:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-16 00:27:59 [DEBUG   ] spawn_process: at 2018-11-16 00:27:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-16 00:27:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-16 00:27:59 [DEBUG   ] spawn_process: at 2018-11-16 00:27:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-16 00:27:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-16 00:27:59 [DEBUG   ] spawn_process: at 2018-11-16 00:27:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-16 00:27:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-16 00:27:59 [DEBUG   ] spawn_process: at 2018-11-16 00:27:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-16 00:27:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-16 00:27:59 [DEBUG   ] spawn_process: at 2018-11-16 00:27:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-16 00:27:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-16 00:27:59 [DEBUG   ] spawn_process: at 2018-11-16 00:27:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-16 00:27:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-16 00:27:59 [DEBUG   ] spawn_process: at 2018-11-16 00:27:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-16 00:27:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-16 00:27:59 [DEBUG   ] spawn_process: at 2018-11-16 00:27:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-16 00:27:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-16 00:27:59 [DEBUG   ] spawn_process: at 2018-11-16 00:27:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-16 00:27:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-16 00:27:59 [DEBUG   ] spawn_process: at 2018-11-16 00:27:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-16 00:27:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-16 00:27:59 [DEBUG   ] spawn_process: at 2018-11-16 00:27:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-16 00:27:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-16 00:27:59 [DEBUG   ] spawn_process: at 2018-11-16 00:27:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-16 00:27:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-16 00:27:59 [DEBUG   ] spawn_process: at 2018-11-16 00:27:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-16 00:27:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-16 00:27:59 [DEBUG   ] spawn_process: at 2018-11-16 00:27:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-16 00:27:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-16 00:27:59 [DEBUG   ] spawn_process: at 2018-11-16 00:27:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-16 00:27:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-16 00:27:59 [DEBUG   ] spawn_process: at 2018-11-16 00:27:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-16 00:27:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-16 00:27:59 [DEBUG   ] spawn_process: at 2018-11-16 00:27:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-16 00:27:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-16 00:27:59 [DEBUG   ] spawn_process: at 2018-11-16 00:27:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-16 00:27:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-16 00:27:59 [DEBUG   ] spawn_process: at 2018-11-16 00:27:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-16 00:27:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-16 00:27:59 [DEBUG   ] spawn_process: at 2018-11-16 00:27:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-16 00:27:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-16 00:27:59 [DEBUG   ] spawn_process: at 2018-11-16 00:27:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-16 00:27:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-16 00:27:59 [DEBUG   ] spawn_process: at 2018-11-16 00:27:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-16 00:27:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-16 00:27:59 [DEBUG   ] spawn_process: at 2018-11-16 00:27:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-16 00:27:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-16 00:27:59 [DEBUG   ] spawn_process: at 2018-11-16 00:27:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-16 00:27:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-16 00:27:59 [DEBUG   ] spawn_process: at 2018-11-16 00:27:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-16 00:27:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-16 00:27:59 [DEBUG   ] spawn_process: at 2018-11-16 00:27:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-16 00:28:01 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-16 00:28:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:28:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-11-16 00:28:03 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-16 00:28:03 [WARNING ] (13, 1, 'bot')
2018-11-16 00:28:03 [WARNING ] (13, 1, 'bot')
2018-11-16 00:28:03 [WARNING ] (13, 1, 'bot')
2018-11-16 00:28:03 [WARNING ] (13, 1, 'bot')
2018-11-16 00:28:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:28:03 [DEBUG   ] Finished updating board flags in 1.005 seconds
2018-11-16 00:28:21 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 00:28:27 [DEBUG   ] Got command RPT from MCS: ref #520812
2018-11-16 00:28:27 [DEBUG   ] summary = ERROR
2018-11-16 00:28:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520812  13 58438  1707741 A  ERRORERROR'
2018-11-16 00:28:27 [DEBUG   ] Got command RPT from MCS: ref #520813
2018-11-16 00:28:27 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 00:28:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520813  77 58438  1707945 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 00:28:28 [DEBUG   ] Got command RPT from MCS: ref #520816
2018-11-16 00:28:28 [DEBUG   ] summary = ERROR
2018-11-16 00:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520816  13 58438  1708137 A  ERRORERROR'
2018-11-16 00:28:28 [DEBUG   ] Got command RPT from MCS: ref #520818
2018-11-16 00:28:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 00:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520818  77 58438  1708341 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 00:28:28 [DEBUG   ] Got command RPT from MCS: ref #520819
2018-11-16 00:28:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 00:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520819  12 58438  1708545 A  ERRORB¡ff'
2018-11-16 00:28:29 [DEBUG   ] Got command BAM from MCS: ref #520815
2018-11-16 00:28:29 [INFO    ] Finished processing BAM request
2018-11-16 00:28:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:28:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520815   8 58438  1709029 A  ERROR'
2018-11-16 00:28:29 [DEBUG   ] Got command BAM from MCS: ref #520814
2018-11-16 00:28:29 [INFO    ] Finished processing BAM request
2018-11-16 00:28:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:28:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520814   8 58438  1709033 A  ERROR'
2018-11-16 00:28:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-16 00:28:29 [DEBUG   ] spawn_process: at 2018-11-16 00:28:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-16 00:28:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-16 00:28:29 [DEBUG   ] spawn_process: at 2018-11-16 00:28:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-16 00:28:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-16 00:28:29 [DEBUG   ] spawn_process: at 2018-11-16 00:28:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-16 00:28:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-16 00:28:29 [DEBUG   ] spawn_process: at 2018-11-16 00:28:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-16 00:28:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-16 00:28:29 [DEBUG   ] spawn_process: at 2018-11-16 00:28:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-16 00:28:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-16 00:28:29 [DEBUG   ] spawn_process: at 2018-11-16 00:28:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-16 00:28:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-16 00:28:29 [DEBUG   ] spawn_process: at 2018-11-16 00:28:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-16 00:28:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-16 00:28:29 [DEBUG   ] spawn_process: at 2018-11-16 00:28:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-16 00:28:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-16 00:28:29 [DEBUG   ] spawn_process: at 2018-11-16 00:28:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-16 00:28:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-16 00:28:29 [DEBUG   ] spawn_process: at 2018-11-16 00:28:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-16 00:28:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-16 00:28:29 [DEBUG   ] spawn_process: at 2018-11-16 00:28:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-16 00:28:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-16 00:28:29 [DEBUG   ] spawn_process: at 2018-11-16 00:28:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-16 00:28:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-16 00:28:29 [DEBUG   ] spawn_process: at 2018-11-16 00:28:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-16 00:28:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-16 00:28:29 [DEBUG   ] spawn_process: at 2018-11-16 00:28:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-16 00:28:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-16 00:28:29 [DEBUG   ] spawn_process: at 2018-11-16 00:28:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-16 00:28:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-16 00:28:29 [DEBUG   ] spawn_process: at 2018-11-16 00:28:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-16 00:28:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-16 00:28:29 [DEBUG   ] spawn_process: at 2018-11-16 00:28:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-16 00:28:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-16 00:28:29 [DEBUG   ] spawn_process: at 2018-11-16 00:28:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-16 00:28:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-16 00:28:29 [DEBUG   ] spawn_process: at 2018-11-16 00:28:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-16 00:28:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-16 00:28:29 [DEBUG   ] spawn_process: at 2018-11-16 00:28:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-16 00:28:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-16 00:28:29 [DEBUG   ] spawn_process: at 2018-11-16 00:28:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-16 00:28:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-16 00:28:29 [DEBUG   ] spawn_process: at 2018-11-16 00:28:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-16 00:28:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-16 00:28:29 [DEBUG   ] spawn_process: at 2018-11-16 00:28:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-16 00:28:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-16 00:28:29 [DEBUG   ] spawn_process: at 2018-11-16 00:28:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-16 00:28:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-16 00:28:29 [DEBUG   ] spawn_process: at 2018-11-16 00:28:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-16 00:28:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-16 00:28:29 [DEBUG   ] spawn_process: at 2018-11-16 00:28:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-16 00:28:41 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-16 00:28:59 [DEBUG   ] Got command BAM from MCS: ref #520824
2018-11-16 00:28:59 [INFO    ] Finished processing BAM request
2018-11-16 00:28:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:28:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520824   8 58438  1739025 A  ERROR'
2018-11-16 00:28:59 [DEBUG   ] Got command BAM from MCS: ref #520825
2018-11-16 00:28:59 [INFO    ] Finished processing BAM request
2018-11-16 00:28:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:28:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520825   8 58438  1739029 A  ERROR'
2018-11-16 00:28:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-16 00:28:59 [DEBUG   ] spawn_process: at 2018-11-16 00:28:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-16 00:28:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-16 00:28:59 [DEBUG   ] spawn_process: at 2018-11-16 00:28:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-16 00:28:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-16 00:28:59 [DEBUG   ] spawn_process: at 2018-11-16 00:28:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-16 00:28:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-16 00:28:59 [DEBUG   ] spawn_process: at 2018-11-16 00:28:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-16 00:28:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-16 00:28:59 [DEBUG   ] spawn_process: at 2018-11-16 00:28:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-16 00:28:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-16 00:28:59 [DEBUG   ] spawn_process: at 2018-11-16 00:28:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-16 00:28:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-16 00:28:59 [DEBUG   ] spawn_process: at 2018-11-16 00:28:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-16 00:28:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-16 00:28:59 [DEBUG   ] spawn_process: at 2018-11-16 00:28:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-16 00:28:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-16 00:28:59 [DEBUG   ] spawn_process: at 2018-11-16 00:28:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-16 00:28:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-16 00:28:59 [DEBUG   ] spawn_process: at 2018-11-16 00:28:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-16 00:28:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-16 00:28:59 [DEBUG   ] spawn_process: at 2018-11-16 00:28:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-16 00:28:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-16 00:28:59 [DEBUG   ] spawn_process: at 2018-11-16 00:28:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-16 00:28:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-16 00:28:59 [DEBUG   ] spawn_process: at 2018-11-16 00:28:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-16 00:28:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-16 00:28:59 [DEBUG   ] spawn_process: at 2018-11-16 00:28:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-16 00:28:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-16 00:28:59 [DEBUG   ] spawn_process: at 2018-11-16 00:28:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-16 00:28:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-16 00:28:59 [DEBUG   ] spawn_process: at 2018-11-16 00:28:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-16 00:28:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-16 00:28:59 [DEBUG   ] spawn_process: at 2018-11-16 00:28:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-16 00:28:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-16 00:28:59 [DEBUG   ] spawn_process: at 2018-11-16 00:28:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-16 00:28:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-16 00:28:59 [DEBUG   ] spawn_process: at 2018-11-16 00:28:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-16 00:28:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-16 00:28:59 [DEBUG   ] spawn_process: at 2018-11-16 00:28:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-16 00:28:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-16 00:28:59 [DEBUG   ] spawn_process: at 2018-11-16 00:28:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-16 00:28:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-16 00:28:59 [DEBUG   ] spawn_process: at 2018-11-16 00:28:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-16 00:28:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-16 00:28:59 [DEBUG   ] spawn_process: at 2018-11-16 00:28:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-16 00:28:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-16 00:28:59 [DEBUG   ] spawn_process: at 2018-11-16 00:28:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-16 00:28:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-16 00:28:59 [DEBUG   ] spawn_process: at 2018-11-16 00:28:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-16 00:28:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-16 00:28:59 [DEBUG   ] spawn_process: at 2018-11-16 00:28:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-16 00:29:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 00:29:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:29:03 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-16 00:29:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-16 00:29:03 [WARNING ] (13, 1, 'bot')
2018-11-16 00:29:03 [WARNING ] (13, 1, 'bot')
2018-11-16 00:29:03 [WARNING ] (13, 1, 'bot')
2018-11-16 00:29:03 [WARNING ] (13, 1, 'bot')
2018-11-16 00:29:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:29:03 [DEBUG   ] Finished updating board flags in 0.980 seconds
2018-11-16 00:29:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 00:29:29 [DEBUG   ] Got command BAM from MCS: ref #520827
2018-11-16 00:29:29 [INFO    ] Finished processing BAM request
2018-11-16 00:29:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:29:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520827   8 58438  1769025 A  ERROR'
2018-11-16 00:29:29 [DEBUG   ] Got command BAM from MCS: ref #520826
2018-11-16 00:29:29 [INFO    ] Finished processing BAM request
2018-11-16 00:29:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:29:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520826   8 58438  1769029 A  ERROR'
2018-11-16 00:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-16 00:29:29 [DEBUG   ] spawn_process: at 2018-11-16 00:29:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-16 00:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-16 00:29:29 [DEBUG   ] spawn_process: at 2018-11-16 00:29:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-16 00:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-16 00:29:29 [DEBUG   ] spawn_process: at 2018-11-16 00:29:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-16 00:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-16 00:29:29 [DEBUG   ] spawn_process: at 2018-11-16 00:29:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-16 00:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-16 00:29:29 [DEBUG   ] spawn_process: at 2018-11-16 00:29:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-16 00:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-16 00:29:29 [DEBUG   ] spawn_process: at 2018-11-16 00:29:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-16 00:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-16 00:29:29 [DEBUG   ] spawn_process: at 2018-11-16 00:29:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-16 00:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-16 00:29:29 [DEBUG   ] spawn_process: at 2018-11-16 00:29:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-16 00:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-16 00:29:29 [DEBUG   ] spawn_process: at 2018-11-16 00:29:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-16 00:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-16 00:29:29 [DEBUG   ] spawn_process: at 2018-11-16 00:29:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-16 00:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-16 00:29:29 [DEBUG   ] spawn_process: at 2018-11-16 00:29:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-16 00:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-16 00:29:29 [DEBUG   ] spawn_process: at 2018-11-16 00:29:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-16 00:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-16 00:29:29 [DEBUG   ] spawn_process: at 2018-11-16 00:29:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-16 00:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-16 00:29:29 [DEBUG   ] spawn_process: at 2018-11-16 00:29:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-16 00:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-16 00:29:29 [DEBUG   ] spawn_process: at 2018-11-16 00:29:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-16 00:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-16 00:29:29 [DEBUG   ] spawn_process: at 2018-11-16 00:29:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-16 00:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-16 00:29:29 [DEBUG   ] spawn_process: at 2018-11-16 00:29:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-16 00:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-16 00:29:29 [DEBUG   ] spawn_process: at 2018-11-16 00:29:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-16 00:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-16 00:29:29 [DEBUG   ] spawn_process: at 2018-11-16 00:29:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-16 00:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-16 00:29:29 [DEBUG   ] spawn_process: at 2018-11-16 00:29:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-16 00:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-16 00:29:29 [DEBUG   ] spawn_process: at 2018-11-16 00:29:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-16 00:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-16 00:29:29 [DEBUG   ] spawn_process: at 2018-11-16 00:29:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-16 00:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-16 00:29:29 [DEBUG   ] spawn_process: at 2018-11-16 00:29:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-16 00:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-16 00:29:29 [DEBUG   ] spawn_process: at 2018-11-16 00:29:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-16 00:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-16 00:29:29 [DEBUG   ] spawn_process: at 2018-11-16 00:29:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-16 00:29:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-16 00:29:29 [DEBUG   ] spawn_process: at 2018-11-16 00:29:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-16 00:29:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 00:29:59 [DEBUG   ] Got command BAM from MCS: ref #520832
2018-11-16 00:29:59 [INFO    ] Finished processing BAM request
2018-11-16 00:29:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:29:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520832   8 58438  1799025 A  ERROR'
2018-11-16 00:29:59 [DEBUG   ] Got command BAM from MCS: ref #520833
2018-11-16 00:29:59 [INFO    ] Finished processing BAM request
2018-11-16 00:29:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:29:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520833   8 58438  1799029 A  ERROR'
2018-11-16 00:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-16 00:29:59 [DEBUG   ] spawn_process: at 2018-11-16 00:29:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-16 00:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-16 00:29:59 [DEBUG   ] spawn_process: at 2018-11-16 00:29:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-16 00:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-16 00:29:59 [DEBUG   ] spawn_process: at 2018-11-16 00:29:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-16 00:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-16 00:29:59 [DEBUG   ] spawn_process: at 2018-11-16 00:29:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-16 00:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-16 00:29:59 [DEBUG   ] spawn_process: at 2018-11-16 00:29:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-16 00:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-16 00:29:59 [DEBUG   ] spawn_process: at 2018-11-16 00:29:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-16 00:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-16 00:29:59 [DEBUG   ] spawn_process: at 2018-11-16 00:29:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-16 00:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-16 00:29:59 [DEBUG   ] spawn_process: at 2018-11-16 00:29:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-16 00:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-16 00:29:59 [DEBUG   ] spawn_process: at 2018-11-16 00:29:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-16 00:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-16 00:29:59 [DEBUG   ] spawn_process: at 2018-11-16 00:29:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-16 00:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-16 00:29:59 [DEBUG   ] spawn_process: at 2018-11-16 00:29:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-16 00:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-16 00:29:59 [DEBUG   ] spawn_process: at 2018-11-16 00:29:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-16 00:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-16 00:29:59 [DEBUG   ] spawn_process: at 2018-11-16 00:29:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-16 00:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-16 00:29:59 [DEBUG   ] spawn_process: at 2018-11-16 00:29:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-16 00:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-16 00:29:59 [DEBUG   ] spawn_process: at 2018-11-16 00:29:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-16 00:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-16 00:29:59 [DEBUG   ] spawn_process: at 2018-11-16 00:29:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-16 00:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-16 00:29:59 [DEBUG   ] spawn_process: at 2018-11-16 00:29:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-16 00:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-16 00:29:59 [DEBUG   ] spawn_process: at 2018-11-16 00:29:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-16 00:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-16 00:29:59 [DEBUG   ] spawn_process: at 2018-11-16 00:29:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-16 00:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-16 00:29:59 [DEBUG   ] spawn_process: at 2018-11-16 00:29:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-16 00:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-16 00:29:59 [DEBUG   ] spawn_process: at 2018-11-16 00:29:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-16 00:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-16 00:29:59 [DEBUG   ] spawn_process: at 2018-11-16 00:29:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-16 00:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-16 00:29:59 [DEBUG   ] spawn_process: at 2018-11-16 00:29:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-16 00:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-16 00:29:59 [DEBUG   ] spawn_process: at 2018-11-16 00:29:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-16 00:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-16 00:29:59 [DEBUG   ] spawn_process: at 2018-11-16 00:29:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-16 00:29:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-16 00:29:59 [DEBUG   ] spawn_process: at 2018-11-16 00:29:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-16 00:30:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 00:30:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-16 00:30:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:30:04 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-16 00:30:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-16 00:30:04 [WARNING ] (13, 1, 'bot')
2018-11-16 00:30:04 [WARNING ] (13, 1, 'bot')
2018-11-16 00:30:04 [WARNING ] (13, 1, 'bot')
2018-11-16 00:30:04 [WARNING ] (13, 1, 'bot')
2018-11-16 00:30:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:30:04 [DEBUG   ] Finished updating board flags in 1.378 seconds
2018-11-16 00:30:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 00:30:29 [DEBUG   ] Got command BAM from MCS: ref #520834
2018-11-16 00:30:29 [INFO    ] Finished processing BAM request
2018-11-16 00:30:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:30:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520834   8 58438  1829029 A  ERROR'
2018-11-16 00:30:29 [DEBUG   ] Got command BAM from MCS: ref #520835
2018-11-16 00:30:29 [INFO    ] Finished processing BAM request
2018-11-16 00:30:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:30:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520835   8 58438  1829033 A  ERROR'
2018-11-16 00:30:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-16 00:30:29 [DEBUG   ] spawn_process: at 2018-11-16 00:30:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-16 00:30:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-16 00:30:29 [DEBUG   ] spawn_process: at 2018-11-16 00:30:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-16 00:30:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-16 00:30:29 [DEBUG   ] spawn_process: at 2018-11-16 00:30:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-16 00:30:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-16 00:30:29 [DEBUG   ] spawn_process: at 2018-11-16 00:30:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-16 00:30:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-16 00:30:29 [DEBUG   ] spawn_process: at 2018-11-16 00:30:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-16 00:30:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-16 00:30:29 [DEBUG   ] spawn_process: at 2018-11-16 00:30:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-16 00:30:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-16 00:30:29 [DEBUG   ] spawn_process: at 2018-11-16 00:30:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-16 00:30:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-16 00:30:29 [DEBUG   ] spawn_process: at 2018-11-16 00:30:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-16 00:30:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-16 00:30:29 [DEBUG   ] spawn_process: at 2018-11-16 00:30:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-16 00:30:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-16 00:30:29 [DEBUG   ] spawn_process: at 2018-11-16 00:30:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-16 00:30:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-16 00:30:29 [DEBUG   ] spawn_process: at 2018-11-16 00:30:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-16 00:30:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-16 00:30:29 [DEBUG   ] spawn_process: at 2018-11-16 00:30:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-16 00:30:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-16 00:30:29 [DEBUG   ] spawn_process: at 2018-11-16 00:30:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-16 00:30:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-16 00:30:29 [DEBUG   ] spawn_process: at 2018-11-16 00:30:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-16 00:30:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-16 00:30:29 [DEBUG   ] spawn_process: at 2018-11-16 00:30:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-16 00:30:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-16 00:30:29 [DEBUG   ] spawn_process: at 2018-11-16 00:30:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-16 00:30:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-16 00:30:29 [DEBUG   ] spawn_process: at 2018-11-16 00:30:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-16 00:30:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-16 00:30:29 [DEBUG   ] spawn_process: at 2018-11-16 00:30:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-16 00:30:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-16 00:30:29 [DEBUG   ] spawn_process: at 2018-11-16 00:30:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-16 00:30:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-16 00:30:29 [DEBUG   ] spawn_process: at 2018-11-16 00:30:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-16 00:30:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-16 00:30:29 [DEBUG   ] spawn_process: at 2018-11-16 00:30:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-16 00:30:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-16 00:30:29 [DEBUG   ] spawn_process: at 2018-11-16 00:30:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-16 00:30:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-16 00:30:29 [DEBUG   ] spawn_process: at 2018-11-16 00:30:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-16 00:30:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-16 00:30:29 [DEBUG   ] spawn_process: at 2018-11-16 00:30:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-16 00:30:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-16 00:30:29 [DEBUG   ] spawn_process: at 2018-11-16 00:30:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-16 00:30:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-16 00:30:29 [DEBUG   ] spawn_process: at 2018-11-16 00:30:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-16 00:30:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 00:30:45 [DEBUG   ] Got command RPT from MCS: ref #520836
2018-11-16 00:30:45 [DEBUG   ] summary = ERROR
2018-11-16 00:30:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520836  13 58438  1845249 A  ERRORERROR'
2018-11-16 00:30:45 [DEBUG   ] Got command RPT from MCS: ref #520837
2018-11-16 00:30:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 00:30:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520837  77 58438  1845250 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 00:30:59 [DEBUG   ] Got command BAM from MCS: ref #520853
2018-11-16 00:30:59 [INFO    ] Finished processing BAM request
2018-11-16 00:30:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:30:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520853   8 58438  1859033 A  ERROR'
2018-11-16 00:30:59 [DEBUG   ] Got command BAM from MCS: ref #520854
2018-11-16 00:30:59 [INFO    ] Finished processing BAM request
2018-11-16 00:30:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:30:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520854   8 58438  1859037 A  ERROR'
2018-11-16 00:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-16 00:30:59 [DEBUG   ] spawn_process: at 2018-11-16 00:30:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-16 00:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-16 00:30:59 [DEBUG   ] spawn_process: at 2018-11-16 00:30:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-16 00:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-16 00:30:59 [DEBUG   ] spawn_process: at 2018-11-16 00:30:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-16 00:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-16 00:30:59 [DEBUG   ] spawn_process: at 2018-11-16 00:30:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-16 00:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-16 00:30:59 [DEBUG   ] spawn_process: at 2018-11-16 00:30:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-16 00:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-16 00:30:59 [DEBUG   ] spawn_process: at 2018-11-16 00:30:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-16 00:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-16 00:30:59 [DEBUG   ] spawn_process: at 2018-11-16 00:30:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-16 00:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-16 00:30:59 [DEBUG   ] spawn_process: at 2018-11-16 00:30:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-16 00:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-16 00:30:59 [DEBUG   ] spawn_process: at 2018-11-16 00:30:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-16 00:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-16 00:30:59 [DEBUG   ] spawn_process: at 2018-11-16 00:30:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-16 00:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-16 00:30:59 [DEBUG   ] spawn_process: at 2018-11-16 00:30:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-16 00:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-16 00:30:59 [DEBUG   ] spawn_process: at 2018-11-16 00:30:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-16 00:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-16 00:30:59 [DEBUG   ] spawn_process: at 2018-11-16 00:30:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-16 00:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-16 00:30:59 [DEBUG   ] spawn_process: at 2018-11-16 00:30:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-16 00:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-16 00:30:59 [DEBUG   ] spawn_process: at 2018-11-16 00:30:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-16 00:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-16 00:30:59 [DEBUG   ] spawn_process: at 2018-11-16 00:30:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-16 00:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-16 00:30:59 [DEBUG   ] spawn_process: at 2018-11-16 00:30:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-16 00:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-16 00:30:59 [DEBUG   ] spawn_process: at 2018-11-16 00:30:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-16 00:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-16 00:30:59 [DEBUG   ] spawn_process: at 2018-11-16 00:30:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-16 00:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-16 00:30:59 [DEBUG   ] spawn_process: at 2018-11-16 00:30:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-16 00:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-16 00:30:59 [DEBUG   ] spawn_process: at 2018-11-16 00:30:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-16 00:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-16 00:30:59 [DEBUG   ] spawn_process: at 2018-11-16 00:30:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-16 00:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-16 00:30:59 [DEBUG   ] spawn_process: at 2018-11-16 00:30:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-16 00:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-16 00:30:59 [DEBUG   ] spawn_process: at 2018-11-16 00:30:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-16 00:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-16 00:30:59 [DEBUG   ] spawn_process: at 2018-11-16 00:30:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-16 00:30:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-16 00:30:59 [DEBUG   ] spawn_process: at 2018-11-16 00:30:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-16 00:31:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 00:31:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-16 00:31:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:31:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 00:31:04 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-16 00:31:04 [WARNING ] (13, 1, 'bot')
2018-11-16 00:31:04 [WARNING ] (13, 1, 'bot')
2018-11-16 00:31:04 [WARNING ] (13, 1, 'bot')
2018-11-16 00:31:04 [WARNING ] (13, 1, 'bot')
2018-11-16 00:31:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:31:04 [DEBUG   ] Finished updating board flags in 1.185 seconds
2018-11-16 00:31:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 00:31:29 [DEBUG   ] Got command BAM from MCS: ref #520855
2018-11-16 00:31:29 [INFO    ] Finished processing BAM request
2018-11-16 00:31:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:31:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520855   8 58438  1889033 A  ERROR'
2018-11-16 00:31:29 [DEBUG   ] Got command BAM from MCS: ref #520856
2018-11-16 00:31:29 [INFO    ] Finished processing BAM request
2018-11-16 00:31:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:31:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520856   8 58438  1889037 A  ERROR'
2018-11-16 00:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-16 00:31:29 [DEBUG   ] spawn_process: at 2018-11-16 00:31:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-16 00:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-16 00:31:29 [DEBUG   ] spawn_process: at 2018-11-16 00:31:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-16 00:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-16 00:31:29 [DEBUG   ] spawn_process: at 2018-11-16 00:31:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-16 00:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-16 00:31:29 [DEBUG   ] spawn_process: at 2018-11-16 00:31:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-16 00:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-16 00:31:29 [DEBUG   ] spawn_process: at 2018-11-16 00:31:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-16 00:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-16 00:31:29 [DEBUG   ] spawn_process: at 2018-11-16 00:31:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-16 00:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-16 00:31:29 [DEBUG   ] spawn_process: at 2018-11-16 00:31:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-16 00:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-16 00:31:29 [DEBUG   ] spawn_process: at 2018-11-16 00:31:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-16 00:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-16 00:31:29 [DEBUG   ] spawn_process: at 2018-11-16 00:31:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-16 00:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-16 00:31:29 [DEBUG   ] spawn_process: at 2018-11-16 00:31:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-16 00:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-16 00:31:29 [DEBUG   ] spawn_process: at 2018-11-16 00:31:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-16 00:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-16 00:31:29 [DEBUG   ] spawn_process: at 2018-11-16 00:31:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-16 00:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-16 00:31:29 [DEBUG   ] spawn_process: at 2018-11-16 00:31:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-16 00:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-16 00:31:29 [DEBUG   ] spawn_process: at 2018-11-16 00:31:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-16 00:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-16 00:31:29 [DEBUG   ] spawn_process: at 2018-11-16 00:31:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-16 00:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-16 00:31:29 [DEBUG   ] spawn_process: at 2018-11-16 00:31:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-16 00:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-16 00:31:29 [DEBUG   ] spawn_process: at 2018-11-16 00:31:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-16 00:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-16 00:31:29 [DEBUG   ] spawn_process: at 2018-11-16 00:31:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-16 00:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-16 00:31:29 [DEBUG   ] spawn_process: at 2018-11-16 00:31:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-16 00:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-16 00:31:29 [DEBUG   ] spawn_process: at 2018-11-16 00:31:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-16 00:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-16 00:31:29 [DEBUG   ] spawn_process: at 2018-11-16 00:31:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-16 00:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-16 00:31:29 [DEBUG   ] spawn_process: at 2018-11-16 00:31:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-16 00:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-16 00:31:29 [DEBUG   ] spawn_process: at 2018-11-16 00:31:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-16 00:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-16 00:31:29 [DEBUG   ] spawn_process: at 2018-11-16 00:31:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-16 00:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-16 00:31:29 [DEBUG   ] spawn_process: at 2018-11-16 00:31:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-16 00:31:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-16 00:31:29 [DEBUG   ] spawn_process: at 2018-11-16 00:31:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-16 00:31:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 00:31:59 [DEBUG   ] Got command BAM from MCS: ref #520858
2018-11-16 00:31:59 [INFO    ] Finished processing BAM request
2018-11-16 00:31:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:31:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520858   8 58438  1919029 A  ERROR'
2018-11-16 00:31:59 [DEBUG   ] Got command BAM from MCS: ref #520857
2018-11-16 00:31:59 [INFO    ] Finished processing BAM request
2018-11-16 00:31:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:31:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520857   8 58438  1919033 A  ERROR'
2018-11-16 00:31:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-16 00:31:59 [DEBUG   ] spawn_process: at 2018-11-16 00:31:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-16 00:31:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-16 00:31:59 [DEBUG   ] spawn_process: at 2018-11-16 00:31:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-16 00:31:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-16 00:31:59 [DEBUG   ] spawn_process: at 2018-11-16 00:31:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-16 00:31:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-16 00:31:59 [DEBUG   ] spawn_process: at 2018-11-16 00:31:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-16 00:31:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-16 00:31:59 [DEBUG   ] spawn_process: at 2018-11-16 00:31:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-16 00:31:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-16 00:31:59 [DEBUG   ] spawn_process: at 2018-11-16 00:31:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-16 00:31:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-16 00:31:59 [DEBUG   ] spawn_process: at 2018-11-16 00:31:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-16 00:31:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-16 00:31:59 [DEBUG   ] spawn_process: at 2018-11-16 00:31:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-16 00:31:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-16 00:31:59 [DEBUG   ] spawn_process: at 2018-11-16 00:31:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-16 00:31:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-16 00:31:59 [DEBUG   ] spawn_process: at 2018-11-16 00:31:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-16 00:31:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-16 00:31:59 [DEBUG   ] spawn_process: at 2018-11-16 00:31:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-16 00:31:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-16 00:31:59 [DEBUG   ] spawn_process: at 2018-11-16 00:31:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-16 00:31:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-16 00:31:59 [DEBUG   ] spawn_process: at 2018-11-16 00:31:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-16 00:31:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-16 00:31:59 [DEBUG   ] spawn_process: at 2018-11-16 00:31:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-16 00:31:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-16 00:31:59 [DEBUG   ] spawn_process: at 2018-11-16 00:31:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-16 00:31:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-16 00:31:59 [DEBUG   ] spawn_process: at 2018-11-16 00:31:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-16 00:31:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-16 00:31:59 [DEBUG   ] spawn_process: at 2018-11-16 00:31:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-16 00:31:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-16 00:31:59 [DEBUG   ] spawn_process: at 2018-11-16 00:31:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-16 00:31:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-16 00:31:59 [DEBUG   ] spawn_process: at 2018-11-16 00:31:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-16 00:31:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-16 00:31:59 [DEBUG   ] spawn_process: at 2018-11-16 00:31:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-16 00:31:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-16 00:31:59 [DEBUG   ] spawn_process: at 2018-11-16 00:31:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-16 00:31:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-16 00:31:59 [DEBUG   ] spawn_process: at 2018-11-16 00:31:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-16 00:31:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-16 00:31:59 [DEBUG   ] spawn_process: at 2018-11-16 00:31:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-16 00:31:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-16 00:31:59 [DEBUG   ] spawn_process: at 2018-11-16 00:31:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-16 00:31:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-16 00:31:59 [DEBUG   ] spawn_process: at 2018-11-16 00:31:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-16 00:31:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-16 00:31:59 [DEBUG   ] spawn_process: at 2018-11-16 00:31:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-16 00:32:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 00:32:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 00:32:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-16 00:32:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-11-16 00:32:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:32:04 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-16 00:32:04 [WARNING ] (13, 1, 'bot')
2018-11-16 00:32:04 [WARNING ] (13, 1, 'bot')
2018-11-16 00:32:04 [WARNING ] (13, 1, 'bot')
2018-11-16 00:32:04 [WARNING ] (13, 1, 'bot')
2018-11-16 00:32:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:32:04 [DEBUG   ] Finished updating board flags in 0.992 seconds
2018-11-16 00:32:22 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 00:32:30 [DEBUG   ] Got command BAM from MCS: ref #520859
2018-11-16 00:32:30 [INFO    ] Finished processing BAM request
2018-11-16 00:32:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:32:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520859   8 58438  1950025 A  ERROR'
2018-11-16 00:32:30 [DEBUG   ] Got command BAM from MCS: ref #520860
2018-11-16 00:32:30 [INFO    ] Finished processing BAM request
2018-11-16 00:32:30 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:32:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520860   8 58438  1950029 A  ERROR'
2018-11-16 00:32:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-16 00:32:30 [DEBUG   ] spawn_process: at 2018-11-16 00:32:30 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-16 00:32:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-16 00:32:30 [DEBUG   ] spawn_process: at 2018-11-16 00:32:30 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-16 00:32:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-16 00:32:30 [DEBUG   ] spawn_process: at 2018-11-16 00:32:30 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-16 00:32:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-16 00:32:30 [DEBUG   ] spawn_process: at 2018-11-16 00:32:30 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-16 00:32:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-16 00:32:30 [DEBUG   ] spawn_process: at 2018-11-16 00:32:30 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-16 00:32:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-16 00:32:30 [DEBUG   ] spawn_process: at 2018-11-16 00:32:30 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-16 00:32:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-16 00:32:30 [DEBUG   ] spawn_process: at 2018-11-16 00:32:30 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-16 00:32:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-16 00:32:30 [DEBUG   ] spawn_process: at 2018-11-16 00:32:30 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-16 00:32:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-16 00:32:30 [DEBUG   ] spawn_process: at 2018-11-16 00:32:30 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-16 00:32:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-16 00:32:30 [DEBUG   ] spawn_process: at 2018-11-16 00:32:30 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-16 00:32:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-16 00:32:30 [DEBUG   ] spawn_process: at 2018-11-16 00:32:30 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-16 00:32:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-16 00:32:30 [DEBUG   ] spawn_process: at 2018-11-16 00:32:30 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-16 00:32:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-16 00:32:30 [DEBUG   ] spawn_process: at 2018-11-16 00:32:30 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-16 00:32:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-16 00:32:30 [DEBUG   ] spawn_process: at 2018-11-16 00:32:30 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-16 00:32:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-16 00:32:30 [DEBUG   ] spawn_process: at 2018-11-16 00:32:30 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-16 00:32:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-16 00:32:30 [DEBUG   ] spawn_process: at 2018-11-16 00:32:30 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-16 00:32:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-16 00:32:30 [DEBUG   ] spawn_process: at 2018-11-16 00:32:30 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-16 00:32:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-16 00:32:30 [DEBUG   ] spawn_process: at 2018-11-16 00:32:30 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-16 00:32:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-16 00:32:30 [DEBUG   ] spawn_process: at 2018-11-16 00:32:30 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-16 00:32:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-16 00:32:30 [DEBUG   ] spawn_process: at 2018-11-16 00:32:30 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-16 00:32:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-16 00:32:30 [DEBUG   ] spawn_process: at 2018-11-16 00:32:30 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-16 00:32:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-16 00:32:30 [DEBUG   ] spawn_process: at 2018-11-16 00:32:30 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-16 00:32:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-16 00:32:30 [DEBUG   ] spawn_process: at 2018-11-16 00:32:30 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-16 00:32:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-16 00:32:30 [DEBUG   ] spawn_process: at 2018-11-16 00:32:30 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-16 00:32:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-16 00:32:30 [DEBUG   ] spawn_process: at 2018-11-16 00:32:30 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-16 00:32:30 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-16 00:32:30 [DEBUG   ] spawn_process: at 2018-11-16 00:32:30 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-16 00:32:42 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 00:33:01 [DEBUG   ] Got command BAM from MCS: ref #520865
2018-11-16 00:33:01 [INFO    ] Finished processing BAM request
2018-11-16 00:33:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:33:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520865   8 58438  1981025 A  ERROR'
2018-11-16 00:33:01 [DEBUG   ] Got command BAM from MCS: ref #520866
2018-11-16 00:33:01 [INFO    ] Finished processing BAM request
2018-11-16 00:33:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:33:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520866   8 58438  1981029 A  ERROR'
2018-11-16 00:33:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-16 00:33:01 [DEBUG   ] spawn_process: at 2018-11-16 00:33:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-16 00:33:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-16 00:33:01 [DEBUG   ] spawn_process: at 2018-11-16 00:33:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-16 00:33:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-16 00:33:01 [DEBUG   ] spawn_process: at 2018-11-16 00:33:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-16 00:33:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-16 00:33:01 [DEBUG   ] spawn_process: at 2018-11-16 00:33:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-16 00:33:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-16 00:33:01 [DEBUG   ] spawn_process: at 2018-11-16 00:33:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-16 00:33:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-16 00:33:01 [DEBUG   ] spawn_process: at 2018-11-16 00:33:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-16 00:33:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-16 00:33:01 [DEBUG   ] spawn_process: at 2018-11-16 00:33:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-16 00:33:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-16 00:33:01 [DEBUG   ] spawn_process: at 2018-11-16 00:33:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-16 00:33:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-16 00:33:01 [DEBUG   ] spawn_process: at 2018-11-16 00:33:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-16 00:33:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-16 00:33:01 [DEBUG   ] spawn_process: at 2018-11-16 00:33:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-16 00:33:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-16 00:33:01 [DEBUG   ] spawn_process: at 2018-11-16 00:33:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-16 00:33:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-16 00:33:01 [DEBUG   ] spawn_process: at 2018-11-16 00:33:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-16 00:33:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-16 00:33:01 [DEBUG   ] spawn_process: at 2018-11-16 00:33:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-16 00:33:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-16 00:33:01 [DEBUG   ] spawn_process: at 2018-11-16 00:33:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-16 00:33:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-16 00:33:01 [DEBUG   ] spawn_process: at 2018-11-16 00:33:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-16 00:33:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-16 00:33:01 [DEBUG   ] spawn_process: at 2018-11-16 00:33:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-16 00:33:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-16 00:33:01 [DEBUG   ] spawn_process: at 2018-11-16 00:33:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-16 00:33:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-16 00:33:01 [DEBUG   ] spawn_process: at 2018-11-16 00:33:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-16 00:33:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-16 00:33:01 [DEBUG   ] spawn_process: at 2018-11-16 00:33:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-16 00:33:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-16 00:33:01 [DEBUG   ] spawn_process: at 2018-11-16 00:33:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-16 00:33:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-16 00:33:01 [DEBUG   ] spawn_process: at 2018-11-16 00:33:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-16 00:33:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-16 00:33:01 [DEBUG   ] spawn_process: at 2018-11-16 00:33:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-16 00:33:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-16 00:33:01 [DEBUG   ] spawn_process: at 2018-11-16 00:33:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-16 00:33:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-16 00:33:01 [DEBUG   ] spawn_process: at 2018-11-16 00:33:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-16 00:33:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-16 00:33:01 [DEBUG   ] spawn_process: at 2018-11-16 00:33:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-16 00:33:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-16 00:33:01 [DEBUG   ] spawn_process: at 2018-11-16 00:33:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-16 00:33:02 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-16 00:33:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:33:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-16 00:33:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-16 00:33:05 [WARNING ] (13, 1, 'bot')
2018-11-16 00:33:05 [WARNING ] (13, 1, 'bot')
2018-11-16 00:33:05 [WARNING ] (13, 1, 'bot')
2018-11-16 00:33:05 [WARNING ] (13, 1, 'bot')
2018-11-16 00:33:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:33:05 [DEBUG   ] Finished updating board flags in 1.809 seconds
2018-11-16 00:33:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 00:33:27 [DEBUG   ] Got command RPT from MCS: ref #520867
2018-11-16 00:33:27 [DEBUG   ] summary = ERROR
2018-11-16 00:33:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520867  13 58438  2007829 A  ERRORERROR'
2018-11-16 00:33:28 [DEBUG   ] Got command RPT from MCS: ref #520868
2018-11-16 00:33:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 00:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520868  77 58438  2008021 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 00:33:28 [DEBUG   ] Got command RPT from MCS: ref #520869
2018-11-16 00:33:28 [DEBUG   ] summary = ERROR
2018-11-16 00:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520869  13 58438  2008225 A  ERRORERROR'
2018-11-16 00:33:28 [DEBUG   ] Got command RPT from MCS: ref #520870
2018-11-16 00:33:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 00:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520870  77 58438  2008429 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 00:33:28 [DEBUG   ] Got command RPT from MCS: ref #520871
2018-11-16 00:33:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 00:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520871  12 58438  2008633 A  ERRORB¢ff'
2018-11-16 00:33:32 [DEBUG   ] Got command BAM from MCS: ref #520872
2018-11-16 00:33:32 [INFO    ] Finished processing BAM request
2018-11-16 00:33:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:33:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520872   8 58438  2012033 A  ERROR'
2018-11-16 00:33:32 [DEBUG   ] Got command BAM from MCS: ref #520873
2018-11-16 00:33:32 [INFO    ] Finished processing BAM request
2018-11-16 00:33:32 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:33:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520873   8 58438  2012037 A  ERROR'
2018-11-16 00:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-16 00:33:32 [DEBUG   ] spawn_process: at 2018-11-16 00:33:32 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-16 00:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-16 00:33:32 [DEBUG   ] spawn_process: at 2018-11-16 00:33:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-16 00:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-16 00:33:32 [DEBUG   ] spawn_process: at 2018-11-16 00:33:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-16 00:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-16 00:33:32 [DEBUG   ] spawn_process: at 2018-11-16 00:33:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-16 00:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-16 00:33:32 [DEBUG   ] spawn_process: at 2018-11-16 00:33:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-16 00:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-16 00:33:32 [DEBUG   ] spawn_process: at 2018-11-16 00:33:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-16 00:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-16 00:33:32 [DEBUG   ] spawn_process: at 2018-11-16 00:33:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-16 00:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-16 00:33:32 [DEBUG   ] spawn_process: at 2018-11-16 00:33:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-16 00:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-16 00:33:32 [DEBUG   ] spawn_process: at 2018-11-16 00:33:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-16 00:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-16 00:33:32 [DEBUG   ] spawn_process: at 2018-11-16 00:33:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-16 00:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-16 00:33:32 [DEBUG   ] spawn_process: at 2018-11-16 00:33:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-16 00:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-16 00:33:32 [DEBUG   ] spawn_process: at 2018-11-16 00:33:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-16 00:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-16 00:33:32 [DEBUG   ] spawn_process: at 2018-11-16 00:33:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-16 00:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-16 00:33:32 [DEBUG   ] spawn_process: at 2018-11-16 00:33:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-16 00:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-16 00:33:32 [DEBUG   ] spawn_process: at 2018-11-16 00:33:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-16 00:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-16 00:33:32 [DEBUG   ] spawn_process: at 2018-11-16 00:33:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-16 00:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-16 00:33:32 [DEBUG   ] spawn_process: at 2018-11-16 00:33:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-16 00:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-16 00:33:32 [DEBUG   ] spawn_process: at 2018-11-16 00:33:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-16 00:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-16 00:33:32 [DEBUG   ] spawn_process: at 2018-11-16 00:33:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-16 00:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-16 00:33:32 [DEBUG   ] spawn_process: at 2018-11-16 00:33:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-16 00:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-16 00:33:32 [DEBUG   ] spawn_process: at 2018-11-16 00:33:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-16 00:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-16 00:33:32 [DEBUG   ] spawn_process: at 2018-11-16 00:33:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-16 00:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-16 00:33:32 [DEBUG   ] spawn_process: at 2018-11-16 00:33:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-16 00:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-16 00:33:32 [DEBUG   ] spawn_process: at 2018-11-16 00:33:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-16 00:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-16 00:33:32 [DEBUG   ] spawn_process: at 2018-11-16 00:33:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-16 00:33:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-16 00:33:32 [DEBUG   ] spawn_process: at 2018-11-16 00:33:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-16 00:33:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 00:34:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 00:34:03 [DEBUG   ] Got command BAM from MCS: ref #520875
2018-11-16 00:34:03 [INFO    ] Finished processing BAM request
2018-11-16 00:34:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:34:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520875   8 58438  2043029 A  ERROR'
2018-11-16 00:34:03 [DEBUG   ] Got command BAM from MCS: ref #520874
2018-11-16 00:34:03 [INFO    ] Finished processing BAM request
2018-11-16 00:34:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:34:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520874   8 58438  2043033 A  ERROR'
2018-11-16 00:34:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-16 00:34:03 [DEBUG   ] spawn_process: at 2018-11-16 00:34:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-16 00:34:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-16 00:34:03 [DEBUG   ] spawn_process: at 2018-11-16 00:34:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-16 00:34:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-16 00:34:03 [DEBUG   ] spawn_process: at 2018-11-16 00:34:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-16 00:34:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-16 00:34:03 [DEBUG   ] spawn_process: at 2018-11-16 00:34:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-16 00:34:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-16 00:34:03 [DEBUG   ] spawn_process: at 2018-11-16 00:34:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-16 00:34:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-16 00:34:03 [DEBUG   ] spawn_process: at 2018-11-16 00:34:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-16 00:34:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-16 00:34:03 [DEBUG   ] spawn_process: at 2018-11-16 00:34:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-16 00:34:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-16 00:34:03 [DEBUG   ] spawn_process: at 2018-11-16 00:34:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-16 00:34:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-16 00:34:03 [DEBUG   ] spawn_process: at 2018-11-16 00:34:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-16 00:34:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-16 00:34:03 [DEBUG   ] spawn_process: at 2018-11-16 00:34:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-16 00:34:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-16 00:34:03 [DEBUG   ] spawn_process: at 2018-11-16 00:34:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-16 00:34:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-16 00:34:03 [DEBUG   ] spawn_process: at 2018-11-16 00:34:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-16 00:34:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-16 00:34:03 [DEBUG   ] spawn_process: at 2018-11-16 00:34:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-16 00:34:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-16 00:34:03 [DEBUG   ] spawn_process: at 2018-11-16 00:34:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-16 00:34:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-16 00:34:03 [DEBUG   ] spawn_process: at 2018-11-16 00:34:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-16 00:34:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-16 00:34:03 [DEBUG   ] spawn_process: at 2018-11-16 00:34:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-16 00:34:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-16 00:34:03 [DEBUG   ] spawn_process: at 2018-11-16 00:34:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-16 00:34:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-16 00:34:03 [DEBUG   ] spawn_process: at 2018-11-16 00:34:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-16 00:34:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-16 00:34:03 [DEBUG   ] spawn_process: at 2018-11-16 00:34:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-16 00:34:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-16 00:34:03 [DEBUG   ] spawn_process: at 2018-11-16 00:34:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-16 00:34:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-16 00:34:03 [DEBUG   ] spawn_process: at 2018-11-16 00:34:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-16 00:34:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-16 00:34:03 [DEBUG   ] spawn_process: at 2018-11-16 00:34:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-16 00:34:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-16 00:34:03 [DEBUG   ] spawn_process: at 2018-11-16 00:34:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-16 00:34:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-16 00:34:03 [DEBUG   ] spawn_process: at 2018-11-16 00:34:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-16 00:34:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-16 00:34:03 [DEBUG   ] spawn_process: at 2018-11-16 00:34:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-16 00:34:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-16 00:34:03 [DEBUG   ] spawn_process: at 2018-11-16 00:34:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-16 00:34:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-11-16 00:34:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 5
2018-11-16 00:34:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:34:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 00:34:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-16 00:34:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-16 00:34:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-16 00:34:05 [WARNING ] (13, 1, 'bot')
2018-11-16 00:34:05 [WARNING ] (13, 1, 'bot')
2018-11-16 00:34:05 [WARNING ] (13, 1, 'bot')
2018-11-16 00:34:05 [WARNING ] (13, 1, 'bot')
2018-11-16 00:34:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:34:05 [DEBUG   ] Finished updating board flags in 1.796 seconds
2018-11-16 00:34:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 00:34:34 [DEBUG   ] Got command BAM from MCS: ref #520877
2018-11-16 00:34:34 [INFO    ] Finished processing BAM request
2018-11-16 00:34:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:34:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520877   8 58438  2074033 A  ERROR'
2018-11-16 00:34:34 [DEBUG   ] Got command BAM from MCS: ref #520876
2018-11-16 00:34:34 [INFO    ] Finished processing BAM request
2018-11-16 00:34:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:34:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520876   8 58438  2074041 A  ERROR'
2018-11-16 00:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-16 00:34:34 [DEBUG   ] spawn_process: at 2018-11-16 00:34:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-16 00:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-16 00:34:34 [DEBUG   ] spawn_process: at 2018-11-16 00:34:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-16 00:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-16 00:34:34 [DEBUG   ] spawn_process: at 2018-11-16 00:34:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-16 00:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-16 00:34:34 [DEBUG   ] spawn_process: at 2018-11-16 00:34:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-16 00:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-16 00:34:34 [DEBUG   ] spawn_process: at 2018-11-16 00:34:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-16 00:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-16 00:34:34 [DEBUG   ] spawn_process: at 2018-11-16 00:34:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-16 00:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-16 00:34:34 [DEBUG   ] spawn_process: at 2018-11-16 00:34:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-16 00:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-16 00:34:34 [DEBUG   ] spawn_process: at 2018-11-16 00:34:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-16 00:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-16 00:34:34 [DEBUG   ] spawn_process: at 2018-11-16 00:34:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-16 00:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-16 00:34:34 [DEBUG   ] spawn_process: at 2018-11-16 00:34:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-16 00:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-16 00:34:34 [DEBUG   ] spawn_process: at 2018-11-16 00:34:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-16 00:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-16 00:34:34 [DEBUG   ] spawn_process: at 2018-11-16 00:34:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-16 00:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-16 00:34:34 [DEBUG   ] spawn_process: at 2018-11-16 00:34:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-16 00:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-16 00:34:34 [DEBUG   ] spawn_process: at 2018-11-16 00:34:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-16 00:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-16 00:34:34 [DEBUG   ] spawn_process: at 2018-11-16 00:34:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-16 00:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-16 00:34:34 [DEBUG   ] spawn_process: at 2018-11-16 00:34:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-16 00:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-16 00:34:34 [DEBUG   ] spawn_process: at 2018-11-16 00:34:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-16 00:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-16 00:34:34 [DEBUG   ] spawn_process: at 2018-11-16 00:34:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-16 00:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-16 00:34:34 [DEBUG   ] spawn_process: at 2018-11-16 00:34:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-16 00:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-16 00:34:34 [DEBUG   ] spawn_process: at 2018-11-16 00:34:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-16 00:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-16 00:34:34 [DEBUG   ] spawn_process: at 2018-11-16 00:34:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-16 00:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-16 00:34:34 [DEBUG   ] spawn_process: at 2018-11-16 00:34:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-16 00:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-16 00:34:34 [DEBUG   ] spawn_process: at 2018-11-16 00:34:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-16 00:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-16 00:34:34 [DEBUG   ] spawn_process: at 2018-11-16 00:34:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-16 00:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-16 00:34:34 [DEBUG   ] spawn_process: at 2018-11-16 00:34:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-16 00:34:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-16 00:34:34 [DEBUG   ] spawn_process: at 2018-11-16 00:34:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-16 00:34:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 00:35:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 00:35:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-16 00:35:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:35:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-16 00:35:04 [WARNING ] (13, 1, 'bot')
2018-11-16 00:35:04 [WARNING ] (13, 1, 'bot')
2018-11-16 00:35:04 [WARNING ] (13, 1, 'bot')
2018-11-16 00:35:04 [WARNING ] (13, 1, 'bot')
2018-11-16 00:35:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:35:04 [DEBUG   ] Finished updating board flags in 1.123 seconds
2018-11-16 00:35:05 [DEBUG   ] Got command BAM from MCS: ref #520879
2018-11-16 00:35:05 [INFO    ] Finished processing BAM request
2018-11-16 00:35:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:35:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520879   8 58438  2105033 A  ERROR'
2018-11-16 00:35:05 [DEBUG   ] Got command BAM from MCS: ref #520878
2018-11-16 00:35:05 [INFO    ] Finished processing BAM request
2018-11-16 00:35:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:35:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520878   8 58438  2105037 A  ERROR'
2018-11-16 00:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-16 00:35:05 [DEBUG   ] spawn_process: at 2018-11-16 00:35:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-16 00:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-16 00:35:05 [DEBUG   ] spawn_process: at 2018-11-16 00:35:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-16 00:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-16 00:35:05 [DEBUG   ] spawn_process: at 2018-11-16 00:35:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-16 00:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-16 00:35:05 [DEBUG   ] spawn_process: at 2018-11-16 00:35:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-16 00:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-16 00:35:05 [DEBUG   ] spawn_process: at 2018-11-16 00:35:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-16 00:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-16 00:35:05 [DEBUG   ] spawn_process: at 2018-11-16 00:35:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-16 00:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-16 00:35:05 [DEBUG   ] spawn_process: at 2018-11-16 00:35:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-16 00:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-16 00:35:05 [DEBUG   ] spawn_process: at 2018-11-16 00:35:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-16 00:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-16 00:35:05 [DEBUG   ] spawn_process: at 2018-11-16 00:35:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-16 00:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-16 00:35:05 [DEBUG   ] spawn_process: at 2018-11-16 00:35:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-16 00:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-16 00:35:05 [DEBUG   ] spawn_process: at 2018-11-16 00:35:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-16 00:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-16 00:35:05 [DEBUG   ] spawn_process: at 2018-11-16 00:35:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-16 00:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-16 00:35:05 [DEBUG   ] spawn_process: at 2018-11-16 00:35:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-16 00:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-16 00:35:05 [DEBUG   ] spawn_process: at 2018-11-16 00:35:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-16 00:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-16 00:35:05 [DEBUG   ] spawn_process: at 2018-11-16 00:35:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-16 00:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-16 00:35:05 [DEBUG   ] spawn_process: at 2018-11-16 00:35:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-16 00:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-16 00:35:05 [DEBUG   ] spawn_process: at 2018-11-16 00:35:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-16 00:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-16 00:35:05 [DEBUG   ] spawn_process: at 2018-11-16 00:35:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-16 00:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-16 00:35:05 [DEBUG   ] spawn_process: at 2018-11-16 00:35:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-16 00:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-16 00:35:05 [DEBUG   ] spawn_process: at 2018-11-16 00:35:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-16 00:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-16 00:35:05 [DEBUG   ] spawn_process: at 2018-11-16 00:35:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-16 00:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-16 00:35:05 [DEBUG   ] spawn_process: at 2018-11-16 00:35:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-16 00:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-16 00:35:05 [DEBUG   ] spawn_process: at 2018-11-16 00:35:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-16 00:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-16 00:35:05 [DEBUG   ] spawn_process: at 2018-11-16 00:35:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-16 00:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-16 00:35:05 [DEBUG   ] spawn_process: at 2018-11-16 00:35:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-16 00:35:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-16 00:35:05 [DEBUG   ] spawn_process: at 2018-11-16 00:35:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-16 00:35:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 00:35:36 [DEBUG   ] Got command BAM from MCS: ref #520884
2018-11-16 00:35:36 [INFO    ] Finished processing BAM request
2018-11-16 00:35:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:35:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520884   8 58438  2136029 A  ERROR'
2018-11-16 00:35:36 [DEBUG   ] Got command BAM from MCS: ref #520885
2018-11-16 00:35:36 [INFO    ] Finished processing BAM request
2018-11-16 00:35:36 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:35:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520885   8 58438  2136033 A  ERROR'
2018-11-16 00:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-16 00:35:36 [DEBUG   ] spawn_process: at 2018-11-16 00:35:36 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-16 00:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-16 00:35:36 [DEBUG   ] spawn_process: at 2018-11-16 00:35:36 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-16 00:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-16 00:35:36 [DEBUG   ] spawn_process: at 2018-11-16 00:35:36 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-16 00:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-16 00:35:36 [DEBUG   ] spawn_process: at 2018-11-16 00:35:36 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-16 00:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-16 00:35:36 [DEBUG   ] spawn_process: at 2018-11-16 00:35:36 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-16 00:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-16 00:35:36 [DEBUG   ] spawn_process: at 2018-11-16 00:35:36 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-16 00:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-16 00:35:36 [DEBUG   ] spawn_process: at 2018-11-16 00:35:36 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-16 00:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-16 00:35:36 [DEBUG   ] spawn_process: at 2018-11-16 00:35:36 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-16 00:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-16 00:35:36 [DEBUG   ] spawn_process: at 2018-11-16 00:35:36 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-16 00:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-16 00:35:36 [DEBUG   ] spawn_process: at 2018-11-16 00:35:36 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-16 00:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-16 00:35:36 [DEBUG   ] spawn_process: at 2018-11-16 00:35:36 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-16 00:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-16 00:35:36 [DEBUG   ] spawn_process: at 2018-11-16 00:35:36 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-16 00:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-16 00:35:36 [DEBUG   ] spawn_process: at 2018-11-16 00:35:36 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-16 00:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-16 00:35:36 [DEBUG   ] spawn_process: at 2018-11-16 00:35:36 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-16 00:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-16 00:35:36 [DEBUG   ] spawn_process: at 2018-11-16 00:35:36 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-16 00:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-16 00:35:36 [DEBUG   ] spawn_process: at 2018-11-16 00:35:36 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-16 00:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-16 00:35:36 [DEBUG   ] spawn_process: at 2018-11-16 00:35:36 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-16 00:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-16 00:35:36 [DEBUG   ] spawn_process: at 2018-11-16 00:35:36 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-16 00:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-16 00:35:36 [DEBUG   ] spawn_process: at 2018-11-16 00:35:36 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-16 00:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-16 00:35:36 [DEBUG   ] spawn_process: at 2018-11-16 00:35:36 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-16 00:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-16 00:35:36 [DEBUG   ] spawn_process: at 2018-11-16 00:35:36 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-16 00:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-16 00:35:36 [DEBUG   ] spawn_process: at 2018-11-16 00:35:36 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-16 00:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-16 00:35:36 [DEBUG   ] spawn_process: at 2018-11-16 00:35:36 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-16 00:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-16 00:35:36 [DEBUG   ] spawn_process: at 2018-11-16 00:35:36 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-16 00:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-16 00:35:36 [DEBUG   ] spawn_process: at 2018-11-16 00:35:36 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-16 00:35:36 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-16 00:35:36 [DEBUG   ] spawn_process: at 2018-11-16 00:35:36 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-16 00:35:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 00:35:45 [DEBUG   ] Got command RPT from MCS: ref #520886
2018-11-16 00:35:45 [DEBUG   ] summary = ERROR
2018-11-16 00:35:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520886  13 58438  2145253 A  ERRORERROR'
2018-11-16 00:35:45 [DEBUG   ] Got command RPT from MCS: ref #520887
2018-11-16 00:35:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 00:35:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520887  77 58438  2145254 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 00:36:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 00:36:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-16 00:36:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:36:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-11-16 00:36:04 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-16 00:36:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-16 00:36:04 [WARNING ] (13, 1, 'bot')
2018-11-16 00:36:04 [WARNING ] (13, 1, 'bot')
2018-11-16 00:36:04 [WARNING ] (13, 1, 'bot')
2018-11-16 00:36:04 [WARNING ] (13, 1, 'bot')
2018-11-16 00:36:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:36:04 [DEBUG   ] Finished updating board flags in 0.926 seconds
2018-11-16 00:36:07 [DEBUG   ] Got command BAM from MCS: ref #520903
2018-11-16 00:36:07 [INFO    ] Finished processing BAM request
2018-11-16 00:36:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:36:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520903   8 58438  2167033 A  ERROR'
2018-11-16 00:36:07 [DEBUG   ] Got command BAM from MCS: ref #520904
2018-11-16 00:36:07 [INFO    ] Finished processing BAM request
2018-11-16 00:36:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:36:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520904   8 58438  2167037 A  ERROR'
2018-11-16 00:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-16 00:36:07 [DEBUG   ] spawn_process: at 2018-11-16 00:36:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-16 00:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-16 00:36:07 [DEBUG   ] spawn_process: at 2018-11-16 00:36:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-16 00:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-16 00:36:07 [DEBUG   ] spawn_process: at 2018-11-16 00:36:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-16 00:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-16 00:36:07 [DEBUG   ] spawn_process: at 2018-11-16 00:36:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-16 00:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-16 00:36:07 [DEBUG   ] spawn_process: at 2018-11-16 00:36:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-16 00:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-16 00:36:07 [DEBUG   ] spawn_process: at 2018-11-16 00:36:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-16 00:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-16 00:36:07 [DEBUG   ] spawn_process: at 2018-11-16 00:36:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-16 00:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-16 00:36:07 [DEBUG   ] spawn_process: at 2018-11-16 00:36:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-16 00:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-16 00:36:07 [DEBUG   ] spawn_process: at 2018-11-16 00:36:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-16 00:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-16 00:36:07 [DEBUG   ] spawn_process: at 2018-11-16 00:36:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-16 00:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-16 00:36:07 [DEBUG   ] spawn_process: at 2018-11-16 00:36:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-16 00:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-16 00:36:07 [DEBUG   ] spawn_process: at 2018-11-16 00:36:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-16 00:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-16 00:36:07 [DEBUG   ] spawn_process: at 2018-11-16 00:36:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-16 00:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-16 00:36:07 [DEBUG   ] spawn_process: at 2018-11-16 00:36:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-16 00:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-16 00:36:07 [DEBUG   ] spawn_process: at 2018-11-16 00:36:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-16 00:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-16 00:36:07 [DEBUG   ] spawn_process: at 2018-11-16 00:36:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-16 00:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-16 00:36:07 [DEBUG   ] spawn_process: at 2018-11-16 00:36:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-16 00:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-16 00:36:07 [DEBUG   ] spawn_process: at 2018-11-16 00:36:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-16 00:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-16 00:36:07 [DEBUG   ] spawn_process: at 2018-11-16 00:36:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-16 00:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-16 00:36:07 [DEBUG   ] spawn_process: at 2018-11-16 00:36:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-16 00:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-16 00:36:07 [DEBUG   ] spawn_process: at 2018-11-16 00:36:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-16 00:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-16 00:36:07 [DEBUG   ] spawn_process: at 2018-11-16 00:36:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-16 00:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-16 00:36:07 [DEBUG   ] spawn_process: at 2018-11-16 00:36:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-16 00:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-16 00:36:07 [DEBUG   ] spawn_process: at 2018-11-16 00:36:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-16 00:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-16 00:36:07 [DEBUG   ] spawn_process: at 2018-11-16 00:36:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-16 00:36:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-16 00:36:07 [DEBUG   ] spawn_process: at 2018-11-16 00:36:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-16 00:36:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 00:36:38 [DEBUG   ] Got command BAM from MCS: ref #520905
2018-11-16 00:36:38 [INFO    ] Finished processing BAM request
2018-11-16 00:36:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:36:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520905   8 58438  2198033 A  ERROR'
2018-11-16 00:36:38 [DEBUG   ] Got command BAM from MCS: ref #520906
2018-11-16 00:36:38 [INFO    ] Finished processing BAM request
2018-11-16 00:36:38 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:36:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520906   8 58438  2198037 A  ERROR'
2018-11-16 00:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-16 00:36:38 [DEBUG   ] spawn_process: at 2018-11-16 00:36:38 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-16 00:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-16 00:36:38 [DEBUG   ] spawn_process: at 2018-11-16 00:36:38 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-16 00:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-16 00:36:38 [DEBUG   ] spawn_process: at 2018-11-16 00:36:38 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-16 00:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-16 00:36:38 [DEBUG   ] spawn_process: at 2018-11-16 00:36:38 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-16 00:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-16 00:36:38 [DEBUG   ] spawn_process: at 2018-11-16 00:36:38 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-16 00:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-16 00:36:38 [DEBUG   ] spawn_process: at 2018-11-16 00:36:38 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-16 00:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-16 00:36:38 [DEBUG   ] spawn_process: at 2018-11-16 00:36:38 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-16 00:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-16 00:36:38 [DEBUG   ] spawn_process: at 2018-11-16 00:36:38 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-16 00:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-16 00:36:38 [DEBUG   ] spawn_process: at 2018-11-16 00:36:38 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-16 00:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-16 00:36:38 [DEBUG   ] spawn_process: at 2018-11-16 00:36:38 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-16 00:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-16 00:36:38 [DEBUG   ] spawn_process: at 2018-11-16 00:36:38 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-16 00:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-16 00:36:38 [DEBUG   ] spawn_process: at 2018-11-16 00:36:38 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-16 00:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-16 00:36:38 [DEBUG   ] spawn_process: at 2018-11-16 00:36:38 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-16 00:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-16 00:36:38 [DEBUG   ] spawn_process: at 2018-11-16 00:36:38 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-16 00:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-16 00:36:38 [DEBUG   ] spawn_process: at 2018-11-16 00:36:38 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-16 00:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-16 00:36:38 [DEBUG   ] spawn_process: at 2018-11-16 00:36:38 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-16 00:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-16 00:36:38 [DEBUG   ] spawn_process: at 2018-11-16 00:36:38 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-16 00:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-16 00:36:38 [DEBUG   ] spawn_process: at 2018-11-16 00:36:38 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-16 00:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-16 00:36:38 [DEBUG   ] spawn_process: at 2018-11-16 00:36:38 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-16 00:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-16 00:36:38 [DEBUG   ] spawn_process: at 2018-11-16 00:36:38 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-16 00:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-16 00:36:38 [DEBUG   ] spawn_process: at 2018-11-16 00:36:38 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-16 00:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-16 00:36:38 [DEBUG   ] spawn_process: at 2018-11-16 00:36:38 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-16 00:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-16 00:36:38 [DEBUG   ] spawn_process: at 2018-11-16 00:36:38 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-16 00:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-16 00:36:38 [DEBUG   ] spawn_process: at 2018-11-16 00:36:38 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-16 00:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-16 00:36:38 [DEBUG   ] spawn_process: at 2018-11-16 00:36:38 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-16 00:36:38 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-16 00:36:38 [DEBUG   ] spawn_process: at 2018-11-16 00:36:38 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-16 00:36:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 00:37:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 00:37:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:37:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-16 00:37:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-16 00:37:05 [WARNING ] (13, 1, 'bot')
2018-11-16 00:37:05 [WARNING ] (13, 1, 'bot')
2018-11-16 00:37:05 [WARNING ] (13, 1, 'bot')
2018-11-16 00:37:05 [WARNING ] (13, 1, 'bot')
2018-11-16 00:37:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:37:05 [DEBUG   ] Finished updating board flags in 1.359 seconds
2018-11-16 00:37:09 [DEBUG   ] Got command BAM from MCS: ref #520907
2018-11-16 00:37:09 [INFO    ] Finished processing BAM request
2018-11-16 00:37:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:37:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520907   8 58438  2229029 A  ERROR'
2018-11-16 00:37:09 [DEBUG   ] Got command BAM from MCS: ref #520908
2018-11-16 00:37:09 [INFO    ] Finished processing BAM request
2018-11-16 00:37:09 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:37:09 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520908   8 58438  2229033 A  ERROR'
2018-11-16 00:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-16 00:37:09 [DEBUG   ] spawn_process: at 2018-11-16 00:37:09 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-16 00:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-16 00:37:09 [DEBUG   ] spawn_process: at 2018-11-16 00:37:09 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-16 00:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-16 00:37:09 [DEBUG   ] spawn_process: at 2018-11-16 00:37:09 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-16 00:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-16 00:37:09 [DEBUG   ] spawn_process: at 2018-11-16 00:37:09 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-16 00:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-16 00:37:09 [DEBUG   ] spawn_process: at 2018-11-16 00:37:09 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-16 00:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-16 00:37:09 [DEBUG   ] spawn_process: at 2018-11-16 00:37:09 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-16 00:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-16 00:37:09 [DEBUG   ] spawn_process: at 2018-11-16 00:37:09 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-16 00:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-16 00:37:09 [DEBUG   ] spawn_process: at 2018-11-16 00:37:09 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-16 00:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-16 00:37:09 [DEBUG   ] spawn_process: at 2018-11-16 00:37:09 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-16 00:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-16 00:37:09 [DEBUG   ] spawn_process: at 2018-11-16 00:37:09 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-16 00:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-16 00:37:09 [DEBUG   ] spawn_process: at 2018-11-16 00:37:09 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-16 00:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-16 00:37:09 [DEBUG   ] spawn_process: at 2018-11-16 00:37:09 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-16 00:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-16 00:37:09 [DEBUG   ] spawn_process: at 2018-11-16 00:37:09 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-16 00:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-16 00:37:09 [DEBUG   ] spawn_process: at 2018-11-16 00:37:09 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-16 00:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-16 00:37:09 [DEBUG   ] spawn_process: at 2018-11-16 00:37:09 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-16 00:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-16 00:37:09 [DEBUG   ] spawn_process: at 2018-11-16 00:37:09 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-16 00:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-16 00:37:09 [DEBUG   ] spawn_process: at 2018-11-16 00:37:09 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-16 00:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-16 00:37:09 [DEBUG   ] spawn_process: at 2018-11-16 00:37:09 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-16 00:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-16 00:37:09 [DEBUG   ] spawn_process: at 2018-11-16 00:37:09 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-16 00:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-16 00:37:09 [DEBUG   ] spawn_process: at 2018-11-16 00:37:09 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-16 00:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-16 00:37:09 [DEBUG   ] spawn_process: at 2018-11-16 00:37:09 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-16 00:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-16 00:37:09 [DEBUG   ] spawn_process: at 2018-11-16 00:37:09 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-16 00:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-16 00:37:09 [DEBUG   ] spawn_process: at 2018-11-16 00:37:09 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-16 00:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-16 00:37:09 [DEBUG   ] spawn_process: at 2018-11-16 00:37:09 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-16 00:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-16 00:37:09 [DEBUG   ] spawn_process: at 2018-11-16 00:37:09 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-16 00:37:09 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-16 00:37:09 [DEBUG   ] spawn_process: at 2018-11-16 00:37:09 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-16 00:37:22 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 00:37:40 [DEBUG   ] Got command BAM from MCS: ref #520909
2018-11-16 00:37:40 [INFO    ] Finished processing BAM request
2018-11-16 00:37:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520909   8 58438  2260029 A  ERROR'
2018-11-16 00:37:40 [DEBUG   ] Got command BAM from MCS: ref #520910
2018-11-16 00:37:40 [INFO    ] Finished processing BAM request
2018-11-16 00:37:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:37:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520910   8 58438  2260033 A  ERROR'
2018-11-16 00:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-16 00:37:40 [DEBUG   ] spawn_process: at 2018-11-16 00:37:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-16 00:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-16 00:37:40 [DEBUG   ] spawn_process: at 2018-11-16 00:37:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-16 00:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-16 00:37:40 [DEBUG   ] spawn_process: at 2018-11-16 00:37:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-16 00:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-16 00:37:40 [DEBUG   ] spawn_process: at 2018-11-16 00:37:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-16 00:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-16 00:37:40 [DEBUG   ] spawn_process: at 2018-11-16 00:37:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-16 00:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-16 00:37:40 [DEBUG   ] spawn_process: at 2018-11-16 00:37:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-16 00:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-16 00:37:40 [DEBUG   ] spawn_process: at 2018-11-16 00:37:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-16 00:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-16 00:37:40 [DEBUG   ] spawn_process: at 2018-11-16 00:37:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-16 00:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-16 00:37:40 [DEBUG   ] spawn_process: at 2018-11-16 00:37:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-16 00:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-16 00:37:40 [DEBUG   ] spawn_process: at 2018-11-16 00:37:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-16 00:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-16 00:37:40 [DEBUG   ] spawn_process: at 2018-11-16 00:37:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-16 00:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-16 00:37:40 [DEBUG   ] spawn_process: at 2018-11-16 00:37:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-16 00:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-16 00:37:40 [DEBUG   ] spawn_process: at 2018-11-16 00:37:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-16 00:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-16 00:37:40 [DEBUG   ] spawn_process: at 2018-11-16 00:37:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-16 00:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-16 00:37:40 [DEBUG   ] spawn_process: at 2018-11-16 00:37:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-16 00:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-16 00:37:40 [DEBUG   ] spawn_process: at 2018-11-16 00:37:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-16 00:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-16 00:37:40 [DEBUG   ] spawn_process: at 2018-11-16 00:37:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-16 00:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-16 00:37:40 [DEBUG   ] spawn_process: at 2018-11-16 00:37:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-16 00:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-16 00:37:40 [DEBUG   ] spawn_process: at 2018-11-16 00:37:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-16 00:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-16 00:37:40 [DEBUG   ] spawn_process: at 2018-11-16 00:37:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-16 00:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-16 00:37:40 [DEBUG   ] spawn_process: at 2018-11-16 00:37:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-16 00:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-16 00:37:40 [DEBUG   ] spawn_process: at 2018-11-16 00:37:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-16 00:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-16 00:37:40 [DEBUG   ] spawn_process: at 2018-11-16 00:37:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-16 00:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-16 00:37:40 [DEBUG   ] spawn_process: at 2018-11-16 00:37:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-16 00:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-16 00:37:40 [DEBUG   ] spawn_process: at 2018-11-16 00:37:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-16 00:37:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-16 00:37:40 [DEBUG   ] spawn_process: at 2018-11-16 00:37:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-16 00:37:42 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 00:38:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 00:38:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:38:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-16 00:38:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-16 00:38:05 [WARNING ] (13, 1, 'bot')
2018-11-16 00:38:05 [WARNING ] (13, 1, 'bot')
2018-11-16 00:38:05 [WARNING ] (13, 1, 'bot')
2018-11-16 00:38:05 [WARNING ] (13, 1, 'bot')
2018-11-16 00:38:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:38:05 [DEBUG   ] Finished updating board flags in 1.207 seconds
2018-11-16 00:38:11 [DEBUG   ] Got command BAM from MCS: ref #520911
2018-11-16 00:38:11 [INFO    ] Finished processing BAM request
2018-11-16 00:38:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:38:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520911   8 58438  2291029 A  ERROR'
2018-11-16 00:38:11 [DEBUG   ] Got command BAM from MCS: ref #520912
2018-11-16 00:38:11 [INFO    ] Finished processing BAM request
2018-11-16 00:38:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:38:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520912   8 58438  2291033 A  ERROR'
2018-11-16 00:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-16 00:38:11 [DEBUG   ] spawn_process: at 2018-11-16 00:38:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-16 00:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-16 00:38:11 [DEBUG   ] spawn_process: at 2018-11-16 00:38:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-16 00:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-16 00:38:11 [DEBUG   ] spawn_process: at 2018-11-16 00:38:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-16 00:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-16 00:38:11 [DEBUG   ] spawn_process: at 2018-11-16 00:38:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-16 00:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-16 00:38:11 [DEBUG   ] spawn_process: at 2018-11-16 00:38:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-16 00:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-16 00:38:11 [DEBUG   ] spawn_process: at 2018-11-16 00:38:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-16 00:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-16 00:38:11 [DEBUG   ] spawn_process: at 2018-11-16 00:38:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-16 00:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-16 00:38:11 [DEBUG   ] spawn_process: at 2018-11-16 00:38:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-16 00:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-16 00:38:11 [DEBUG   ] spawn_process: at 2018-11-16 00:38:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-16 00:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-16 00:38:11 [DEBUG   ] spawn_process: at 2018-11-16 00:38:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-16 00:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-16 00:38:11 [DEBUG   ] spawn_process: at 2018-11-16 00:38:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-16 00:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-16 00:38:11 [DEBUG   ] spawn_process: at 2018-11-16 00:38:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-16 00:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-16 00:38:11 [DEBUG   ] spawn_process: at 2018-11-16 00:38:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-16 00:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-16 00:38:11 [DEBUG   ] spawn_process: at 2018-11-16 00:38:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-16 00:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-16 00:38:11 [DEBUG   ] spawn_process: at 2018-11-16 00:38:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-16 00:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-16 00:38:11 [DEBUG   ] spawn_process: at 2018-11-16 00:38:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-16 00:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-16 00:38:11 [DEBUG   ] spawn_process: at 2018-11-16 00:38:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-16 00:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-16 00:38:11 [DEBUG   ] spawn_process: at 2018-11-16 00:38:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-16 00:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-16 00:38:11 [DEBUG   ] spawn_process: at 2018-11-16 00:38:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-16 00:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-16 00:38:11 [DEBUG   ] spawn_process: at 2018-11-16 00:38:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-16 00:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-16 00:38:11 [DEBUG   ] spawn_process: at 2018-11-16 00:38:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-16 00:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-16 00:38:11 [DEBUG   ] spawn_process: at 2018-11-16 00:38:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-16 00:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-16 00:38:11 [DEBUG   ] spawn_process: at 2018-11-16 00:38:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-16 00:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-16 00:38:11 [DEBUG   ] spawn_process: at 2018-11-16 00:38:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-16 00:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-16 00:38:11 [DEBUG   ] spawn_process: at 2018-11-16 00:38:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-16 00:38:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-16 00:38:11 [DEBUG   ] spawn_process: at 2018-11-16 00:38:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-16 00:38:22 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-16 00:38:27 [DEBUG   ] Got command RPT from MCS: ref #520915
2018-11-16 00:38:27 [DEBUG   ] summary = ERROR
2018-11-16 00:38:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520915  13 58438  2307913 A  ERRORERROR'
2018-11-16 00:38:28 [DEBUG   ] Got command RPT from MCS: ref #520916
2018-11-16 00:38:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 00:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520916  77 58438  2308117 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 00:38:28 [DEBUG   ] Got command RPT from MCS: ref #520917
2018-11-16 00:38:28 [DEBUG   ] summary = ERROR
2018-11-16 00:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520917  13 58438  2308309 A  ERRORERROR'
2018-11-16 00:38:28 [DEBUG   ] Got command RPT from MCS: ref #520919
2018-11-16 00:38:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 00:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520919  77 58438  2308513 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 00:38:28 [DEBUG   ] Got command RPT from MCS: ref #520920
2018-11-16 00:38:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 00:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520920  12 58438  2308717 A  ERRORB£ff'
2018-11-16 00:38:42 [DEBUG   ] Got command BAM from MCS: ref #520929
2018-11-16 00:38:42 [INFO    ] Finished processing BAM request
2018-11-16 00:38:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:38:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520929   8 58438  2322029 A  ERROR'
2018-11-16 00:38:42 [DEBUG   ] Got command BAM from MCS: ref #520930
2018-11-16 00:38:42 [INFO    ] Finished processing BAM request
2018-11-16 00:38:42 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:38:42 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520930   8 58438  2322033 A  ERROR'
2018-11-16 00:38:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 00:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-16 00:38:42 [DEBUG   ] spawn_process: at 2018-11-16 00:38:42 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-16 00:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-16 00:38:42 [DEBUG   ] spawn_process: at 2018-11-16 00:38:42 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-16 00:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-16 00:38:42 [DEBUG   ] spawn_process: at 2018-11-16 00:38:42 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-16 00:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-16 00:38:42 [DEBUG   ] spawn_process: at 2018-11-16 00:38:42 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-16 00:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-16 00:38:42 [DEBUG   ] spawn_process: at 2018-11-16 00:38:42 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-16 00:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-16 00:38:42 [DEBUG   ] spawn_process: at 2018-11-16 00:38:42 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-16 00:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-16 00:38:42 [DEBUG   ] spawn_process: at 2018-11-16 00:38:42 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-16 00:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-16 00:38:42 [DEBUG   ] spawn_process: at 2018-11-16 00:38:42 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-16 00:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-16 00:38:42 [DEBUG   ] spawn_process: at 2018-11-16 00:38:42 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-16 00:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-16 00:38:42 [DEBUG   ] spawn_process: at 2018-11-16 00:38:42 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-16 00:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-16 00:38:42 [DEBUG   ] spawn_process: at 2018-11-16 00:38:42 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-16 00:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-16 00:38:42 [DEBUG   ] spawn_process: at 2018-11-16 00:38:42 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-16 00:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-16 00:38:42 [DEBUG   ] spawn_process: at 2018-11-16 00:38:42 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-16 00:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-16 00:38:42 [DEBUG   ] spawn_process: at 2018-11-16 00:38:42 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-16 00:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-16 00:38:42 [DEBUG   ] spawn_process: at 2018-11-16 00:38:42 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-16 00:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-16 00:38:42 [DEBUG   ] spawn_process: at 2018-11-16 00:38:42 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-16 00:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-16 00:38:42 [DEBUG   ] spawn_process: at 2018-11-16 00:38:42 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-16 00:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-16 00:38:42 [DEBUG   ] spawn_process: at 2018-11-16 00:38:42 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-16 00:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-16 00:38:42 [DEBUG   ] spawn_process: at 2018-11-16 00:38:42 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-16 00:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-16 00:38:42 [DEBUG   ] spawn_process: at 2018-11-16 00:38:42 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-16 00:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-16 00:38:42 [DEBUG   ] spawn_process: at 2018-11-16 00:38:42 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-16 00:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-16 00:38:42 [DEBUG   ] spawn_process: at 2018-11-16 00:38:42 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-16 00:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-16 00:38:42 [DEBUG   ] spawn_process: at 2018-11-16 00:38:42 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-16 00:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-16 00:38:42 [DEBUG   ] spawn_process: at 2018-11-16 00:38:42 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-16 00:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-16 00:38:42 [DEBUG   ] spawn_process: at 2018-11-16 00:38:42 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-16 00:38:42 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-16 00:38:42 [DEBUG   ] spawn_process: at 2018-11-16 00:38:42 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-16 00:39:02 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-16 00:39:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-16 00:39:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:39:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-16 00:39:05 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-16 00:39:05 [WARNING ] (13, 1, 'bot')
2018-11-16 00:39:05 [WARNING ] (13, 1, 'bot')
2018-11-16 00:39:05 [WARNING ] (13, 1, 'bot')
2018-11-16 00:39:05 [WARNING ] (13, 1, 'bot')
2018-11-16 00:39:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:39:05 [DEBUG   ] Finished updating board flags in 1.200 seconds
2018-11-16 00:39:13 [DEBUG   ] Got command BAM from MCS: ref #520932
2018-11-16 00:39:13 [INFO    ] Finished processing BAM request
2018-11-16 00:39:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:39:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520932   8 58438  2353025 A  ERROR'
2018-11-16 00:39:13 [DEBUG   ] Got command BAM from MCS: ref #520931
2018-11-16 00:39:13 [INFO    ] Finished processing BAM request
2018-11-16 00:39:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:39:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520931   8 58438  2353029 A  ERROR'
2018-11-16 00:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-16 00:39:13 [DEBUG   ] spawn_process: at 2018-11-16 00:39:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-16 00:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-16 00:39:13 [DEBUG   ] spawn_process: at 2018-11-16 00:39:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-16 00:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-16 00:39:13 [DEBUG   ] spawn_process: at 2018-11-16 00:39:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-16 00:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-16 00:39:13 [DEBUG   ] spawn_process: at 2018-11-16 00:39:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-16 00:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-16 00:39:13 [DEBUG   ] spawn_process: at 2018-11-16 00:39:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-16 00:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-16 00:39:13 [DEBUG   ] spawn_process: at 2018-11-16 00:39:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-16 00:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-16 00:39:13 [DEBUG   ] spawn_process: at 2018-11-16 00:39:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-16 00:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-16 00:39:13 [DEBUG   ] spawn_process: at 2018-11-16 00:39:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-16 00:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-16 00:39:13 [DEBUG   ] spawn_process: at 2018-11-16 00:39:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-16 00:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-16 00:39:13 [DEBUG   ] spawn_process: at 2018-11-16 00:39:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-16 00:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-16 00:39:13 [DEBUG   ] spawn_process: at 2018-11-16 00:39:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-16 00:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-16 00:39:13 [DEBUG   ] spawn_process: at 2018-11-16 00:39:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-16 00:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-16 00:39:13 [DEBUG   ] spawn_process: at 2018-11-16 00:39:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-16 00:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-16 00:39:13 [DEBUG   ] spawn_process: at 2018-11-16 00:39:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-16 00:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-16 00:39:13 [DEBUG   ] spawn_process: at 2018-11-16 00:39:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-16 00:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-16 00:39:13 [DEBUG   ] spawn_process: at 2018-11-16 00:39:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-16 00:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-16 00:39:13 [DEBUG   ] spawn_process: at 2018-11-16 00:39:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-16 00:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-16 00:39:13 [DEBUG   ] spawn_process: at 2018-11-16 00:39:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-16 00:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-16 00:39:13 [DEBUG   ] spawn_process: at 2018-11-16 00:39:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-16 00:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-16 00:39:13 [DEBUG   ] spawn_process: at 2018-11-16 00:39:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-16 00:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-16 00:39:13 [DEBUG   ] spawn_process: at 2018-11-16 00:39:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-16 00:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-16 00:39:13 [DEBUG   ] spawn_process: at 2018-11-16 00:39:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-16 00:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-16 00:39:13 [DEBUG   ] spawn_process: at 2018-11-16 00:39:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-16 00:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-16 00:39:13 [DEBUG   ] spawn_process: at 2018-11-16 00:39:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-16 00:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-16 00:39:13 [DEBUG   ] spawn_process: at 2018-11-16 00:39:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-16 00:39:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-16 00:39:13 [DEBUG   ] spawn_process: at 2018-11-16 00:39:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-16 00:39:22 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 00:39:42 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 00:39:44 [DEBUG   ] Got command BAM from MCS: ref #520934
2018-11-16 00:39:44 [INFO    ] Finished processing BAM request
2018-11-16 00:39:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:39:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520934   8 58438  2384033 A  ERROR'
2018-11-16 00:39:44 [DEBUG   ] Got command BAM from MCS: ref #520933
2018-11-16 00:39:44 [INFO    ] Finished processing BAM request
2018-11-16 00:39:44 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:39:44 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520933   8 58438  2384037 A  ERROR'
2018-11-16 00:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-16 00:39:44 [DEBUG   ] spawn_process: at 2018-11-16 00:39:44 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-16 00:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-16 00:39:44 [DEBUG   ] spawn_process: at 2018-11-16 00:39:44 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-16 00:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-16 00:39:44 [DEBUG   ] spawn_process: at 2018-11-16 00:39:44 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-16 00:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-16 00:39:44 [DEBUG   ] spawn_process: at 2018-11-16 00:39:44 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-16 00:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-16 00:39:44 [DEBUG   ] spawn_process: at 2018-11-16 00:39:44 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-16 00:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-16 00:39:44 [DEBUG   ] spawn_process: at 2018-11-16 00:39:44 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-16 00:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-16 00:39:44 [DEBUG   ] spawn_process: at 2018-11-16 00:39:44 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-16 00:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-16 00:39:44 [DEBUG   ] spawn_process: at 2018-11-16 00:39:44 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-16 00:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-16 00:39:44 [DEBUG   ] spawn_process: at 2018-11-16 00:39:44 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-16 00:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-16 00:39:44 [DEBUG   ] spawn_process: at 2018-11-16 00:39:44 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-16 00:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-16 00:39:44 [DEBUG   ] spawn_process: at 2018-11-16 00:39:44 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-16 00:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-16 00:39:44 [DEBUG   ] spawn_process: at 2018-11-16 00:39:44 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-16 00:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-16 00:39:44 [DEBUG   ] spawn_process: at 2018-11-16 00:39:44 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-16 00:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-16 00:39:44 [DEBUG   ] spawn_process: at 2018-11-16 00:39:44 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-16 00:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-16 00:39:44 [DEBUG   ] spawn_process: at 2018-11-16 00:39:44 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-16 00:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-16 00:39:44 [DEBUG   ] spawn_process: at 2018-11-16 00:39:44 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-16 00:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-16 00:39:44 [DEBUG   ] spawn_process: at 2018-11-16 00:39:44 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-16 00:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-16 00:39:44 [DEBUG   ] spawn_process: at 2018-11-16 00:39:44 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-16 00:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-16 00:39:44 [DEBUG   ] spawn_process: at 2018-11-16 00:39:44 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-16 00:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-16 00:39:44 [DEBUG   ] spawn_process: at 2018-11-16 00:39:44 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-16 00:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-16 00:39:44 [DEBUG   ] spawn_process: at 2018-11-16 00:39:44 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-16 00:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-16 00:39:44 [DEBUG   ] spawn_process: at 2018-11-16 00:39:44 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-16 00:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-16 00:39:44 [DEBUG   ] spawn_process: at 2018-11-16 00:39:44 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-16 00:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-16 00:39:44 [DEBUG   ] spawn_process: at 2018-11-16 00:39:44 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-16 00:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-16 00:39:44 [DEBUG   ] spawn_process: at 2018-11-16 00:39:44 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-16 00:39:44 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-16 00:39:44 [DEBUG   ] spawn_process: at 2018-11-16 00:39:44 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-16 00:40:02 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 00:40:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-16 00:40:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:40:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-16 00:40:05 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-16 00:40:05 [WARNING ] (13, 1, 'bot')
2018-11-16 00:40:05 [WARNING ] (13, 1, 'bot')
2018-11-16 00:40:05 [WARNING ] (13, 1, 'bot')
2018-11-16 00:40:05 [WARNING ] (13, 1, 'bot')
2018-11-16 00:40:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:40:05 [DEBUG   ] Finished updating board flags in 1.202 seconds
2018-11-16 00:40:15 [DEBUG   ] Got command BAM from MCS: ref #520936
2018-11-16 00:40:15 [INFO    ] Finished processing BAM request
2018-11-16 00:40:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:40:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520936   8 58438  2415033 A  ERROR'
2018-11-16 00:40:15 [DEBUG   ] Got command BAM from MCS: ref #520935
2018-11-16 00:40:15 [INFO    ] Finished processing BAM request
2018-11-16 00:40:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:40:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520935   8 58438  2415037 A  ERROR'
2018-11-16 00:40:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-16 00:40:15 [DEBUG   ] spawn_process: at 2018-11-16 00:40:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-16 00:40:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-16 00:40:15 [DEBUG   ] spawn_process: at 2018-11-16 00:40:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-16 00:40:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-16 00:40:15 [DEBUG   ] spawn_process: at 2018-11-16 00:40:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-16 00:40:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-16 00:40:15 [DEBUG   ] spawn_process: at 2018-11-16 00:40:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-16 00:40:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-16 00:40:15 [DEBUG   ] spawn_process: at 2018-11-16 00:40:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-16 00:40:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-16 00:40:15 [DEBUG   ] spawn_process: at 2018-11-16 00:40:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-16 00:40:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-16 00:40:15 [DEBUG   ] spawn_process: at 2018-11-16 00:40:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-16 00:40:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-16 00:40:15 [DEBUG   ] spawn_process: at 2018-11-16 00:40:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-16 00:40:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-16 00:40:15 [DEBUG   ] spawn_process: at 2018-11-16 00:40:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-16 00:40:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-16 00:40:15 [DEBUG   ] spawn_process: at 2018-11-16 00:40:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-16 00:40:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-16 00:40:15 [DEBUG   ] spawn_process: at 2018-11-16 00:40:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-16 00:40:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-16 00:40:15 [DEBUG   ] spawn_process: at 2018-11-16 00:40:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-16 00:40:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-16 00:40:15 [DEBUG   ] spawn_process: at 2018-11-16 00:40:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-16 00:40:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-16 00:40:15 [DEBUG   ] spawn_process: at 2018-11-16 00:40:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-16 00:40:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-16 00:40:15 [DEBUG   ] spawn_process: at 2018-11-16 00:40:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-16 00:40:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-16 00:40:15 [DEBUG   ] spawn_process: at 2018-11-16 00:40:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-16 00:40:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-16 00:40:15 [DEBUG   ] spawn_process: at 2018-11-16 00:40:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-16 00:40:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-16 00:40:15 [DEBUG   ] spawn_process: at 2018-11-16 00:40:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-16 00:40:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-16 00:40:15 [DEBUG   ] spawn_process: at 2018-11-16 00:40:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-16 00:40:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-16 00:40:15 [DEBUG   ] spawn_process: at 2018-11-16 00:40:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-16 00:40:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-16 00:40:15 [DEBUG   ] spawn_process: at 2018-11-16 00:40:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-16 00:40:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-16 00:40:15 [DEBUG   ] spawn_process: at 2018-11-16 00:40:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-16 00:40:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-16 00:40:15 [DEBUG   ] spawn_process: at 2018-11-16 00:40:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-16 00:40:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-16 00:40:15 [DEBUG   ] spawn_process: at 2018-11-16 00:40:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-16 00:40:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-16 00:40:15 [DEBUG   ] spawn_process: at 2018-11-16 00:40:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-16 00:40:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-16 00:40:15 [DEBUG   ] spawn_process: at 2018-11-16 00:40:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-16 00:40:22 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-16 00:40:42 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-16 00:40:45 [DEBUG   ] Got command RPT from MCS: ref #520939
2018-11-16 00:40:45 [DEBUG   ] summary = ERROR
2018-11-16 00:40:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520939  13 58438  2445253 A  ERRORERROR'
2018-11-16 00:40:45 [DEBUG   ] Got command RPT from MCS: ref #520940
2018-11-16 00:40:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 00:40:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520940  77 58438  2445254 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 00:40:46 [DEBUG   ] Got command BAM from MCS: ref #520938
2018-11-16 00:40:46 [INFO    ] Finished processing BAM request
2018-11-16 00:40:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:40:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520938   8 58438  2446025 A  ERROR'
2018-11-16 00:40:46 [DEBUG   ] Got command BAM from MCS: ref #520937
2018-11-16 00:40:46 [INFO    ] Finished processing BAM request
2018-11-16 00:40:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:40:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520937   8 58438  2446029 A  ERROR'
2018-11-16 00:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-16 00:40:46 [DEBUG   ] spawn_process: at 2018-11-16 00:40:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-16 00:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-16 00:40:46 [DEBUG   ] spawn_process: at 2018-11-16 00:40:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-16 00:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-16 00:40:46 [DEBUG   ] spawn_process: at 2018-11-16 00:40:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-16 00:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-16 00:40:46 [DEBUG   ] spawn_process: at 2018-11-16 00:40:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-16 00:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-16 00:40:46 [DEBUG   ] spawn_process: at 2018-11-16 00:40:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-16 00:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-16 00:40:46 [DEBUG   ] spawn_process: at 2018-11-16 00:40:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-16 00:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-16 00:40:46 [DEBUG   ] spawn_process: at 2018-11-16 00:40:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-16 00:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-16 00:40:46 [DEBUG   ] spawn_process: at 2018-11-16 00:40:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-16 00:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-16 00:40:46 [DEBUG   ] spawn_process: at 2018-11-16 00:40:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-16 00:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-16 00:40:46 [DEBUG   ] spawn_process: at 2018-11-16 00:40:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-16 00:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-16 00:40:46 [DEBUG   ] spawn_process: at 2018-11-16 00:40:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-16 00:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-16 00:40:46 [DEBUG   ] spawn_process: at 2018-11-16 00:40:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-16 00:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-16 00:40:46 [DEBUG   ] spawn_process: at 2018-11-16 00:40:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-16 00:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-16 00:40:46 [DEBUG   ] spawn_process: at 2018-11-16 00:40:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-16 00:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-16 00:40:46 [DEBUG   ] spawn_process: at 2018-11-16 00:40:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-16 00:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-16 00:40:46 [DEBUG   ] spawn_process: at 2018-11-16 00:40:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-16 00:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-16 00:40:46 [DEBUG   ] spawn_process: at 2018-11-16 00:40:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-16 00:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-16 00:40:46 [DEBUG   ] spawn_process: at 2018-11-16 00:40:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-16 00:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-16 00:40:46 [DEBUG   ] spawn_process: at 2018-11-16 00:40:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-16 00:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-16 00:40:46 [DEBUG   ] spawn_process: at 2018-11-16 00:40:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-16 00:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-16 00:40:46 [DEBUG   ] spawn_process: at 2018-11-16 00:40:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-16 00:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-16 00:40:46 [DEBUG   ] spawn_process: at 2018-11-16 00:40:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-16 00:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-16 00:40:46 [DEBUG   ] spawn_process: at 2018-11-16 00:40:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-16 00:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-16 00:40:46 [DEBUG   ] spawn_process: at 2018-11-16 00:40:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-16 00:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-16 00:40:46 [DEBUG   ] spawn_process: at 2018-11-16 00:40:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-16 00:40:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-16 00:40:46 [DEBUG   ] spawn_process: at 2018-11-16 00:40:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-16 00:41:02 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-16 00:41:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-11-16 00:41:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-16 00:41:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:41:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-16 00:41:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-16 00:41:05 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-16 00:41:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa28, chip 4
2018-11-16 00:41:05 [WARNING ] (13, 1, 'bot')
2018-11-16 00:41:05 [WARNING ] (13, 1, 'bot')
2018-11-16 00:41:05 [WARNING ] (13, 1, 'bot')
2018-11-16 00:41:05 [WARNING ] (13, 1, 'bot')
2018-11-16 00:41:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:41:05 [DEBUG   ] Finished updating board flags in 1.192 seconds
2018-11-16 00:41:17 [DEBUG   ] Got command BAM from MCS: ref #520956
2018-11-16 00:41:17 [INFO    ] Finished processing BAM request
2018-11-16 00:41:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:41:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520956   8 58438  2477033 A  ERROR'
2018-11-16 00:41:17 [DEBUG   ] Got command BAM from MCS: ref #520957
2018-11-16 00:41:17 [INFO    ] Finished processing BAM request
2018-11-16 00:41:17 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:41:17 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520957   8 58438  2477037 A  ERROR'
2018-11-16 00:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-16 00:41:17 [DEBUG   ] spawn_process: at 2018-11-16 00:41:17 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-16 00:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-16 00:41:17 [DEBUG   ] spawn_process: at 2018-11-16 00:41:17 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-16 00:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-16 00:41:17 [DEBUG   ] spawn_process: at 2018-11-16 00:41:17 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-16 00:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-16 00:41:17 [DEBUG   ] spawn_process: at 2018-11-16 00:41:17 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-16 00:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-16 00:41:17 [DEBUG   ] spawn_process: at 2018-11-16 00:41:17 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-16 00:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-16 00:41:17 [DEBUG   ] spawn_process: at 2018-11-16 00:41:17 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-16 00:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-16 00:41:17 [DEBUG   ] spawn_process: at 2018-11-16 00:41:17 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-16 00:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-16 00:41:17 [DEBUG   ] spawn_process: at 2018-11-16 00:41:17 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-16 00:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-16 00:41:17 [DEBUG   ] spawn_process: at 2018-11-16 00:41:17 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-16 00:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-16 00:41:17 [DEBUG   ] spawn_process: at 2018-11-16 00:41:17 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-16 00:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-16 00:41:17 [DEBUG   ] spawn_process: at 2018-11-16 00:41:17 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-16 00:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-16 00:41:17 [DEBUG   ] spawn_process: at 2018-11-16 00:41:17 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-16 00:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-16 00:41:17 [DEBUG   ] spawn_process: at 2018-11-16 00:41:17 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-16 00:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-16 00:41:17 [DEBUG   ] spawn_process: at 2018-11-16 00:41:17 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-16 00:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-16 00:41:17 [DEBUG   ] spawn_process: at 2018-11-16 00:41:17 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-16 00:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-16 00:41:17 [DEBUG   ] spawn_process: at 2018-11-16 00:41:17 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-16 00:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-16 00:41:17 [DEBUG   ] spawn_process: at 2018-11-16 00:41:17 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-16 00:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-16 00:41:17 [DEBUG   ] spawn_process: at 2018-11-16 00:41:17 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-16 00:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-16 00:41:17 [DEBUG   ] spawn_process: at 2018-11-16 00:41:17 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-16 00:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-16 00:41:17 [DEBUG   ] spawn_process: at 2018-11-16 00:41:17 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-16 00:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-16 00:41:17 [DEBUG   ] spawn_process: at 2018-11-16 00:41:17 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-16 00:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-16 00:41:17 [DEBUG   ] spawn_process: at 2018-11-16 00:41:17 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-16 00:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-16 00:41:17 [DEBUG   ] spawn_process: at 2018-11-16 00:41:17 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-16 00:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-16 00:41:17 [DEBUG   ] spawn_process: at 2018-11-16 00:41:17 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-16 00:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-16 00:41:17 [DEBUG   ] spawn_process: at 2018-11-16 00:41:17 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-16 00:41:17 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-16 00:41:17 [DEBUG   ] spawn_process: at 2018-11-16 00:41:17 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-16 00:41:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 00:41:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 00:41:48 [DEBUG   ] Got command BAM from MCS: ref #520963
2018-11-16 00:41:48 [INFO    ] Finished processing BAM request
2018-11-16 00:41:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:41:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520963   8 58438  2508025 A  ERROR'
2018-11-16 00:41:48 [DEBUG   ] Got command BAM from MCS: ref #520962
2018-11-16 00:41:48 [INFO    ] Finished processing BAM request
2018-11-16 00:41:48 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:41:48 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520962   8 58438  2508029 A  ERROR'
2018-11-16 00:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-16 00:41:48 [DEBUG   ] spawn_process: at 2018-11-16 00:41:48 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-16 00:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-16 00:41:48 [DEBUG   ] spawn_process: at 2018-11-16 00:41:48 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-16 00:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-16 00:41:48 [DEBUG   ] spawn_process: at 2018-11-16 00:41:48 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-16 00:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-16 00:41:48 [DEBUG   ] spawn_process: at 2018-11-16 00:41:48 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-16 00:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-16 00:41:48 [DEBUG   ] spawn_process: at 2018-11-16 00:41:48 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-16 00:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-16 00:41:48 [DEBUG   ] spawn_process: at 2018-11-16 00:41:48 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-16 00:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-16 00:41:48 [DEBUG   ] spawn_process: at 2018-11-16 00:41:48 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-16 00:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-16 00:41:48 [DEBUG   ] spawn_process: at 2018-11-16 00:41:48 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-16 00:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-16 00:41:48 [DEBUG   ] spawn_process: at 2018-11-16 00:41:48 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-16 00:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-16 00:41:48 [DEBUG   ] spawn_process: at 2018-11-16 00:41:48 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-16 00:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-16 00:41:48 [DEBUG   ] spawn_process: at 2018-11-16 00:41:48 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-16 00:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-16 00:41:48 [DEBUG   ] spawn_process: at 2018-11-16 00:41:48 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-16 00:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-16 00:41:48 [DEBUG   ] spawn_process: at 2018-11-16 00:41:48 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-16 00:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-16 00:41:48 [DEBUG   ] spawn_process: at 2018-11-16 00:41:48 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-16 00:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-16 00:41:48 [DEBUG   ] spawn_process: at 2018-11-16 00:41:48 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-16 00:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-16 00:41:48 [DEBUG   ] spawn_process: at 2018-11-16 00:41:48 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-16 00:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-16 00:41:48 [DEBUG   ] spawn_process: at 2018-11-16 00:41:48 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-16 00:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-16 00:41:48 [DEBUG   ] spawn_process: at 2018-11-16 00:41:48 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-16 00:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-16 00:41:48 [DEBUG   ] spawn_process: at 2018-11-16 00:41:48 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-16 00:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-16 00:41:48 [DEBUG   ] spawn_process: at 2018-11-16 00:41:48 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-16 00:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-16 00:41:48 [DEBUG   ] spawn_process: at 2018-11-16 00:41:48 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-16 00:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-16 00:41:48 [DEBUG   ] spawn_process: at 2018-11-16 00:41:48 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-16 00:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-16 00:41:48 [DEBUG   ] spawn_process: at 2018-11-16 00:41:48 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-16 00:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-16 00:41:48 [DEBUG   ] spawn_process: at 2018-11-16 00:41:48 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-16 00:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-16 00:41:48 [DEBUG   ] spawn_process: at 2018-11-16 00:41:48 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-16 00:41:48 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-16 00:41:48 [DEBUG   ] spawn_process: at 2018-11-16 00:41:48 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-16 00:42:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 00:42:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 00:42:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:42:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-16 00:42:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-16 00:42:05 [WARNING ] (13, 1, 'bot')
2018-11-16 00:42:05 [WARNING ] (13, 1, 'bot')
2018-11-16 00:42:05 [WARNING ] (13, 1, 'bot')
2018-11-16 00:42:05 [WARNING ] (13, 1, 'bot')
2018-11-16 00:42:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:42:05 [DEBUG   ] Finished updating board flags in 1.027 seconds
2018-11-16 00:42:19 [DEBUG   ] Got command BAM from MCS: ref #520964
2018-11-16 00:42:19 [INFO    ] Finished processing BAM request
2018-11-16 00:42:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:42:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520964   8 58438  2539029 A  ERROR'
2018-11-16 00:42:19 [DEBUG   ] Got command BAM from MCS: ref #520965
2018-11-16 00:42:19 [INFO    ] Finished processing BAM request
2018-11-16 00:42:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:42:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520965   8 58438  2539033 A  ERROR'
2018-11-16 00:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-16 00:42:19 [DEBUG   ] spawn_process: at 2018-11-16 00:42:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-16 00:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-16 00:42:19 [DEBUG   ] spawn_process: at 2018-11-16 00:42:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-16 00:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-16 00:42:19 [DEBUG   ] spawn_process: at 2018-11-16 00:42:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-16 00:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-16 00:42:19 [DEBUG   ] spawn_process: at 2018-11-16 00:42:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-16 00:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-16 00:42:19 [DEBUG   ] spawn_process: at 2018-11-16 00:42:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-16 00:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-16 00:42:19 [DEBUG   ] spawn_process: at 2018-11-16 00:42:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-16 00:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-16 00:42:19 [DEBUG   ] spawn_process: at 2018-11-16 00:42:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-16 00:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-16 00:42:19 [DEBUG   ] spawn_process: at 2018-11-16 00:42:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-16 00:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-16 00:42:19 [DEBUG   ] spawn_process: at 2018-11-16 00:42:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-16 00:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-16 00:42:19 [DEBUG   ] spawn_process: at 2018-11-16 00:42:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-16 00:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-16 00:42:19 [DEBUG   ] spawn_process: at 2018-11-16 00:42:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-16 00:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-16 00:42:19 [DEBUG   ] spawn_process: at 2018-11-16 00:42:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-16 00:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-16 00:42:19 [DEBUG   ] spawn_process: at 2018-11-16 00:42:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-16 00:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-16 00:42:19 [DEBUG   ] spawn_process: at 2018-11-16 00:42:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-16 00:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-16 00:42:19 [DEBUG   ] spawn_process: at 2018-11-16 00:42:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-16 00:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-16 00:42:19 [DEBUG   ] spawn_process: at 2018-11-16 00:42:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-16 00:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-16 00:42:19 [DEBUG   ] spawn_process: at 2018-11-16 00:42:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-16 00:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-16 00:42:19 [DEBUG   ] spawn_process: at 2018-11-16 00:42:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-16 00:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-16 00:42:19 [DEBUG   ] spawn_process: at 2018-11-16 00:42:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-16 00:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-16 00:42:19 [DEBUG   ] spawn_process: at 2018-11-16 00:42:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-16 00:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-16 00:42:19 [DEBUG   ] spawn_process: at 2018-11-16 00:42:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-16 00:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-16 00:42:19 [DEBUG   ] spawn_process: at 2018-11-16 00:42:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-16 00:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-16 00:42:19 [DEBUG   ] spawn_process: at 2018-11-16 00:42:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-16 00:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-16 00:42:19 [DEBUG   ] spawn_process: at 2018-11-16 00:42:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-16 00:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-16 00:42:19 [DEBUG   ] spawn_process: at 2018-11-16 00:42:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-16 00:42:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-16 00:42:19 [DEBUG   ] spawn_process: at 2018-11-16 00:42:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-16 00:42:23 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-16 00:42:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 00:42:50 [DEBUG   ] Got command BAM from MCS: ref #520967
2018-11-16 00:42:50 [INFO    ] Finished processing BAM request
2018-11-16 00:42:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:42:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520967   8 58438  2570025 A  ERROR'
2018-11-16 00:42:50 [DEBUG   ] Got command BAM from MCS: ref #520966
2018-11-16 00:42:50 [INFO    ] Finished processing BAM request
2018-11-16 00:42:50 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:42:50 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520966   8 58438  2570029 A  ERROR'
2018-11-16 00:42:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-16 00:42:50 [DEBUG   ] spawn_process: at 2018-11-16 00:42:50 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-16 00:42:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-16 00:42:50 [DEBUG   ] spawn_process: at 2018-11-16 00:42:50 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-16 00:42:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-16 00:42:50 [DEBUG   ] spawn_process: at 2018-11-16 00:42:50 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-16 00:42:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-16 00:42:50 [DEBUG   ] spawn_process: at 2018-11-16 00:42:50 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-16 00:42:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-16 00:42:50 [DEBUG   ] spawn_process: at 2018-11-16 00:42:50 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-16 00:42:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-16 00:42:50 [DEBUG   ] spawn_process: at 2018-11-16 00:42:50 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-16 00:42:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-16 00:42:50 [DEBUG   ] spawn_process: at 2018-11-16 00:42:50 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-16 00:42:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-16 00:42:50 [DEBUG   ] spawn_process: at 2018-11-16 00:42:50 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-16 00:42:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-16 00:42:50 [DEBUG   ] spawn_process: at 2018-11-16 00:42:50 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-16 00:42:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-16 00:42:50 [DEBUG   ] spawn_process: at 2018-11-16 00:42:50 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-16 00:42:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-16 00:42:50 [DEBUG   ] spawn_process: at 2018-11-16 00:42:50 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-16 00:42:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-16 00:42:50 [DEBUG   ] spawn_process: at 2018-11-16 00:42:50 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-16 00:42:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-16 00:42:50 [DEBUG   ] spawn_process: at 2018-11-16 00:42:50 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-16 00:42:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-16 00:42:50 [DEBUG   ] spawn_process: at 2018-11-16 00:42:50 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-16 00:42:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-16 00:42:50 [DEBUG   ] spawn_process: at 2018-11-16 00:42:50 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-16 00:42:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-16 00:42:50 [DEBUG   ] spawn_process: at 2018-11-16 00:42:50 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-16 00:42:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-16 00:42:50 [DEBUG   ] spawn_process: at 2018-11-16 00:42:50 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-16 00:42:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-16 00:42:50 [DEBUG   ] spawn_process: at 2018-11-16 00:42:50 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-16 00:42:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-16 00:42:50 [DEBUG   ] spawn_process: at 2018-11-16 00:42:50 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-16 00:42:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-16 00:42:50 [DEBUG   ] spawn_process: at 2018-11-16 00:42:50 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-16 00:42:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-16 00:42:50 [DEBUG   ] spawn_process: at 2018-11-16 00:42:50 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-16 00:42:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-16 00:42:50 [DEBUG   ] spawn_process: at 2018-11-16 00:42:50 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-16 00:42:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-16 00:42:50 [DEBUG   ] spawn_process: at 2018-11-16 00:42:50 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-16 00:42:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-16 00:42:50 [DEBUG   ] spawn_process: at 2018-11-16 00:42:50 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-16 00:42:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-16 00:42:50 [DEBUG   ] spawn_process: at 2018-11-16 00:42:50 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-16 00:42:50 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-16 00:42:50 [DEBUG   ] spawn_process: at 2018-11-16 00:42:50 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-16 00:43:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 00:43:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-16 00:43:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-16 00:43:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:43:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-16 00:43:05 [WARNING ] (13, 1, 'bot')
2018-11-16 00:43:05 [WARNING ] (13, 1, 'bot')
2018-11-16 00:43:05 [WARNING ] (13, 1, 'bot')
2018-11-16 00:43:05 [WARNING ] (13, 1, 'bot')
2018-11-16 00:43:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:43:05 [DEBUG   ] Finished updating board flags in 0.975 seconds
2018-11-16 00:43:21 [DEBUG   ] Got command BAM from MCS: ref #520969
2018-11-16 00:43:21 [INFO    ] Finished processing BAM request
2018-11-16 00:43:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:43:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520969   8 58438  2601025 A  ERROR'
2018-11-16 00:43:21 [DEBUG   ] Got command BAM from MCS: ref #520968
2018-11-16 00:43:21 [INFO    ] Finished processing BAM request
2018-11-16 00:43:21 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:43:21 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520968   8 58438  2601029 A  ERROR'
2018-11-16 00:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-16 00:43:21 [DEBUG   ] spawn_process: at 2018-11-16 00:43:21 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-16 00:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-16 00:43:21 [DEBUG   ] spawn_process: at 2018-11-16 00:43:21 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-16 00:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-16 00:43:21 [DEBUG   ] spawn_process: at 2018-11-16 00:43:21 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-16 00:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-16 00:43:21 [DEBUG   ] spawn_process: at 2018-11-16 00:43:21 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-16 00:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-16 00:43:21 [DEBUG   ] spawn_process: at 2018-11-16 00:43:21 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-16 00:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-16 00:43:21 [DEBUG   ] spawn_process: at 2018-11-16 00:43:21 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-16 00:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-16 00:43:21 [DEBUG   ] spawn_process: at 2018-11-16 00:43:21 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-16 00:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-16 00:43:21 [DEBUG   ] spawn_process: at 2018-11-16 00:43:21 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-16 00:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-16 00:43:21 [DEBUG   ] spawn_process: at 2018-11-16 00:43:21 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-16 00:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-16 00:43:21 [DEBUG   ] spawn_process: at 2018-11-16 00:43:21 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-16 00:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-16 00:43:21 [DEBUG   ] spawn_process: at 2018-11-16 00:43:21 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-16 00:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-16 00:43:21 [DEBUG   ] spawn_process: at 2018-11-16 00:43:21 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-16 00:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-16 00:43:21 [DEBUG   ] spawn_process: at 2018-11-16 00:43:21 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-16 00:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-16 00:43:21 [DEBUG   ] spawn_process: at 2018-11-16 00:43:21 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-16 00:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-16 00:43:21 [DEBUG   ] spawn_process: at 2018-11-16 00:43:21 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-16 00:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-16 00:43:21 [DEBUG   ] spawn_process: at 2018-11-16 00:43:21 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-16 00:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-16 00:43:21 [DEBUG   ] spawn_process: at 2018-11-16 00:43:21 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-16 00:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-16 00:43:21 [DEBUG   ] spawn_process: at 2018-11-16 00:43:21 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-16 00:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-16 00:43:21 [DEBUG   ] spawn_process: at 2018-11-16 00:43:21 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-16 00:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-16 00:43:21 [DEBUG   ] spawn_process: at 2018-11-16 00:43:21 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-16 00:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-16 00:43:21 [DEBUG   ] spawn_process: at 2018-11-16 00:43:21 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-16 00:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-16 00:43:21 [DEBUG   ] spawn_process: at 2018-11-16 00:43:21 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-16 00:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-16 00:43:21 [DEBUG   ] spawn_process: at 2018-11-16 00:43:21 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-16 00:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-16 00:43:21 [DEBUG   ] spawn_process: at 2018-11-16 00:43:21 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-16 00:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-16 00:43:21 [DEBUG   ] spawn_process: at 2018-11-16 00:43:21 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-16 00:43:21 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-16 00:43:21 [DEBUG   ] spawn_process: at 2018-11-16 00:43:21 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-16 00:43:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 00:43:27 [DEBUG   ] Got command RPT from MCS: ref #520970
2018-11-16 00:43:27 [DEBUG   ] summary = ERROR
2018-11-16 00:43:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520970  13 58438  2607993 A  ERRORERROR'
2018-11-16 00:43:28 [DEBUG   ] Got command RPT from MCS: ref #520971
2018-11-16 00:43:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 00:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520971  77 58438  2608197 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 00:43:28 [DEBUG   ] Got command RPT from MCS: ref #520972
2018-11-16 00:43:28 [DEBUG   ] summary = ERROR
2018-11-16 00:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520972  13 58438  2608401 A  ERRORERROR'
2018-11-16 00:43:28 [DEBUG   ] Got command RPT from MCS: ref #520973
2018-11-16 00:43:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 00:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520973  77 58438  2608605 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 00:43:28 [DEBUG   ] Got command RPT from MCS: ref #520974
2018-11-16 00:43:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 00:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520974  12 58438  2608797 A  ERRORB£ff'
2018-11-16 00:43:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 00:43:52 [DEBUG   ] Got command BAM from MCS: ref #520975
2018-11-16 00:43:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:43:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520975   8 58438  2632030 A  ERROR'
2018-11-16 00:43:52 [DEBUG   ] Got command BAM from MCS: ref #520976
2018-11-16 00:43:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:43:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520976   8 58438  2632034 A  ERROR'
2018-11-16 00:43:52 [INFO    ] Finished processing BAM request
2018-11-16 00:43:52 [INFO    ] Finished processing BAM request
2018-11-16 00:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-16 00:43:52 [DEBUG   ] spawn_process: at 2018-11-16 00:43:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-16 00:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-16 00:43:52 [DEBUG   ] spawn_process: at 2018-11-16 00:43:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-16 00:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-16 00:43:52 [DEBUG   ] spawn_process: at 2018-11-16 00:43:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-16 00:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-16 00:43:52 [DEBUG   ] spawn_process: at 2018-11-16 00:43:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-16 00:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-16 00:43:52 [DEBUG   ] spawn_process: at 2018-11-16 00:43:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-16 00:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-16 00:43:52 [DEBUG   ] spawn_process: at 2018-11-16 00:43:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-16 00:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-16 00:43:52 [DEBUG   ] spawn_process: at 2018-11-16 00:43:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-16 00:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-16 00:43:52 [DEBUG   ] spawn_process: at 2018-11-16 00:43:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-16 00:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-16 00:43:52 [DEBUG   ] spawn_process: at 2018-11-16 00:43:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-16 00:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-16 00:43:52 [DEBUG   ] spawn_process: at 2018-11-16 00:43:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-16 00:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-16 00:43:52 [DEBUG   ] spawn_process: at 2018-11-16 00:43:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-16 00:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-16 00:43:52 [DEBUG   ] spawn_process: at 2018-11-16 00:43:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-16 00:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-16 00:43:52 [DEBUG   ] spawn_process: at 2018-11-16 00:43:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-16 00:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-16 00:43:52 [DEBUG   ] spawn_process: at 2018-11-16 00:43:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-16 00:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-16 00:43:52 [DEBUG   ] spawn_process: at 2018-11-16 00:43:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-16 00:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-16 00:43:52 [DEBUG   ] spawn_process: at 2018-11-16 00:43:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-16 00:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-16 00:43:52 [DEBUG   ] spawn_process: at 2018-11-16 00:43:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-16 00:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-16 00:43:52 [DEBUG   ] spawn_process: at 2018-11-16 00:43:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-16 00:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-16 00:43:52 [DEBUG   ] spawn_process: at 2018-11-16 00:43:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-16 00:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-16 00:43:52 [DEBUG   ] spawn_process: at 2018-11-16 00:43:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-16 00:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-16 00:43:52 [DEBUG   ] spawn_process: at 2018-11-16 00:43:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-16 00:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-16 00:43:52 [DEBUG   ] spawn_process: at 2018-11-16 00:43:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-16 00:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-16 00:43:52 [DEBUG   ] spawn_process: at 2018-11-16 00:43:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-16 00:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-16 00:43:52 [DEBUG   ] spawn_process: at 2018-11-16 00:43:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-16 00:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-16 00:43:52 [DEBUG   ] spawn_process: at 2018-11-16 00:43:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-16 00:43:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-16 00:43:52 [DEBUG   ] spawn_process: at 2018-11-16 00:43:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-16 00:44:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 00:44:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-16 00:44:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:44:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 00:44:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-16 00:44:05 [WARNING ] (13, 1, 'bot')
2018-11-16 00:44:05 [WARNING ] (13, 1, 'bot')
2018-11-16 00:44:05 [WARNING ] (13, 1, 'bot')
2018-11-16 00:44:05 [WARNING ] (13, 1, 'bot')
2018-11-16 00:44:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:44:05 [DEBUG   ] Finished updating board flags in 1.267 seconds
2018-11-16 00:44:23 [DEBUG   ] Got command BAM from MCS: ref #520978
2018-11-16 00:44:23 [INFO    ] Finished processing BAM request
2018-11-16 00:44:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:44:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520978   8 58438  2663033 A  ERROR'
2018-11-16 00:44:23 [DEBUG   ] Got command BAM from MCS: ref #520977
2018-11-16 00:44:23 [INFO    ] Finished processing BAM request
2018-11-16 00:44:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:44:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520977   8 58438  2663037 A  ERROR'
2018-11-16 00:44:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 00:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-16 00:44:23 [DEBUG   ] spawn_process: at 2018-11-16 00:44:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-16 00:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-16 00:44:23 [DEBUG   ] spawn_process: at 2018-11-16 00:44:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-16 00:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-16 00:44:23 [DEBUG   ] spawn_process: at 2018-11-16 00:44:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-16 00:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-16 00:44:23 [DEBUG   ] spawn_process: at 2018-11-16 00:44:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-16 00:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-16 00:44:23 [DEBUG   ] spawn_process: at 2018-11-16 00:44:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-16 00:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-16 00:44:23 [DEBUG   ] spawn_process: at 2018-11-16 00:44:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-16 00:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-16 00:44:23 [DEBUG   ] spawn_process: at 2018-11-16 00:44:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-16 00:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-16 00:44:23 [DEBUG   ] spawn_process: at 2018-11-16 00:44:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-16 00:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-16 00:44:23 [DEBUG   ] spawn_process: at 2018-11-16 00:44:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-16 00:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-16 00:44:23 [DEBUG   ] spawn_process: at 2018-11-16 00:44:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-16 00:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-16 00:44:23 [DEBUG   ] spawn_process: at 2018-11-16 00:44:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-16 00:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-16 00:44:23 [DEBUG   ] spawn_process: at 2018-11-16 00:44:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-16 00:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-16 00:44:23 [DEBUG   ] spawn_process: at 2018-11-16 00:44:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-16 00:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-16 00:44:23 [DEBUG   ] spawn_process: at 2018-11-16 00:44:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-16 00:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-16 00:44:23 [DEBUG   ] spawn_process: at 2018-11-16 00:44:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-16 00:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-16 00:44:23 [DEBUG   ] spawn_process: at 2018-11-16 00:44:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-16 00:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-16 00:44:23 [DEBUG   ] spawn_process: at 2018-11-16 00:44:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-16 00:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-16 00:44:23 [DEBUG   ] spawn_process: at 2018-11-16 00:44:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-16 00:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-16 00:44:23 [DEBUG   ] spawn_process: at 2018-11-16 00:44:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-16 00:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-16 00:44:23 [DEBUG   ] spawn_process: at 2018-11-16 00:44:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-16 00:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-16 00:44:23 [DEBUG   ] spawn_process: at 2018-11-16 00:44:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-16 00:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-16 00:44:23 [DEBUG   ] spawn_process: at 2018-11-16 00:44:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-16 00:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-16 00:44:23 [DEBUG   ] spawn_process: at 2018-11-16 00:44:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-16 00:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-16 00:44:23 [DEBUG   ] spawn_process: at 2018-11-16 00:44:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-16 00:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-16 00:44:23 [DEBUG   ] spawn_process: at 2018-11-16 00:44:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-16 00:44:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-16 00:44:23 [DEBUG   ] spawn_process: at 2018-11-16 00:44:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-16 00:44:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 00:44:54 [DEBUG   ] Got command BAM from MCS: ref #520983
2018-11-16 00:44:54 [INFO    ] Finished processing BAM request
2018-11-16 00:44:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:44:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520983   8 58438  2694029 A  ERROR'
2018-11-16 00:44:54 [DEBUG   ] Got command BAM from MCS: ref #520984
2018-11-16 00:44:54 [INFO    ] Finished processing BAM request
2018-11-16 00:44:54 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:44:54 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520984   8 58438  2694033 A  ERROR'
2018-11-16 00:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-16 00:44:54 [DEBUG   ] spawn_process: at 2018-11-16 00:44:54 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-16 00:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-16 00:44:54 [DEBUG   ] spawn_process: at 2018-11-16 00:44:54 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-16 00:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-16 00:44:54 [DEBUG   ] spawn_process: at 2018-11-16 00:44:54 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-16 00:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-16 00:44:54 [DEBUG   ] spawn_process: at 2018-11-16 00:44:54 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-16 00:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-16 00:44:54 [DEBUG   ] spawn_process: at 2018-11-16 00:44:54 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-16 00:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-16 00:44:54 [DEBUG   ] spawn_process: at 2018-11-16 00:44:54 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-16 00:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-16 00:44:54 [DEBUG   ] spawn_process: at 2018-11-16 00:44:54 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-16 00:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-16 00:44:54 [DEBUG   ] spawn_process: at 2018-11-16 00:44:54 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-16 00:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-16 00:44:54 [DEBUG   ] spawn_process: at 2018-11-16 00:44:54 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-16 00:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-16 00:44:54 [DEBUG   ] spawn_process: at 2018-11-16 00:44:54 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-16 00:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-16 00:44:54 [DEBUG   ] spawn_process: at 2018-11-16 00:44:54 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-16 00:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-16 00:44:54 [DEBUG   ] spawn_process: at 2018-11-16 00:44:54 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-16 00:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-16 00:44:54 [DEBUG   ] spawn_process: at 2018-11-16 00:44:54 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-16 00:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-16 00:44:54 [DEBUG   ] spawn_process: at 2018-11-16 00:44:54 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-16 00:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-16 00:44:54 [DEBUG   ] spawn_process: at 2018-11-16 00:44:54 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-16 00:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-16 00:44:54 [DEBUG   ] spawn_process: at 2018-11-16 00:44:54 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-16 00:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-16 00:44:54 [DEBUG   ] spawn_process: at 2018-11-16 00:44:54 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-16 00:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-16 00:44:54 [DEBUG   ] spawn_process: at 2018-11-16 00:44:54 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-16 00:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-16 00:44:54 [DEBUG   ] spawn_process: at 2018-11-16 00:44:54 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-16 00:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-16 00:44:54 [DEBUG   ] spawn_process: at 2018-11-16 00:44:54 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-16 00:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-16 00:44:54 [DEBUG   ] spawn_process: at 2018-11-16 00:44:54 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-16 00:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-16 00:44:54 [DEBUG   ] spawn_process: at 2018-11-16 00:44:54 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-16 00:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-16 00:44:54 [DEBUG   ] spawn_process: at 2018-11-16 00:44:54 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-16 00:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-16 00:44:54 [DEBUG   ] spawn_process: at 2018-11-16 00:44:54 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-16 00:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-16 00:44:54 [DEBUG   ] spawn_process: at 2018-11-16 00:44:54 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-16 00:44:54 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-16 00:44:54 [DEBUG   ] spawn_process: at 2018-11-16 00:44:54 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-16 00:45:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 00:45:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:45:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-16 00:45:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-16 00:45:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-16 00:45:05 [WARNING ] (13, 1, 'bot')
2018-11-16 00:45:05 [WARNING ] (13, 1, 'bot')
2018-11-16 00:45:05 [WARNING ] (13, 1, 'bot')
2018-11-16 00:45:05 [WARNING ] (13, 1, 'bot')
2018-11-16 00:45:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:45:05 [DEBUG   ] Finished updating board flags in 1.208 seconds
2018-11-16 00:45:23 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-16 00:45:25 [DEBUG   ] Got command BAM from MCS: ref #520985
2018-11-16 00:45:25 [INFO    ] Finished processing BAM request
2018-11-16 00:45:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:45:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520985   8 58438  2725029 A  ERROR'
2018-11-16 00:45:25 [DEBUG   ] Got command BAM from MCS: ref #520986
2018-11-16 00:45:25 [INFO    ] Finished processing BAM request
2018-11-16 00:45:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:45:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   520986   8 58438  2725033 A  ERROR'
2018-11-16 00:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-16 00:45:25 [DEBUG   ] spawn_process: at 2018-11-16 00:45:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-16 00:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-16 00:45:25 [DEBUG   ] spawn_process: at 2018-11-16 00:45:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-16 00:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-16 00:45:25 [DEBUG   ] spawn_process: at 2018-11-16 00:45:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-16 00:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-16 00:45:25 [DEBUG   ] spawn_process: at 2018-11-16 00:45:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-16 00:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-16 00:45:25 [DEBUG   ] spawn_process: at 2018-11-16 00:45:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-16 00:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-16 00:45:25 [DEBUG   ] spawn_process: at 2018-11-16 00:45:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-16 00:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-16 00:45:25 [DEBUG   ] spawn_process: at 2018-11-16 00:45:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-16 00:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-16 00:45:25 [DEBUG   ] spawn_process: at 2018-11-16 00:45:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-16 00:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-16 00:45:25 [DEBUG   ] spawn_process: at 2018-11-16 00:45:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-16 00:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-16 00:45:25 [DEBUG   ] spawn_process: at 2018-11-16 00:45:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-16 00:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-16 00:45:25 [DEBUG   ] spawn_process: at 2018-11-16 00:45:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-16 00:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-16 00:45:25 [DEBUG   ] spawn_process: at 2018-11-16 00:45:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-16 00:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-16 00:45:25 [DEBUG   ] spawn_process: at 2018-11-16 00:45:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-16 00:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-16 00:45:25 [DEBUG   ] spawn_process: at 2018-11-16 00:45:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-16 00:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-16 00:45:25 [DEBUG   ] spawn_process: at 2018-11-16 00:45:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-16 00:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-16 00:45:25 [DEBUG   ] spawn_process: at 2018-11-16 00:45:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-16 00:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-16 00:45:25 [DEBUG   ] spawn_process: at 2018-11-16 00:45:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-16 00:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-16 00:45:25 [DEBUG   ] spawn_process: at 2018-11-16 00:45:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-16 00:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-16 00:45:25 [DEBUG   ] spawn_process: at 2018-11-16 00:45:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-16 00:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-16 00:45:25 [DEBUG   ] spawn_process: at 2018-11-16 00:45:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-16 00:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-16 00:45:25 [DEBUG   ] spawn_process: at 2018-11-16 00:45:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-16 00:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-16 00:45:25 [DEBUG   ] spawn_process: at 2018-11-16 00:45:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-16 00:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-16 00:45:25 [DEBUG   ] spawn_process: at 2018-11-16 00:45:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-16 00:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-16 00:45:25 [DEBUG   ] spawn_process: at 2018-11-16 00:45:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-16 00:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-16 00:45:25 [DEBUG   ] spawn_process: at 2018-11-16 00:45:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-16 00:45:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-16 00:45:25 [DEBUG   ] spawn_process: at 2018-11-16 00:45:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-16 00:45:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 00:45:45 [DEBUG   ] Got command RPT from MCS: ref #520987
2018-11-16 00:45:45 [DEBUG   ] summary = ERROR
2018-11-16 00:45:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520987  13 58438  2745257 A  ERRORERROR'
2018-11-16 00:45:45 [DEBUG   ] Got command RPT from MCS: ref #520988
2018-11-16 00:45:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 00:45:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   520988  77 58438  2745258 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 00:45:56 [DEBUG   ] Got command BAM from MCS: ref #521004
2018-11-16 00:45:56 [INFO    ] Finished processing BAM request
2018-11-16 00:45:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:45:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521004   8 58438  2756025 A  ERROR'
2018-11-16 00:45:56 [DEBUG   ] Got command BAM from MCS: ref #521005
2018-11-16 00:45:56 [INFO    ] Finished processing BAM request
2018-11-16 00:45:56 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:45:56 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521005   8 58438  2756029 A  ERROR'
2018-11-16 00:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-16 00:45:56 [DEBUG   ] spawn_process: at 2018-11-16 00:45:56 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-16 00:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-16 00:45:56 [DEBUG   ] spawn_process: at 2018-11-16 00:45:56 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-16 00:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-16 00:45:56 [DEBUG   ] spawn_process: at 2018-11-16 00:45:56 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-16 00:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-16 00:45:56 [DEBUG   ] spawn_process: at 2018-11-16 00:45:56 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-16 00:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-16 00:45:56 [DEBUG   ] spawn_process: at 2018-11-16 00:45:56 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-16 00:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-16 00:45:56 [DEBUG   ] spawn_process: at 2018-11-16 00:45:56 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-16 00:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-16 00:45:56 [DEBUG   ] spawn_process: at 2018-11-16 00:45:56 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-16 00:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-16 00:45:56 [DEBUG   ] spawn_process: at 2018-11-16 00:45:56 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-16 00:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-16 00:45:56 [DEBUG   ] spawn_process: at 2018-11-16 00:45:56 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-16 00:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-16 00:45:56 [DEBUG   ] spawn_process: at 2018-11-16 00:45:56 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-16 00:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-16 00:45:56 [DEBUG   ] spawn_process: at 2018-11-16 00:45:56 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-16 00:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-16 00:45:56 [DEBUG   ] spawn_process: at 2018-11-16 00:45:56 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-16 00:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-16 00:45:56 [DEBUG   ] spawn_process: at 2018-11-16 00:45:56 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-16 00:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-16 00:45:56 [DEBUG   ] spawn_process: at 2018-11-16 00:45:56 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-16 00:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-16 00:45:56 [DEBUG   ] spawn_process: at 2018-11-16 00:45:56 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-16 00:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-16 00:45:56 [DEBUG   ] spawn_process: at 2018-11-16 00:45:56 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-16 00:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-16 00:45:56 [DEBUG   ] spawn_process: at 2018-11-16 00:45:56 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-16 00:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-16 00:45:56 [DEBUG   ] spawn_process: at 2018-11-16 00:45:56 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-16 00:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-16 00:45:56 [DEBUG   ] spawn_process: at 2018-11-16 00:45:56 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-16 00:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-16 00:45:56 [DEBUG   ] spawn_process: at 2018-11-16 00:45:56 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-16 00:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-16 00:45:56 [DEBUG   ] spawn_process: at 2018-11-16 00:45:56 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-16 00:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-16 00:45:56 [DEBUG   ] spawn_process: at 2018-11-16 00:45:56 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-16 00:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-16 00:45:56 [DEBUG   ] spawn_process: at 2018-11-16 00:45:56 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-16 00:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-16 00:45:56 [DEBUG   ] spawn_process: at 2018-11-16 00:45:56 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-16 00:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-16 00:45:56 [DEBUG   ] spawn_process: at 2018-11-16 00:45:56 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-16 00:45:56 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-16 00:45:56 [DEBUG   ] spawn_process: at 2018-11-16 00:45:56 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-16 00:46:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 00:46:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-16 00:46:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:46:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 00:46:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-16 00:46:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-16 00:46:05 [WARNING ] (13, 1, 'bot')
2018-11-16 00:46:05 [WARNING ] (13, 1, 'bot')
2018-11-16 00:46:05 [WARNING ] (13, 1, 'bot')
2018-11-16 00:46:05 [WARNING ] (13, 1, 'bot')
2018-11-16 00:46:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:46:05 [DEBUG   ] Finished updating board flags in 1.183 seconds
2018-11-16 00:46:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 00:46:27 [DEBUG   ] Got command BAM from MCS: ref #521006
2018-11-16 00:46:27 [INFO    ] Finished processing BAM request
2018-11-16 00:46:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:46:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521006   8 58438  2787033 A  ERROR'
2018-11-16 00:46:27 [DEBUG   ] Got command BAM from MCS: ref #521007
2018-11-16 00:46:27 [INFO    ] Finished processing BAM request
2018-11-16 00:46:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:46:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521007   8 58438  2787037 A  ERROR'
2018-11-16 00:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-16 00:46:27 [DEBUG   ] spawn_process: at 2018-11-16 00:46:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-16 00:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-16 00:46:27 [DEBUG   ] spawn_process: at 2018-11-16 00:46:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-16 00:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-16 00:46:27 [DEBUG   ] spawn_process: at 2018-11-16 00:46:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-16 00:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-16 00:46:27 [DEBUG   ] spawn_process: at 2018-11-16 00:46:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-16 00:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-16 00:46:27 [DEBUG   ] spawn_process: at 2018-11-16 00:46:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-16 00:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-16 00:46:27 [DEBUG   ] spawn_process: at 2018-11-16 00:46:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-16 00:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-16 00:46:27 [DEBUG   ] spawn_process: at 2018-11-16 00:46:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-16 00:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-16 00:46:27 [DEBUG   ] spawn_process: at 2018-11-16 00:46:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-16 00:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-16 00:46:27 [DEBUG   ] spawn_process: at 2018-11-16 00:46:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-16 00:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-16 00:46:27 [DEBUG   ] spawn_process: at 2018-11-16 00:46:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-16 00:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-16 00:46:27 [DEBUG   ] spawn_process: at 2018-11-16 00:46:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-16 00:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-16 00:46:27 [DEBUG   ] spawn_process: at 2018-11-16 00:46:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-16 00:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-16 00:46:27 [DEBUG   ] spawn_process: at 2018-11-16 00:46:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-16 00:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-16 00:46:27 [DEBUG   ] spawn_process: at 2018-11-16 00:46:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-16 00:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-16 00:46:27 [DEBUG   ] spawn_process: at 2018-11-16 00:46:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-16 00:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-16 00:46:27 [DEBUG   ] spawn_process: at 2018-11-16 00:46:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-16 00:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-16 00:46:27 [DEBUG   ] spawn_process: at 2018-11-16 00:46:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-16 00:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-16 00:46:27 [DEBUG   ] spawn_process: at 2018-11-16 00:46:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-16 00:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-16 00:46:27 [DEBUG   ] spawn_process: at 2018-11-16 00:46:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-16 00:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-16 00:46:27 [DEBUG   ] spawn_process: at 2018-11-16 00:46:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-16 00:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-16 00:46:27 [DEBUG   ] spawn_process: at 2018-11-16 00:46:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-16 00:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-16 00:46:27 [DEBUG   ] spawn_process: at 2018-11-16 00:46:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-16 00:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-16 00:46:27 [DEBUG   ] spawn_process: at 2018-11-16 00:46:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-16 00:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-16 00:46:27 [DEBUG   ] spawn_process: at 2018-11-16 00:46:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-16 00:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-16 00:46:27 [DEBUG   ] spawn_process: at 2018-11-16 00:46:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-16 00:46:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-16 00:46:27 [DEBUG   ] spawn_process: at 2018-11-16 00:46:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-16 00:46:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 00:46:58 [DEBUG   ] Got command BAM from MCS: ref #521008
2018-11-16 00:46:58 [INFO    ] Finished processing BAM request
2018-11-16 00:46:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:46:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521008   8 58438  2818033 A  ERROR'
2018-11-16 00:46:58 [DEBUG   ] Got command BAM from MCS: ref #521009
2018-11-16 00:46:58 [INFO    ] Finished processing BAM request
2018-11-16 00:46:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:46:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521009   8 58438  2818037 A  ERROR'
2018-11-16 00:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-16 00:46:58 [DEBUG   ] spawn_process: at 2018-11-16 00:46:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-16 00:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-16 00:46:58 [DEBUG   ] spawn_process: at 2018-11-16 00:46:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-16 00:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-16 00:46:58 [DEBUG   ] spawn_process: at 2018-11-16 00:46:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-16 00:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-16 00:46:58 [DEBUG   ] spawn_process: at 2018-11-16 00:46:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-16 00:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-16 00:46:58 [DEBUG   ] spawn_process: at 2018-11-16 00:46:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-16 00:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-16 00:46:58 [DEBUG   ] spawn_process: at 2018-11-16 00:46:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-16 00:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-16 00:46:58 [DEBUG   ] spawn_process: at 2018-11-16 00:46:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-16 00:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-16 00:46:58 [DEBUG   ] spawn_process: at 2018-11-16 00:46:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-16 00:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-16 00:46:58 [DEBUG   ] spawn_process: at 2018-11-16 00:46:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-16 00:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-16 00:46:58 [DEBUG   ] spawn_process: at 2018-11-16 00:46:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-16 00:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-16 00:46:58 [DEBUG   ] spawn_process: at 2018-11-16 00:46:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-16 00:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-16 00:46:58 [DEBUG   ] spawn_process: at 2018-11-16 00:46:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-16 00:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-16 00:46:58 [DEBUG   ] spawn_process: at 2018-11-16 00:46:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-16 00:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-16 00:46:58 [DEBUG   ] spawn_process: at 2018-11-16 00:46:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-16 00:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-16 00:46:58 [DEBUG   ] spawn_process: at 2018-11-16 00:46:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-16 00:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-16 00:46:58 [DEBUG   ] spawn_process: at 2018-11-16 00:46:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-16 00:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-16 00:46:58 [DEBUG   ] spawn_process: at 2018-11-16 00:46:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-16 00:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-16 00:46:58 [DEBUG   ] spawn_process: at 2018-11-16 00:46:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-16 00:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-16 00:46:58 [DEBUG   ] spawn_process: at 2018-11-16 00:46:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-16 00:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-16 00:46:58 [DEBUG   ] spawn_process: at 2018-11-16 00:46:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-16 00:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-16 00:46:58 [DEBUG   ] spawn_process: at 2018-11-16 00:46:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-16 00:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-16 00:46:58 [DEBUG   ] spawn_process: at 2018-11-16 00:46:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-16 00:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-16 00:46:58 [DEBUG   ] spawn_process: at 2018-11-16 00:46:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-16 00:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-16 00:46:58 [DEBUG   ] spawn_process: at 2018-11-16 00:46:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-16 00:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-16 00:46:58 [DEBUG   ] spawn_process: at 2018-11-16 00:46:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-16 00:46:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-16 00:46:58 [DEBUG   ] spawn_process: at 2018-11-16 00:46:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-16 00:47:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 00:47:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-16 00:47:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-11-16 00:47:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:47:05 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-16 00:47:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-16 00:47:05 [WARNING ] (13, 1, 'bot')
2018-11-16 00:47:05 [WARNING ] (13, 1, 'bot')
2018-11-16 00:47:05 [WARNING ] (13, 1, 'bot')
2018-11-16 00:47:05 [WARNING ] (13, 1, 'bot')
2018-11-16 00:47:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:47:05 [DEBUG   ] Finished updating board flags in 1.016 seconds
2018-11-16 00:47:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 00:47:29 [DEBUG   ] Got command BAM from MCS: ref #521010
2018-11-16 00:47:29 [INFO    ] Finished processing BAM request
2018-11-16 00:47:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:47:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521010   8 58438  2849025 A  ERROR'
2018-11-16 00:47:29 [DEBUG   ] Got command BAM from MCS: ref #521011
2018-11-16 00:47:29 [INFO    ] Finished processing BAM request
2018-11-16 00:47:29 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:47:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521011   8 58438  2849029 A  ERROR'
2018-11-16 00:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-16 00:47:29 [DEBUG   ] spawn_process: at 2018-11-16 00:47:29 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-16 00:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-16 00:47:29 [DEBUG   ] spawn_process: at 2018-11-16 00:47:29 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-16 00:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-16 00:47:29 [DEBUG   ] spawn_process: at 2018-11-16 00:47:29 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-16 00:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-16 00:47:29 [DEBUG   ] spawn_process: at 2018-11-16 00:47:29 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-16 00:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-16 00:47:29 [DEBUG   ] spawn_process: at 2018-11-16 00:47:29 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-16 00:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-16 00:47:29 [DEBUG   ] spawn_process: at 2018-11-16 00:47:29 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-16 00:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-16 00:47:29 [DEBUG   ] spawn_process: at 2018-11-16 00:47:29 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-16 00:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-16 00:47:29 [DEBUG   ] spawn_process: at 2018-11-16 00:47:29 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-16 00:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-16 00:47:29 [DEBUG   ] spawn_process: at 2018-11-16 00:47:29 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-16 00:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-16 00:47:29 [DEBUG   ] spawn_process: at 2018-11-16 00:47:29 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-16 00:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-16 00:47:29 [DEBUG   ] spawn_process: at 2018-11-16 00:47:29 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-16 00:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-16 00:47:29 [DEBUG   ] spawn_process: at 2018-11-16 00:47:29 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-16 00:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-16 00:47:29 [DEBUG   ] spawn_process: at 2018-11-16 00:47:29 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-16 00:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-16 00:47:29 [DEBUG   ] spawn_process: at 2018-11-16 00:47:29 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-16 00:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-16 00:47:29 [DEBUG   ] spawn_process: at 2018-11-16 00:47:29 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-16 00:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-16 00:47:29 [DEBUG   ] spawn_process: at 2018-11-16 00:47:29 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-16 00:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-16 00:47:29 [DEBUG   ] spawn_process: at 2018-11-16 00:47:29 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-16 00:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-16 00:47:29 [DEBUG   ] spawn_process: at 2018-11-16 00:47:29 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-16 00:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-16 00:47:29 [DEBUG   ] spawn_process: at 2018-11-16 00:47:29 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-16 00:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-16 00:47:29 [DEBUG   ] spawn_process: at 2018-11-16 00:47:29 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-16 00:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-16 00:47:29 [DEBUG   ] spawn_process: at 2018-11-16 00:47:29 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-16 00:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-16 00:47:29 [DEBUG   ] spawn_process: at 2018-11-16 00:47:29 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-16 00:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-16 00:47:29 [DEBUG   ] spawn_process: at 2018-11-16 00:47:29 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-16 00:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-16 00:47:29 [DEBUG   ] spawn_process: at 2018-11-16 00:47:29 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-16 00:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-16 00:47:29 [DEBUG   ] spawn_process: at 2018-11-16 00:47:29 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-16 00:47:29 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-16 00:47:29 [DEBUG   ] spawn_process: at 2018-11-16 00:47:29 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-16 00:47:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 00:48:00 [DEBUG   ] Got command BAM from MCS: ref #521016
2018-11-16 00:48:00 [INFO    ] Finished processing BAM request
2018-11-16 00:48:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:48:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521016   8 58438  2880033 A  ERROR'
2018-11-16 00:48:00 [DEBUG   ] Got command BAM from MCS: ref #521017
2018-11-16 00:48:00 [INFO    ] Finished processing BAM request
2018-11-16 00:48:00 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:48:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521017   8 58438  2880037 A  ERROR'
2018-11-16 00:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-16 00:48:00 [DEBUG   ] spawn_process: at 2018-11-16 00:48:00 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-16 00:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-16 00:48:00 [DEBUG   ] spawn_process: at 2018-11-16 00:48:00 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-16 00:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-16 00:48:00 [DEBUG   ] spawn_process: at 2018-11-16 00:48:00 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-16 00:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-16 00:48:00 [DEBUG   ] spawn_process: at 2018-11-16 00:48:00 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-16 00:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-16 00:48:00 [DEBUG   ] spawn_process: at 2018-11-16 00:48:00 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-16 00:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-16 00:48:00 [DEBUG   ] spawn_process: at 2018-11-16 00:48:00 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-16 00:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-16 00:48:00 [DEBUG   ] spawn_process: at 2018-11-16 00:48:00 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-16 00:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-16 00:48:00 [DEBUG   ] spawn_process: at 2018-11-16 00:48:00 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-16 00:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-16 00:48:00 [DEBUG   ] spawn_process: at 2018-11-16 00:48:00 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-16 00:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-16 00:48:00 [DEBUG   ] spawn_process: at 2018-11-16 00:48:00 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-16 00:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-16 00:48:00 [DEBUG   ] spawn_process: at 2018-11-16 00:48:00 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-16 00:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-16 00:48:00 [DEBUG   ] spawn_process: at 2018-11-16 00:48:00 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-16 00:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-16 00:48:00 [DEBUG   ] spawn_process: at 2018-11-16 00:48:00 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-16 00:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-16 00:48:00 [DEBUG   ] spawn_process: at 2018-11-16 00:48:00 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-16 00:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-16 00:48:00 [DEBUG   ] spawn_process: at 2018-11-16 00:48:00 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-16 00:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-16 00:48:00 [DEBUG   ] spawn_process: at 2018-11-16 00:48:00 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-16 00:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-16 00:48:00 [DEBUG   ] spawn_process: at 2018-11-16 00:48:00 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-16 00:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-16 00:48:00 [DEBUG   ] spawn_process: at 2018-11-16 00:48:00 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-16 00:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-16 00:48:00 [DEBUG   ] spawn_process: at 2018-11-16 00:48:00 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-16 00:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-16 00:48:00 [DEBUG   ] spawn_process: at 2018-11-16 00:48:00 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-16 00:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-16 00:48:00 [DEBUG   ] spawn_process: at 2018-11-16 00:48:00 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-16 00:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-16 00:48:00 [DEBUG   ] spawn_process: at 2018-11-16 00:48:00 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-16 00:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-16 00:48:00 [DEBUG   ] spawn_process: at 2018-11-16 00:48:00 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-16 00:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-16 00:48:00 [DEBUG   ] spawn_process: at 2018-11-16 00:48:00 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-16 00:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-16 00:48:00 [DEBUG   ] spawn_process: at 2018-11-16 00:48:00 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-16 00:48:00 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-16 00:48:00 [DEBUG   ] spawn_process: at 2018-11-16 00:48:00 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-16 00:48:03 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 00:48:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:48:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 5
2018-11-16 00:48:05 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-16 00:48:05 [WARNING ] (13, 1, 'bot')
2018-11-16 00:48:05 [WARNING ] (13, 1, 'bot')
2018-11-16 00:48:05 [WARNING ] (13, 1, 'bot')
2018-11-16 00:48:05 [WARNING ] (13, 1, 'bot')
2018-11-16 00:48:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:48:05 [DEBUG   ] Finished updating board flags in 0.984 seconds
2018-11-16 00:48:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 00:48:28 [DEBUG   ] Got command RPT from MCS: ref #521020
2018-11-16 00:48:28 [DEBUG   ] summary = ERROR
2018-11-16 00:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521020  13 58438  2908081 A  ERRORERROR'
2018-11-16 00:48:28 [DEBUG   ] Got command RPT from MCS: ref #521021
2018-11-16 00:48:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 00:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521021  77 58438  2908285 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 00:48:28 [DEBUG   ] Got command RPT from MCS: ref #521022
2018-11-16 00:48:28 [DEBUG   ] summary = ERROR
2018-11-16 00:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521022  13 58438  2908489 A  ERRORERROR'
2018-11-16 00:48:28 [DEBUG   ] Got command RPT from MCS: ref #521024
2018-11-16 00:48:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 00:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521024  77 58438  2908693 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 00:48:28 [DEBUG   ] Got command RPT from MCS: ref #521025
2018-11-16 00:48:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 00:48:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521025  12 58438  2908885 A  ERRORB¢ff'
2018-11-16 00:48:31 [DEBUG   ] Got command BAM from MCS: ref #521030
2018-11-16 00:48:31 [INFO    ] Finished processing BAM request
2018-11-16 00:48:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:48:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521030   8 58438  2911025 A  ERROR'
2018-11-16 00:48:31 [DEBUG   ] Got command BAM from MCS: ref #521031
2018-11-16 00:48:31 [INFO    ] Finished processing BAM request
2018-11-16 00:48:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:48:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521031   8 58438  2911029 A  ERROR'
2018-11-16 00:48:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-16 00:48:31 [DEBUG   ] spawn_process: at 2018-11-16 00:48:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-16 00:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-16 00:48:32 [DEBUG   ] spawn_process: at 2018-11-16 00:48:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-16 00:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-16 00:48:32 [DEBUG   ] spawn_process: at 2018-11-16 00:48:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-16 00:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-16 00:48:32 [DEBUG   ] spawn_process: at 2018-11-16 00:48:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-16 00:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-16 00:48:32 [DEBUG   ] spawn_process: at 2018-11-16 00:48:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-16 00:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-16 00:48:32 [DEBUG   ] spawn_process: at 2018-11-16 00:48:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-16 00:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-16 00:48:32 [DEBUG   ] spawn_process: at 2018-11-16 00:48:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-16 00:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-16 00:48:32 [DEBUG   ] spawn_process: at 2018-11-16 00:48:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-16 00:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-16 00:48:32 [DEBUG   ] spawn_process: at 2018-11-16 00:48:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-16 00:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-16 00:48:32 [DEBUG   ] spawn_process: at 2018-11-16 00:48:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-16 00:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-16 00:48:32 [DEBUG   ] spawn_process: at 2018-11-16 00:48:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-16 00:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-16 00:48:32 [DEBUG   ] spawn_process: at 2018-11-16 00:48:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-16 00:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-16 00:48:32 [DEBUG   ] spawn_process: at 2018-11-16 00:48:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-16 00:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-16 00:48:32 [DEBUG   ] spawn_process: at 2018-11-16 00:48:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-16 00:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-16 00:48:32 [DEBUG   ] spawn_process: at 2018-11-16 00:48:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-16 00:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-16 00:48:32 [DEBUG   ] spawn_process: at 2018-11-16 00:48:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-16 00:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-16 00:48:32 [DEBUG   ] spawn_process: at 2018-11-16 00:48:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-16 00:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-16 00:48:32 [DEBUG   ] spawn_process: at 2018-11-16 00:48:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-16 00:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-16 00:48:32 [DEBUG   ] spawn_process: at 2018-11-16 00:48:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-16 00:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-16 00:48:32 [DEBUG   ] spawn_process: at 2018-11-16 00:48:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-16 00:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-16 00:48:32 [DEBUG   ] spawn_process: at 2018-11-16 00:48:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-16 00:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-16 00:48:32 [DEBUG   ] spawn_process: at 2018-11-16 00:48:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-16 00:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-16 00:48:32 [DEBUG   ] spawn_process: at 2018-11-16 00:48:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-16 00:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-16 00:48:32 [DEBUG   ] spawn_process: at 2018-11-16 00:48:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-16 00:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-16 00:48:32 [DEBUG   ] spawn_process: at 2018-11-16 00:48:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-16 00:48:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-16 00:48:32 [DEBUG   ] spawn_process: at 2018-11-16 00:48:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-16 00:48:43 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-16 00:49:02 [DEBUG   ] Got command BAM from MCS: ref #521032
2018-11-16 00:49:02 [INFO    ] Finished processing BAM request
2018-11-16 00:49:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:49:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521032   8 58438  2942029 A  ERROR'
2018-11-16 00:49:02 [DEBUG   ] Got command BAM from MCS: ref #521033
2018-11-16 00:49:02 [INFO    ] Finished processing BAM request
2018-11-16 00:49:02 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:49:02 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521033   8 58438  2942033 A  ERROR'
2018-11-16 00:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-16 00:49:02 [DEBUG   ] spawn_process: at 2018-11-16 00:49:02 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-16 00:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-16 00:49:02 [DEBUG   ] spawn_process: at 2018-11-16 00:49:02 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-16 00:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-16 00:49:02 [DEBUG   ] spawn_process: at 2018-11-16 00:49:02 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-16 00:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-16 00:49:02 [DEBUG   ] spawn_process: at 2018-11-16 00:49:02 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-16 00:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-16 00:49:02 [DEBUG   ] spawn_process: at 2018-11-16 00:49:02 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-16 00:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-16 00:49:02 [DEBUG   ] spawn_process: at 2018-11-16 00:49:02 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-16 00:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-16 00:49:02 [DEBUG   ] spawn_process: at 2018-11-16 00:49:02 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-16 00:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-16 00:49:02 [DEBUG   ] spawn_process: at 2018-11-16 00:49:02 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-16 00:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-16 00:49:02 [DEBUG   ] spawn_process: at 2018-11-16 00:49:02 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-16 00:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-16 00:49:02 [DEBUG   ] spawn_process: at 2018-11-16 00:49:02 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-16 00:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-16 00:49:02 [DEBUG   ] spawn_process: at 2018-11-16 00:49:02 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-16 00:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-16 00:49:02 [DEBUG   ] spawn_process: at 2018-11-16 00:49:02 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-16 00:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-16 00:49:02 [DEBUG   ] spawn_process: at 2018-11-16 00:49:02 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-16 00:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-16 00:49:02 [DEBUG   ] spawn_process: at 2018-11-16 00:49:02 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-16 00:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-16 00:49:02 [DEBUG   ] spawn_process: at 2018-11-16 00:49:02 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-16 00:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-16 00:49:02 [DEBUG   ] spawn_process: at 2018-11-16 00:49:02 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-16 00:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-16 00:49:02 [DEBUG   ] spawn_process: at 2018-11-16 00:49:02 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-16 00:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-16 00:49:02 [DEBUG   ] spawn_process: at 2018-11-16 00:49:02 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-16 00:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-16 00:49:02 [DEBUG   ] spawn_process: at 2018-11-16 00:49:02 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-16 00:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-16 00:49:02 [DEBUG   ] spawn_process: at 2018-11-16 00:49:02 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-16 00:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-16 00:49:02 [DEBUG   ] spawn_process: at 2018-11-16 00:49:02 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-16 00:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-16 00:49:02 [DEBUG   ] spawn_process: at 2018-11-16 00:49:02 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-16 00:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-16 00:49:02 [DEBUG   ] spawn_process: at 2018-11-16 00:49:02 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-16 00:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-16 00:49:02 [DEBUG   ] spawn_process: at 2018-11-16 00:49:02 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-16 00:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-16 00:49:02 [DEBUG   ] spawn_process: at 2018-11-16 00:49:02 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-16 00:49:02 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-16 00:49:02 [DEBUG   ] spawn_process: at 2018-11-16 00:49:02 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-16 00:49:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 00:49:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 00:49:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:49:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-16 00:49:06 [WARNING ] (13, 1, 'bot')
2018-11-16 00:49:06 [WARNING ] (13, 1, 'bot')
2018-11-16 00:49:06 [WARNING ] (13, 1, 'bot')
2018-11-16 00:49:06 [WARNING ] (13, 1, 'bot')
2018-11-16 00:49:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:49:06 [DEBUG   ] Finished updating board flags in 1.358 seconds
2018-11-16 00:49:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 00:49:33 [DEBUG   ] Got command BAM from MCS: ref #521034
2018-11-16 00:49:33 [INFO    ] Finished processing BAM request
2018-11-16 00:49:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:49:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521034   8 58438  2973025 A  ERROR'
2018-11-16 00:49:33 [DEBUG   ] Got command BAM from MCS: ref #521035
2018-11-16 00:49:33 [INFO    ] Finished processing BAM request
2018-11-16 00:49:33 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:49:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521035   8 58438  2973029 A  ERROR'
2018-11-16 00:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-16 00:49:33 [DEBUG   ] spawn_process: at 2018-11-16 00:49:33 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-16 00:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-16 00:49:33 [DEBUG   ] spawn_process: at 2018-11-16 00:49:33 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-16 00:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-16 00:49:33 [DEBUG   ] spawn_process: at 2018-11-16 00:49:33 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-16 00:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-16 00:49:33 [DEBUG   ] spawn_process: at 2018-11-16 00:49:33 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-16 00:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-16 00:49:33 [DEBUG   ] spawn_process: at 2018-11-16 00:49:33 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-16 00:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-16 00:49:33 [DEBUG   ] spawn_process: at 2018-11-16 00:49:33 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-16 00:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-16 00:49:33 [DEBUG   ] spawn_process: at 2018-11-16 00:49:33 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-16 00:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-16 00:49:33 [DEBUG   ] spawn_process: at 2018-11-16 00:49:33 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-16 00:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-16 00:49:33 [DEBUG   ] spawn_process: at 2018-11-16 00:49:33 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-16 00:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-16 00:49:33 [DEBUG   ] spawn_process: at 2018-11-16 00:49:33 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-16 00:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-16 00:49:33 [DEBUG   ] spawn_process: at 2018-11-16 00:49:33 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-16 00:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-16 00:49:33 [DEBUG   ] spawn_process: at 2018-11-16 00:49:33 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-16 00:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-16 00:49:33 [DEBUG   ] spawn_process: at 2018-11-16 00:49:33 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-16 00:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-16 00:49:33 [DEBUG   ] spawn_process: at 2018-11-16 00:49:33 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-16 00:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-16 00:49:33 [DEBUG   ] spawn_process: at 2018-11-16 00:49:33 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-16 00:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-16 00:49:33 [DEBUG   ] spawn_process: at 2018-11-16 00:49:33 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-16 00:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-16 00:49:33 [DEBUG   ] spawn_process: at 2018-11-16 00:49:33 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-16 00:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-16 00:49:33 [DEBUG   ] spawn_process: at 2018-11-16 00:49:33 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-16 00:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-16 00:49:33 [DEBUG   ] spawn_process: at 2018-11-16 00:49:33 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-16 00:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-16 00:49:33 [DEBUG   ] spawn_process: at 2018-11-16 00:49:33 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-16 00:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-16 00:49:33 [DEBUG   ] spawn_process: at 2018-11-16 00:49:33 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-16 00:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-16 00:49:33 [DEBUG   ] spawn_process: at 2018-11-16 00:49:33 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-16 00:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-16 00:49:33 [DEBUG   ] spawn_process: at 2018-11-16 00:49:33 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-16 00:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-16 00:49:33 [DEBUG   ] spawn_process: at 2018-11-16 00:49:33 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-16 00:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-16 00:49:33 [DEBUG   ] spawn_process: at 2018-11-16 00:49:33 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-16 00:49:33 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-16 00:49:33 [DEBUG   ] spawn_process: at 2018-11-16 00:49:33 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-16 00:49:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 00:50:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 00:50:04 [DEBUG   ] Got command BAM from MCS: ref #521036
2018-11-16 00:50:04 [INFO    ] Finished processing BAM request
2018-11-16 00:50:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:50:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521036   8 58438  3004025 A  ERROR'
2018-11-16 00:50:04 [DEBUG   ] Got command BAM from MCS: ref #521037
2018-11-16 00:50:04 [INFO    ] Finished processing BAM request
2018-11-16 00:50:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:50:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521037   8 58438  3004029 A  ERROR'
2018-11-16 00:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-16 00:50:04 [DEBUG   ] spawn_process: at 2018-11-16 00:50:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-16 00:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-16 00:50:04 [DEBUG   ] spawn_process: at 2018-11-16 00:50:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-16 00:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-16 00:50:04 [DEBUG   ] spawn_process: at 2018-11-16 00:50:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-16 00:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-16 00:50:04 [DEBUG   ] spawn_process: at 2018-11-16 00:50:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-16 00:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-16 00:50:04 [DEBUG   ] spawn_process: at 2018-11-16 00:50:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-16 00:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-16 00:50:04 [DEBUG   ] spawn_process: at 2018-11-16 00:50:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-16 00:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-16 00:50:04 [DEBUG   ] spawn_process: at 2018-11-16 00:50:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-16 00:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-16 00:50:04 [DEBUG   ] spawn_process: at 2018-11-16 00:50:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-16 00:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-16 00:50:04 [DEBUG   ] spawn_process: at 2018-11-16 00:50:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-16 00:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-16 00:50:04 [DEBUG   ] spawn_process: at 2018-11-16 00:50:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-16 00:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-16 00:50:04 [DEBUG   ] spawn_process: at 2018-11-16 00:50:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-16 00:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-16 00:50:04 [DEBUG   ] spawn_process: at 2018-11-16 00:50:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-16 00:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-16 00:50:04 [DEBUG   ] spawn_process: at 2018-11-16 00:50:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-16 00:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-16 00:50:04 [DEBUG   ] spawn_process: at 2018-11-16 00:50:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-16 00:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-16 00:50:04 [DEBUG   ] spawn_process: at 2018-11-16 00:50:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-16 00:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-16 00:50:04 [DEBUG   ] spawn_process: at 2018-11-16 00:50:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-16 00:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-16 00:50:04 [DEBUG   ] spawn_process: at 2018-11-16 00:50:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-16 00:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-16 00:50:04 [DEBUG   ] spawn_process: at 2018-11-16 00:50:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-16 00:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-16 00:50:04 [DEBUG   ] spawn_process: at 2018-11-16 00:50:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-16 00:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-16 00:50:04 [DEBUG   ] spawn_process: at 2018-11-16 00:50:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-16 00:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-16 00:50:04 [DEBUG   ] spawn_process: at 2018-11-16 00:50:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-16 00:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-16 00:50:04 [DEBUG   ] spawn_process: at 2018-11-16 00:50:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-16 00:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-16 00:50:04 [DEBUG   ] spawn_process: at 2018-11-16 00:50:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-16 00:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-16 00:50:04 [DEBUG   ] spawn_process: at 2018-11-16 00:50:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-16 00:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-16 00:50:04 [DEBUG   ] spawn_process: at 2018-11-16 00:50:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-16 00:50:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-16 00:50:04 [DEBUG   ] spawn_process: at 2018-11-16 00:50:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-16 00:50:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 00:50:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-16 00:50:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-11-16 00:50:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:50:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-16 00:50:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-16 00:50:06 [WARNING ] (13, 1, 'bot')
2018-11-16 00:50:06 [WARNING ] (13, 1, 'bot')
2018-11-16 00:50:06 [WARNING ] (13, 1, 'bot')
2018-11-16 00:50:06 [WARNING ] (13, 1, 'bot')
2018-11-16 00:50:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:50:06 [DEBUG   ] Finished updating board flags in 1.202 seconds
2018-11-16 00:50:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 00:50:35 [DEBUG   ] Got command BAM from MCS: ref #521043
2018-11-16 00:50:35 [INFO    ] Finished processing BAM request
2018-11-16 00:50:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:50:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521043   8 58438  3035029 A  ERROR'
2018-11-16 00:50:35 [DEBUG   ] Got command BAM from MCS: ref #521042
2018-11-16 00:50:35 [INFO    ] Finished processing BAM request
2018-11-16 00:50:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:50:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521042   8 58438  3035033 A  ERROR'
2018-11-16 00:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-16 00:50:35 [DEBUG   ] spawn_process: at 2018-11-16 00:50:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-16 00:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-16 00:50:35 [DEBUG   ] spawn_process: at 2018-11-16 00:50:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-16 00:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-16 00:50:35 [DEBUG   ] spawn_process: at 2018-11-16 00:50:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-16 00:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-16 00:50:35 [DEBUG   ] spawn_process: at 2018-11-16 00:50:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-16 00:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-16 00:50:35 [DEBUG   ] spawn_process: at 2018-11-16 00:50:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-16 00:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-16 00:50:35 [DEBUG   ] spawn_process: at 2018-11-16 00:50:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-16 00:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-16 00:50:35 [DEBUG   ] spawn_process: at 2018-11-16 00:50:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-16 00:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-16 00:50:35 [DEBUG   ] spawn_process: at 2018-11-16 00:50:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-16 00:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-16 00:50:35 [DEBUG   ] spawn_process: at 2018-11-16 00:50:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-16 00:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-16 00:50:35 [DEBUG   ] spawn_process: at 2018-11-16 00:50:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-16 00:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-16 00:50:35 [DEBUG   ] spawn_process: at 2018-11-16 00:50:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-16 00:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-16 00:50:35 [DEBUG   ] spawn_process: at 2018-11-16 00:50:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-16 00:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-16 00:50:35 [DEBUG   ] spawn_process: at 2018-11-16 00:50:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-16 00:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-16 00:50:35 [DEBUG   ] spawn_process: at 2018-11-16 00:50:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-16 00:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-16 00:50:35 [DEBUG   ] spawn_process: at 2018-11-16 00:50:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-16 00:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-16 00:50:35 [DEBUG   ] spawn_process: at 2018-11-16 00:50:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-16 00:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-16 00:50:35 [DEBUG   ] spawn_process: at 2018-11-16 00:50:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-16 00:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-16 00:50:35 [DEBUG   ] spawn_process: at 2018-11-16 00:50:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-16 00:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-16 00:50:35 [DEBUG   ] spawn_process: at 2018-11-16 00:50:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-16 00:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-16 00:50:35 [DEBUG   ] spawn_process: at 2018-11-16 00:50:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-16 00:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-16 00:50:35 [DEBUG   ] spawn_process: at 2018-11-16 00:50:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-16 00:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-16 00:50:35 [DEBUG   ] spawn_process: at 2018-11-16 00:50:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-16 00:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-16 00:50:35 [DEBUG   ] spawn_process: at 2018-11-16 00:50:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-16 00:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-16 00:50:35 [DEBUG   ] spawn_process: at 2018-11-16 00:50:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-16 00:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-16 00:50:35 [DEBUG   ] spawn_process: at 2018-11-16 00:50:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-16 00:50:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-16 00:50:35 [DEBUG   ] spawn_process: at 2018-11-16 00:50:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-16 00:50:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 00:50:45 [DEBUG   ] Got command RPT from MCS: ref #521044
2018-11-16 00:50:45 [DEBUG   ] summary = ERROR
2018-11-16 00:50:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521044  13 58438  3045257 A  ERRORERROR'
2018-11-16 00:50:45 [DEBUG   ] Got command RPT from MCS: ref #521045
2018-11-16 00:50:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 00:50:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521045  77 58438  3045258 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 00:51:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 00:51:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:51:06 [DEBUG   ] Got command BAM from MCS: ref #521062
2018-11-16 00:51:06 [INFO    ] Finished processing BAM request
2018-11-16 00:51:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521062   8 58438  3066029 A  ERROR'
2018-11-16 00:51:06 [DEBUG   ] Got command BAM from MCS: ref #521061
2018-11-16 00:51:06 [INFO    ] Finished processing BAM request
2018-11-16 00:51:06 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:51:06 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521061   8 58438  3066037 A  ERROR'
2018-11-16 00:51:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 00:51:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-16 00:51:06 [WARNING ] (13, 1, 'bot')
2018-11-16 00:51:06 [WARNING ] (13, 1, 'bot')
2018-11-16 00:51:06 [WARNING ] (13, 1, 'bot')
2018-11-16 00:51:06 [WARNING ] (13, 1, 'bot')
2018-11-16 00:51:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:51:06 [DEBUG   ] Finished updating board flags in 1.227 seconds
2018-11-16 00:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-16 00:51:06 [DEBUG   ] spawn_process: at 2018-11-16 00:51:06 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-16 00:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-16 00:51:06 [DEBUG   ] spawn_process: at 2018-11-16 00:51:06 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-16 00:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-16 00:51:06 [DEBUG   ] spawn_process: at 2018-11-16 00:51:06 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-16 00:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-16 00:51:06 [DEBUG   ] spawn_process: at 2018-11-16 00:51:06 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-16 00:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-16 00:51:06 [DEBUG   ] spawn_process: at 2018-11-16 00:51:06 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-16 00:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-16 00:51:06 [DEBUG   ] spawn_process: at 2018-11-16 00:51:06 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-16 00:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-16 00:51:06 [DEBUG   ] spawn_process: at 2018-11-16 00:51:06 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-16 00:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-16 00:51:06 [DEBUG   ] spawn_process: at 2018-11-16 00:51:06 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-16 00:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-16 00:51:06 [DEBUG   ] spawn_process: at 2018-11-16 00:51:06 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-16 00:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-16 00:51:06 [DEBUG   ] spawn_process: at 2018-11-16 00:51:06 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-16 00:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-16 00:51:06 [DEBUG   ] spawn_process: at 2018-11-16 00:51:06 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-16 00:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-16 00:51:06 [DEBUG   ] spawn_process: at 2018-11-16 00:51:06 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-16 00:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-16 00:51:06 [DEBUG   ] spawn_process: at 2018-11-16 00:51:06 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-16 00:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-16 00:51:06 [DEBUG   ] spawn_process: at 2018-11-16 00:51:06 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-16 00:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-16 00:51:06 [DEBUG   ] spawn_process: at 2018-11-16 00:51:06 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-16 00:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-16 00:51:06 [DEBUG   ] spawn_process: at 2018-11-16 00:51:06 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-16 00:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-16 00:51:06 [DEBUG   ] spawn_process: at 2018-11-16 00:51:06 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-16 00:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-16 00:51:06 [DEBUG   ] spawn_process: at 2018-11-16 00:51:06 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-16 00:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-16 00:51:06 [DEBUG   ] spawn_process: at 2018-11-16 00:51:06 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-16 00:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-16 00:51:06 [DEBUG   ] spawn_process: at 2018-11-16 00:51:06 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-16 00:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-16 00:51:06 [DEBUG   ] spawn_process: at 2018-11-16 00:51:06 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-16 00:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-16 00:51:06 [DEBUG   ] spawn_process: at 2018-11-16 00:51:06 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-16 00:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-16 00:51:06 [DEBUG   ] spawn_process: at 2018-11-16 00:51:06 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-16 00:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-16 00:51:06 [DEBUG   ] spawn_process: at 2018-11-16 00:51:06 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-16 00:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-16 00:51:06 [DEBUG   ] spawn_process: at 2018-11-16 00:51:06 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-16 00:51:06 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-16 00:51:06 [DEBUG   ] spawn_process: at 2018-11-16 00:51:06 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-16 00:51:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 00:51:37 [DEBUG   ] Got command BAM from MCS: ref #521064
2018-11-16 00:51:37 [INFO    ] Finished processing BAM request
2018-11-16 00:51:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:51:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521064   8 58438  3097034 A  ERROR'
2018-11-16 00:51:37 [DEBUG   ] Got command BAM from MCS: ref #521063
2018-11-16 00:51:37 [INFO    ] Finished processing BAM request
2018-11-16 00:51:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:51:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521063   8 58438  3097038 A  ERROR'
2018-11-16 00:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-16 00:51:37 [DEBUG   ] spawn_process: at 2018-11-16 00:51:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-16 00:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-16 00:51:37 [DEBUG   ] spawn_process: at 2018-11-16 00:51:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-16 00:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-16 00:51:37 [DEBUG   ] spawn_process: at 2018-11-16 00:51:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-16 00:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-16 00:51:37 [DEBUG   ] spawn_process: at 2018-11-16 00:51:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-16 00:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-16 00:51:37 [DEBUG   ] spawn_process: at 2018-11-16 00:51:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-16 00:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-16 00:51:37 [DEBUG   ] spawn_process: at 2018-11-16 00:51:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-16 00:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-16 00:51:37 [DEBUG   ] spawn_process: at 2018-11-16 00:51:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-16 00:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-16 00:51:37 [DEBUG   ] spawn_process: at 2018-11-16 00:51:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-16 00:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-16 00:51:37 [DEBUG   ] spawn_process: at 2018-11-16 00:51:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-16 00:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-16 00:51:37 [DEBUG   ] spawn_process: at 2018-11-16 00:51:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-16 00:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-16 00:51:37 [DEBUG   ] spawn_process: at 2018-11-16 00:51:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-16 00:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-16 00:51:37 [DEBUG   ] spawn_process: at 2018-11-16 00:51:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-16 00:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-16 00:51:37 [DEBUG   ] spawn_process: at 2018-11-16 00:51:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-16 00:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-16 00:51:37 [DEBUG   ] spawn_process: at 2018-11-16 00:51:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-16 00:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-16 00:51:37 [DEBUG   ] spawn_process: at 2018-11-16 00:51:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-16 00:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-16 00:51:37 [DEBUG   ] spawn_process: at 2018-11-16 00:51:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-16 00:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-16 00:51:37 [DEBUG   ] spawn_process: at 2018-11-16 00:51:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-16 00:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-16 00:51:37 [DEBUG   ] spawn_process: at 2018-11-16 00:51:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-16 00:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-16 00:51:37 [DEBUG   ] spawn_process: at 2018-11-16 00:51:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-16 00:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-16 00:51:37 [DEBUG   ] spawn_process: at 2018-11-16 00:51:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-16 00:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-16 00:51:37 [DEBUG   ] spawn_process: at 2018-11-16 00:51:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-16 00:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-16 00:51:37 [DEBUG   ] spawn_process: at 2018-11-16 00:51:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-16 00:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-16 00:51:37 [DEBUG   ] spawn_process: at 2018-11-16 00:51:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-16 00:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-16 00:51:37 [DEBUG   ] spawn_process: at 2018-11-16 00:51:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-16 00:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-16 00:51:37 [DEBUG   ] spawn_process: at 2018-11-16 00:51:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-16 00:51:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-16 00:51:37 [DEBUG   ] spawn_process: at 2018-11-16 00:51:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-16 00:51:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 00:52:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 00:52:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 00:52:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-16 00:52:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-16 00:52:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:52:06 [WARNING ] MonitorFlags: Temperature 80.70 > 80 on hostname lwa21, chip 2
2018-11-16 00:52:06 [WARNING ] (13, 1, 'bot')
2018-11-16 00:52:06 [WARNING ] (13, 1, 'bot')
2018-11-16 00:52:06 [WARNING ] (13, 1, 'bot')
2018-11-16 00:52:06 [WARNING ] (13, 1, 'bot')
2018-11-16 00:52:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:52:06 [DEBUG   ] Finished updating board flags in 1.176 seconds
2018-11-16 00:52:08 [DEBUG   ] Got command BAM from MCS: ref #521066
2018-11-16 00:52:08 [INFO    ] Finished processing BAM request
2018-11-16 00:52:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:52:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521066   8 58438  3128026 A  ERROR'
2018-11-16 00:52:08 [DEBUG   ] Got command BAM from MCS: ref #521065
2018-11-16 00:52:08 [INFO    ] Finished processing BAM request
2018-11-16 00:52:08 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:52:08 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521065   8 58438  3128030 A  ERROR'
2018-11-16 00:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-16 00:52:08 [DEBUG   ] spawn_process: at 2018-11-16 00:52:08 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-16 00:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-16 00:52:08 [DEBUG   ] spawn_process: at 2018-11-16 00:52:08 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-16 00:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-16 00:52:08 [DEBUG   ] spawn_process: at 2018-11-16 00:52:08 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-16 00:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-16 00:52:08 [DEBUG   ] spawn_process: at 2018-11-16 00:52:08 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-16 00:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-16 00:52:08 [DEBUG   ] spawn_process: at 2018-11-16 00:52:08 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-16 00:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-16 00:52:08 [DEBUG   ] spawn_process: at 2018-11-16 00:52:08 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-16 00:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-16 00:52:08 [DEBUG   ] spawn_process: at 2018-11-16 00:52:08 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-16 00:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-16 00:52:08 [DEBUG   ] spawn_process: at 2018-11-16 00:52:08 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-16 00:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-16 00:52:08 [DEBUG   ] spawn_process: at 2018-11-16 00:52:08 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-16 00:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-16 00:52:08 [DEBUG   ] spawn_process: at 2018-11-16 00:52:08 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-16 00:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-16 00:52:08 [DEBUG   ] spawn_process: at 2018-11-16 00:52:08 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-16 00:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-16 00:52:08 [DEBUG   ] spawn_process: at 2018-11-16 00:52:08 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-16 00:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-16 00:52:08 [DEBUG   ] spawn_process: at 2018-11-16 00:52:08 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-16 00:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-16 00:52:08 [DEBUG   ] spawn_process: at 2018-11-16 00:52:08 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-16 00:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-16 00:52:08 [DEBUG   ] spawn_process: at 2018-11-16 00:52:08 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-16 00:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-16 00:52:08 [DEBUG   ] spawn_process: at 2018-11-16 00:52:08 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-16 00:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-16 00:52:08 [DEBUG   ] spawn_process: at 2018-11-16 00:52:08 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-16 00:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-16 00:52:08 [DEBUG   ] spawn_process: at 2018-11-16 00:52:08 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-16 00:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-16 00:52:08 [DEBUG   ] spawn_process: at 2018-11-16 00:52:08 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-16 00:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-16 00:52:08 [DEBUG   ] spawn_process: at 2018-11-16 00:52:08 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-16 00:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-16 00:52:08 [DEBUG   ] spawn_process: at 2018-11-16 00:52:08 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-16 00:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-16 00:52:08 [DEBUG   ] spawn_process: at 2018-11-16 00:52:08 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-16 00:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-16 00:52:08 [DEBUG   ] spawn_process: at 2018-11-16 00:52:08 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-16 00:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-16 00:52:08 [DEBUG   ] spawn_process: at 2018-11-16 00:52:08 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-16 00:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-16 00:52:08 [DEBUG   ] spawn_process: at 2018-11-16 00:52:08 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-16 00:52:08 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-16 00:52:08 [DEBUG   ] spawn_process: at 2018-11-16 00:52:08 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-16 00:52:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 00:52:39 [DEBUG   ] Got command BAM from MCS: ref #521067
2018-11-16 00:52:39 [INFO    ] Finished processing BAM request
2018-11-16 00:52:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:52:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521067   8 58438  3159030 A  ERROR'
2018-11-16 00:52:39 [DEBUG   ] Got command BAM from MCS: ref #521068
2018-11-16 00:52:39 [INFO    ] Finished processing BAM request
2018-11-16 00:52:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:52:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521068   8 58438  3159037 A  ERROR'
2018-11-16 00:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-16 00:52:39 [DEBUG   ] spawn_process: at 2018-11-16 00:52:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-16 00:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-16 00:52:39 [DEBUG   ] spawn_process: at 2018-11-16 00:52:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-16 00:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-16 00:52:39 [DEBUG   ] spawn_process: at 2018-11-16 00:52:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-16 00:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-16 00:52:39 [DEBUG   ] spawn_process: at 2018-11-16 00:52:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-16 00:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-16 00:52:39 [DEBUG   ] spawn_process: at 2018-11-16 00:52:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-16 00:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-16 00:52:39 [DEBUG   ] spawn_process: at 2018-11-16 00:52:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-16 00:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-16 00:52:39 [DEBUG   ] spawn_process: at 2018-11-16 00:52:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-16 00:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-16 00:52:39 [DEBUG   ] spawn_process: at 2018-11-16 00:52:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-16 00:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-16 00:52:39 [DEBUG   ] spawn_process: at 2018-11-16 00:52:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-16 00:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-16 00:52:39 [DEBUG   ] spawn_process: at 2018-11-16 00:52:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-16 00:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-16 00:52:39 [DEBUG   ] spawn_process: at 2018-11-16 00:52:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-16 00:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-16 00:52:39 [DEBUG   ] spawn_process: at 2018-11-16 00:52:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-16 00:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-16 00:52:39 [DEBUG   ] spawn_process: at 2018-11-16 00:52:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-16 00:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-16 00:52:39 [DEBUG   ] spawn_process: at 2018-11-16 00:52:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-16 00:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-16 00:52:39 [DEBUG   ] spawn_process: at 2018-11-16 00:52:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-16 00:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-16 00:52:39 [DEBUG   ] spawn_process: at 2018-11-16 00:52:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-16 00:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-16 00:52:39 [DEBUG   ] spawn_process: at 2018-11-16 00:52:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-16 00:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-16 00:52:39 [DEBUG   ] spawn_process: at 2018-11-16 00:52:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-16 00:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-16 00:52:39 [DEBUG   ] spawn_process: at 2018-11-16 00:52:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-16 00:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-16 00:52:39 [DEBUG   ] spawn_process: at 2018-11-16 00:52:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-16 00:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-16 00:52:39 [DEBUG   ] spawn_process: at 2018-11-16 00:52:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-16 00:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-16 00:52:39 [DEBUG   ] spawn_process: at 2018-11-16 00:52:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-16 00:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-16 00:52:39 [DEBUG   ] spawn_process: at 2018-11-16 00:52:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-16 00:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-16 00:52:39 [DEBUG   ] spawn_process: at 2018-11-16 00:52:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-16 00:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-16 00:52:39 [DEBUG   ] spawn_process: at 2018-11-16 00:52:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-16 00:52:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-16 00:52:39 [DEBUG   ] spawn_process: at 2018-11-16 00:52:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-16 00:52:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 00:53:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 00:53:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-16 00:53:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:53:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 00:53:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-16 00:53:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-16 00:53:06 [WARNING ] (13, 1, 'bot')
2018-11-16 00:53:06 [WARNING ] (13, 1, 'bot')
2018-11-16 00:53:06 [WARNING ] (13, 1, 'bot')
2018-11-16 00:53:06 [WARNING ] (13, 1, 'bot')
2018-11-16 00:53:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:53:06 [DEBUG   ] Finished updating board flags in 1.015 seconds
2018-11-16 00:53:11 [DEBUG   ] Got command BAM from MCS: ref #521070
2018-11-16 00:53:11 [INFO    ] Finished processing BAM request
2018-11-16 00:53:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:53:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521070   8 58438  3191033 A  ERROR'
2018-11-16 00:53:11 [DEBUG   ] Got command BAM from MCS: ref #521069
2018-11-16 00:53:11 [INFO    ] Finished processing BAM request
2018-11-16 00:53:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:53:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521069   8 58438  3191037 A  ERROR'
2018-11-16 00:53:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-16 00:53:11 [DEBUG   ] spawn_process: at 2018-11-16 00:53:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-16 00:53:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-16 00:53:12 [DEBUG   ] spawn_process: at 2018-11-16 00:53:12 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-16 00:53:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-16 00:53:12 [DEBUG   ] spawn_process: at 2018-11-16 00:53:12 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-16 00:53:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-16 00:53:12 [DEBUG   ] spawn_process: at 2018-11-16 00:53:12 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-16 00:53:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-16 00:53:12 [DEBUG   ] spawn_process: at 2018-11-16 00:53:12 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-16 00:53:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-16 00:53:12 [DEBUG   ] spawn_process: at 2018-11-16 00:53:12 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-16 00:53:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-16 00:53:12 [DEBUG   ] spawn_process: at 2018-11-16 00:53:12 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-16 00:53:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-16 00:53:12 [DEBUG   ] spawn_process: at 2018-11-16 00:53:12 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-16 00:53:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-16 00:53:12 [DEBUG   ] spawn_process: at 2018-11-16 00:53:12 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-16 00:53:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-16 00:53:12 [DEBUG   ] spawn_process: at 2018-11-16 00:53:12 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-16 00:53:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-16 00:53:12 [DEBUG   ] spawn_process: at 2018-11-16 00:53:12 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-16 00:53:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-16 00:53:12 [DEBUG   ] spawn_process: at 2018-11-16 00:53:12 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-16 00:53:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-16 00:53:12 [DEBUG   ] spawn_process: at 2018-11-16 00:53:12 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-16 00:53:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-16 00:53:12 [DEBUG   ] spawn_process: at 2018-11-16 00:53:12 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-16 00:53:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-16 00:53:12 [DEBUG   ] spawn_process: at 2018-11-16 00:53:12 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-16 00:53:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-16 00:53:12 [DEBUG   ] spawn_process: at 2018-11-16 00:53:12 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-16 00:53:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-16 00:53:12 [DEBUG   ] spawn_process: at 2018-11-16 00:53:12 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-16 00:53:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-16 00:53:12 [DEBUG   ] spawn_process: at 2018-11-16 00:53:12 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-16 00:53:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-16 00:53:12 [DEBUG   ] spawn_process: at 2018-11-16 00:53:12 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-16 00:53:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-16 00:53:12 [DEBUG   ] spawn_process: at 2018-11-16 00:53:12 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-16 00:53:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-16 00:53:12 [DEBUG   ] spawn_process: at 2018-11-16 00:53:12 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-16 00:53:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-16 00:53:12 [DEBUG   ] spawn_process: at 2018-11-16 00:53:12 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-16 00:53:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-16 00:53:12 [DEBUG   ] spawn_process: at 2018-11-16 00:53:12 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-16 00:53:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-16 00:53:12 [DEBUG   ] spawn_process: at 2018-11-16 00:53:12 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-16 00:53:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-16 00:53:12 [DEBUG   ] spawn_process: at 2018-11-16 00:53:12 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-16 00:53:12 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-16 00:53:12 [DEBUG   ] spawn_process: at 2018-11-16 00:53:12 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-16 00:53:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 00:53:28 [DEBUG   ] Got command RPT from MCS: ref #521071
2018-11-16 00:53:28 [DEBUG   ] summary = ERROR
2018-11-16 00:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521071  13 58438  3208173 A  ERRORERROR'
2018-11-16 00:53:28 [DEBUG   ] Got command RPT from MCS: ref #521072
2018-11-16 00:53:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 00:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521072  77 58438  3208365 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 00:53:28 [DEBUG   ] Got command RPT from MCS: ref #521073
2018-11-16 00:53:28 [DEBUG   ] summary = ERROR
2018-11-16 00:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521073  13 58438  3208569 A  ERRORERROR'
2018-11-16 00:53:28 [DEBUG   ] Got command RPT from MCS: ref #521074
2018-11-16 00:53:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 00:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521074  77 58438  3208773 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 00:53:28 [DEBUG   ] Got command RPT from MCS: ref #521075
2018-11-16 00:53:28 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 00:53:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521075  12 58438  3208977 A  ERRORB¢ff'
2018-11-16 00:53:43 [DEBUG   ] Got command BAM from MCS: ref #521081
2018-11-16 00:53:43 [INFO    ] Finished processing BAM request
2018-11-16 00:53:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:53:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521081   8 58438  3223033 A  ERROR'
2018-11-16 00:53:43 [DEBUG   ] Got command BAM from MCS: ref #521080
2018-11-16 00:53:43 [INFO    ] Finished processing BAM request
2018-11-16 00:53:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:53:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521080   8 58438  3223037 A  ERROR'
2018-11-16 00:53:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 00:53:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-16 00:53:43 [DEBUG   ] spawn_process: at 2018-11-16 00:53:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-16 00:53:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-16 00:53:43 [DEBUG   ] spawn_process: at 2018-11-16 00:53:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-16 00:53:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-16 00:53:43 [DEBUG   ] spawn_process: at 2018-11-16 00:53:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-16 00:53:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-16 00:53:43 [DEBUG   ] spawn_process: at 2018-11-16 00:53:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-16 00:53:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-16 00:53:43 [DEBUG   ] spawn_process: at 2018-11-16 00:53:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-16 00:53:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-16 00:53:43 [DEBUG   ] spawn_process: at 2018-11-16 00:53:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-16 00:53:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-16 00:53:43 [DEBUG   ] spawn_process: at 2018-11-16 00:53:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-16 00:53:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-16 00:53:43 [DEBUG   ] spawn_process: at 2018-11-16 00:53:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-16 00:53:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-16 00:53:43 [DEBUG   ] spawn_process: at 2018-11-16 00:53:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-16 00:53:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-16 00:53:43 [DEBUG   ] spawn_process: at 2018-11-16 00:53:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-16 00:53:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-16 00:53:43 [DEBUG   ] spawn_process: at 2018-11-16 00:53:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-16 00:53:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-16 00:53:43 [DEBUG   ] spawn_process: at 2018-11-16 00:53:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-16 00:53:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-16 00:53:43 [DEBUG   ] spawn_process: at 2018-11-16 00:53:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-16 00:53:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-16 00:53:43 [DEBUG   ] spawn_process: at 2018-11-16 00:53:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-16 00:53:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-16 00:53:43 [DEBUG   ] spawn_process: at 2018-11-16 00:53:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-16 00:53:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-16 00:53:43 [DEBUG   ] spawn_process: at 2018-11-16 00:53:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-16 00:53:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-16 00:53:43 [DEBUG   ] spawn_process: at 2018-11-16 00:53:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-16 00:53:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-16 00:53:43 [DEBUG   ] spawn_process: at 2018-11-16 00:53:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-16 00:53:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-16 00:53:43 [DEBUG   ] spawn_process: at 2018-11-16 00:53:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-16 00:53:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-16 00:53:43 [DEBUG   ] spawn_process: at 2018-11-16 00:53:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-16 00:53:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-16 00:53:43 [DEBUG   ] spawn_process: at 2018-11-16 00:53:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-16 00:53:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-16 00:53:43 [DEBUG   ] spawn_process: at 2018-11-16 00:53:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-16 00:53:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-16 00:53:43 [DEBUG   ] spawn_process: at 2018-11-16 00:53:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-16 00:53:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-16 00:53:43 [DEBUG   ] spawn_process: at 2018-11-16 00:53:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-16 00:53:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-16 00:53:43 [DEBUG   ] spawn_process: at 2018-11-16 00:53:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-16 00:53:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-16 00:53:43 [DEBUG   ] spawn_process: at 2018-11-16 00:53:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-16 00:54:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 00:54:05 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa32, chip 3
2018-11-16 00:54:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:54:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 00:54:06 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-16 00:54:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-16 00:54:06 [WARNING ] (13, 1, 'bot')
2018-11-16 00:54:06 [WARNING ] (13, 1, 'bot')
2018-11-16 00:54:06 [WARNING ] (13, 1, 'bot')
2018-11-16 00:54:06 [WARNING ] (13, 1, 'bot')
2018-11-16 00:54:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:54:06 [DEBUG   ] Finished updating board flags in 0.997 seconds
2018-11-16 00:54:15 [DEBUG   ] Got command BAM from MCS: ref #521082
2018-11-16 00:54:15 [INFO    ] Finished processing BAM request
2018-11-16 00:54:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:54:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521082   8 58438  3255025 A  ERROR'
2018-11-16 00:54:15 [DEBUG   ] Got command BAM from MCS: ref #521083
2018-11-16 00:54:15 [INFO    ] Finished processing BAM request
2018-11-16 00:54:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:54:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521083   8 58438  3255029 A  ERROR'
2018-11-16 00:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-16 00:54:15 [DEBUG   ] spawn_process: at 2018-11-16 00:54:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-16 00:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-16 00:54:15 [DEBUG   ] spawn_process: at 2018-11-16 00:54:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-16 00:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-16 00:54:15 [DEBUG   ] spawn_process: at 2018-11-16 00:54:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-16 00:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-16 00:54:15 [DEBUG   ] spawn_process: at 2018-11-16 00:54:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-16 00:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-16 00:54:15 [DEBUG   ] spawn_process: at 2018-11-16 00:54:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-16 00:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-16 00:54:15 [DEBUG   ] spawn_process: at 2018-11-16 00:54:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-16 00:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-16 00:54:15 [DEBUG   ] spawn_process: at 2018-11-16 00:54:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-16 00:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-16 00:54:15 [DEBUG   ] spawn_process: at 2018-11-16 00:54:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-16 00:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-16 00:54:15 [DEBUG   ] spawn_process: at 2018-11-16 00:54:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-16 00:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-16 00:54:15 [DEBUG   ] spawn_process: at 2018-11-16 00:54:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-16 00:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-16 00:54:15 [DEBUG   ] spawn_process: at 2018-11-16 00:54:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-16 00:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-16 00:54:15 [DEBUG   ] spawn_process: at 2018-11-16 00:54:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-16 00:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-16 00:54:15 [DEBUG   ] spawn_process: at 2018-11-16 00:54:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-16 00:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-16 00:54:15 [DEBUG   ] spawn_process: at 2018-11-16 00:54:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-16 00:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-16 00:54:15 [DEBUG   ] spawn_process: at 2018-11-16 00:54:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-16 00:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-16 00:54:15 [DEBUG   ] spawn_process: at 2018-11-16 00:54:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-16 00:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-16 00:54:15 [DEBUG   ] spawn_process: at 2018-11-16 00:54:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-16 00:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-16 00:54:15 [DEBUG   ] spawn_process: at 2018-11-16 00:54:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-16 00:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-16 00:54:15 [DEBUG   ] spawn_process: at 2018-11-16 00:54:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-16 00:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-16 00:54:15 [DEBUG   ] spawn_process: at 2018-11-16 00:54:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-16 00:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-16 00:54:15 [DEBUG   ] spawn_process: at 2018-11-16 00:54:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-16 00:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-16 00:54:15 [DEBUG   ] spawn_process: at 2018-11-16 00:54:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-16 00:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-16 00:54:15 [DEBUG   ] spawn_process: at 2018-11-16 00:54:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-16 00:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-16 00:54:15 [DEBUG   ] spawn_process: at 2018-11-16 00:54:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-16 00:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-16 00:54:15 [DEBUG   ] spawn_process: at 2018-11-16 00:54:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-16 00:54:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-16 00:54:15 [DEBUG   ] spawn_process: at 2018-11-16 00:54:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-16 00:54:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 00:54:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 00:54:47 [DEBUG   ] Got command BAM from MCS: ref #521084
2018-11-16 00:54:47 [INFO    ] Finished processing BAM request
2018-11-16 00:54:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:54:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521084   8 58438  3287025 A  ERROR'
2018-11-16 00:54:47 [DEBUG   ] Got command BAM from MCS: ref #521085
2018-11-16 00:54:47 [INFO    ] Finished processing BAM request
2018-11-16 00:54:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:54:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521085   8 58438  3287029 A  ERROR'
2018-11-16 00:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-16 00:54:47 [DEBUG   ] spawn_process: at 2018-11-16 00:54:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-16 00:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-16 00:54:47 [DEBUG   ] spawn_process: at 2018-11-16 00:54:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-16 00:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-16 00:54:47 [DEBUG   ] spawn_process: at 2018-11-16 00:54:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-16 00:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-16 00:54:47 [DEBUG   ] spawn_process: at 2018-11-16 00:54:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-16 00:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-16 00:54:47 [DEBUG   ] spawn_process: at 2018-11-16 00:54:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-16 00:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-16 00:54:47 [DEBUG   ] spawn_process: at 2018-11-16 00:54:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-16 00:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-16 00:54:47 [DEBUG   ] spawn_process: at 2018-11-16 00:54:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-16 00:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-16 00:54:47 [DEBUG   ] spawn_process: at 2018-11-16 00:54:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-16 00:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-16 00:54:47 [DEBUG   ] spawn_process: at 2018-11-16 00:54:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-16 00:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-16 00:54:47 [DEBUG   ] spawn_process: at 2018-11-16 00:54:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-16 00:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-16 00:54:47 [DEBUG   ] spawn_process: at 2018-11-16 00:54:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-16 00:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-16 00:54:47 [DEBUG   ] spawn_process: at 2018-11-16 00:54:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-16 00:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-16 00:54:47 [DEBUG   ] spawn_process: at 2018-11-16 00:54:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-16 00:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-16 00:54:47 [DEBUG   ] spawn_process: at 2018-11-16 00:54:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-16 00:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-16 00:54:47 [DEBUG   ] spawn_process: at 2018-11-16 00:54:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-16 00:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-16 00:54:47 [DEBUG   ] spawn_process: at 2018-11-16 00:54:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-16 00:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-16 00:54:47 [DEBUG   ] spawn_process: at 2018-11-16 00:54:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-16 00:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-16 00:54:47 [DEBUG   ] spawn_process: at 2018-11-16 00:54:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-16 00:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-16 00:54:47 [DEBUG   ] spawn_process: at 2018-11-16 00:54:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-16 00:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-16 00:54:47 [DEBUG   ] spawn_process: at 2018-11-16 00:54:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-16 00:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-16 00:54:47 [DEBUG   ] spawn_process: at 2018-11-16 00:54:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-16 00:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-16 00:54:47 [DEBUG   ] spawn_process: at 2018-11-16 00:54:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-16 00:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-16 00:54:47 [DEBUG   ] spawn_process: at 2018-11-16 00:54:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-16 00:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-16 00:54:47 [DEBUG   ] spawn_process: at 2018-11-16 00:54:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-16 00:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-16 00:54:47 [DEBUG   ] spawn_process: at 2018-11-16 00:54:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-16 00:54:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-16 00:54:47 [DEBUG   ] spawn_process: at 2018-11-16 00:54:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-16 00:55:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 00:55:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-16 00:55:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:55:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 00:55:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-16 00:55:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-16 00:55:07 [WARNING ] (13, 1, 'bot')
2018-11-16 00:55:07 [WARNING ] (13, 1, 'bot')
2018-11-16 00:55:07 [WARNING ] (13, 1, 'bot')
2018-11-16 00:55:07 [WARNING ] (13, 1, 'bot')
2018-11-16 00:55:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:55:07 [DEBUG   ] Finished updating board flags in 1.801 seconds
2018-11-16 00:55:19 [DEBUG   ] Got command BAM from MCS: ref #521086
2018-11-16 00:55:19 [INFO    ] Finished processing BAM request
2018-11-16 00:55:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:55:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521086   8 58438  3319025 A  ERROR'
2018-11-16 00:55:19 [DEBUG   ] Got command BAM from MCS: ref #521087
2018-11-16 00:55:19 [INFO    ] Finished processing BAM request
2018-11-16 00:55:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:55:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521087   8 58438  3319029 A  ERROR'
2018-11-16 00:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-16 00:55:19 [DEBUG   ] spawn_process: at 2018-11-16 00:55:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-16 00:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-16 00:55:19 [DEBUG   ] spawn_process: at 2018-11-16 00:55:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-16 00:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-16 00:55:19 [DEBUG   ] spawn_process: at 2018-11-16 00:55:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-16 00:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-16 00:55:19 [DEBUG   ] spawn_process: at 2018-11-16 00:55:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-16 00:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-16 00:55:19 [DEBUG   ] spawn_process: at 2018-11-16 00:55:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-16 00:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-16 00:55:19 [DEBUG   ] spawn_process: at 2018-11-16 00:55:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-16 00:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-16 00:55:19 [DEBUG   ] spawn_process: at 2018-11-16 00:55:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-16 00:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-16 00:55:19 [DEBUG   ] spawn_process: at 2018-11-16 00:55:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-16 00:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-16 00:55:19 [DEBUG   ] spawn_process: at 2018-11-16 00:55:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-16 00:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-16 00:55:19 [DEBUG   ] spawn_process: at 2018-11-16 00:55:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-16 00:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-16 00:55:19 [DEBUG   ] spawn_process: at 2018-11-16 00:55:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-16 00:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-16 00:55:19 [DEBUG   ] spawn_process: at 2018-11-16 00:55:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-16 00:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-16 00:55:19 [DEBUG   ] spawn_process: at 2018-11-16 00:55:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-16 00:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-16 00:55:19 [DEBUG   ] spawn_process: at 2018-11-16 00:55:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-16 00:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-16 00:55:19 [DEBUG   ] spawn_process: at 2018-11-16 00:55:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-16 00:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-16 00:55:19 [DEBUG   ] spawn_process: at 2018-11-16 00:55:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-16 00:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-16 00:55:19 [DEBUG   ] spawn_process: at 2018-11-16 00:55:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-16 00:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-16 00:55:19 [DEBUG   ] spawn_process: at 2018-11-16 00:55:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-16 00:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-16 00:55:19 [DEBUG   ] spawn_process: at 2018-11-16 00:55:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-16 00:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-16 00:55:19 [DEBUG   ] spawn_process: at 2018-11-16 00:55:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-16 00:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-16 00:55:19 [DEBUG   ] spawn_process: at 2018-11-16 00:55:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-16 00:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-16 00:55:19 [DEBUG   ] spawn_process: at 2018-11-16 00:55:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-16 00:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-16 00:55:19 [DEBUG   ] spawn_process: at 2018-11-16 00:55:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-16 00:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-16 00:55:19 [DEBUG   ] spawn_process: at 2018-11-16 00:55:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-16 00:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-16 00:55:19 [DEBUG   ] spawn_process: at 2018-11-16 00:55:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-16 00:55:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-16 00:55:19 [DEBUG   ] spawn_process: at 2018-11-16 00:55:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-16 00:55:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 00:55:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 00:55:45 [DEBUG   ] Got command RPT from MCS: ref #521088
2018-11-16 00:55:45 [DEBUG   ] summary = ERROR
2018-11-16 00:55:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521088  13 58438  3345257 A  ERRORERROR'
2018-11-16 00:55:45 [DEBUG   ] Got command RPT from MCS: ref #521089
2018-11-16 00:55:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 00:55:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521089  77 58438  3345258 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 00:55:51 [DEBUG   ] Got command BAM from MCS: ref #521105
2018-11-16 00:55:51 [INFO    ] Finished processing BAM request
2018-11-16 00:55:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:55:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521105   8 58438  3351033 A  ERROR'
2018-11-16 00:55:51 [DEBUG   ] Got command BAM from MCS: ref #521106
2018-11-16 00:55:51 [INFO    ] Finished processing BAM request
2018-11-16 00:55:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:55:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521106   8 58438  3351037 A  ERROR'
2018-11-16 00:55:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-16 00:55:51 [DEBUG   ] spawn_process: at 2018-11-16 00:55:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-16 00:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-16 00:55:52 [DEBUG   ] spawn_process: at 2018-11-16 00:55:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-16 00:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-16 00:55:52 [DEBUG   ] spawn_process: at 2018-11-16 00:55:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-16 00:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-16 00:55:52 [DEBUG   ] spawn_process: at 2018-11-16 00:55:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-16 00:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-16 00:55:52 [DEBUG   ] spawn_process: at 2018-11-16 00:55:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-16 00:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-16 00:55:52 [DEBUG   ] spawn_process: at 2018-11-16 00:55:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-16 00:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-16 00:55:52 [DEBUG   ] spawn_process: at 2018-11-16 00:55:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-16 00:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-16 00:55:52 [DEBUG   ] spawn_process: at 2018-11-16 00:55:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-16 00:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-16 00:55:52 [DEBUG   ] spawn_process: at 2018-11-16 00:55:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-16 00:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-16 00:55:52 [DEBUG   ] spawn_process: at 2018-11-16 00:55:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-16 00:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-16 00:55:52 [DEBUG   ] spawn_process: at 2018-11-16 00:55:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-16 00:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-16 00:55:52 [DEBUG   ] spawn_process: at 2018-11-16 00:55:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-16 00:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-16 00:55:52 [DEBUG   ] spawn_process: at 2018-11-16 00:55:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-16 00:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-16 00:55:52 [DEBUG   ] spawn_process: at 2018-11-16 00:55:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-16 00:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-16 00:55:52 [DEBUG   ] spawn_process: at 2018-11-16 00:55:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-16 00:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-16 00:55:52 [DEBUG   ] spawn_process: at 2018-11-16 00:55:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-16 00:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-16 00:55:52 [DEBUG   ] spawn_process: at 2018-11-16 00:55:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-16 00:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-16 00:55:52 [DEBUG   ] spawn_process: at 2018-11-16 00:55:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-16 00:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-16 00:55:52 [DEBUG   ] spawn_process: at 2018-11-16 00:55:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-16 00:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-16 00:55:52 [DEBUG   ] spawn_process: at 2018-11-16 00:55:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-16 00:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-16 00:55:52 [DEBUG   ] spawn_process: at 2018-11-16 00:55:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-16 00:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-16 00:55:52 [DEBUG   ] spawn_process: at 2018-11-16 00:55:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-16 00:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-16 00:55:52 [DEBUG   ] spawn_process: at 2018-11-16 00:55:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-16 00:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-16 00:55:52 [DEBUG   ] spawn_process: at 2018-11-16 00:55:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-16 00:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-16 00:55:52 [DEBUG   ] spawn_process: at 2018-11-16 00:55:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-16 00:55:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-16 00:55:52 [DEBUG   ] spawn_process: at 2018-11-16 00:55:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-16 00:56:03 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-16 00:56:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-16 00:56:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-16 00:56:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:56:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-11-16 00:56:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-16 00:56:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-16 00:56:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-16 00:56:06 [WARNING ] (13, 1, 'bot')
2018-11-16 00:56:06 [WARNING ] (13, 1, 'bot')
2018-11-16 00:56:06 [WARNING ] (13, 1, 'bot')
2018-11-16 00:56:06 [WARNING ] (13, 1, 'bot')
2018-11-16 00:56:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:56:06 [DEBUG   ] Finished updating board flags in 1.233 seconds
2018-11-16 00:56:23 [DEBUG   ] Got command BAM from MCS: ref #521107
2018-11-16 00:56:23 [INFO    ] Finished processing BAM request
2018-11-16 00:56:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:56:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521107   8 58438  3383029 A  ERROR'
2018-11-16 00:56:23 [DEBUG   ] Got command BAM from MCS: ref #521108
2018-11-16 00:56:23 [INFO    ] Finished processing BAM request
2018-11-16 00:56:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:56:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521108   8 58438  3383033 A  ERROR'
2018-11-16 00:56:23 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 00:56:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-16 00:56:23 [DEBUG   ] spawn_process: at 2018-11-16 00:56:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-16 00:56:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-16 00:56:23 [DEBUG   ] spawn_process: at 2018-11-16 00:56:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-16 00:56:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-16 00:56:23 [DEBUG   ] spawn_process: at 2018-11-16 00:56:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-16 00:56:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-16 00:56:23 [DEBUG   ] spawn_process: at 2018-11-16 00:56:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-16 00:56:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-16 00:56:23 [DEBUG   ] spawn_process: at 2018-11-16 00:56:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-16 00:56:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-16 00:56:23 [DEBUG   ] spawn_process: at 2018-11-16 00:56:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-16 00:56:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-16 00:56:23 [DEBUG   ] spawn_process: at 2018-11-16 00:56:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-16 00:56:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-16 00:56:23 [DEBUG   ] spawn_process: at 2018-11-16 00:56:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-16 00:56:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-16 00:56:23 [DEBUG   ] spawn_process: at 2018-11-16 00:56:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-16 00:56:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-16 00:56:23 [DEBUG   ] spawn_process: at 2018-11-16 00:56:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-16 00:56:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-16 00:56:23 [DEBUG   ] spawn_process: at 2018-11-16 00:56:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-16 00:56:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-16 00:56:23 [DEBUG   ] spawn_process: at 2018-11-16 00:56:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-16 00:56:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-16 00:56:23 [DEBUG   ] spawn_process: at 2018-11-16 00:56:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-16 00:56:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-16 00:56:23 [DEBUG   ] spawn_process: at 2018-11-16 00:56:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-16 00:56:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-16 00:56:23 [DEBUG   ] spawn_process: at 2018-11-16 00:56:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-16 00:56:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-16 00:56:23 [DEBUG   ] spawn_process: at 2018-11-16 00:56:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-16 00:56:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-16 00:56:23 [DEBUG   ] spawn_process: at 2018-11-16 00:56:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-16 00:56:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-16 00:56:23 [DEBUG   ] spawn_process: at 2018-11-16 00:56:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-16 00:56:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-16 00:56:23 [DEBUG   ] spawn_process: at 2018-11-16 00:56:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-16 00:56:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-16 00:56:23 [DEBUG   ] spawn_process: at 2018-11-16 00:56:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-16 00:56:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-16 00:56:23 [DEBUG   ] spawn_process: at 2018-11-16 00:56:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-16 00:56:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-16 00:56:23 [DEBUG   ] spawn_process: at 2018-11-16 00:56:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-16 00:56:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-16 00:56:23 [DEBUG   ] spawn_process: at 2018-11-16 00:56:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-16 00:56:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-16 00:56:23 [DEBUG   ] spawn_process: at 2018-11-16 00:56:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-16 00:56:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-16 00:56:23 [DEBUG   ] spawn_process: at 2018-11-16 00:56:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-16 00:56:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-16 00:56:23 [DEBUG   ] spawn_process: at 2018-11-16 00:56:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-16 00:56:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 00:56:55 [DEBUG   ] Got command BAM from MCS: ref #521113
2018-11-16 00:56:55 [INFO    ] Finished processing BAM request
2018-11-16 00:56:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:56:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521113   8 58438  3415033 A  ERROR'
2018-11-16 00:56:55 [DEBUG   ] Got command BAM from MCS: ref #521114
2018-11-16 00:56:55 [INFO    ] Finished processing BAM request
2018-11-16 00:56:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:56:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521114   8 58438  3415037 A  ERROR'
2018-11-16 00:56:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-16 00:56:55 [DEBUG   ] spawn_process: at 2018-11-16 00:56:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-16 00:56:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-16 00:56:55 [DEBUG   ] spawn_process: at 2018-11-16 00:56:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-16 00:56:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-16 00:56:55 [DEBUG   ] spawn_process: at 2018-11-16 00:56:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-16 00:56:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-16 00:56:55 [DEBUG   ] spawn_process: at 2018-11-16 00:56:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-16 00:56:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-16 00:56:55 [DEBUG   ] spawn_process: at 2018-11-16 00:56:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-16 00:56:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-16 00:56:55 [DEBUG   ] spawn_process: at 2018-11-16 00:56:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-16 00:56:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-16 00:56:55 [DEBUG   ] spawn_process: at 2018-11-16 00:56:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-16 00:56:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-16 00:56:55 [DEBUG   ] spawn_process: at 2018-11-16 00:56:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-16 00:56:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-16 00:56:55 [DEBUG   ] spawn_process: at 2018-11-16 00:56:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-16 00:56:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-16 00:56:55 [DEBUG   ] spawn_process: at 2018-11-16 00:56:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-16 00:56:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-16 00:56:55 [DEBUG   ] spawn_process: at 2018-11-16 00:56:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-16 00:56:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-16 00:56:55 [DEBUG   ] spawn_process: at 2018-11-16 00:56:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-16 00:56:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-16 00:56:55 [DEBUG   ] spawn_process: at 2018-11-16 00:56:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-16 00:56:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-16 00:56:55 [DEBUG   ] spawn_process: at 2018-11-16 00:56:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-16 00:56:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-16 00:56:55 [DEBUG   ] spawn_process: at 2018-11-16 00:56:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-16 00:56:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-16 00:56:55 [DEBUG   ] spawn_process: at 2018-11-16 00:56:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-16 00:56:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-16 00:56:55 [DEBUG   ] spawn_process: at 2018-11-16 00:56:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-16 00:56:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-16 00:56:55 [DEBUG   ] spawn_process: at 2018-11-16 00:56:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-16 00:56:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-16 00:56:55 [DEBUG   ] spawn_process: at 2018-11-16 00:56:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-16 00:56:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-16 00:56:55 [DEBUG   ] spawn_process: at 2018-11-16 00:56:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-16 00:56:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-16 00:56:55 [DEBUG   ] spawn_process: at 2018-11-16 00:56:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-16 00:56:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-16 00:56:55 [DEBUG   ] spawn_process: at 2018-11-16 00:56:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-16 00:56:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-16 00:56:55 [DEBUG   ] spawn_process: at 2018-11-16 00:56:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-16 00:56:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-16 00:56:55 [DEBUG   ] spawn_process: at 2018-11-16 00:56:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-16 00:56:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-16 00:56:55 [DEBUG   ] spawn_process: at 2018-11-16 00:56:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-16 00:56:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-16 00:56:55 [DEBUG   ] spawn_process: at 2018-11-16 00:56:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-16 00:57:03 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 00:57:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-16 00:57:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-16 00:57:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:57:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-11-16 00:57:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-16 00:57:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-16 00:57:06 [WARNING ] (13, 1, 'bot')
2018-11-16 00:57:06 [WARNING ] (13, 1, 'bot')
2018-11-16 00:57:06 [WARNING ] (13, 1, 'bot')
2018-11-16 00:57:06 [WARNING ] (13, 1, 'bot')
2018-11-16 00:57:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:57:06 [DEBUG   ] Finished updating board flags in 1.217 seconds
2018-11-16 00:57:23 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 00:57:27 [DEBUG   ] Got command BAM from MCS: ref #521115
2018-11-16 00:57:27 [INFO    ] Finished processing BAM request
2018-11-16 00:57:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:57:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521115   8 58438  3447025 A  ERROR'
2018-11-16 00:57:27 [DEBUG   ] Got command BAM from MCS: ref #521116
2018-11-16 00:57:27 [INFO    ] Finished processing BAM request
2018-11-16 00:57:27 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:57:27 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521116   8 58438  3447029 A  ERROR'
2018-11-16 00:57:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-16 00:57:27 [DEBUG   ] spawn_process: at 2018-11-16 00:57:27 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-16 00:57:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-16 00:57:27 [DEBUG   ] spawn_process: at 2018-11-16 00:57:27 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-16 00:57:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-16 00:57:27 [DEBUG   ] spawn_process: at 2018-11-16 00:57:27 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-16 00:57:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-16 00:57:27 [DEBUG   ] spawn_process: at 2018-11-16 00:57:27 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-16 00:57:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-16 00:57:27 [DEBUG   ] spawn_process: at 2018-11-16 00:57:27 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-16 00:57:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-16 00:57:27 [DEBUG   ] spawn_process: at 2018-11-16 00:57:27 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-16 00:57:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-16 00:57:27 [DEBUG   ] spawn_process: at 2018-11-16 00:57:27 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-16 00:57:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-16 00:57:27 [DEBUG   ] spawn_process: at 2018-11-16 00:57:27 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-16 00:57:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-16 00:57:27 [DEBUG   ] spawn_process: at 2018-11-16 00:57:27 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-16 00:57:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-16 00:57:27 [DEBUG   ] spawn_process: at 2018-11-16 00:57:27 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-16 00:57:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-16 00:57:27 [DEBUG   ] spawn_process: at 2018-11-16 00:57:27 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-16 00:57:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-16 00:57:27 [DEBUG   ] spawn_process: at 2018-11-16 00:57:27 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-16 00:57:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-16 00:57:27 [DEBUG   ] spawn_process: at 2018-11-16 00:57:27 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-16 00:57:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-16 00:57:27 [DEBUG   ] spawn_process: at 2018-11-16 00:57:27 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-16 00:57:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-16 00:57:27 [DEBUG   ] spawn_process: at 2018-11-16 00:57:27 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-16 00:57:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-16 00:57:27 [DEBUG   ] spawn_process: at 2018-11-16 00:57:27 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-16 00:57:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-16 00:57:27 [DEBUG   ] spawn_process: at 2018-11-16 00:57:27 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-16 00:57:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-16 00:57:27 [DEBUG   ] spawn_process: at 2018-11-16 00:57:27 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-16 00:57:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-16 00:57:27 [DEBUG   ] spawn_process: at 2018-11-16 00:57:27 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-16 00:57:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-16 00:57:27 [DEBUG   ] spawn_process: at 2018-11-16 00:57:27 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-16 00:57:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-16 00:57:27 [DEBUG   ] spawn_process: at 2018-11-16 00:57:27 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-16 00:57:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-16 00:57:27 [DEBUG   ] spawn_process: at 2018-11-16 00:57:27 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-16 00:57:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-16 00:57:27 [DEBUG   ] spawn_process: at 2018-11-16 00:57:27 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-16 00:57:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-16 00:57:27 [DEBUG   ] spawn_process: at 2018-11-16 00:57:27 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-16 00:57:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-16 00:57:27 [DEBUG   ] spawn_process: at 2018-11-16 00:57:27 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-16 00:57:27 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-16 00:57:27 [DEBUG   ] spawn_process: at 2018-11-16 00:57:27 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-16 00:57:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 00:57:59 [DEBUG   ] Got command BAM from MCS: ref #521118
2018-11-16 00:57:59 [INFO    ] Finished processing BAM request
2018-11-16 00:57:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:57:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521118   8 58438  3479029 A  ERROR'
2018-11-16 00:57:59 [DEBUG   ] Got command BAM from MCS: ref #521117
2018-11-16 00:57:59 [INFO    ] Finished processing BAM request
2018-11-16 00:57:59 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:57:59 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521117   8 58438  3479033 A  ERROR'
2018-11-16 00:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-16 00:57:59 [DEBUG   ] spawn_process: at 2018-11-16 00:57:59 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-16 00:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-16 00:57:59 [DEBUG   ] spawn_process: at 2018-11-16 00:57:59 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-16 00:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-16 00:57:59 [DEBUG   ] spawn_process: at 2018-11-16 00:57:59 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-16 00:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-16 00:57:59 [DEBUG   ] spawn_process: at 2018-11-16 00:57:59 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-16 00:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-16 00:57:59 [DEBUG   ] spawn_process: at 2018-11-16 00:57:59 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-16 00:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-16 00:57:59 [DEBUG   ] spawn_process: at 2018-11-16 00:57:59 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-16 00:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-16 00:57:59 [DEBUG   ] spawn_process: at 2018-11-16 00:57:59 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-16 00:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-16 00:57:59 [DEBUG   ] spawn_process: at 2018-11-16 00:57:59 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-16 00:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-16 00:57:59 [DEBUG   ] spawn_process: at 2018-11-16 00:57:59 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-16 00:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-16 00:57:59 [DEBUG   ] spawn_process: at 2018-11-16 00:57:59 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-16 00:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-16 00:57:59 [DEBUG   ] spawn_process: at 2018-11-16 00:57:59 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-16 00:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-16 00:57:59 [DEBUG   ] spawn_process: at 2018-11-16 00:57:59 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-16 00:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-16 00:57:59 [DEBUG   ] spawn_process: at 2018-11-16 00:57:59 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-16 00:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-16 00:57:59 [DEBUG   ] spawn_process: at 2018-11-16 00:57:59 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-16 00:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-16 00:57:59 [DEBUG   ] spawn_process: at 2018-11-16 00:57:59 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-16 00:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-16 00:57:59 [DEBUG   ] spawn_process: at 2018-11-16 00:57:59 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-16 00:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-16 00:57:59 [DEBUG   ] spawn_process: at 2018-11-16 00:57:59 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-16 00:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-16 00:57:59 [DEBUG   ] spawn_process: at 2018-11-16 00:57:59 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-16 00:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-16 00:57:59 [DEBUG   ] spawn_process: at 2018-11-16 00:57:59 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-16 00:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-16 00:57:59 [DEBUG   ] spawn_process: at 2018-11-16 00:57:59 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-16 00:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-16 00:57:59 [DEBUG   ] spawn_process: at 2018-11-16 00:57:59 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-16 00:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-16 00:57:59 [DEBUG   ] spawn_process: at 2018-11-16 00:57:59 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-16 00:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-16 00:57:59 [DEBUG   ] spawn_process: at 2018-11-16 00:57:59 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-16 00:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-16 00:57:59 [DEBUG   ] spawn_process: at 2018-11-16 00:57:59 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-16 00:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-16 00:57:59 [DEBUG   ] spawn_process: at 2018-11-16 00:57:59 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-16 00:57:59 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-16 00:57:59 [DEBUG   ] spawn_process: at 2018-11-16 00:57:59 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-16 00:58:03 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 00:58:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 1
2018-11-16 00:58:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-16 00:58:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:58:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-16 00:58:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-11-16 00:58:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-11-16 00:58:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-16 00:58:06 [WARNING ] (13, 1, 'bot')
2018-11-16 00:58:06 [WARNING ] (13, 1, 'bot')
2018-11-16 00:58:06 [WARNING ] (13, 1, 'bot')
2018-11-16 00:58:06 [WARNING ] (13, 1, 'bot')
2018-11-16 00:58:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:58:06 [DEBUG   ] Finished updating board flags in 1.206 seconds
2018-11-16 00:58:23 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 00:58:28 [DEBUG   ] Got command RPT from MCS: ref #521121
2018-11-16 00:58:28 [DEBUG   ] summary = ERROR
2018-11-16 00:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521121  13 58438  3508257 A  ERRORERROR'
2018-11-16 00:58:28 [DEBUG   ] Got command RPT from MCS: ref #521122
2018-11-16 00:58:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 00:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521122  77 58438  3508449 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 00:58:28 [DEBUG   ] Got command RPT from MCS: ref #521123
2018-11-16 00:58:28 [DEBUG   ] summary = ERROR
2018-11-16 00:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521123  13 58438  3508653 A  ERRORERROR'
2018-11-16 00:58:28 [DEBUG   ] Got command RPT from MCS: ref #521125
2018-11-16 00:58:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 00:58:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521125  77 58438  3508857 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 00:58:29 [DEBUG   ] Got command RPT from MCS: ref #521126
2018-11-16 00:58:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 00:58:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521126  12 58438  3509061 A  ERRORB£ff'
2018-11-16 00:58:31 [DEBUG   ] Got command BAM from MCS: ref #521132
2018-11-16 00:58:31 [INFO    ] Finished processing BAM request
2018-11-16 00:58:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:58:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521132   8 58438  3511025 A  ERROR'
2018-11-16 00:58:31 [DEBUG   ] Got command BAM from MCS: ref #521131
2018-11-16 00:58:31 [INFO    ] Finished processing BAM request
2018-11-16 00:58:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:58:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521131   8 58438  3511029 A  ERROR'
2018-11-16 00:58:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-16 00:58:31 [DEBUG   ] spawn_process: at 2018-11-16 00:58:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-16 00:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-16 00:58:32 [DEBUG   ] spawn_process: at 2018-11-16 00:58:32 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-16 00:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-16 00:58:32 [DEBUG   ] spawn_process: at 2018-11-16 00:58:32 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-16 00:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-16 00:58:32 [DEBUG   ] spawn_process: at 2018-11-16 00:58:32 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-16 00:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-16 00:58:32 [DEBUG   ] spawn_process: at 2018-11-16 00:58:32 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-16 00:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-16 00:58:32 [DEBUG   ] spawn_process: at 2018-11-16 00:58:32 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-16 00:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-16 00:58:32 [DEBUG   ] spawn_process: at 2018-11-16 00:58:32 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-16 00:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-16 00:58:32 [DEBUG   ] spawn_process: at 2018-11-16 00:58:32 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-16 00:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-16 00:58:32 [DEBUG   ] spawn_process: at 2018-11-16 00:58:32 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-16 00:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-16 00:58:32 [DEBUG   ] spawn_process: at 2018-11-16 00:58:32 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-16 00:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-16 00:58:32 [DEBUG   ] spawn_process: at 2018-11-16 00:58:32 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-16 00:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-16 00:58:32 [DEBUG   ] spawn_process: at 2018-11-16 00:58:32 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-16 00:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-16 00:58:32 [DEBUG   ] spawn_process: at 2018-11-16 00:58:32 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-16 00:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-16 00:58:32 [DEBUG   ] spawn_process: at 2018-11-16 00:58:32 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-16 00:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-16 00:58:32 [DEBUG   ] spawn_process: at 2018-11-16 00:58:32 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-16 00:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-16 00:58:32 [DEBUG   ] spawn_process: at 2018-11-16 00:58:32 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-16 00:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-16 00:58:32 [DEBUG   ] spawn_process: at 2018-11-16 00:58:32 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-16 00:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-16 00:58:32 [DEBUG   ] spawn_process: at 2018-11-16 00:58:32 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-16 00:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-16 00:58:32 [DEBUG   ] spawn_process: at 2018-11-16 00:58:32 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-16 00:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-16 00:58:32 [DEBUG   ] spawn_process: at 2018-11-16 00:58:32 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-16 00:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-16 00:58:32 [DEBUG   ] spawn_process: at 2018-11-16 00:58:32 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-16 00:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-16 00:58:32 [DEBUG   ] spawn_process: at 2018-11-16 00:58:32 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-16 00:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-16 00:58:32 [DEBUG   ] spawn_process: at 2018-11-16 00:58:32 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-16 00:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-16 00:58:32 [DEBUG   ] spawn_process: at 2018-11-16 00:58:32 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-16 00:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-16 00:58:32 [DEBUG   ] spawn_process: at 2018-11-16 00:58:32 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-16 00:58:32 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-16 00:58:32 [DEBUG   ] spawn_process: at 2018-11-16 00:58:32 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-16 00:58:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 00:59:03 [DEBUG   ] Got command BAM from MCS: ref #521133
2018-11-16 00:59:03 [INFO    ] Finished processing BAM request
2018-11-16 00:59:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:59:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521133   8 58438  3543025 A  ERROR'
2018-11-16 00:59:03 [DEBUG   ] Got command BAM from MCS: ref #521134
2018-11-16 00:59:03 [INFO    ] Finished processing BAM request
2018-11-16 00:59:03 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:59:03 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521134   8 58438  3543029 A  ERROR'
2018-11-16 00:59:03 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 00:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-16 00:59:03 [DEBUG   ] spawn_process: at 2018-11-16 00:59:03 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-16 00:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-16 00:59:03 [DEBUG   ] spawn_process: at 2018-11-16 00:59:03 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-16 00:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-16 00:59:03 [DEBUG   ] spawn_process: at 2018-11-16 00:59:03 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-16 00:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-16 00:59:03 [DEBUG   ] spawn_process: at 2018-11-16 00:59:03 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-16 00:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-16 00:59:03 [DEBUG   ] spawn_process: at 2018-11-16 00:59:03 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-16 00:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-16 00:59:03 [DEBUG   ] spawn_process: at 2018-11-16 00:59:03 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-16 00:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-16 00:59:03 [DEBUG   ] spawn_process: at 2018-11-16 00:59:03 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-16 00:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-16 00:59:03 [DEBUG   ] spawn_process: at 2018-11-16 00:59:03 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-16 00:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-16 00:59:03 [DEBUG   ] spawn_process: at 2018-11-16 00:59:03 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-16 00:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-16 00:59:03 [DEBUG   ] spawn_process: at 2018-11-16 00:59:03 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-16 00:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-16 00:59:03 [DEBUG   ] spawn_process: at 2018-11-16 00:59:03 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-16 00:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-16 00:59:03 [DEBUG   ] spawn_process: at 2018-11-16 00:59:03 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-16 00:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-16 00:59:03 [DEBUG   ] spawn_process: at 2018-11-16 00:59:03 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-16 00:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-16 00:59:03 [DEBUG   ] spawn_process: at 2018-11-16 00:59:03 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-16 00:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-16 00:59:03 [DEBUG   ] spawn_process: at 2018-11-16 00:59:03 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-16 00:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-16 00:59:03 [DEBUG   ] spawn_process: at 2018-11-16 00:59:03 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-16 00:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-16 00:59:03 [DEBUG   ] spawn_process: at 2018-11-16 00:59:03 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-16 00:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-16 00:59:03 [DEBUG   ] spawn_process: at 2018-11-16 00:59:03 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-16 00:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-16 00:59:03 [DEBUG   ] spawn_process: at 2018-11-16 00:59:03 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-16 00:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-16 00:59:03 [DEBUG   ] spawn_process: at 2018-11-16 00:59:03 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-16 00:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-16 00:59:03 [DEBUG   ] spawn_process: at 2018-11-16 00:59:03 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-16 00:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-16 00:59:03 [DEBUG   ] spawn_process: at 2018-11-16 00:59:03 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-16 00:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-16 00:59:03 [DEBUG   ] spawn_process: at 2018-11-16 00:59:03 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-16 00:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-16 00:59:03 [DEBUG   ] spawn_process: at 2018-11-16 00:59:03 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-16 00:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-16 00:59:03 [DEBUG   ] spawn_process: at 2018-11-16 00:59:03 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-16 00:59:03 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-16 00:59:03 [DEBUG   ] spawn_process: at 2018-11-16 00:59:03 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-16 00:59:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-16 00:59:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 00:59:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-16 00:59:06 [WARNING ] (13, 1, 'bot')
2018-11-16 00:59:06 [WARNING ] (13, 1, 'bot')
2018-11-16 00:59:06 [WARNING ] (13, 1, 'bot')
2018-11-16 00:59:06 [WARNING ] (13, 1, 'bot')
2018-11-16 00:59:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 00:59:06 [DEBUG   ] Finished updating board flags in 1.192 seconds
2018-11-16 00:59:23 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 00:59:35 [DEBUG   ] Got command BAM from MCS: ref #521139
2018-11-16 00:59:35 [INFO    ] Finished processing BAM request
2018-11-16 00:59:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:59:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521139   8 58438  3575029 A  ERROR'
2018-11-16 00:59:35 [DEBUG   ] Got command BAM from MCS: ref #521140
2018-11-16 00:59:35 [INFO    ] Finished processing BAM request
2018-11-16 00:59:35 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 00:59:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521140   8 58438  3575033 A  ERROR'
2018-11-16 00:59:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-16 00:59:35 [DEBUG   ] spawn_process: at 2018-11-16 00:59:35 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-16 00:59:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-16 00:59:35 [DEBUG   ] spawn_process: at 2018-11-16 00:59:35 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-16 00:59:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-16 00:59:35 [DEBUG   ] spawn_process: at 2018-11-16 00:59:35 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-16 00:59:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-16 00:59:35 [DEBUG   ] spawn_process: at 2018-11-16 00:59:35 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-16 00:59:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-16 00:59:35 [DEBUG   ] spawn_process: at 2018-11-16 00:59:35 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-16 00:59:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-16 00:59:35 [DEBUG   ] spawn_process: at 2018-11-16 00:59:35 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-16 00:59:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-16 00:59:35 [DEBUG   ] spawn_process: at 2018-11-16 00:59:35 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-16 00:59:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-16 00:59:35 [DEBUG   ] spawn_process: at 2018-11-16 00:59:35 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-16 00:59:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-16 00:59:35 [DEBUG   ] spawn_process: at 2018-11-16 00:59:35 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-16 00:59:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-16 00:59:35 [DEBUG   ] spawn_process: at 2018-11-16 00:59:35 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-16 00:59:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-16 00:59:35 [DEBUG   ] spawn_process: at 2018-11-16 00:59:35 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-16 00:59:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-16 00:59:35 [DEBUG   ] spawn_process: at 2018-11-16 00:59:35 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-16 00:59:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-16 00:59:35 [DEBUG   ] spawn_process: at 2018-11-16 00:59:35 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-16 00:59:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-16 00:59:35 [DEBUG   ] spawn_process: at 2018-11-16 00:59:35 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-16 00:59:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-16 00:59:35 [DEBUG   ] spawn_process: at 2018-11-16 00:59:35 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-16 00:59:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-16 00:59:35 [DEBUG   ] spawn_process: at 2018-11-16 00:59:35 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-16 00:59:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-16 00:59:35 [DEBUG   ] spawn_process: at 2018-11-16 00:59:35 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-16 00:59:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-16 00:59:35 [DEBUG   ] spawn_process: at 2018-11-16 00:59:35 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-16 00:59:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-16 00:59:35 [DEBUG   ] spawn_process: at 2018-11-16 00:59:35 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-16 00:59:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-16 00:59:35 [DEBUG   ] spawn_process: at 2018-11-16 00:59:35 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-16 00:59:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-16 00:59:35 [DEBUG   ] spawn_process: at 2018-11-16 00:59:35 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-16 00:59:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-16 00:59:35 [DEBUG   ] spawn_process: at 2018-11-16 00:59:35 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-16 00:59:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-16 00:59:35 [DEBUG   ] spawn_process: at 2018-11-16 00:59:35 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-16 00:59:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-16 00:59:35 [DEBUG   ] spawn_process: at 2018-11-16 00:59:35 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-16 00:59:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-16 00:59:35 [DEBUG   ] spawn_process: at 2018-11-16 00:59:35 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-16 00:59:35 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-16 00:59:35 [DEBUG   ] spawn_process: at 2018-11-16 00:59:35 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-16 00:59:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 01:00:03 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 01:00:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-16 01:00:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-16 01:00:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:00:07 [DEBUG   ] Got command BAM from MCS: ref #521142
2018-11-16 01:00:07 [INFO    ] Finished processing BAM request
2018-11-16 01:00:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:00:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521142   8 58438  3607029 A  ERROR'
2018-11-16 01:00:07 [DEBUG   ] Got command BAM from MCS: ref #521141
2018-11-16 01:00:07 [INFO    ] Finished processing BAM request
2018-11-16 01:00:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:00:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521141   8 58438  3607033 A  ERROR'
2018-11-16 01:00:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 1
2018-11-16 01:00:07 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-16 01:00:07 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-16 01:00:07 [WARNING ] (13, 1, 'bot')
2018-11-16 01:00:07 [WARNING ] (13, 1, 'bot')
2018-11-16 01:00:07 [WARNING ] (13, 1, 'bot')
2018-11-16 01:00:07 [WARNING ] (13, 1, 'bot')
2018-11-16 01:00:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:00:07 [DEBUG   ] Finished updating board flags in 1.624 seconds
2018-11-16 01:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-16 01:00:07 [DEBUG   ] spawn_process: at 2018-11-16 01:00:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-16 01:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-16 01:00:07 [DEBUG   ] spawn_process: at 2018-11-16 01:00:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-16 01:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-16 01:00:07 [DEBUG   ] spawn_process: at 2018-11-16 01:00:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-16 01:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-16 01:00:07 [DEBUG   ] spawn_process: at 2018-11-16 01:00:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-16 01:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-16 01:00:07 [DEBUG   ] spawn_process: at 2018-11-16 01:00:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-16 01:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-16 01:00:07 [DEBUG   ] spawn_process: at 2018-11-16 01:00:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-16 01:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-16 01:00:07 [DEBUG   ] spawn_process: at 2018-11-16 01:00:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-16 01:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-16 01:00:07 [DEBUG   ] spawn_process: at 2018-11-16 01:00:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-16 01:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-16 01:00:07 [DEBUG   ] spawn_process: at 2018-11-16 01:00:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-16 01:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-16 01:00:07 [DEBUG   ] spawn_process: at 2018-11-16 01:00:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-16 01:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-16 01:00:07 [DEBUG   ] spawn_process: at 2018-11-16 01:00:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-16 01:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-16 01:00:07 [DEBUG   ] spawn_process: at 2018-11-16 01:00:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-16 01:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-16 01:00:07 [DEBUG   ] spawn_process: at 2018-11-16 01:00:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-16 01:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-16 01:00:07 [DEBUG   ] spawn_process: at 2018-11-16 01:00:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-16 01:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-16 01:00:07 [DEBUG   ] spawn_process: at 2018-11-16 01:00:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-16 01:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-16 01:00:07 [DEBUG   ] spawn_process: at 2018-11-16 01:00:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-16 01:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-16 01:00:07 [DEBUG   ] spawn_process: at 2018-11-16 01:00:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-16 01:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-16 01:00:07 [DEBUG   ] spawn_process: at 2018-11-16 01:00:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-16 01:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-16 01:00:07 [DEBUG   ] spawn_process: at 2018-11-16 01:00:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-16 01:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-16 01:00:07 [DEBUG   ] spawn_process: at 2018-11-16 01:00:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-16 01:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-16 01:00:07 [DEBUG   ] spawn_process: at 2018-11-16 01:00:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-16 01:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-16 01:00:07 [DEBUG   ] spawn_process: at 2018-11-16 01:00:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-16 01:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-16 01:00:07 [DEBUG   ] spawn_process: at 2018-11-16 01:00:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-16 01:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-16 01:00:07 [DEBUG   ] spawn_process: at 2018-11-16 01:00:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-16 01:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-16 01:00:07 [DEBUG   ] spawn_process: at 2018-11-16 01:00:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-16 01:00:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-16 01:00:07 [DEBUG   ] spawn_process: at 2018-11-16 01:00:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-16 01:00:23 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 01:00:39 [DEBUG   ] Got command BAM from MCS: ref #521143
2018-11-16 01:00:39 [INFO    ] Finished processing BAM request
2018-11-16 01:00:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:00:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521143   8 58438  3639033 A  ERROR'
2018-11-16 01:00:39 [DEBUG   ] Got command BAM from MCS: ref #521144
2018-11-16 01:00:39 [INFO    ] Finished processing BAM request
2018-11-16 01:00:39 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:00:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521144   8 58438  3639041 A  ERROR'
2018-11-16 01:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-16 01:00:39 [DEBUG   ] spawn_process: at 2018-11-16 01:00:39 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-16 01:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-16 01:00:39 [DEBUG   ] spawn_process: at 2018-11-16 01:00:39 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-16 01:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-16 01:00:39 [DEBUG   ] spawn_process: at 2018-11-16 01:00:39 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-16 01:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-16 01:00:39 [DEBUG   ] spawn_process: at 2018-11-16 01:00:39 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-16 01:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-16 01:00:39 [DEBUG   ] spawn_process: at 2018-11-16 01:00:39 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-16 01:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-16 01:00:39 [DEBUG   ] spawn_process: at 2018-11-16 01:00:39 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-16 01:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-16 01:00:39 [DEBUG   ] spawn_process: at 2018-11-16 01:00:39 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-16 01:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-16 01:00:39 [DEBUG   ] spawn_process: at 2018-11-16 01:00:39 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-16 01:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-16 01:00:39 [DEBUG   ] spawn_process: at 2018-11-16 01:00:39 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-16 01:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-16 01:00:39 [DEBUG   ] spawn_process: at 2018-11-16 01:00:39 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-16 01:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-16 01:00:39 [DEBUG   ] spawn_process: at 2018-11-16 01:00:39 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-16 01:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-16 01:00:39 [DEBUG   ] spawn_process: at 2018-11-16 01:00:39 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-16 01:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-16 01:00:39 [DEBUG   ] spawn_process: at 2018-11-16 01:00:39 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-16 01:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-16 01:00:39 [DEBUG   ] spawn_process: at 2018-11-16 01:00:39 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-16 01:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-16 01:00:39 [DEBUG   ] spawn_process: at 2018-11-16 01:00:39 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-16 01:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-16 01:00:39 [DEBUG   ] spawn_process: at 2018-11-16 01:00:39 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-16 01:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-16 01:00:39 [DEBUG   ] spawn_process: at 2018-11-16 01:00:39 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-16 01:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-16 01:00:39 [DEBUG   ] spawn_process: at 2018-11-16 01:00:39 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-16 01:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-16 01:00:39 [DEBUG   ] spawn_process: at 2018-11-16 01:00:39 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-16 01:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-16 01:00:39 [DEBUG   ] spawn_process: at 2018-11-16 01:00:39 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-16 01:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-16 01:00:39 [DEBUG   ] spawn_process: at 2018-11-16 01:00:39 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-16 01:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-16 01:00:39 [DEBUG   ] spawn_process: at 2018-11-16 01:00:39 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-16 01:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-16 01:00:39 [DEBUG   ] spawn_process: at 2018-11-16 01:00:39 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-16 01:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-16 01:00:39 [DEBUG   ] spawn_process: at 2018-11-16 01:00:39 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-16 01:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-16 01:00:39 [DEBUG   ] spawn_process: at 2018-11-16 01:00:39 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-16 01:00:39 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-16 01:00:39 [DEBUG   ] spawn_process: at 2018-11-16 01:00:39 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-16 01:00:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 01:00:45 [DEBUG   ] Got command RPT from MCS: ref #521145
2018-11-16 01:00:45 [DEBUG   ] summary = ERROR
2018-11-16 01:00:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521145  13 58438  3645261 A  ERRORERROR'
2018-11-16 01:00:45 [DEBUG   ] Got command RPT from MCS: ref #521146
2018-11-16 01:00:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 01:00:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521146  77 58438  3645262 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 01:01:03 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 01:01:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-16 01:01:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-16 01:01:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:01:06 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-16 01:01:06 [WARNING ] (13, 1, 'bot')
2018-11-16 01:01:06 [WARNING ] (13, 1, 'bot')
2018-11-16 01:01:06 [WARNING ] (13, 1, 'bot')
2018-11-16 01:01:06 [WARNING ] (13, 1, 'bot')
2018-11-16 01:01:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:01:06 [DEBUG   ] Finished updating board flags in 0.990 seconds
2018-11-16 01:01:11 [DEBUG   ] Got command BAM from MCS: ref #521163
2018-11-16 01:01:11 [INFO    ] Finished processing BAM request
2018-11-16 01:01:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:01:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521163   8 58438  3671025 A  ERROR'
2018-11-16 01:01:11 [DEBUG   ] Got command BAM from MCS: ref #521162
2018-11-16 01:01:11 [INFO    ] Finished processing BAM request
2018-11-16 01:01:11 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:01:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521162   8 58438  3671029 A  ERROR'
2018-11-16 01:01:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-16 01:01:11 [DEBUG   ] spawn_process: at 2018-11-16 01:01:11 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-16 01:01:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-16 01:01:11 [DEBUG   ] spawn_process: at 2018-11-16 01:01:11 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-16 01:01:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-16 01:01:11 [DEBUG   ] spawn_process: at 2018-11-16 01:01:11 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-16 01:01:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-16 01:01:11 [DEBUG   ] spawn_process: at 2018-11-16 01:01:11 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-16 01:01:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-16 01:01:11 [DEBUG   ] spawn_process: at 2018-11-16 01:01:11 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-16 01:01:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-16 01:01:11 [DEBUG   ] spawn_process: at 2018-11-16 01:01:11 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-16 01:01:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-16 01:01:11 [DEBUG   ] spawn_process: at 2018-11-16 01:01:11 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-16 01:01:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-16 01:01:11 [DEBUG   ] spawn_process: at 2018-11-16 01:01:11 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-16 01:01:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-16 01:01:11 [DEBUG   ] spawn_process: at 2018-11-16 01:01:11 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-16 01:01:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-16 01:01:11 [DEBUG   ] spawn_process: at 2018-11-16 01:01:11 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-16 01:01:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-16 01:01:11 [DEBUG   ] spawn_process: at 2018-11-16 01:01:11 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-16 01:01:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-16 01:01:11 [DEBUG   ] spawn_process: at 2018-11-16 01:01:11 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-16 01:01:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-16 01:01:11 [DEBUG   ] spawn_process: at 2018-11-16 01:01:11 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-16 01:01:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-16 01:01:11 [DEBUG   ] spawn_process: at 2018-11-16 01:01:11 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-16 01:01:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-16 01:01:11 [DEBUG   ] spawn_process: at 2018-11-16 01:01:11 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-16 01:01:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-16 01:01:11 [DEBUG   ] spawn_process: at 2018-11-16 01:01:11 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-16 01:01:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-16 01:01:11 [DEBUG   ] spawn_process: at 2018-11-16 01:01:11 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-16 01:01:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-16 01:01:11 [DEBUG   ] spawn_process: at 2018-11-16 01:01:11 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-16 01:01:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-16 01:01:11 [DEBUG   ] spawn_process: at 2018-11-16 01:01:11 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-16 01:01:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-16 01:01:11 [DEBUG   ] spawn_process: at 2018-11-16 01:01:11 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-16 01:01:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-16 01:01:11 [DEBUG   ] spawn_process: at 2018-11-16 01:01:11 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-16 01:01:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-16 01:01:11 [DEBUG   ] spawn_process: at 2018-11-16 01:01:11 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-16 01:01:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-16 01:01:11 [DEBUG   ] spawn_process: at 2018-11-16 01:01:11 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-16 01:01:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-16 01:01:11 [DEBUG   ] spawn_process: at 2018-11-16 01:01:11 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-16 01:01:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-16 01:01:11 [DEBUG   ] spawn_process: at 2018-11-16 01:01:11 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-16 01:01:11 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-16 01:01:11 [DEBUG   ] spawn_process: at 2018-11-16 01:01:11 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-16 01:01:23 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 01:01:43 [DEBUG   ] Got command BAM from MCS: ref #521165
2018-11-16 01:01:43 [INFO    ] Finished processing BAM request
2018-11-16 01:01:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:01:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521165   8 58438  3703029 A  ERROR'
2018-11-16 01:01:43 [DEBUG   ] Got command BAM from MCS: ref #521164
2018-11-16 01:01:43 [INFO    ] Finished processing BAM request
2018-11-16 01:01:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:01:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521164   8 58438  3703033 A  ERROR'
2018-11-16 01:01:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 01:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-16 01:01:43 [DEBUG   ] spawn_process: at 2018-11-16 01:01:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-16 01:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-16 01:01:43 [DEBUG   ] spawn_process: at 2018-11-16 01:01:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-16 01:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-16 01:01:43 [DEBUG   ] spawn_process: at 2018-11-16 01:01:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-16 01:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-16 01:01:43 [DEBUG   ] spawn_process: at 2018-11-16 01:01:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-16 01:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-16 01:01:43 [DEBUG   ] spawn_process: at 2018-11-16 01:01:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-16 01:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-16 01:01:43 [DEBUG   ] spawn_process: at 2018-11-16 01:01:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-16 01:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-16 01:01:43 [DEBUG   ] spawn_process: at 2018-11-16 01:01:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-16 01:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-16 01:01:43 [DEBUG   ] spawn_process: at 2018-11-16 01:01:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-16 01:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-16 01:01:43 [DEBUG   ] spawn_process: at 2018-11-16 01:01:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-16 01:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-16 01:01:43 [DEBUG   ] spawn_process: at 2018-11-16 01:01:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-16 01:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-16 01:01:43 [DEBUG   ] spawn_process: at 2018-11-16 01:01:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-16 01:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-16 01:01:43 [DEBUG   ] spawn_process: at 2018-11-16 01:01:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-16 01:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-16 01:01:43 [DEBUG   ] spawn_process: at 2018-11-16 01:01:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-16 01:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-16 01:01:43 [DEBUG   ] spawn_process: at 2018-11-16 01:01:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-16 01:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-16 01:01:43 [DEBUG   ] spawn_process: at 2018-11-16 01:01:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-16 01:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-16 01:01:43 [DEBUG   ] spawn_process: at 2018-11-16 01:01:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-16 01:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-16 01:01:43 [DEBUG   ] spawn_process: at 2018-11-16 01:01:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-16 01:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-16 01:01:43 [DEBUG   ] spawn_process: at 2018-11-16 01:01:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-16 01:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-16 01:01:43 [DEBUG   ] spawn_process: at 2018-11-16 01:01:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-16 01:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-16 01:01:43 [DEBUG   ] spawn_process: at 2018-11-16 01:01:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-16 01:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-16 01:01:43 [DEBUG   ] spawn_process: at 2018-11-16 01:01:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-16 01:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-16 01:01:43 [DEBUG   ] spawn_process: at 2018-11-16 01:01:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-16 01:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-16 01:01:43 [DEBUG   ] spawn_process: at 2018-11-16 01:01:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-16 01:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-16 01:01:43 [DEBUG   ] spawn_process: at 2018-11-16 01:01:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-16 01:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-16 01:01:43 [DEBUG   ] spawn_process: at 2018-11-16 01:01:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-16 01:01:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-16 01:01:43 [DEBUG   ] spawn_process: at 2018-11-16 01:01:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-16 01:02:03 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 01:02:06 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-16 01:02:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:02:07 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-16 01:02:07 [WARNING ] (13, 1, 'bot')
2018-11-16 01:02:07 [WARNING ] (13, 1, 'bot')
2018-11-16 01:02:07 [WARNING ] (13, 1, 'bot')
2018-11-16 01:02:07 [WARNING ] (13, 1, 'bot')
2018-11-16 01:02:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:02:07 [DEBUG   ] Finished updating board flags in 1.362 seconds
2018-11-16 01:02:15 [DEBUG   ] Got command BAM from MCS: ref #521167
2018-11-16 01:02:15 [INFO    ] Finished processing BAM request
2018-11-16 01:02:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:02:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521167   8 58438  3735033 A  ERROR'
2018-11-16 01:02:15 [DEBUG   ] Got command BAM from MCS: ref #521166
2018-11-16 01:02:15 [INFO    ] Finished processing BAM request
2018-11-16 01:02:15 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:02:15 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521166   8 58438  3735037 A  ERROR'
2018-11-16 01:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-16 01:02:15 [DEBUG   ] spawn_process: at 2018-11-16 01:02:15 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-16 01:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-16 01:02:15 [DEBUG   ] spawn_process: at 2018-11-16 01:02:15 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-16 01:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-16 01:02:15 [DEBUG   ] spawn_process: at 2018-11-16 01:02:15 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-16 01:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-16 01:02:15 [DEBUG   ] spawn_process: at 2018-11-16 01:02:15 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-16 01:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-16 01:02:15 [DEBUG   ] spawn_process: at 2018-11-16 01:02:15 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-16 01:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-16 01:02:15 [DEBUG   ] spawn_process: at 2018-11-16 01:02:15 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-16 01:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-16 01:02:15 [DEBUG   ] spawn_process: at 2018-11-16 01:02:15 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-16 01:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-16 01:02:15 [DEBUG   ] spawn_process: at 2018-11-16 01:02:15 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-16 01:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-16 01:02:15 [DEBUG   ] spawn_process: at 2018-11-16 01:02:15 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-16 01:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-16 01:02:15 [DEBUG   ] spawn_process: at 2018-11-16 01:02:15 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-16 01:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-16 01:02:15 [DEBUG   ] spawn_process: at 2018-11-16 01:02:15 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-16 01:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-16 01:02:15 [DEBUG   ] spawn_process: at 2018-11-16 01:02:15 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-16 01:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-16 01:02:15 [DEBUG   ] spawn_process: at 2018-11-16 01:02:15 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-16 01:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-16 01:02:15 [DEBUG   ] spawn_process: at 2018-11-16 01:02:15 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-16 01:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-16 01:02:15 [DEBUG   ] spawn_process: at 2018-11-16 01:02:15 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-16 01:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-16 01:02:15 [DEBUG   ] spawn_process: at 2018-11-16 01:02:15 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-16 01:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-16 01:02:15 [DEBUG   ] spawn_process: at 2018-11-16 01:02:15 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-16 01:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-16 01:02:15 [DEBUG   ] spawn_process: at 2018-11-16 01:02:15 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-16 01:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-16 01:02:15 [DEBUG   ] spawn_process: at 2018-11-16 01:02:15 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-16 01:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-16 01:02:15 [DEBUG   ] spawn_process: at 2018-11-16 01:02:15 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-16 01:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-16 01:02:15 [DEBUG   ] spawn_process: at 2018-11-16 01:02:15 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-16 01:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-16 01:02:15 [DEBUG   ] spawn_process: at 2018-11-16 01:02:15 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-16 01:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-16 01:02:15 [DEBUG   ] spawn_process: at 2018-11-16 01:02:15 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-16 01:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-16 01:02:15 [DEBUG   ] spawn_process: at 2018-11-16 01:02:15 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-16 01:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-16 01:02:15 [DEBUG   ] spawn_process: at 2018-11-16 01:02:15 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-16 01:02:15 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-16 01:02:15 [DEBUG   ] spawn_process: at 2018-11-16 01:02:15 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-16 01:02:23 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 01:02:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 01:02:47 [DEBUG   ] Got command BAM from MCS: ref #521173
2018-11-16 01:02:47 [INFO    ] Finished processing BAM request
2018-11-16 01:02:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:02:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521173   8 58438  3767033 A  ERROR'
2018-11-16 01:02:47 [DEBUG   ] Got command BAM from MCS: ref #521172
2018-11-16 01:02:47 [INFO    ] Finished processing BAM request
2018-11-16 01:02:47 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:02:47 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521172   8 58438  3767037 A  ERROR'
2018-11-16 01:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-16 01:02:47 [DEBUG   ] spawn_process: at 2018-11-16 01:02:47 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-16 01:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-16 01:02:47 [DEBUG   ] spawn_process: at 2018-11-16 01:02:47 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-16 01:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-16 01:02:47 [DEBUG   ] spawn_process: at 2018-11-16 01:02:47 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-16 01:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-16 01:02:47 [DEBUG   ] spawn_process: at 2018-11-16 01:02:47 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-16 01:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-16 01:02:47 [DEBUG   ] spawn_process: at 2018-11-16 01:02:47 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-16 01:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-16 01:02:47 [DEBUG   ] spawn_process: at 2018-11-16 01:02:47 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-16 01:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-16 01:02:47 [DEBUG   ] spawn_process: at 2018-11-16 01:02:47 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-16 01:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-16 01:02:47 [DEBUG   ] spawn_process: at 2018-11-16 01:02:47 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-16 01:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-16 01:02:47 [DEBUG   ] spawn_process: at 2018-11-16 01:02:47 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-16 01:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-16 01:02:47 [DEBUG   ] spawn_process: at 2018-11-16 01:02:47 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-16 01:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-16 01:02:47 [DEBUG   ] spawn_process: at 2018-11-16 01:02:47 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-16 01:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-16 01:02:47 [DEBUG   ] spawn_process: at 2018-11-16 01:02:47 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-16 01:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-16 01:02:47 [DEBUG   ] spawn_process: at 2018-11-16 01:02:47 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-16 01:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-16 01:02:47 [DEBUG   ] spawn_process: at 2018-11-16 01:02:47 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-16 01:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-16 01:02:47 [DEBUG   ] spawn_process: at 2018-11-16 01:02:47 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-16 01:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-16 01:02:47 [DEBUG   ] spawn_process: at 2018-11-16 01:02:47 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-16 01:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-16 01:02:47 [DEBUG   ] spawn_process: at 2018-11-16 01:02:47 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-16 01:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-16 01:02:47 [DEBUG   ] spawn_process: at 2018-11-16 01:02:47 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-16 01:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-16 01:02:47 [DEBUG   ] spawn_process: at 2018-11-16 01:02:47 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-16 01:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-16 01:02:47 [DEBUG   ] spawn_process: at 2018-11-16 01:02:47 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-16 01:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-16 01:02:47 [DEBUG   ] spawn_process: at 2018-11-16 01:02:47 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-16 01:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-16 01:02:47 [DEBUG   ] spawn_process: at 2018-11-16 01:02:47 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-16 01:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-16 01:02:47 [DEBUG   ] spawn_process: at 2018-11-16 01:02:47 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-16 01:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-16 01:02:47 [DEBUG   ] spawn_process: at 2018-11-16 01:02:47 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-16 01:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-16 01:02:47 [DEBUG   ] spawn_process: at 2018-11-16 01:02:47 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-16 01:02:47 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-16 01:02:47 [DEBUG   ] spawn_process: at 2018-11-16 01:02:47 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-16 01:03:03 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 01:03:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-16 01:03:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:03:07 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-16 01:03:07 [WARNING ] (13, 1, 'bot')
2018-11-16 01:03:07 [WARNING ] (13, 1, 'bot')
2018-11-16 01:03:07 [WARNING ] (13, 1, 'bot')
2018-11-16 01:03:07 [WARNING ] (13, 1, 'bot')
2018-11-16 01:03:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:03:07 [DEBUG   ] Finished updating board flags in 1.196 seconds
2018-11-16 01:03:19 [DEBUG   ] Got command BAM from MCS: ref #521174
2018-11-16 01:03:19 [INFO    ] Finished processing BAM request
2018-11-16 01:03:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:03:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521174   8 58438  3799029 A  ERROR'
2018-11-16 01:03:19 [DEBUG   ] Got command BAM from MCS: ref #521175
2018-11-16 01:03:19 [INFO    ] Finished processing BAM request
2018-11-16 01:03:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:03:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521175   8 58438  3799033 A  ERROR'
2018-11-16 01:03:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-16 01:03:19 [DEBUG   ] spawn_process: at 2018-11-16 01:03:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-16 01:03:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-16 01:03:19 [DEBUG   ] spawn_process: at 2018-11-16 01:03:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-16 01:03:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-16 01:03:19 [DEBUG   ] spawn_process: at 2018-11-16 01:03:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-16 01:03:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-16 01:03:19 [DEBUG   ] spawn_process: at 2018-11-16 01:03:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-16 01:03:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-16 01:03:19 [DEBUG   ] spawn_process: at 2018-11-16 01:03:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-16 01:03:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-16 01:03:19 [DEBUG   ] spawn_process: at 2018-11-16 01:03:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-16 01:03:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-16 01:03:19 [DEBUG   ] spawn_process: at 2018-11-16 01:03:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-16 01:03:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-16 01:03:19 [DEBUG   ] spawn_process: at 2018-11-16 01:03:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-16 01:03:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-16 01:03:19 [DEBUG   ] spawn_process: at 2018-11-16 01:03:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-16 01:03:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-16 01:03:19 [DEBUG   ] spawn_process: at 2018-11-16 01:03:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-16 01:03:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-16 01:03:19 [DEBUG   ] spawn_process: at 2018-11-16 01:03:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-16 01:03:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-16 01:03:19 [DEBUG   ] spawn_process: at 2018-11-16 01:03:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-16 01:03:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-16 01:03:19 [DEBUG   ] spawn_process: at 2018-11-16 01:03:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-16 01:03:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-16 01:03:19 [DEBUG   ] spawn_process: at 2018-11-16 01:03:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-16 01:03:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-16 01:03:19 [DEBUG   ] spawn_process: at 2018-11-16 01:03:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-16 01:03:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-16 01:03:19 [DEBUG   ] spawn_process: at 2018-11-16 01:03:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-16 01:03:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-16 01:03:19 [DEBUG   ] spawn_process: at 2018-11-16 01:03:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-16 01:03:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-16 01:03:19 [DEBUG   ] spawn_process: at 2018-11-16 01:03:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-16 01:03:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-16 01:03:19 [DEBUG   ] spawn_process: at 2018-11-16 01:03:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-16 01:03:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-16 01:03:19 [DEBUG   ] spawn_process: at 2018-11-16 01:03:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-16 01:03:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-16 01:03:19 [DEBUG   ] spawn_process: at 2018-11-16 01:03:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-16 01:03:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-16 01:03:19 [DEBUG   ] spawn_process: at 2018-11-16 01:03:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-16 01:03:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-16 01:03:19 [DEBUG   ] spawn_process: at 2018-11-16 01:03:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-16 01:03:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-16 01:03:19 [DEBUG   ] spawn_process: at 2018-11-16 01:03:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-16 01:03:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-16 01:03:19 [DEBUG   ] spawn_process: at 2018-11-16 01:03:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-16 01:03:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-16 01:03:19 [DEBUG   ] spawn_process: at 2018-11-16 01:03:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-16 01:03:23 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 01:03:28 [DEBUG   ] Got command RPT from MCS: ref #521176
2018-11-16 01:03:28 [DEBUG   ] summary = ERROR
2018-11-16 01:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521176  13 58438  3808341 A  ERRORERROR'
2018-11-16 01:03:28 [DEBUG   ] Got command RPT from MCS: ref #521177
2018-11-16 01:03:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 01:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521177  77 58438  3808545 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 01:03:28 [DEBUG   ] Got command RPT from MCS: ref #521178
2018-11-16 01:03:28 [DEBUG   ] summary = ERROR
2018-11-16 01:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521178  13 58438  3808737 A  ERRORERROR'
2018-11-16 01:03:28 [DEBUG   ] Got command RPT from MCS: ref #521179
2018-11-16 01:03:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 01:03:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521179  77 58438  3808941 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 01:03:29 [DEBUG   ] Got command RPT from MCS: ref #521180
2018-11-16 01:03:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 01:03:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521180  12 58438  3809145 A  ERRORB£ff'
2018-11-16 01:03:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 01:03:51 [DEBUG   ] Got command BAM from MCS: ref #521181
2018-11-16 01:03:51 [INFO    ] Finished processing BAM request
2018-11-16 01:03:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:03:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521181   8 58438  3831033 A  ERROR'
2018-11-16 01:03:51 [DEBUG   ] Got command BAM from MCS: ref #521182
2018-11-16 01:03:51 [INFO    ] Finished processing BAM request
2018-11-16 01:03:51 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:03:51 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521182   8 58438  3831037 A  ERROR'
2018-11-16 01:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-16 01:03:51 [DEBUG   ] spawn_process: at 2018-11-16 01:03:51 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-16 01:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-16 01:03:51 [DEBUG   ] spawn_process: at 2018-11-16 01:03:51 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-16 01:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-16 01:03:51 [DEBUG   ] spawn_process: at 2018-11-16 01:03:51 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-16 01:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-16 01:03:51 [DEBUG   ] spawn_process: at 2018-11-16 01:03:51 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-16 01:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-16 01:03:51 [DEBUG   ] spawn_process: at 2018-11-16 01:03:51 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-16 01:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-16 01:03:51 [DEBUG   ] spawn_process: at 2018-11-16 01:03:51 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-16 01:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-16 01:03:51 [DEBUG   ] spawn_process: at 2018-11-16 01:03:51 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-16 01:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-16 01:03:51 [DEBUG   ] spawn_process: at 2018-11-16 01:03:51 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-16 01:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-16 01:03:51 [DEBUG   ] spawn_process: at 2018-11-16 01:03:51 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-16 01:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-16 01:03:51 [DEBUG   ] spawn_process: at 2018-11-16 01:03:51 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-16 01:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-16 01:03:51 [DEBUG   ] spawn_process: at 2018-11-16 01:03:51 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-16 01:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-16 01:03:51 [DEBUG   ] spawn_process: at 2018-11-16 01:03:51 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-16 01:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-16 01:03:51 [DEBUG   ] spawn_process: at 2018-11-16 01:03:51 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-16 01:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-16 01:03:51 [DEBUG   ] spawn_process: at 2018-11-16 01:03:51 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-16 01:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-16 01:03:51 [DEBUG   ] spawn_process: at 2018-11-16 01:03:51 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-16 01:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-16 01:03:51 [DEBUG   ] spawn_process: at 2018-11-16 01:03:51 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-16 01:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-16 01:03:51 [DEBUG   ] spawn_process: at 2018-11-16 01:03:51 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-16 01:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-16 01:03:51 [DEBUG   ] spawn_process: at 2018-11-16 01:03:51 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-16 01:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-16 01:03:51 [DEBUG   ] spawn_process: at 2018-11-16 01:03:51 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-16 01:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-16 01:03:51 [DEBUG   ] spawn_process: at 2018-11-16 01:03:51 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-16 01:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-16 01:03:51 [DEBUG   ] spawn_process: at 2018-11-16 01:03:51 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-16 01:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-16 01:03:51 [DEBUG   ] spawn_process: at 2018-11-16 01:03:51 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-16 01:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-16 01:03:51 [DEBUG   ] spawn_process: at 2018-11-16 01:03:51 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-16 01:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-16 01:03:51 [DEBUG   ] spawn_process: at 2018-11-16 01:03:51 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-16 01:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-16 01:03:51 [DEBUG   ] spawn_process: at 2018-11-16 01:03:51 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-16 01:03:51 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-16 01:03:51 [DEBUG   ] spawn_process: at 2018-11-16 01:03:51 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-16 01:04:03 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 01:04:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-16 01:04:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:04:07 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-16 01:04:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-16 01:04:07 [WARNING ] (13, 1, 'bot')
2018-11-16 01:04:07 [WARNING ] (13, 1, 'bot')
2018-11-16 01:04:07 [WARNING ] (13, 1, 'bot')
2018-11-16 01:04:07 [WARNING ] (13, 1, 'bot')
2018-11-16 01:04:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:04:07 [DEBUG   ] Finished updating board flags in 1.009 seconds
2018-11-16 01:04:23 [DEBUG   ] Got command BAM from MCS: ref #521183
2018-11-16 01:04:23 [INFO    ] Finished processing BAM request
2018-11-16 01:04:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:04:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521183   8 58438  3863033 A  ERROR'
2018-11-16 01:04:23 [DEBUG   ] Got command BAM from MCS: ref #521184
2018-11-16 01:04:23 [INFO    ] Finished processing BAM request
2018-11-16 01:04:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:04:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521184   8 58438  3863037 A  ERROR'
2018-11-16 01:04:23 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 01:04:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-16 01:04:23 [DEBUG   ] spawn_process: at 2018-11-16 01:04:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-16 01:04:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-16 01:04:23 [DEBUG   ] spawn_process: at 2018-11-16 01:04:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-16 01:04:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-16 01:04:23 [DEBUG   ] spawn_process: at 2018-11-16 01:04:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-16 01:04:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-16 01:04:23 [DEBUG   ] spawn_process: at 2018-11-16 01:04:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-16 01:04:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-16 01:04:23 [DEBUG   ] spawn_process: at 2018-11-16 01:04:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-16 01:04:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-16 01:04:23 [DEBUG   ] spawn_process: at 2018-11-16 01:04:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-16 01:04:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-16 01:04:23 [DEBUG   ] spawn_process: at 2018-11-16 01:04:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-16 01:04:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-16 01:04:23 [DEBUG   ] spawn_process: at 2018-11-16 01:04:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-16 01:04:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-16 01:04:23 [DEBUG   ] spawn_process: at 2018-11-16 01:04:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-16 01:04:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-16 01:04:23 [DEBUG   ] spawn_process: at 2018-11-16 01:04:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-16 01:04:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-16 01:04:23 [DEBUG   ] spawn_process: at 2018-11-16 01:04:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-16 01:04:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-16 01:04:23 [DEBUG   ] spawn_process: at 2018-11-16 01:04:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-16 01:04:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-16 01:04:23 [DEBUG   ] spawn_process: at 2018-11-16 01:04:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-16 01:04:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-16 01:04:23 [DEBUG   ] spawn_process: at 2018-11-16 01:04:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-16 01:04:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-16 01:04:23 [DEBUG   ] spawn_process: at 2018-11-16 01:04:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-16 01:04:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-16 01:04:23 [DEBUG   ] spawn_process: at 2018-11-16 01:04:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-16 01:04:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-16 01:04:23 [DEBUG   ] spawn_process: at 2018-11-16 01:04:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-16 01:04:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-16 01:04:23 [DEBUG   ] spawn_process: at 2018-11-16 01:04:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-16 01:04:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-16 01:04:23 [DEBUG   ] spawn_process: at 2018-11-16 01:04:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-16 01:04:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-16 01:04:23 [DEBUG   ] spawn_process: at 2018-11-16 01:04:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-16 01:04:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-16 01:04:23 [DEBUG   ] spawn_process: at 2018-11-16 01:04:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-16 01:04:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-16 01:04:23 [DEBUG   ] spawn_process: at 2018-11-16 01:04:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-16 01:04:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-16 01:04:23 [DEBUG   ] spawn_process: at 2018-11-16 01:04:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-16 01:04:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-16 01:04:23 [DEBUG   ] spawn_process: at 2018-11-16 01:04:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-16 01:04:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-16 01:04:23 [DEBUG   ] spawn_process: at 2018-11-16 01:04:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-16 01:04:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-16 01:04:23 [DEBUG   ] spawn_process: at 2018-11-16 01:04:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-16 01:04:43 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 01:04:55 [DEBUG   ] Got command BAM from MCS: ref #521186
2018-11-16 01:04:55 [INFO    ] Finished processing BAM request
2018-11-16 01:04:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:04:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521186   8 58438  3895033 A  ERROR'
2018-11-16 01:04:55 [DEBUG   ] Got command BAM from MCS: ref #521185
2018-11-16 01:04:55 [INFO    ] Finished processing BAM request
2018-11-16 01:04:55 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:04:55 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521185   8 58438  3895037 A  ERROR'
2018-11-16 01:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-16 01:04:55 [DEBUG   ] spawn_process: at 2018-11-16 01:04:55 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-16 01:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-16 01:04:55 [DEBUG   ] spawn_process: at 2018-11-16 01:04:55 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-16 01:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-16 01:04:55 [DEBUG   ] spawn_process: at 2018-11-16 01:04:55 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-16 01:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-16 01:04:55 [DEBUG   ] spawn_process: at 2018-11-16 01:04:55 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-16 01:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-16 01:04:55 [DEBUG   ] spawn_process: at 2018-11-16 01:04:55 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-16 01:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-16 01:04:55 [DEBUG   ] spawn_process: at 2018-11-16 01:04:55 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-16 01:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-16 01:04:55 [DEBUG   ] spawn_process: at 2018-11-16 01:04:55 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-16 01:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-16 01:04:55 [DEBUG   ] spawn_process: at 2018-11-16 01:04:55 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-16 01:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-16 01:04:55 [DEBUG   ] spawn_process: at 2018-11-16 01:04:55 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-16 01:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-16 01:04:55 [DEBUG   ] spawn_process: at 2018-11-16 01:04:55 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-16 01:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-16 01:04:55 [DEBUG   ] spawn_process: at 2018-11-16 01:04:55 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-16 01:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-16 01:04:55 [DEBUG   ] spawn_process: at 2018-11-16 01:04:55 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-16 01:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-16 01:04:55 [DEBUG   ] spawn_process: at 2018-11-16 01:04:55 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-16 01:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-16 01:04:55 [DEBUG   ] spawn_process: at 2018-11-16 01:04:55 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-16 01:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-16 01:04:55 [DEBUG   ] spawn_process: at 2018-11-16 01:04:55 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-16 01:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-16 01:04:55 [DEBUG   ] spawn_process: at 2018-11-16 01:04:55 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-16 01:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-16 01:04:55 [DEBUG   ] spawn_process: at 2018-11-16 01:04:55 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-16 01:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-16 01:04:55 [DEBUG   ] spawn_process: at 2018-11-16 01:04:55 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-16 01:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-16 01:04:55 [DEBUG   ] spawn_process: at 2018-11-16 01:04:55 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-16 01:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-16 01:04:55 [DEBUG   ] spawn_process: at 2018-11-16 01:04:55 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-16 01:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-16 01:04:55 [DEBUG   ] spawn_process: at 2018-11-16 01:04:55 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-16 01:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-16 01:04:55 [DEBUG   ] spawn_process: at 2018-11-16 01:04:55 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-16 01:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-16 01:04:55 [DEBUG   ] spawn_process: at 2018-11-16 01:04:55 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-16 01:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-16 01:04:55 [DEBUG   ] spawn_process: at 2018-11-16 01:04:55 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-16 01:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-16 01:04:55 [DEBUG   ] spawn_process: at 2018-11-16 01:04:55 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-16 01:04:55 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-16 01:04:55 [DEBUG   ] spawn_process: at 2018-11-16 01:04:55 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-16 01:05:03 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 01:05:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:05:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 01:05:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-16 01:05:07 [WARNING ] (13, 1, 'bot')
2018-11-16 01:05:07 [WARNING ] (13, 1, 'bot')
2018-11-16 01:05:07 [WARNING ] (13, 1, 'bot')
2018-11-16 01:05:07 [WARNING ] (13, 1, 'bot')
2018-11-16 01:05:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:05:07 [DEBUG   ] Finished updating board flags in 0.986 seconds
2018-11-16 01:05:23 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-16 01:05:28 [DEBUG   ] Got command BAM from MCS: ref #521188
2018-11-16 01:05:28 [INFO    ] Finished processing BAM request
2018-11-16 01:05:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:05:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521188   8 58438  3928025 A  ERROR'
2018-11-16 01:05:28 [DEBUG   ] Got command BAM from MCS: ref #521187
2018-11-16 01:05:28 [INFO    ] Finished processing BAM request
2018-11-16 01:05:28 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:05:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521187   8 58438  3928029 A  ERROR'
2018-11-16 01:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-16 01:05:28 [DEBUG   ] spawn_process: at 2018-11-16 01:05:28 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-16 01:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-16 01:05:28 [DEBUG   ] spawn_process: at 2018-11-16 01:05:28 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-16 01:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-16 01:05:28 [DEBUG   ] spawn_process: at 2018-11-16 01:05:28 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-16 01:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-16 01:05:28 [DEBUG   ] spawn_process: at 2018-11-16 01:05:28 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-16 01:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-16 01:05:28 [DEBUG   ] spawn_process: at 2018-11-16 01:05:28 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-16 01:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-16 01:05:28 [DEBUG   ] spawn_process: at 2018-11-16 01:05:28 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-16 01:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-16 01:05:28 [DEBUG   ] spawn_process: at 2018-11-16 01:05:28 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-16 01:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-16 01:05:28 [DEBUG   ] spawn_process: at 2018-11-16 01:05:28 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-16 01:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-16 01:05:28 [DEBUG   ] spawn_process: at 2018-11-16 01:05:28 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-16 01:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-16 01:05:28 [DEBUG   ] spawn_process: at 2018-11-16 01:05:28 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-16 01:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-16 01:05:28 [DEBUG   ] spawn_process: at 2018-11-16 01:05:28 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-16 01:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-16 01:05:28 [DEBUG   ] spawn_process: at 2018-11-16 01:05:28 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-16 01:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-16 01:05:28 [DEBUG   ] spawn_process: at 2018-11-16 01:05:28 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-16 01:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-16 01:05:28 [DEBUG   ] spawn_process: at 2018-11-16 01:05:28 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-16 01:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-16 01:05:28 [DEBUG   ] spawn_process: at 2018-11-16 01:05:28 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-16 01:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-16 01:05:28 [DEBUG   ] spawn_process: at 2018-11-16 01:05:28 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-16 01:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-16 01:05:28 [DEBUG   ] spawn_process: at 2018-11-16 01:05:28 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-16 01:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-16 01:05:28 [DEBUG   ] spawn_process: at 2018-11-16 01:05:28 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-16 01:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-16 01:05:28 [DEBUG   ] spawn_process: at 2018-11-16 01:05:28 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-16 01:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-16 01:05:28 [DEBUG   ] spawn_process: at 2018-11-16 01:05:28 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-16 01:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-16 01:05:28 [DEBUG   ] spawn_process: at 2018-11-16 01:05:28 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-16 01:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-16 01:05:28 [DEBUG   ] spawn_process: at 2018-11-16 01:05:28 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-16 01:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-16 01:05:28 [DEBUG   ] spawn_process: at 2018-11-16 01:05:28 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-16 01:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-16 01:05:28 [DEBUG   ] spawn_process: at 2018-11-16 01:05:28 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-16 01:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-16 01:05:28 [DEBUG   ] spawn_process: at 2018-11-16 01:05:28 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-16 01:05:28 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-16 01:05:28 [DEBUG   ] spawn_process: at 2018-11-16 01:05:28 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-16 01:05:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 01:05:45 [DEBUG   ] Got command RPT from MCS: ref #521193
2018-11-16 01:05:45 [DEBUG   ] summary = ERROR
2018-11-16 01:05:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521193  13 58438  3945253 A  ERRORERROR'
2018-11-16 01:05:45 [DEBUG   ] Got command RPT from MCS: ref #521194
2018-11-16 01:05:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 01:05:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521194  77 58438  3945254 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 01:06:01 [DEBUG   ] Got command BAM from MCS: ref #521211
2018-11-16 01:06:01 [INFO    ] Finished processing BAM request
2018-11-16 01:06:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:06:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521211   8 58438  3961025 A  ERROR'
2018-11-16 01:06:01 [DEBUG   ] Got command BAM from MCS: ref #521210
2018-11-16 01:06:01 [INFO    ] Finished processing BAM request
2018-11-16 01:06:01 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:06:01 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521210   8 58438  3961029 A  ERROR'
2018-11-16 01:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-16 01:06:01 [DEBUG   ] spawn_process: at 2018-11-16 01:06:01 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-16 01:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-16 01:06:01 [DEBUG   ] spawn_process: at 2018-11-16 01:06:01 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-16 01:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-16 01:06:01 [DEBUG   ] spawn_process: at 2018-11-16 01:06:01 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-16 01:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-16 01:06:01 [DEBUG   ] spawn_process: at 2018-11-16 01:06:01 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-16 01:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-16 01:06:01 [DEBUG   ] spawn_process: at 2018-11-16 01:06:01 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-16 01:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-16 01:06:01 [DEBUG   ] spawn_process: at 2018-11-16 01:06:01 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-16 01:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-16 01:06:01 [DEBUG   ] spawn_process: at 2018-11-16 01:06:01 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-16 01:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-16 01:06:01 [DEBUG   ] spawn_process: at 2018-11-16 01:06:01 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-16 01:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-16 01:06:01 [DEBUG   ] spawn_process: at 2018-11-16 01:06:01 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-16 01:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-16 01:06:01 [DEBUG   ] spawn_process: at 2018-11-16 01:06:01 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-16 01:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-16 01:06:01 [DEBUG   ] spawn_process: at 2018-11-16 01:06:01 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-16 01:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-16 01:06:01 [DEBUG   ] spawn_process: at 2018-11-16 01:06:01 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-16 01:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-16 01:06:01 [DEBUG   ] spawn_process: at 2018-11-16 01:06:01 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-16 01:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-16 01:06:01 [DEBUG   ] spawn_process: at 2018-11-16 01:06:01 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-16 01:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-16 01:06:01 [DEBUG   ] spawn_process: at 2018-11-16 01:06:01 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-16 01:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-16 01:06:01 [DEBUG   ] spawn_process: at 2018-11-16 01:06:01 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-16 01:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-16 01:06:01 [DEBUG   ] spawn_process: at 2018-11-16 01:06:01 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-16 01:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-16 01:06:01 [DEBUG   ] spawn_process: at 2018-11-16 01:06:01 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-16 01:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-16 01:06:01 [DEBUG   ] spawn_process: at 2018-11-16 01:06:01 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-16 01:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-16 01:06:01 [DEBUG   ] spawn_process: at 2018-11-16 01:06:01 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-16 01:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-16 01:06:01 [DEBUG   ] spawn_process: at 2018-11-16 01:06:01 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-16 01:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-16 01:06:01 [DEBUG   ] spawn_process: at 2018-11-16 01:06:01 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-16 01:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-16 01:06:01 [DEBUG   ] spawn_process: at 2018-11-16 01:06:01 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-16 01:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-16 01:06:01 [DEBUG   ] spawn_process: at 2018-11-16 01:06:01 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-16 01:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-16 01:06:01 [DEBUG   ] spawn_process: at 2018-11-16 01:06:01 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-16 01:06:01 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-16 01:06:01 [DEBUG   ] spawn_process: at 2018-11-16 01:06:01 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-16 01:06:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 01:06:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-16 01:06:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:06:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-16 01:06:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-16 01:06:07 [WARNING ] (13, 1, 'bot')
2018-11-16 01:06:07 [WARNING ] (13, 1, 'bot')
2018-11-16 01:06:07 [WARNING ] (13, 1, 'bot')
2018-11-16 01:06:07 [WARNING ] (13, 1, 'bot')
2018-11-16 01:06:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:06:07 [DEBUG   ] Finished updating board flags in 1.271 seconds
2018-11-16 01:06:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 01:06:34 [DEBUG   ] Got command BAM from MCS: ref #521213
2018-11-16 01:06:34 [INFO    ] Finished processing BAM request
2018-11-16 01:06:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:06:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521213   8 58438  3994025 A  ERROR'
2018-11-16 01:06:34 [DEBUG   ] Got command BAM from MCS: ref #521212
2018-11-16 01:06:34 [INFO    ] Finished processing BAM request
2018-11-16 01:06:34 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:06:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521212   8 58438  3994029 A  ERROR'
2018-11-16 01:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-16 01:06:34 [DEBUG   ] spawn_process: at 2018-11-16 01:06:34 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-16 01:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-16 01:06:34 [DEBUG   ] spawn_process: at 2018-11-16 01:06:34 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-16 01:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-16 01:06:34 [DEBUG   ] spawn_process: at 2018-11-16 01:06:34 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-16 01:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-16 01:06:34 [DEBUG   ] spawn_process: at 2018-11-16 01:06:34 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-16 01:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-16 01:06:34 [DEBUG   ] spawn_process: at 2018-11-16 01:06:34 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-16 01:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-16 01:06:34 [DEBUG   ] spawn_process: at 2018-11-16 01:06:34 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-16 01:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-16 01:06:34 [DEBUG   ] spawn_process: at 2018-11-16 01:06:34 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-16 01:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-16 01:06:34 [DEBUG   ] spawn_process: at 2018-11-16 01:06:34 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-16 01:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-16 01:06:34 [DEBUG   ] spawn_process: at 2018-11-16 01:06:34 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-16 01:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-16 01:06:34 [DEBUG   ] spawn_process: at 2018-11-16 01:06:34 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-16 01:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-16 01:06:34 [DEBUG   ] spawn_process: at 2018-11-16 01:06:34 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-16 01:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-16 01:06:34 [DEBUG   ] spawn_process: at 2018-11-16 01:06:34 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-16 01:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-16 01:06:34 [DEBUG   ] spawn_process: at 2018-11-16 01:06:34 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-16 01:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-16 01:06:34 [DEBUG   ] spawn_process: at 2018-11-16 01:06:34 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-16 01:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-16 01:06:34 [DEBUG   ] spawn_process: at 2018-11-16 01:06:34 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-16 01:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-16 01:06:34 [DEBUG   ] spawn_process: at 2018-11-16 01:06:34 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-16 01:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-16 01:06:34 [DEBUG   ] spawn_process: at 2018-11-16 01:06:34 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-16 01:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-16 01:06:34 [DEBUG   ] spawn_process: at 2018-11-16 01:06:34 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-16 01:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-16 01:06:34 [DEBUG   ] spawn_process: at 2018-11-16 01:06:34 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-16 01:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-16 01:06:34 [DEBUG   ] spawn_process: at 2018-11-16 01:06:34 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-16 01:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-16 01:06:34 [DEBUG   ] spawn_process: at 2018-11-16 01:06:34 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-16 01:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-16 01:06:34 [DEBUG   ] spawn_process: at 2018-11-16 01:06:34 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-16 01:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-16 01:06:34 [DEBUG   ] spawn_process: at 2018-11-16 01:06:34 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-16 01:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-16 01:06:34 [DEBUG   ] spawn_process: at 2018-11-16 01:06:34 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-16 01:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-16 01:06:34 [DEBUG   ] spawn_process: at 2018-11-16 01:06:34 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-16 01:06:34 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-16 01:06:34 [DEBUG   ] spawn_process: at 2018-11-16 01:06:34 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-16 01:06:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 01:07:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 01:07:07 [DEBUG   ] Got command BAM from MCS: ref #521215
2018-11-16 01:07:07 [INFO    ] Finished processing BAM request
2018-11-16 01:07:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:07:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521215   8 58438  4027029 A  ERROR'
2018-11-16 01:07:07 [DEBUG   ] Got command BAM from MCS: ref #521214
2018-11-16 01:07:07 [INFO    ] Finished processing BAM request
2018-11-16 01:07:07 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:07:07 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521214   8 58438  4027033 A  ERROR'
2018-11-16 01:07:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa32, chip 5
2018-11-16 01:07:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-16 01:07:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-16 01:07:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-11-16 01:07:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-16 01:07:07 [DEBUG   ] spawn_process: at 2018-11-16 01:07:07 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-16 01:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-16 01:07:07 [DEBUG   ] spawn_process: at 2018-11-16 01:07:07 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-16 01:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-16 01:07:07 [DEBUG   ] spawn_process: at 2018-11-16 01:07:07 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-16 01:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-16 01:07:07 [DEBUG   ] spawn_process: at 2018-11-16 01:07:07 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-16 01:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-16 01:07:07 [DEBUG   ] spawn_process: at 2018-11-16 01:07:07 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-16 01:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-16 01:07:07 [DEBUG   ] spawn_process: at 2018-11-16 01:07:07 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-16 01:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-16 01:07:07 [DEBUG   ] spawn_process: at 2018-11-16 01:07:07 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-16 01:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-16 01:07:07 [DEBUG   ] spawn_process: at 2018-11-16 01:07:07 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-16 01:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-16 01:07:07 [DEBUG   ] spawn_process: at 2018-11-16 01:07:07 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-16 01:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-16 01:07:07 [DEBUG   ] spawn_process: at 2018-11-16 01:07:07 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-16 01:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-16 01:07:07 [DEBUG   ] spawn_process: at 2018-11-16 01:07:07 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-16 01:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-16 01:07:07 [DEBUG   ] spawn_process: at 2018-11-16 01:07:07 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-16 01:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-16 01:07:07 [DEBUG   ] spawn_process: at 2018-11-16 01:07:07 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-16 01:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-16 01:07:07 [DEBUG   ] spawn_process: at 2018-11-16 01:07:07 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-16 01:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-16 01:07:07 [DEBUG   ] spawn_process: at 2018-11-16 01:07:07 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-16 01:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-16 01:07:07 [DEBUG   ] spawn_process: at 2018-11-16 01:07:07 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-16 01:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-16 01:07:07 [DEBUG   ] spawn_process: at 2018-11-16 01:07:07 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-16 01:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-16 01:07:07 [DEBUG   ] spawn_process: at 2018-11-16 01:07:07 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-16 01:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-16 01:07:07 [DEBUG   ] spawn_process: at 2018-11-16 01:07:07 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-16 01:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-16 01:07:07 [DEBUG   ] spawn_process: at 2018-11-16 01:07:07 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-16 01:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-16 01:07:07 [DEBUG   ] spawn_process: at 2018-11-16 01:07:07 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-16 01:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-16 01:07:07 [DEBUG   ] spawn_process: at 2018-11-16 01:07:07 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-16 01:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-16 01:07:07 [DEBUG   ] spawn_process: at 2018-11-16 01:07:07 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-16 01:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-16 01:07:07 [DEBUG   ] spawn_process: at 2018-11-16 01:07:07 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-16 01:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-16 01:07:07 [DEBUG   ] spawn_process: at 2018-11-16 01:07:07 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-16 01:07:07 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-16 01:07:07 [DEBUG   ] spawn_process: at 2018-11-16 01:07:07 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-16 01:07:08 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-16 01:07:08 [WARNING ] (13, 1, 'bot')
2018-11-16 01:07:08 [WARNING ] (13, 1, 'bot')
2018-11-16 01:07:08 [WARNING ] (13, 1, 'bot')
2018-11-16 01:07:08 [WARNING ] (13, 1, 'bot')
2018-11-16 01:07:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:07:08 [DEBUG   ] Finished updating board flags in 1.736 seconds
2018-11-16 01:07:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 01:07:40 [DEBUG   ] Got command BAM from MCS: ref #521216
2018-11-16 01:07:40 [INFO    ] Finished processing BAM request
2018-11-16 01:07:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521216   8 58438  4060033 A  ERROR'
2018-11-16 01:07:40 [DEBUG   ] Got command BAM from MCS: ref #521217
2018-11-16 01:07:40 [INFO    ] Finished processing BAM request
2018-11-16 01:07:40 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:07:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521217   8 58438  4060037 A  ERROR'
2018-11-16 01:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-16 01:07:40 [DEBUG   ] spawn_process: at 2018-11-16 01:07:40 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-16 01:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-16 01:07:40 [DEBUG   ] spawn_process: at 2018-11-16 01:07:40 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-16 01:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-16 01:07:40 [DEBUG   ] spawn_process: at 2018-11-16 01:07:40 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-16 01:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-16 01:07:40 [DEBUG   ] spawn_process: at 2018-11-16 01:07:40 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-16 01:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-16 01:07:40 [DEBUG   ] spawn_process: at 2018-11-16 01:07:40 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-16 01:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-16 01:07:40 [DEBUG   ] spawn_process: at 2018-11-16 01:07:40 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-16 01:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-16 01:07:40 [DEBUG   ] spawn_process: at 2018-11-16 01:07:40 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-16 01:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-16 01:07:40 [DEBUG   ] spawn_process: at 2018-11-16 01:07:40 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-16 01:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-16 01:07:40 [DEBUG   ] spawn_process: at 2018-11-16 01:07:40 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-16 01:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-16 01:07:40 [DEBUG   ] spawn_process: at 2018-11-16 01:07:40 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-16 01:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-16 01:07:40 [DEBUG   ] spawn_process: at 2018-11-16 01:07:40 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-16 01:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-16 01:07:40 [DEBUG   ] spawn_process: at 2018-11-16 01:07:40 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-16 01:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-16 01:07:40 [DEBUG   ] spawn_process: at 2018-11-16 01:07:40 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-16 01:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-16 01:07:40 [DEBUG   ] spawn_process: at 2018-11-16 01:07:40 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-16 01:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-16 01:07:40 [DEBUG   ] spawn_process: at 2018-11-16 01:07:40 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-16 01:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-16 01:07:40 [DEBUG   ] spawn_process: at 2018-11-16 01:07:40 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-16 01:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-16 01:07:40 [DEBUG   ] spawn_process: at 2018-11-16 01:07:40 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-16 01:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-16 01:07:40 [DEBUG   ] spawn_process: at 2018-11-16 01:07:40 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-16 01:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-16 01:07:40 [DEBUG   ] spawn_process: at 2018-11-16 01:07:40 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-16 01:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-16 01:07:40 [DEBUG   ] spawn_process: at 2018-11-16 01:07:40 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-16 01:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-16 01:07:40 [DEBUG   ] spawn_process: at 2018-11-16 01:07:40 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-16 01:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-16 01:07:40 [DEBUG   ] spawn_process: at 2018-11-16 01:07:40 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-16 01:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-16 01:07:40 [DEBUG   ] spawn_process: at 2018-11-16 01:07:40 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-16 01:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-16 01:07:40 [DEBUG   ] spawn_process: at 2018-11-16 01:07:40 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-16 01:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-16 01:07:40 [DEBUG   ] spawn_process: at 2018-11-16 01:07:40 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-16 01:07:40 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-16 01:07:40 [DEBUG   ] spawn_process: at 2018-11-16 01:07:40 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-16 01:07:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 01:08:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 01:08:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa13, chip 1
2018-11-16 01:08:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:08:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa5, chip 1
2018-11-16 01:08:07 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-16 01:08:07 [WARNING ] (13, 1, 'bot')
2018-11-16 01:08:07 [WARNING ] (13, 1, 'bot')
2018-11-16 01:08:07 [WARNING ] (13, 1, 'bot')
2018-11-16 01:08:07 [WARNING ] (13, 1, 'bot')
2018-11-16 01:08:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:08:07 [DEBUG   ] Finished updating board flags in 1.079 seconds
2018-11-16 01:08:13 [DEBUG   ] Got command BAM from MCS: ref #521218
2018-11-16 01:08:13 [INFO    ] Finished processing BAM request
2018-11-16 01:08:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:08:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521218   8 58438  4093029 A  ERROR'
2018-11-16 01:08:13 [DEBUG   ] Got command BAM from MCS: ref #521219
2018-11-16 01:08:13 [INFO    ] Finished processing BAM request
2018-11-16 01:08:13 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:08:13 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521219   8 58438  4093033 A  ERROR'
2018-11-16 01:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-16 01:08:13 [DEBUG   ] spawn_process: at 2018-11-16 01:08:13 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-16 01:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-16 01:08:13 [DEBUG   ] spawn_process: at 2018-11-16 01:08:13 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-16 01:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-16 01:08:13 [DEBUG   ] spawn_process: at 2018-11-16 01:08:13 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-16 01:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-16 01:08:13 [DEBUG   ] spawn_process: at 2018-11-16 01:08:13 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-16 01:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-16 01:08:13 [DEBUG   ] spawn_process: at 2018-11-16 01:08:13 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-16 01:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-16 01:08:13 [DEBUG   ] spawn_process: at 2018-11-16 01:08:13 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-16 01:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-16 01:08:13 [DEBUG   ] spawn_process: at 2018-11-16 01:08:13 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-16 01:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-16 01:08:13 [DEBUG   ] spawn_process: at 2018-11-16 01:08:13 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-16 01:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-16 01:08:13 [DEBUG   ] spawn_process: at 2018-11-16 01:08:13 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-16 01:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-16 01:08:13 [DEBUG   ] spawn_process: at 2018-11-16 01:08:13 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-16 01:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-16 01:08:13 [DEBUG   ] spawn_process: at 2018-11-16 01:08:13 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-16 01:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-16 01:08:13 [DEBUG   ] spawn_process: at 2018-11-16 01:08:13 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-16 01:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-16 01:08:13 [DEBUG   ] spawn_process: at 2018-11-16 01:08:13 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-16 01:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-16 01:08:13 [DEBUG   ] spawn_process: at 2018-11-16 01:08:13 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-16 01:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-16 01:08:13 [DEBUG   ] spawn_process: at 2018-11-16 01:08:13 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-16 01:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-16 01:08:13 [DEBUG   ] spawn_process: at 2018-11-16 01:08:13 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-16 01:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-16 01:08:13 [DEBUG   ] spawn_process: at 2018-11-16 01:08:13 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-16 01:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-16 01:08:13 [DEBUG   ] spawn_process: at 2018-11-16 01:08:13 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-16 01:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-16 01:08:13 [DEBUG   ] spawn_process: at 2018-11-16 01:08:13 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-16 01:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-16 01:08:13 [DEBUG   ] spawn_process: at 2018-11-16 01:08:13 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-16 01:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-16 01:08:13 [DEBUG   ] spawn_process: at 2018-11-16 01:08:13 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-16 01:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-16 01:08:13 [DEBUG   ] spawn_process: at 2018-11-16 01:08:13 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-16 01:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-16 01:08:13 [DEBUG   ] spawn_process: at 2018-11-16 01:08:13 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-16 01:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-16 01:08:13 [DEBUG   ] spawn_process: at 2018-11-16 01:08:13 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-16 01:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-16 01:08:13 [DEBUG   ] spawn_process: at 2018-11-16 01:08:13 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-16 01:08:13 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-16 01:08:13 [DEBUG   ] spawn_process: at 2018-11-16 01:08:13 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-16 01:08:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 01:08:28 [DEBUG   ] Got command RPT from MCS: ref #521222
2018-11-16 01:08:28 [DEBUG   ] summary = ERROR
2018-11-16 01:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521222  13 58438  4108429 A  ERRORERROR'
2018-11-16 01:08:28 [DEBUG   ] Got command RPT from MCS: ref #521223
2018-11-16 01:08:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 01:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521223  77 58438  4108621 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 01:08:28 [DEBUG   ] Got command RPT from MCS: ref #521224
2018-11-16 01:08:28 [DEBUG   ] summary = ERROR
2018-11-16 01:08:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521224  13 58438  4108825 A  ERRORERROR'
2018-11-16 01:08:29 [DEBUG   ] Got command RPT from MCS: ref #521226
2018-11-16 01:08:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 01:08:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521226  77 58438  4109029 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 01:08:29 [DEBUG   ] Got command RPT from MCS: ref #521228
2018-11-16 01:08:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 01:08:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521228  12 58438  4109233 A  ERRORB¢ff'
2018-11-16 01:08:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 01:08:46 [DEBUG   ] Got command BAM from MCS: ref #521236
2018-11-16 01:08:46 [INFO    ] Finished processing BAM request
2018-11-16 01:08:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:08:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521236   8 58438  4126029 A  ERROR'
2018-11-16 01:08:46 [DEBUG   ] Got command BAM from MCS: ref #521237
2018-11-16 01:08:46 [INFO    ] Finished processing BAM request
2018-11-16 01:08:46 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:08:46 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521237   8 58438  4126033 A  ERROR'
2018-11-16 01:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-16 01:08:46 [DEBUG   ] spawn_process: at 2018-11-16 01:08:46 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-16 01:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-16 01:08:46 [DEBUG   ] spawn_process: at 2018-11-16 01:08:46 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-16 01:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-16 01:08:46 [DEBUG   ] spawn_process: at 2018-11-16 01:08:46 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-16 01:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-16 01:08:46 [DEBUG   ] spawn_process: at 2018-11-16 01:08:46 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-16 01:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-16 01:08:46 [DEBUG   ] spawn_process: at 2018-11-16 01:08:46 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-16 01:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-16 01:08:46 [DEBUG   ] spawn_process: at 2018-11-16 01:08:46 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-16 01:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-16 01:08:46 [DEBUG   ] spawn_process: at 2018-11-16 01:08:46 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-16 01:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-16 01:08:46 [DEBUG   ] spawn_process: at 2018-11-16 01:08:46 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-16 01:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-16 01:08:46 [DEBUG   ] spawn_process: at 2018-11-16 01:08:46 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-16 01:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-16 01:08:46 [DEBUG   ] spawn_process: at 2018-11-16 01:08:46 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-16 01:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-16 01:08:46 [DEBUG   ] spawn_process: at 2018-11-16 01:08:46 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-16 01:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-16 01:08:46 [DEBUG   ] spawn_process: at 2018-11-16 01:08:46 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-16 01:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-16 01:08:46 [DEBUG   ] spawn_process: at 2018-11-16 01:08:46 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-16 01:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-16 01:08:46 [DEBUG   ] spawn_process: at 2018-11-16 01:08:46 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-16 01:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-16 01:08:46 [DEBUG   ] spawn_process: at 2018-11-16 01:08:46 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-16 01:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-16 01:08:46 [DEBUG   ] spawn_process: at 2018-11-16 01:08:46 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-16 01:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-16 01:08:46 [DEBUG   ] spawn_process: at 2018-11-16 01:08:46 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-16 01:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-16 01:08:46 [DEBUG   ] spawn_process: at 2018-11-16 01:08:46 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-16 01:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-16 01:08:46 [DEBUG   ] spawn_process: at 2018-11-16 01:08:46 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-16 01:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-16 01:08:46 [DEBUG   ] spawn_process: at 2018-11-16 01:08:46 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-16 01:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-16 01:08:46 [DEBUG   ] spawn_process: at 2018-11-16 01:08:46 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-16 01:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-16 01:08:46 [DEBUG   ] spawn_process: at 2018-11-16 01:08:46 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-16 01:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-16 01:08:46 [DEBUG   ] spawn_process: at 2018-11-16 01:08:46 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-16 01:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-16 01:08:46 [DEBUG   ] spawn_process: at 2018-11-16 01:08:46 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-16 01:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-16 01:08:46 [DEBUG   ] spawn_process: at 2018-11-16 01:08:46 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-16 01:08:46 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-16 01:08:46 [DEBUG   ] spawn_process: at 2018-11-16 01:08:46 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-16 01:09:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 01:09:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:09:08 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-16 01:09:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-16 01:09:08 [WARNING ] (13, 1, 'bot')
2018-11-16 01:09:08 [WARNING ] (13, 1, 'bot')
2018-11-16 01:09:08 [WARNING ] (13, 1, 'bot')
2018-11-16 01:09:08 [WARNING ] (13, 1, 'bot')
2018-11-16 01:09:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:09:08 [DEBUG   ] Finished updating board flags in 1.546 seconds
2018-11-16 01:09:19 [DEBUG   ] Got command BAM from MCS: ref #521239
2018-11-16 01:09:19 [INFO    ] Finished processing BAM request
2018-11-16 01:09:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:09:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521239   8 58438  4159029 A  ERROR'
2018-11-16 01:09:19 [DEBUG   ] Got command BAM from MCS: ref #521238
2018-11-16 01:09:19 [INFO    ] Finished processing BAM request
2018-11-16 01:09:19 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:09:19 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521238   8 58438  4159033 A  ERROR'
2018-11-16 01:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-16 01:09:19 [DEBUG   ] spawn_process: at 2018-11-16 01:09:19 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-16 01:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-16 01:09:19 [DEBUG   ] spawn_process: at 2018-11-16 01:09:19 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-16 01:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-16 01:09:19 [DEBUG   ] spawn_process: at 2018-11-16 01:09:19 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-16 01:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-16 01:09:19 [DEBUG   ] spawn_process: at 2018-11-16 01:09:19 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-16 01:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-16 01:09:19 [DEBUG   ] spawn_process: at 2018-11-16 01:09:19 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-16 01:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-16 01:09:19 [DEBUG   ] spawn_process: at 2018-11-16 01:09:19 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-16 01:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-16 01:09:19 [DEBUG   ] spawn_process: at 2018-11-16 01:09:19 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-16 01:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-16 01:09:19 [DEBUG   ] spawn_process: at 2018-11-16 01:09:19 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-16 01:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-16 01:09:19 [DEBUG   ] spawn_process: at 2018-11-16 01:09:19 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-16 01:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-16 01:09:19 [DEBUG   ] spawn_process: at 2018-11-16 01:09:19 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-16 01:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-16 01:09:19 [DEBUG   ] spawn_process: at 2018-11-16 01:09:19 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-16 01:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-16 01:09:19 [DEBUG   ] spawn_process: at 2018-11-16 01:09:19 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-16 01:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-16 01:09:19 [DEBUG   ] spawn_process: at 2018-11-16 01:09:19 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-16 01:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-16 01:09:19 [DEBUG   ] spawn_process: at 2018-11-16 01:09:19 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-16 01:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-16 01:09:19 [DEBUG   ] spawn_process: at 2018-11-16 01:09:19 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-16 01:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-16 01:09:19 [DEBUG   ] spawn_process: at 2018-11-16 01:09:19 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-16 01:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-16 01:09:19 [DEBUG   ] spawn_process: at 2018-11-16 01:09:19 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-16 01:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-16 01:09:19 [DEBUG   ] spawn_process: at 2018-11-16 01:09:19 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-16 01:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-16 01:09:19 [DEBUG   ] spawn_process: at 2018-11-16 01:09:19 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-16 01:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-16 01:09:19 [DEBUG   ] spawn_process: at 2018-11-16 01:09:19 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-16 01:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-16 01:09:19 [DEBUG   ] spawn_process: at 2018-11-16 01:09:19 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-16 01:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-16 01:09:19 [DEBUG   ] spawn_process: at 2018-11-16 01:09:19 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-16 01:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-16 01:09:19 [DEBUG   ] spawn_process: at 2018-11-16 01:09:19 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-16 01:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-16 01:09:19 [DEBUG   ] spawn_process: at 2018-11-16 01:09:19 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-16 01:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-16 01:09:19 [DEBUG   ] spawn_process: at 2018-11-16 01:09:19 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-16 01:09:19 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-16 01:09:19 [DEBUG   ] spawn_process: at 2018-11-16 01:09:19 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-16 01:09:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 01:09:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 01:09:52 [DEBUG   ] Got command BAM from MCS: ref #521241
2018-11-16 01:09:52 [INFO    ] Finished processing BAM request
2018-11-16 01:09:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:09:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521241   8 58438  4192029 A  ERROR'
2018-11-16 01:09:52 [DEBUG   ] Got command BAM from MCS: ref #521240
2018-11-16 01:09:52 [INFO    ] Finished processing BAM request
2018-11-16 01:09:52 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:09:52 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521240   8 58438  4192033 A  ERROR'
2018-11-16 01:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-16 01:09:52 [DEBUG   ] spawn_process: at 2018-11-16 01:09:52 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-16 01:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-16 01:09:52 [DEBUG   ] spawn_process: at 2018-11-16 01:09:52 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-16 01:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-16 01:09:52 [DEBUG   ] spawn_process: at 2018-11-16 01:09:52 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-16 01:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-16 01:09:52 [DEBUG   ] spawn_process: at 2018-11-16 01:09:52 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-16 01:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-16 01:09:52 [DEBUG   ] spawn_process: at 2018-11-16 01:09:52 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-16 01:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-16 01:09:52 [DEBUG   ] spawn_process: at 2018-11-16 01:09:52 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-16 01:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-16 01:09:52 [DEBUG   ] spawn_process: at 2018-11-16 01:09:52 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-16 01:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-16 01:09:52 [DEBUG   ] spawn_process: at 2018-11-16 01:09:52 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-16 01:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-16 01:09:52 [DEBUG   ] spawn_process: at 2018-11-16 01:09:52 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-16 01:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-16 01:09:52 [DEBUG   ] spawn_process: at 2018-11-16 01:09:52 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-16 01:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-16 01:09:52 [DEBUG   ] spawn_process: at 2018-11-16 01:09:52 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-16 01:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-16 01:09:52 [DEBUG   ] spawn_process: at 2018-11-16 01:09:52 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-16 01:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-16 01:09:52 [DEBUG   ] spawn_process: at 2018-11-16 01:09:52 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-16 01:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-16 01:09:52 [DEBUG   ] spawn_process: at 2018-11-16 01:09:52 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-16 01:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-16 01:09:52 [DEBUG   ] spawn_process: at 2018-11-16 01:09:52 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-16 01:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-16 01:09:52 [DEBUG   ] spawn_process: at 2018-11-16 01:09:52 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-16 01:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-16 01:09:52 [DEBUG   ] spawn_process: at 2018-11-16 01:09:52 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-16 01:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-16 01:09:52 [DEBUG   ] spawn_process: at 2018-11-16 01:09:52 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-16 01:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-16 01:09:52 [DEBUG   ] spawn_process: at 2018-11-16 01:09:52 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-16 01:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-16 01:09:52 [DEBUG   ] spawn_process: at 2018-11-16 01:09:52 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-16 01:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-16 01:09:52 [DEBUG   ] spawn_process: at 2018-11-16 01:09:52 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-16 01:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-16 01:09:52 [DEBUG   ] spawn_process: at 2018-11-16 01:09:52 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-16 01:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-16 01:09:52 [DEBUG   ] spawn_process: at 2018-11-16 01:09:52 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-16 01:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-16 01:09:52 [DEBUG   ] spawn_process: at 2018-11-16 01:09:52 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-16 01:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-16 01:09:52 [DEBUG   ] spawn_process: at 2018-11-16 01:09:52 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-16 01:09:52 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-16 01:09:52 [DEBUG   ] spawn_process: at 2018-11-16 01:09:52 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-16 01:10:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 01:10:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa11, chip 5
2018-11-16 01:10:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:10:08 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-16 01:10:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-16 01:10:08 [WARNING ] (13, 1, 'bot')
2018-11-16 01:10:08 [WARNING ] (13, 1, 'bot')
2018-11-16 01:10:08 [WARNING ] (13, 1, 'bot')
2018-11-16 01:10:08 [WARNING ] (13, 1, 'bot')
2018-11-16 01:10:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:10:08 [DEBUG   ] Finished updating board flags in 1.386 seconds
2018-11-16 01:10:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 01:10:25 [DEBUG   ] Got command BAM from MCS: ref #521243
2018-11-16 01:10:25 [INFO    ] Finished processing BAM request
2018-11-16 01:10:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:10:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521243   8 58438  4225025 A  ERROR'
2018-11-16 01:10:25 [DEBUG   ] Got command BAM from MCS: ref #521242
2018-11-16 01:10:25 [INFO    ] Finished processing BAM request
2018-11-16 01:10:25 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:10:25 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521242   8 58438  4225029 A  ERROR'
2018-11-16 01:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-16 01:10:25 [DEBUG   ] spawn_process: at 2018-11-16 01:10:25 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-16 01:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-16 01:10:25 [DEBUG   ] spawn_process: at 2018-11-16 01:10:25 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-16 01:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-16 01:10:25 [DEBUG   ] spawn_process: at 2018-11-16 01:10:25 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-16 01:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-16 01:10:25 [DEBUG   ] spawn_process: at 2018-11-16 01:10:25 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-16 01:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-16 01:10:25 [DEBUG   ] spawn_process: at 2018-11-16 01:10:25 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-16 01:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-16 01:10:25 [DEBUG   ] spawn_process: at 2018-11-16 01:10:25 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-16 01:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-16 01:10:25 [DEBUG   ] spawn_process: at 2018-11-16 01:10:25 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-16 01:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-16 01:10:25 [DEBUG   ] spawn_process: at 2018-11-16 01:10:25 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-16 01:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-16 01:10:25 [DEBUG   ] spawn_process: at 2018-11-16 01:10:25 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-16 01:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-16 01:10:25 [DEBUG   ] spawn_process: at 2018-11-16 01:10:25 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-16 01:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-16 01:10:25 [DEBUG   ] spawn_process: at 2018-11-16 01:10:25 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-16 01:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-16 01:10:25 [DEBUG   ] spawn_process: at 2018-11-16 01:10:25 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-16 01:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-16 01:10:25 [DEBUG   ] spawn_process: at 2018-11-16 01:10:25 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-16 01:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-16 01:10:25 [DEBUG   ] spawn_process: at 2018-11-16 01:10:25 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-16 01:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-16 01:10:25 [DEBUG   ] spawn_process: at 2018-11-16 01:10:25 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-16 01:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-16 01:10:25 [DEBUG   ] spawn_process: at 2018-11-16 01:10:25 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-16 01:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-16 01:10:25 [DEBUG   ] spawn_process: at 2018-11-16 01:10:25 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-16 01:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-16 01:10:25 [DEBUG   ] spawn_process: at 2018-11-16 01:10:25 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-16 01:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-16 01:10:25 [DEBUG   ] spawn_process: at 2018-11-16 01:10:25 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-16 01:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-16 01:10:25 [DEBUG   ] spawn_process: at 2018-11-16 01:10:25 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-16 01:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-16 01:10:25 [DEBUG   ] spawn_process: at 2018-11-16 01:10:25 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-16 01:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-16 01:10:25 [DEBUG   ] spawn_process: at 2018-11-16 01:10:25 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-16 01:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-16 01:10:25 [DEBUG   ] spawn_process: at 2018-11-16 01:10:25 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-16 01:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-16 01:10:25 [DEBUG   ] spawn_process: at 2018-11-16 01:10:25 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-16 01:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-16 01:10:25 [DEBUG   ] spawn_process: at 2018-11-16 01:10:25 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-16 01:10:25 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-16 01:10:25 [DEBUG   ] spawn_process: at 2018-11-16 01:10:25 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-16 01:10:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 01:10:45 [DEBUG   ] Got command RPT from MCS: ref #521244
2018-11-16 01:10:45 [DEBUG   ] summary = ERROR
2018-11-16 01:10:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521244  13 58438  4245257 A  ERRORERROR'
2018-11-16 01:10:45 [DEBUG   ] Got command RPT from MCS: ref #521245
2018-11-16 01:10:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 01:10:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521245  77 58438  4245258 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 01:10:58 [DEBUG   ] Got command BAM from MCS: ref #521262
2018-11-16 01:10:58 [INFO    ] Finished processing BAM request
2018-11-16 01:10:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:10:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521262   8 58438  4258033 A  ERROR'
2018-11-16 01:10:58 [DEBUG   ] Got command BAM from MCS: ref #521261
2018-11-16 01:10:58 [INFO    ] Finished processing BAM request
2018-11-16 01:10:58 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:10:58 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521261   8 58438  4258037 A  ERROR'
2018-11-16 01:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-16 01:10:58 [DEBUG   ] spawn_process: at 2018-11-16 01:10:58 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-16 01:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-16 01:10:58 [DEBUG   ] spawn_process: at 2018-11-16 01:10:58 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-16 01:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-16 01:10:58 [DEBUG   ] spawn_process: at 2018-11-16 01:10:58 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-16 01:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-16 01:10:58 [DEBUG   ] spawn_process: at 2018-11-16 01:10:58 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-16 01:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-16 01:10:58 [DEBUG   ] spawn_process: at 2018-11-16 01:10:58 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-16 01:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-16 01:10:58 [DEBUG   ] spawn_process: at 2018-11-16 01:10:58 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-16 01:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-16 01:10:58 [DEBUG   ] spawn_process: at 2018-11-16 01:10:58 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-16 01:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-16 01:10:58 [DEBUG   ] spawn_process: at 2018-11-16 01:10:58 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-16 01:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-16 01:10:58 [DEBUG   ] spawn_process: at 2018-11-16 01:10:58 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-16 01:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-16 01:10:58 [DEBUG   ] spawn_process: at 2018-11-16 01:10:58 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-16 01:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-16 01:10:58 [DEBUG   ] spawn_process: at 2018-11-16 01:10:58 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-16 01:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-16 01:10:58 [DEBUG   ] spawn_process: at 2018-11-16 01:10:58 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-16 01:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-16 01:10:58 [DEBUG   ] spawn_process: at 2018-11-16 01:10:58 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-16 01:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-16 01:10:58 [DEBUG   ] spawn_process: at 2018-11-16 01:10:58 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-16 01:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-16 01:10:58 [DEBUG   ] spawn_process: at 2018-11-16 01:10:58 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-16 01:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-16 01:10:58 [DEBUG   ] spawn_process: at 2018-11-16 01:10:58 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-16 01:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-16 01:10:58 [DEBUG   ] spawn_process: at 2018-11-16 01:10:58 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-16 01:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-16 01:10:58 [DEBUG   ] spawn_process: at 2018-11-16 01:10:58 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-16 01:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-16 01:10:58 [DEBUG   ] spawn_process: at 2018-11-16 01:10:58 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-16 01:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-16 01:10:58 [DEBUG   ] spawn_process: at 2018-11-16 01:10:58 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-16 01:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-16 01:10:58 [DEBUG   ] spawn_process: at 2018-11-16 01:10:58 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-16 01:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-16 01:10:58 [DEBUG   ] spawn_process: at 2018-11-16 01:10:58 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-16 01:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-16 01:10:58 [DEBUG   ] spawn_process: at 2018-11-16 01:10:58 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-16 01:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-16 01:10:58 [DEBUG   ] spawn_process: at 2018-11-16 01:10:58 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-16 01:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-16 01:10:58 [DEBUG   ] spawn_process: at 2018-11-16 01:10:58 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-16 01:10:58 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-16 01:10:58 [DEBUG   ] spawn_process: at 2018-11-16 01:10:58 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-16 01:11:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 01:11:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:11:08 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-16 01:11:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-16 01:11:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-16 01:11:08 [WARNING ] (13, 1, 'bot')
2018-11-16 01:11:08 [WARNING ] (13, 1, 'bot')
2018-11-16 01:11:08 [WARNING ] (13, 1, 'bot')
2018-11-16 01:11:08 [WARNING ] (13, 1, 'bot')
2018-11-16 01:11:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:11:08 [DEBUG   ] Finished updating board flags in 1.202 seconds
2018-11-16 01:11:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 01:11:31 [DEBUG   ] Got command BAM from MCS: ref #521264
2018-11-16 01:11:31 [INFO    ] Finished processing BAM request
2018-11-16 01:11:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:11:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521264   8 58438  4291029 A  ERROR'
2018-11-16 01:11:31 [DEBUG   ] Got command BAM from MCS: ref #521263
2018-11-16 01:11:31 [INFO    ] Finished processing BAM request
2018-11-16 01:11:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:11:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521263   8 58438  4291033 A  ERROR'
2018-11-16 01:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1'] to hostname lwa27
2018-11-16 01:11:31 [DEBUG   ] spawn_process: at 2018-11-16 01:11:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp1 1']
2018-11-16 01:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2'] to hostname lwa24
2018-11-16 01:11:31 [DEBUG   ] spawn_process: at 2018-11-16 01:11:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp1 2']
2018-11-16 01:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3'] to hostname lwa23
2018-11-16 01:11:31 [DEBUG   ] spawn_process: at 2018-11-16 01:11:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp1 3']
2018-11-16 01:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4'] to hostname lwa18
2018-11-16 01:11:31 [DEBUG   ] spawn_process: at 2018-11-16 01:11:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp1 4']
2018-11-16 01:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5'] to hostname lwa10
2018-11-16 01:11:31 [DEBUG   ] spawn_process: at 2018-11-16 01:11:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp1 5']
2018-11-16 01:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6'] to hostname lwa32
2018-11-16 01:11:31 [DEBUG   ] spawn_process: at 2018-11-16 01:11:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp1 6']
2018-11-16 01:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7'] to hostname lwa11
2018-11-16 01:11:31 [DEBUG   ] spawn_process: at 2018-11-16 01:11:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp1 7']
2018-11-16 01:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8'] to hostname lwa30
2018-11-16 01:11:31 [DEBUG   ] spawn_process: at 2018-11-16 01:11:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp1 8']
2018-11-16 01:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9'] to hostname lwa12
2018-11-16 01:11:31 [DEBUG   ] spawn_process: at 2018-11-16 01:11:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp1 9']
2018-11-16 01:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10'] to hostname lwa8
2018-11-16 01:11:31 [DEBUG   ] spawn_process: at 2018-11-16 01:11:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp1 10']
2018-11-16 01:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11'] to hostname lwa13
2018-11-16 01:11:31 [DEBUG   ] spawn_process: at 2018-11-16 01:11:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp1 11']
2018-11-16 01:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12'] to hostname lwa26
2018-11-16 01:11:31 [DEBUG   ] spawn_process: at 2018-11-16 01:11:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp1 12']
2018-11-16 01:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13'] to hostname lwa14
2018-11-16 01:11:31 [DEBUG   ] spawn_process: at 2018-11-16 01:11:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp1 13']
2018-11-16 01:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14'] to hostname lwa22
2018-11-16 01:11:31 [DEBUG   ] spawn_process: at 2018-11-16 01:11:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp1 14']
2018-11-16 01:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15'] to hostname lwa20
2018-11-16 01:11:31 [DEBUG   ] spawn_process: at 2018-11-16 01:11:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp1 15']
2018-11-16 01:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16'] to hostname lwa1
2018-11-16 01:11:31 [DEBUG   ] spawn_process: at 2018-11-16 01:11:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp1 16']
2018-11-16 01:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17'] to hostname lwa5
2018-11-16 01:11:31 [DEBUG   ] spawn_process: at 2018-11-16 01:11:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp1 17']
2018-11-16 01:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18'] to hostname lwa25
2018-11-16 01:11:31 [DEBUG   ] spawn_process: at 2018-11-16 01:11:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp1 18']
2018-11-16 01:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19'] to hostname lwa35
2018-11-16 01:11:31 [DEBUG   ] spawn_process: at 2018-11-16 01:11:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp1 19']
2018-11-16 01:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20'] to hostname lwa19
2018-11-16 01:11:31 [DEBUG   ] spawn_process: at 2018-11-16 01:11:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp1 20']
2018-11-16 01:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21'] to hostname lwa21
2018-11-16 01:11:31 [DEBUG   ] spawn_process: at 2018-11-16 01:11:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp1 21']
2018-11-16 01:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22'] to hostname lwa6
2018-11-16 01:11:31 [DEBUG   ] spawn_process: at 2018-11-16 01:11:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp1 22']
2018-11-16 01:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23'] to hostname lwa7
2018-11-16 01:11:31 [DEBUG   ] spawn_process: at 2018-11-16 01:11:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp1 23']
2018-11-16 01:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24'] to hostname lwa33
2018-11-16 01:11:31 [DEBUG   ] spawn_process: at 2018-11-16 01:11:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp1 24']
2018-11-16 01:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25'] to hostname lwa15
2018-11-16 01:11:31 [DEBUG   ] spawn_process: at 2018-11-16 01:11:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp1 25']
2018-11-16 01:11:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26'] to hostname lwa28
2018-11-16 01:11:31 [DEBUG   ] spawn_process: at 2018-11-16 01:11:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp1 26']
2018-11-16 01:11:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 01:12:04 [DEBUG   ] Got command BAM from MCS: ref #521270
2018-11-16 01:12:04 [INFO    ] Finished processing BAM request
2018-11-16 01:12:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:12:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521270   8 58438  4324033 A  ERROR'
2018-11-16 01:12:04 [DEBUG   ] Got command BAM from MCS: ref #521269
2018-11-16 01:12:04 [INFO    ] Finished processing BAM request
2018-11-16 01:12:04 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:12:04 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521269   8 58438  4324037 A  ERROR'
2018-11-16 01:12:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 01:12:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-16 01:12:04 [DEBUG   ] spawn_process: at 2018-11-16 01:12:04 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-16 01:12:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-16 01:12:04 [DEBUG   ] spawn_process: at 2018-11-16 01:12:04 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-16 01:12:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-16 01:12:04 [DEBUG   ] spawn_process: at 2018-11-16 01:12:04 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-16 01:12:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-16 01:12:04 [DEBUG   ] spawn_process: at 2018-11-16 01:12:04 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-16 01:12:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-16 01:12:04 [DEBUG   ] spawn_process: at 2018-11-16 01:12:04 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-16 01:12:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-16 01:12:04 [DEBUG   ] spawn_process: at 2018-11-16 01:12:04 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-16 01:12:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-16 01:12:04 [DEBUG   ] spawn_process: at 2018-11-16 01:12:04 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-16 01:12:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-16 01:12:04 [DEBUG   ] spawn_process: at 2018-11-16 01:12:04 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-16 01:12:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-16 01:12:04 [DEBUG   ] spawn_process: at 2018-11-16 01:12:04 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-16 01:12:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-16 01:12:04 [DEBUG   ] spawn_process: at 2018-11-16 01:12:04 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-16 01:12:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-16 01:12:04 [DEBUG   ] spawn_process: at 2018-11-16 01:12:04 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-16 01:12:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-16 01:12:04 [DEBUG   ] spawn_process: at 2018-11-16 01:12:04 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-16 01:12:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-16 01:12:04 [DEBUG   ] spawn_process: at 2018-11-16 01:12:04 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-16 01:12:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-16 01:12:04 [DEBUG   ] spawn_process: at 2018-11-16 01:12:04 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-16 01:12:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-16 01:12:04 [DEBUG   ] spawn_process: at 2018-11-16 01:12:04 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-16 01:12:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-16 01:12:04 [DEBUG   ] spawn_process: at 2018-11-16 01:12:04 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-16 01:12:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-16 01:12:04 [DEBUG   ] spawn_process: at 2018-11-16 01:12:04 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-16 01:12:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-16 01:12:04 [DEBUG   ] spawn_process: at 2018-11-16 01:12:04 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-16 01:12:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-16 01:12:04 [DEBUG   ] spawn_process: at 2018-11-16 01:12:04 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-16 01:12:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-16 01:12:04 [DEBUG   ] spawn_process: at 2018-11-16 01:12:04 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-16 01:12:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-16 01:12:04 [DEBUG   ] spawn_process: at 2018-11-16 01:12:04 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-16 01:12:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-16 01:12:04 [DEBUG   ] spawn_process: at 2018-11-16 01:12:04 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-16 01:12:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-16 01:12:04 [DEBUG   ] spawn_process: at 2018-11-16 01:12:04 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-16 01:12:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-16 01:12:04 [DEBUG   ] spawn_process: at 2018-11-16 01:12:04 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-16 01:12:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-16 01:12:04 [DEBUG   ] spawn_process: at 2018-11-16 01:12:04 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-16 01:12:04 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-16 01:12:04 [DEBUG   ] spawn_process: at 2018-11-16 01:12:04 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-16 01:12:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:12:08 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-16 01:12:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-16 01:12:08 [WARNING ] (13, 1, 'bot')
2018-11-16 01:12:08 [WARNING ] (13, 1, 'bot')
2018-11-16 01:12:08 [WARNING ] (13, 1, 'bot')
2018-11-16 01:12:08 [WARNING ] (13, 1, 'bot')
2018-11-16 01:12:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:12:08 [DEBUG   ] Finished updating board flags in 1.193 seconds
2018-11-16 01:12:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 01:12:37 [DEBUG   ] Got command BAM from MCS: ref #521272
2018-11-16 01:12:37 [INFO    ] Finished processing BAM request
2018-11-16 01:12:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:12:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521272   8 58438  4357025 A  ERROR'
2018-11-16 01:12:37 [DEBUG   ] Got command BAM from MCS: ref #521271
2018-11-16 01:12:37 [INFO    ] Finished processing BAM request
2018-11-16 01:12:37 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:12:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521271   8 58438  4357029 A  ERROR'
2018-11-16 01:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-16 01:12:37 [DEBUG   ] spawn_process: at 2018-11-16 01:12:37 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-16 01:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-16 01:12:37 [DEBUG   ] spawn_process: at 2018-11-16 01:12:37 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-16 01:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-16 01:12:37 [DEBUG   ] spawn_process: at 2018-11-16 01:12:37 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-16 01:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-16 01:12:37 [DEBUG   ] spawn_process: at 2018-11-16 01:12:37 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-16 01:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-16 01:12:37 [DEBUG   ] spawn_process: at 2018-11-16 01:12:37 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-16 01:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-16 01:12:37 [DEBUG   ] spawn_process: at 2018-11-16 01:12:37 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-16 01:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-16 01:12:37 [DEBUG   ] spawn_process: at 2018-11-16 01:12:37 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-16 01:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-16 01:12:37 [DEBUG   ] spawn_process: at 2018-11-16 01:12:37 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-16 01:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-16 01:12:37 [DEBUG   ] spawn_process: at 2018-11-16 01:12:37 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-16 01:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-16 01:12:37 [DEBUG   ] spawn_process: at 2018-11-16 01:12:37 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-16 01:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-16 01:12:37 [DEBUG   ] spawn_process: at 2018-11-16 01:12:37 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-16 01:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-16 01:12:37 [DEBUG   ] spawn_process: at 2018-11-16 01:12:37 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-16 01:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-16 01:12:37 [DEBUG   ] spawn_process: at 2018-11-16 01:12:37 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-16 01:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-16 01:12:37 [DEBUG   ] spawn_process: at 2018-11-16 01:12:37 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-16 01:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-16 01:12:37 [DEBUG   ] spawn_process: at 2018-11-16 01:12:37 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-16 01:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-16 01:12:37 [DEBUG   ] spawn_process: at 2018-11-16 01:12:37 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-16 01:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-16 01:12:37 [DEBUG   ] spawn_process: at 2018-11-16 01:12:37 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-16 01:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-16 01:12:37 [DEBUG   ] spawn_process: at 2018-11-16 01:12:37 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-16 01:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-16 01:12:37 [DEBUG   ] spawn_process: at 2018-11-16 01:12:37 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-16 01:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-16 01:12:37 [DEBUG   ] spawn_process: at 2018-11-16 01:12:37 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-16 01:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-16 01:12:37 [DEBUG   ] spawn_process: at 2018-11-16 01:12:37 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-16 01:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-16 01:12:37 [DEBUG   ] spawn_process: at 2018-11-16 01:12:37 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-16 01:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-16 01:12:37 [DEBUG   ] spawn_process: at 2018-11-16 01:12:37 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-16 01:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-16 01:12:37 [DEBUG   ] spawn_process: at 2018-11-16 01:12:37 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-16 01:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-16 01:12:37 [DEBUG   ] spawn_process: at 2018-11-16 01:12:37 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-16 01:12:37 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-16 01:12:37 [DEBUG   ] spawn_process: at 2018-11-16 01:12:37 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-16 01:12:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 01:13:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 01:13:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:13:08 [WARNING ] MonitorFlags: Temperature 81.20 > 80 on hostname lwa21, chip 2
2018-11-16 01:13:08 [WARNING ] (13, 1, 'bot')
2018-11-16 01:13:08 [WARNING ] (13, 1, 'bot')
2018-11-16 01:13:08 [WARNING ] (13, 1, 'bot')
2018-11-16 01:13:08 [WARNING ] (13, 1, 'bot')
2018-11-16 01:13:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:13:08 [DEBUG   ] Finished updating board flags in 1.049 seconds
2018-11-16 01:13:10 [DEBUG   ] Got command BAM from MCS: ref #521274
2018-11-16 01:13:10 [INFO    ] Finished processing BAM request
2018-11-16 01:13:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:13:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521274   8 58438  4390025 A  ERROR'
2018-11-16 01:13:10 [DEBUG   ] Got command BAM from MCS: ref #521273
2018-11-16 01:13:10 [INFO    ] Finished processing BAM request
2018-11-16 01:13:10 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:13:10 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521273   8 58438  4390029 A  ERROR'
2018-11-16 01:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-16 01:13:10 [DEBUG   ] spawn_process: at 2018-11-16 01:13:10 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-16 01:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-16 01:13:10 [DEBUG   ] spawn_process: at 2018-11-16 01:13:10 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-16 01:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-16 01:13:10 [DEBUG   ] spawn_process: at 2018-11-16 01:13:10 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-16 01:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-16 01:13:10 [DEBUG   ] spawn_process: at 2018-11-16 01:13:10 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-16 01:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-16 01:13:10 [DEBUG   ] spawn_process: at 2018-11-16 01:13:10 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-16 01:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-16 01:13:10 [DEBUG   ] spawn_process: at 2018-11-16 01:13:10 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-16 01:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-16 01:13:10 [DEBUG   ] spawn_process: at 2018-11-16 01:13:10 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-16 01:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-16 01:13:10 [DEBUG   ] spawn_process: at 2018-11-16 01:13:10 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-16 01:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-16 01:13:10 [DEBUG   ] spawn_process: at 2018-11-16 01:13:10 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-16 01:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-16 01:13:10 [DEBUG   ] spawn_process: at 2018-11-16 01:13:10 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-16 01:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-16 01:13:10 [DEBUG   ] spawn_process: at 2018-11-16 01:13:10 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-16 01:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-16 01:13:10 [DEBUG   ] spawn_process: at 2018-11-16 01:13:10 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-16 01:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-16 01:13:10 [DEBUG   ] spawn_process: at 2018-11-16 01:13:10 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-16 01:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-16 01:13:10 [DEBUG   ] spawn_process: at 2018-11-16 01:13:10 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-16 01:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-16 01:13:10 [DEBUG   ] spawn_process: at 2018-11-16 01:13:10 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-16 01:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-16 01:13:10 [DEBUG   ] spawn_process: at 2018-11-16 01:13:10 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-16 01:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-16 01:13:10 [DEBUG   ] spawn_process: at 2018-11-16 01:13:10 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-16 01:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-16 01:13:10 [DEBUG   ] spawn_process: at 2018-11-16 01:13:10 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-16 01:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-16 01:13:10 [DEBUG   ] spawn_process: at 2018-11-16 01:13:10 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-16 01:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-16 01:13:10 [DEBUG   ] spawn_process: at 2018-11-16 01:13:10 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-16 01:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-16 01:13:10 [DEBUG   ] spawn_process: at 2018-11-16 01:13:10 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-16 01:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-16 01:13:10 [DEBUG   ] spawn_process: at 2018-11-16 01:13:10 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-16 01:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-16 01:13:10 [DEBUG   ] spawn_process: at 2018-11-16 01:13:10 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-16 01:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-16 01:13:10 [DEBUG   ] spawn_process: at 2018-11-16 01:13:10 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-16 01:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-16 01:13:10 [DEBUG   ] spawn_process: at 2018-11-16 01:13:10 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-16 01:13:10 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-16 01:13:10 [DEBUG   ] spawn_process: at 2018-11-16 01:13:10 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-16 01:13:24 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-16 01:13:28 [DEBUG   ] Got command RPT from MCS: ref #521275
2018-11-16 01:13:28 [DEBUG   ] summary = ERROR
2018-11-16 01:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521275  13 58438  4408513 A  ERRORERROR'
2018-11-16 01:13:28 [DEBUG   ] Got command RPT from MCS: ref #521276
2018-11-16 01:13:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 01:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521276  77 58438  4408717 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 01:13:28 [DEBUG   ] Got command RPT from MCS: ref #521277
2018-11-16 01:13:28 [DEBUG   ] summary = ERROR
2018-11-16 01:13:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521277  13 58438  4408909 A  ERRORERROR'
2018-11-16 01:13:29 [DEBUG   ] Got command RPT from MCS: ref #521278
2018-11-16 01:13:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 01:13:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521278  77 58438  4409113 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 01:13:29 [DEBUG   ] Got command RPT from MCS: ref #521279
2018-11-16 01:13:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 01:13:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521279  12 58438  4409317 A  ERRORB¢ff'
2018-11-16 01:13:43 [DEBUG   ] Got command BAM from MCS: ref #521280
2018-11-16 01:13:43 [INFO    ] Finished processing BAM request
2018-11-16 01:13:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:13:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521280   8 58438  4423025 A  ERROR'
2018-11-16 01:13:43 [DEBUG   ] Got command BAM from MCS: ref #521281
2018-11-16 01:13:43 [INFO    ] Finished processing BAM request
2018-11-16 01:13:43 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:13:43 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521281   8 58438  4423029 A  ERROR'
2018-11-16 01:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1'] to hostname lwa27
2018-11-16 01:13:43 [DEBUG   ] spawn_process: at 2018-11-16 01:13:43 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp5 1']
2018-11-16 01:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2'] to hostname lwa24
2018-11-16 01:13:43 [DEBUG   ] spawn_process: at 2018-11-16 01:13:43 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp5 2']
2018-11-16 01:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3'] to hostname lwa23
2018-11-16 01:13:43 [DEBUG   ] spawn_process: at 2018-11-16 01:13:43 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp5 3']
2018-11-16 01:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4'] to hostname lwa18
2018-11-16 01:13:43 [DEBUG   ] spawn_process: at 2018-11-16 01:13:43 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp5 4']
2018-11-16 01:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5'] to hostname lwa10
2018-11-16 01:13:43 [DEBUG   ] spawn_process: at 2018-11-16 01:13:43 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp5 5']
2018-11-16 01:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6'] to hostname lwa32
2018-11-16 01:13:43 [DEBUG   ] spawn_process: at 2018-11-16 01:13:43 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp5 6']
2018-11-16 01:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7'] to hostname lwa11
2018-11-16 01:13:43 [DEBUG   ] spawn_process: at 2018-11-16 01:13:43 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp5 7']
2018-11-16 01:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8'] to hostname lwa30
2018-11-16 01:13:43 [DEBUG   ] spawn_process: at 2018-11-16 01:13:43 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp5 8']
2018-11-16 01:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9'] to hostname lwa12
2018-11-16 01:13:43 [DEBUG   ] spawn_process: at 2018-11-16 01:13:43 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp5 9']
2018-11-16 01:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10'] to hostname lwa8
2018-11-16 01:13:43 [DEBUG   ] spawn_process: at 2018-11-16 01:13:43 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp5 10']
2018-11-16 01:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11'] to hostname lwa13
2018-11-16 01:13:43 [DEBUG   ] spawn_process: at 2018-11-16 01:13:43 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp5 11']
2018-11-16 01:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12'] to hostname lwa26
2018-11-16 01:13:43 [DEBUG   ] spawn_process: at 2018-11-16 01:13:43 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp5 12']
2018-11-16 01:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13'] to hostname lwa14
2018-11-16 01:13:43 [DEBUG   ] spawn_process: at 2018-11-16 01:13:43 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp5 13']
2018-11-16 01:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14'] to hostname lwa22
2018-11-16 01:13:43 [DEBUG   ] spawn_process: at 2018-11-16 01:13:43 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp5 14']
2018-11-16 01:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15'] to hostname lwa20
2018-11-16 01:13:43 [DEBUG   ] spawn_process: at 2018-11-16 01:13:43 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp5 15']
2018-11-16 01:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16'] to hostname lwa1
2018-11-16 01:13:43 [DEBUG   ] spawn_process: at 2018-11-16 01:13:43 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp5 16']
2018-11-16 01:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17'] to hostname lwa5
2018-11-16 01:13:43 [DEBUG   ] spawn_process: at 2018-11-16 01:13:43 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp5 17']
2018-11-16 01:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18'] to hostname lwa25
2018-11-16 01:13:43 [DEBUG   ] spawn_process: at 2018-11-16 01:13:43 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp5 18']
2018-11-16 01:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19'] to hostname lwa35
2018-11-16 01:13:43 [DEBUG   ] spawn_process: at 2018-11-16 01:13:43 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp5 19']
2018-11-16 01:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20'] to hostname lwa19
2018-11-16 01:13:43 [DEBUG   ] spawn_process: at 2018-11-16 01:13:43 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp5 20']
2018-11-16 01:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21'] to hostname lwa21
2018-11-16 01:13:43 [DEBUG   ] spawn_process: at 2018-11-16 01:13:43 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp5 21']
2018-11-16 01:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22'] to hostname lwa6
2018-11-16 01:13:43 [DEBUG   ] spawn_process: at 2018-11-16 01:13:43 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp5 22']
2018-11-16 01:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23'] to hostname lwa7
2018-11-16 01:13:43 [DEBUG   ] spawn_process: at 2018-11-16 01:13:43 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp5 23']
2018-11-16 01:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24'] to hostname lwa33
2018-11-16 01:13:43 [DEBUG   ] spawn_process: at 2018-11-16 01:13:43 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp5 24']
2018-11-16 01:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25'] to hostname lwa15
2018-11-16 01:13:43 [DEBUG   ] spawn_process: at 2018-11-16 01:13:43 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp5 25']
2018-11-16 01:13:43 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26'] to hostname lwa28
2018-11-16 01:13:43 [DEBUG   ] spawn_process: at 2018-11-16 01:13:43 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp5 26']
2018-11-16 01:13:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 01:14:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 01:14:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 1
2018-11-16 01:14:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-16 01:14:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:14:09 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-16 01:14:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-16 01:14:09 [WARNING ] (13, 1, 'bot')
2018-11-16 01:14:09 [WARNING ] (13, 1, 'bot')
2018-11-16 01:14:09 [WARNING ] (13, 1, 'bot')
2018-11-16 01:14:09 [WARNING ] (13, 1, 'bot')
2018-11-16 01:14:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:14:09 [DEBUG   ] Finished updating board flags in 2.006 seconds
2018-11-16 01:14:16 [DEBUG   ] Got command BAM from MCS: ref #521282
2018-11-16 01:14:16 [INFO    ] Finished processing BAM request
2018-11-16 01:14:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:14:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521282   8 58438  4456033 A  ERROR'
2018-11-16 01:14:16 [DEBUG   ] Got command BAM from MCS: ref #521283
2018-11-16 01:14:16 [INFO    ] Finished processing BAM request
2018-11-16 01:14:16 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:14:16 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521283   8 58438  4456037 A  ERROR'
2018-11-16 01:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1'] to hostname lwa27
2018-11-16 01:14:16 [DEBUG   ] spawn_process: at 2018-11-16 01:14:16 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp4 1']
2018-11-16 01:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2'] to hostname lwa24
2018-11-16 01:14:16 [DEBUG   ] spawn_process: at 2018-11-16 01:14:16 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp4 2']
2018-11-16 01:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3'] to hostname lwa23
2018-11-16 01:14:16 [DEBUG   ] spawn_process: at 2018-11-16 01:14:16 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp4 3']
2018-11-16 01:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4'] to hostname lwa18
2018-11-16 01:14:16 [DEBUG   ] spawn_process: at 2018-11-16 01:14:16 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp4 4']
2018-11-16 01:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5'] to hostname lwa10
2018-11-16 01:14:16 [DEBUG   ] spawn_process: at 2018-11-16 01:14:16 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp4 5']
2018-11-16 01:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6'] to hostname lwa32
2018-11-16 01:14:16 [DEBUG   ] spawn_process: at 2018-11-16 01:14:16 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp4 6']
2018-11-16 01:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7'] to hostname lwa11
2018-11-16 01:14:16 [DEBUG   ] spawn_process: at 2018-11-16 01:14:16 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp4 7']
2018-11-16 01:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8'] to hostname lwa30
2018-11-16 01:14:16 [DEBUG   ] spawn_process: at 2018-11-16 01:14:16 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp4 8']
2018-11-16 01:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9'] to hostname lwa12
2018-11-16 01:14:16 [DEBUG   ] spawn_process: at 2018-11-16 01:14:16 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp4 9']
2018-11-16 01:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10'] to hostname lwa8
2018-11-16 01:14:16 [DEBUG   ] spawn_process: at 2018-11-16 01:14:16 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp4 10']
2018-11-16 01:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11'] to hostname lwa13
2018-11-16 01:14:16 [DEBUG   ] spawn_process: at 2018-11-16 01:14:16 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp4 11']
2018-11-16 01:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12'] to hostname lwa26
2018-11-16 01:14:16 [DEBUG   ] spawn_process: at 2018-11-16 01:14:16 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp4 12']
2018-11-16 01:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13'] to hostname lwa14
2018-11-16 01:14:16 [DEBUG   ] spawn_process: at 2018-11-16 01:14:16 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp4 13']
2018-11-16 01:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14'] to hostname lwa22
2018-11-16 01:14:16 [DEBUG   ] spawn_process: at 2018-11-16 01:14:16 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp4 14']
2018-11-16 01:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15'] to hostname lwa20
2018-11-16 01:14:16 [DEBUG   ] spawn_process: at 2018-11-16 01:14:16 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp4 15']
2018-11-16 01:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16'] to hostname lwa1
2018-11-16 01:14:16 [DEBUG   ] spawn_process: at 2018-11-16 01:14:16 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp4 16']
2018-11-16 01:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17'] to hostname lwa5
2018-11-16 01:14:16 [DEBUG   ] spawn_process: at 2018-11-16 01:14:16 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp4 17']
2018-11-16 01:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18'] to hostname lwa25
2018-11-16 01:14:16 [DEBUG   ] spawn_process: at 2018-11-16 01:14:16 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp4 18']
2018-11-16 01:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19'] to hostname lwa35
2018-11-16 01:14:16 [DEBUG   ] spawn_process: at 2018-11-16 01:14:16 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp4 19']
2018-11-16 01:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20'] to hostname lwa19
2018-11-16 01:14:16 [DEBUG   ] spawn_process: at 2018-11-16 01:14:16 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp4 20']
2018-11-16 01:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21'] to hostname lwa21
2018-11-16 01:14:16 [DEBUG   ] spawn_process: at 2018-11-16 01:14:16 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp4 21']
2018-11-16 01:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22'] to hostname lwa6
2018-11-16 01:14:16 [DEBUG   ] spawn_process: at 2018-11-16 01:14:16 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp4 22']
2018-11-16 01:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23'] to hostname lwa7
2018-11-16 01:14:16 [DEBUG   ] spawn_process: at 2018-11-16 01:14:16 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp4 23']
2018-11-16 01:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24'] to hostname lwa33
2018-11-16 01:14:16 [DEBUG   ] spawn_process: at 2018-11-16 01:14:16 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp4 24']
2018-11-16 01:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25'] to hostname lwa15
2018-11-16 01:14:16 [DEBUG   ] spawn_process: at 2018-11-16 01:14:16 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp4 25']
2018-11-16 01:14:16 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26'] to hostname lwa28
2018-11-16 01:14:16 [DEBUG   ] spawn_process: at 2018-11-16 01:14:16 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp4 26']
2018-11-16 01:14:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 01:14:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 01:14:49 [DEBUG   ] Got command BAM from MCS: ref #521288
2018-11-16 01:14:49 [INFO    ] Finished processing BAM request
2018-11-16 01:14:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:14:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521288   8 58438  4489033 A  ERROR'
2018-11-16 01:14:49 [DEBUG   ] Got command BAM from MCS: ref #521289
2018-11-16 01:14:49 [INFO    ] Finished processing BAM request
2018-11-16 01:14:49 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:14:49 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521289   8 58438  4489037 A  ERROR'
2018-11-16 01:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-16 01:14:49 [DEBUG   ] spawn_process: at 2018-11-16 01:14:49 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-16 01:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-16 01:14:49 [DEBUG   ] spawn_process: at 2018-11-16 01:14:49 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-16 01:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-16 01:14:49 [DEBUG   ] spawn_process: at 2018-11-16 01:14:49 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-16 01:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-16 01:14:49 [DEBUG   ] spawn_process: at 2018-11-16 01:14:49 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-16 01:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-16 01:14:49 [DEBUG   ] spawn_process: at 2018-11-16 01:14:49 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-16 01:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-16 01:14:49 [DEBUG   ] spawn_process: at 2018-11-16 01:14:49 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-16 01:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-16 01:14:49 [DEBUG   ] spawn_process: at 2018-11-16 01:14:49 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-16 01:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-16 01:14:49 [DEBUG   ] spawn_process: at 2018-11-16 01:14:49 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-16 01:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-16 01:14:49 [DEBUG   ] spawn_process: at 2018-11-16 01:14:49 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-16 01:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-16 01:14:49 [DEBUG   ] spawn_process: at 2018-11-16 01:14:49 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-16 01:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-16 01:14:49 [DEBUG   ] spawn_process: at 2018-11-16 01:14:49 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-16 01:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-16 01:14:49 [DEBUG   ] spawn_process: at 2018-11-16 01:14:49 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-16 01:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-16 01:14:49 [DEBUG   ] spawn_process: at 2018-11-16 01:14:49 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-16 01:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-16 01:14:49 [DEBUG   ] spawn_process: at 2018-11-16 01:14:49 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-16 01:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-16 01:14:49 [DEBUG   ] spawn_process: at 2018-11-16 01:14:49 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-16 01:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-16 01:14:49 [DEBUG   ] spawn_process: at 2018-11-16 01:14:49 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-16 01:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-16 01:14:49 [DEBUG   ] spawn_process: at 2018-11-16 01:14:49 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-16 01:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-16 01:14:49 [DEBUG   ] spawn_process: at 2018-11-16 01:14:49 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-16 01:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-16 01:14:49 [DEBUG   ] spawn_process: at 2018-11-16 01:14:49 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-16 01:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-16 01:14:49 [DEBUG   ] spawn_process: at 2018-11-16 01:14:49 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-16 01:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-16 01:14:49 [DEBUG   ] spawn_process: at 2018-11-16 01:14:49 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-16 01:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-16 01:14:49 [DEBUG   ] spawn_process: at 2018-11-16 01:14:49 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-16 01:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-16 01:14:49 [DEBUG   ] spawn_process: at 2018-11-16 01:14:49 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-16 01:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-16 01:14:49 [DEBUG   ] spawn_process: at 2018-11-16 01:14:49 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-16 01:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-16 01:14:49 [DEBUG   ] spawn_process: at 2018-11-16 01:14:49 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-16 01:14:49 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-16 01:14:49 [DEBUG   ] spawn_process: at 2018-11-16 01:14:49 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-16 01:15:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 01:15:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-16 01:15:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:15:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa19, chip 1
2018-11-16 01:15:09 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-16 01:15:09 [WARNING ] (13, 1, 'bot')
2018-11-16 01:15:09 [WARNING ] (13, 1, 'bot')
2018-11-16 01:15:09 [WARNING ] (13, 1, 'bot')
2018-11-16 01:15:09 [WARNING ] (13, 1, 'bot')
2018-11-16 01:15:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:15:09 [DEBUG   ] Finished updating board flags in 2.019 seconds
2018-11-16 01:15:23 [DEBUG   ] Got command BAM from MCS: ref #521291
2018-11-16 01:15:23 [INFO    ] Finished processing BAM request
2018-11-16 01:15:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:15:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521291   8 58438  4523033 A  ERROR'
2018-11-16 01:15:23 [DEBUG   ] Got command BAM from MCS: ref #521290
2018-11-16 01:15:23 [INFO    ] Finished processing BAM request
2018-11-16 01:15:23 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:15:23 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521290   8 58438  4523037 A  ERROR'
2018-11-16 01:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-16 01:15:23 [DEBUG   ] spawn_process: at 2018-11-16 01:15:23 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-16 01:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-16 01:15:23 [DEBUG   ] spawn_process: at 2018-11-16 01:15:23 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-16 01:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-16 01:15:23 [DEBUG   ] spawn_process: at 2018-11-16 01:15:23 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-16 01:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-16 01:15:23 [DEBUG   ] spawn_process: at 2018-11-16 01:15:23 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-16 01:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-16 01:15:23 [DEBUG   ] spawn_process: at 2018-11-16 01:15:23 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-16 01:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-16 01:15:23 [DEBUG   ] spawn_process: at 2018-11-16 01:15:23 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-16 01:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-16 01:15:23 [DEBUG   ] spawn_process: at 2018-11-16 01:15:23 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-16 01:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-16 01:15:23 [DEBUG   ] spawn_process: at 2018-11-16 01:15:23 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-16 01:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-16 01:15:23 [DEBUG   ] spawn_process: at 2018-11-16 01:15:23 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-16 01:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-16 01:15:23 [DEBUG   ] spawn_process: at 2018-11-16 01:15:23 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-16 01:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-16 01:15:23 [DEBUG   ] spawn_process: at 2018-11-16 01:15:23 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-16 01:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-16 01:15:23 [DEBUG   ] spawn_process: at 2018-11-16 01:15:23 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-16 01:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-16 01:15:23 [DEBUG   ] spawn_process: at 2018-11-16 01:15:23 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-16 01:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-16 01:15:23 [DEBUG   ] spawn_process: at 2018-11-16 01:15:23 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-16 01:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-16 01:15:23 [DEBUG   ] spawn_process: at 2018-11-16 01:15:23 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-16 01:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-16 01:15:23 [DEBUG   ] spawn_process: at 2018-11-16 01:15:23 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-16 01:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-16 01:15:23 [DEBUG   ] spawn_process: at 2018-11-16 01:15:23 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-16 01:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-16 01:15:23 [DEBUG   ] spawn_process: at 2018-11-16 01:15:23 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-16 01:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-16 01:15:23 [DEBUG   ] spawn_process: at 2018-11-16 01:15:23 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-16 01:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-16 01:15:23 [DEBUG   ] spawn_process: at 2018-11-16 01:15:23 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-16 01:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-16 01:15:23 [DEBUG   ] spawn_process: at 2018-11-16 01:15:23 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-16 01:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-16 01:15:23 [DEBUG   ] spawn_process: at 2018-11-16 01:15:23 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-16 01:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-16 01:15:23 [DEBUG   ] spawn_process: at 2018-11-16 01:15:23 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-16 01:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-16 01:15:23 [DEBUG   ] spawn_process: at 2018-11-16 01:15:23 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-16 01:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-16 01:15:23 [DEBUG   ] spawn_process: at 2018-11-16 01:15:23 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-16 01:15:23 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-16 01:15:23 [DEBUG   ] spawn_process: at 2018-11-16 01:15:23 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-16 01:15:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 01:15:44 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 01:15:45 [DEBUG   ] Got command RPT from MCS: ref #521292
2018-11-16 01:15:45 [DEBUG   ] summary = ERROR
2018-11-16 01:15:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521292  13 58438  4545257 A  ERRORERROR'
2018-11-16 01:15:45 [DEBUG   ] Got command RPT from MCS: ref #521293
2018-11-16 01:15:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 01:15:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521293  77 58438  4545258 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 01:15:57 [DEBUG   ] Got command BAM from MCS: ref #521309
2018-11-16 01:15:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:15:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521309   8 58438  4557026 A  ERROR'
2018-11-16 01:15:57 [DEBUG   ] Got command BAM from MCS: ref #521310
2018-11-16 01:15:57 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:15:57 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521310   8 58438  4557030 A  ERROR'
2018-11-16 01:15:57 [ERROR   ] SendBAM: sendCommands failed with: [Errno 17] File exists at line 828
2018-11-16 01:15:57 [INFO    ] Finished processing BAM request
2018-11-16 01:15:57 [INFO    ] Finished processing BAM request
2018-11-16 01:15:57 [DEBUG   ]   File "/var/lwa_root/lwa/software/dpThreads.py", line 828, in sendCommands
2018-11-16 01:15:57 [DEBUG   ]     os.symlink(tmpBAMFilename, BAMFilename)
2018-11-16 01:15:57 [DEBUG   ] 
2018-11-16 01:16:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 01:16:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:16:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 3
2018-11-16 01:16:08 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-16 01:16:08 [WARNING ] MonitorFlags: Temperature 80.20 > 80 on hostname lwa7, chip 2
2018-11-16 01:16:08 [WARNING ] (13, 1, 'bot')
2018-11-16 01:16:08 [WARNING ] (13, 1, 'bot')
2018-11-16 01:16:08 [WARNING ] (13, 1, 'bot')
2018-11-16 01:16:08 [WARNING ] (13, 1, 'bot')
2018-11-16 01:16:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:16:08 [DEBUG   ] Finished updating board flags in 1.412 seconds
2018-11-16 01:16:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 01:16:31 [DEBUG   ] Got command BAM from MCS: ref #521311
2018-11-16 01:16:31 [INFO    ] Finished processing BAM request
2018-11-16 01:16:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:16:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521311   8 58438  4591033 A  ERROR'
2018-11-16 01:16:31 [DEBUG   ] Got command BAM from MCS: ref #521312
2018-11-16 01:16:31 [INFO    ] Finished processing BAM request
2018-11-16 01:16:31 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:16:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521312   8 58438  4591037 A  ERROR'
2018-11-16 01:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-16 01:16:31 [DEBUG   ] spawn_process: at 2018-11-16 01:16:31 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-16 01:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-16 01:16:31 [DEBUG   ] spawn_process: at 2018-11-16 01:16:31 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-16 01:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-16 01:16:31 [DEBUG   ] spawn_process: at 2018-11-16 01:16:31 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-16 01:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-16 01:16:31 [DEBUG   ] spawn_process: at 2018-11-16 01:16:31 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-16 01:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-16 01:16:31 [DEBUG   ] spawn_process: at 2018-11-16 01:16:31 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-16 01:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-16 01:16:31 [DEBUG   ] spawn_process: at 2018-11-16 01:16:31 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-16 01:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-16 01:16:31 [DEBUG   ] spawn_process: at 2018-11-16 01:16:31 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-16 01:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-16 01:16:31 [DEBUG   ] spawn_process: at 2018-11-16 01:16:31 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-16 01:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-16 01:16:31 [DEBUG   ] spawn_process: at 2018-11-16 01:16:31 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-16 01:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-16 01:16:31 [DEBUG   ] spawn_process: at 2018-11-16 01:16:31 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-16 01:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-16 01:16:31 [DEBUG   ] spawn_process: at 2018-11-16 01:16:31 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-16 01:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-16 01:16:31 [DEBUG   ] spawn_process: at 2018-11-16 01:16:31 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-16 01:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-16 01:16:31 [DEBUG   ] spawn_process: at 2018-11-16 01:16:31 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-16 01:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-16 01:16:31 [DEBUG   ] spawn_process: at 2018-11-16 01:16:31 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-16 01:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-16 01:16:31 [DEBUG   ] spawn_process: at 2018-11-16 01:16:31 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-16 01:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-16 01:16:31 [DEBUG   ] spawn_process: at 2018-11-16 01:16:31 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-16 01:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-16 01:16:31 [DEBUG   ] spawn_process: at 2018-11-16 01:16:31 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-16 01:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-16 01:16:31 [DEBUG   ] spawn_process: at 2018-11-16 01:16:31 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-16 01:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-16 01:16:31 [DEBUG   ] spawn_process: at 2018-11-16 01:16:31 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-16 01:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-16 01:16:31 [DEBUG   ] spawn_process: at 2018-11-16 01:16:31 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-16 01:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-16 01:16:31 [DEBUG   ] spawn_process: at 2018-11-16 01:16:31 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-16 01:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-16 01:16:31 [DEBUG   ] spawn_process: at 2018-11-16 01:16:31 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-16 01:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-16 01:16:31 [DEBUG   ] spawn_process: at 2018-11-16 01:16:31 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-16 01:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-16 01:16:31 [DEBUG   ] spawn_process: at 2018-11-16 01:16:31 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-16 01:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-16 01:16:31 [DEBUG   ] spawn_process: at 2018-11-16 01:16:31 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-16 01:16:31 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-16 01:16:31 [DEBUG   ] spawn_process: at 2018-11-16 01:16:31 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-16 01:16:44 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-16 01:17:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 01:17:05 [DEBUG   ] Got command BAM from MCS: ref #521313
2018-11-16 01:17:05 [INFO    ] Finished processing BAM request
2018-11-16 01:17:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:17:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521313   8 58438  4625025 A  ERROR'
2018-11-16 01:17:05 [DEBUG   ] Got command BAM from MCS: ref #521314
2018-11-16 01:17:05 [INFO    ] Finished processing BAM request
2018-11-16 01:17:05 [DEBUG   ] bam = exited with status True, code 0x00
2018-11-16 01:17:05 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_BAM   521314   8 58438  4625029 A  ERROR'
2018-11-16 01:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1'] to hostname lwa27
2018-11-16 01:17:05 [DEBUG   ] spawn_process: at 2018-11-16 01:17:05 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp2 1']
2018-11-16 01:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2'] to hostname lwa24
2018-11-16 01:17:05 [DEBUG   ] spawn_process: at 2018-11-16 01:17:05 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp2 2']
2018-11-16 01:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3'] to hostname lwa23
2018-11-16 01:17:05 [DEBUG   ] spawn_process: at 2018-11-16 01:17:05 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp2 3']
2018-11-16 01:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4'] to hostname lwa18
2018-11-16 01:17:05 [DEBUG   ] spawn_process: at 2018-11-16 01:17:05 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp2 4']
2018-11-16 01:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5'] to hostname lwa10
2018-11-16 01:17:05 [DEBUG   ] spawn_process: at 2018-11-16 01:17:05 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp2 5']
2018-11-16 01:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6'] to hostname lwa32
2018-11-16 01:17:05 [DEBUG   ] spawn_process: at 2018-11-16 01:17:05 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp2 6']
2018-11-16 01:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7'] to hostname lwa11
2018-11-16 01:17:05 [DEBUG   ] spawn_process: at 2018-11-16 01:17:05 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp2 7']
2018-11-16 01:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8'] to hostname lwa30
2018-11-16 01:17:05 [DEBUG   ] spawn_process: at 2018-11-16 01:17:05 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp2 8']
2018-11-16 01:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9'] to hostname lwa12
2018-11-16 01:17:05 [DEBUG   ] spawn_process: at 2018-11-16 01:17:05 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp2 9']
2018-11-16 01:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10'] to hostname lwa8
2018-11-16 01:17:05 [DEBUG   ] spawn_process: at 2018-11-16 01:17:05 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp2 10']
2018-11-16 01:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11'] to hostname lwa13
2018-11-16 01:17:05 [DEBUG   ] spawn_process: at 2018-11-16 01:17:05 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp2 11']
2018-11-16 01:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12'] to hostname lwa26
2018-11-16 01:17:05 [DEBUG   ] spawn_process: at 2018-11-16 01:17:05 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp2 12']
2018-11-16 01:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13'] to hostname lwa14
2018-11-16 01:17:05 [DEBUG   ] spawn_process: at 2018-11-16 01:17:05 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp2 13']
2018-11-16 01:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14'] to hostname lwa22
2018-11-16 01:17:05 [DEBUG   ] spawn_process: at 2018-11-16 01:17:05 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp2 14']
2018-11-16 01:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15'] to hostname lwa20
2018-11-16 01:17:05 [DEBUG   ] spawn_process: at 2018-11-16 01:17:05 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp2 15']
2018-11-16 01:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16'] to hostname lwa1
2018-11-16 01:17:05 [DEBUG   ] spawn_process: at 2018-11-16 01:17:05 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp2 16']
2018-11-16 01:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17'] to hostname lwa5
2018-11-16 01:17:05 [DEBUG   ] spawn_process: at 2018-11-16 01:17:05 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp2 17']
2018-11-16 01:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18'] to hostname lwa25
2018-11-16 01:17:05 [DEBUG   ] spawn_process: at 2018-11-16 01:17:05 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp2 18']
2018-11-16 01:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19'] to hostname lwa35
2018-11-16 01:17:05 [DEBUG   ] spawn_process: at 2018-11-16 01:17:05 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp2 19']
2018-11-16 01:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20'] to hostname lwa19
2018-11-16 01:17:05 [DEBUG   ] spawn_process: at 2018-11-16 01:17:05 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp2 20']
2018-11-16 01:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21'] to hostname lwa21
2018-11-16 01:17:05 [DEBUG   ] spawn_process: at 2018-11-16 01:17:05 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp2 21']
2018-11-16 01:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22'] to hostname lwa6
2018-11-16 01:17:05 [DEBUG   ] spawn_process: at 2018-11-16 01:17:05 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp2 22']
2018-11-16 01:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23'] to hostname lwa7
2018-11-16 01:17:05 [DEBUG   ] spawn_process: at 2018-11-16 01:17:05 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp2 23']
2018-11-16 01:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24'] to hostname lwa33
2018-11-16 01:17:05 [DEBUG   ] spawn_process: at 2018-11-16 01:17:05 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp2 24']
2018-11-16 01:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25'] to hostname lwa15
2018-11-16 01:17:05 [DEBUG   ] spawn_process: at 2018-11-16 01:17:05 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp2 25']
2018-11-16 01:17:05 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26'] to hostname lwa28
2018-11-16 01:17:05 [DEBUG   ] spawn_process: at 2018-11-16 01:17:05 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp2 26']
2018-11-16 01:17:08 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa8, chip 2
2018-11-16 01:17:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa8, chip 3
2018-11-16 01:17:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:17:08 [WARNING ] MonitorFlags: Temperature 81.70 > 80 on hostname lwa21, chip 2
2018-11-16 01:17:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa15, chip 2
2018-11-16 01:17:08 [WARNING ] (13, 1, 'bot')
2018-11-16 01:17:08 [WARNING ] (13, 1, 'bot')
2018-11-16 01:17:08 [WARNING ] (13, 1, 'bot')
2018-11-16 01:17:08 [WARNING ] (13, 1, 'bot')
2018-11-16 01:17:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:17:08 [DEBUG   ] Finished updating board flags in 1.375 seconds
2018-11-16 01:17:24 [DEBUG   ] Got command STP from MCS: ref #521315
2018-11-16 01:17:24 [INFO    ] Finished processing BAM request
2018-11-16 01:17:24 [INFO    ] Shutdown the adder chain on beam #3
2018-11-16 01:17:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP   521315   8 58438  4644117 A  ERROR'
2018-11-16 01:17:24 [DEBUG   ] Got command STP from MCS: ref #521316
2018-11-16 01:17:24 [INFO    ] Finished processing BAM request
2018-11-16 01:17:24 [INFO    ] Shutdown the adder chain on beam #2
2018-11-16 01:17:24 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_STP   521316   8 58438  4644121 A  ERROR'
2018-11-16 01:17:24 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-16 01:17:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1'] to hostname lwa27
2018-11-16 01:17:24 [DEBUG   ] spawn_process: at 2018-11-16 01:17:24 running ['/usr/local/bin/lwa27', '/lwa/software/bamx /lwa/test/bamx.tmp3 1']
2018-11-16 01:17:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2'] to hostname lwa24
2018-11-16 01:17:24 [DEBUG   ] spawn_process: at 2018-11-16 01:17:24 running ['/usr/local/bin/lwa24', '/lwa/software/bamx /lwa/test/bamx.tmp3 2']
2018-11-16 01:17:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3'] to hostname lwa23
2018-11-16 01:17:24 [DEBUG   ] spawn_process: at 2018-11-16 01:17:24 running ['/usr/local/bin/lwa23', '/lwa/software/bamx /lwa/test/bamx.tmp3 3']
2018-11-16 01:17:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4'] to hostname lwa18
2018-11-16 01:17:24 [DEBUG   ] spawn_process: at 2018-11-16 01:17:24 running ['/usr/local/bin/lwa18', '/lwa/software/bamx /lwa/test/bamx.tmp3 4']
2018-11-16 01:17:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5'] to hostname lwa10
2018-11-16 01:17:24 [DEBUG   ] spawn_process: at 2018-11-16 01:17:24 running ['/usr/local/bin/lwa10', '/lwa/software/bamx /lwa/test/bamx.tmp3 5']
2018-11-16 01:17:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6'] to hostname lwa32
2018-11-16 01:17:24 [DEBUG   ] spawn_process: at 2018-11-16 01:17:24 running ['/usr/local/bin/lwa32', '/lwa/software/bamx /lwa/test/bamx.tmp3 6']
2018-11-16 01:17:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7'] to hostname lwa11
2018-11-16 01:17:24 [DEBUG   ] spawn_process: at 2018-11-16 01:17:24 running ['/usr/local/bin/lwa11', '/lwa/software/bamx /lwa/test/bamx.tmp3 7']
2018-11-16 01:17:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8'] to hostname lwa30
2018-11-16 01:17:24 [DEBUG   ] spawn_process: at 2018-11-16 01:17:24 running ['/usr/local/bin/lwa30', '/lwa/software/bamx /lwa/test/bamx.tmp3 8']
2018-11-16 01:17:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9'] to hostname lwa12
2018-11-16 01:17:24 [DEBUG   ] spawn_process: at 2018-11-16 01:17:24 running ['/usr/local/bin/lwa12', '/lwa/software/bamx /lwa/test/bamx.tmp3 9']
2018-11-16 01:17:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10'] to hostname lwa8
2018-11-16 01:17:24 [DEBUG   ] spawn_process: at 2018-11-16 01:17:24 running ['/usr/local/bin/lwa8', '/lwa/software/bamx /lwa/test/bamx.tmp3 10']
2018-11-16 01:17:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11'] to hostname lwa13
2018-11-16 01:17:24 [DEBUG   ] spawn_process: at 2018-11-16 01:17:24 running ['/usr/local/bin/lwa13', '/lwa/software/bamx /lwa/test/bamx.tmp3 11']
2018-11-16 01:17:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12'] to hostname lwa26
2018-11-16 01:17:24 [DEBUG   ] spawn_process: at 2018-11-16 01:17:24 running ['/usr/local/bin/lwa26', '/lwa/software/bamx /lwa/test/bamx.tmp3 12']
2018-11-16 01:17:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13'] to hostname lwa14
2018-11-16 01:17:24 [DEBUG   ] spawn_process: at 2018-11-16 01:17:24 running ['/usr/local/bin/lwa14', '/lwa/software/bamx /lwa/test/bamx.tmp3 13']
2018-11-16 01:17:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14'] to hostname lwa22
2018-11-16 01:17:24 [DEBUG   ] spawn_process: at 2018-11-16 01:17:24 running ['/usr/local/bin/lwa22', '/lwa/software/bamx /lwa/test/bamx.tmp3 14']
2018-11-16 01:17:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15'] to hostname lwa20
2018-11-16 01:17:24 [DEBUG   ] spawn_process: at 2018-11-16 01:17:24 running ['/usr/local/bin/lwa20', '/lwa/software/bamx /lwa/test/bamx.tmp3 15']
2018-11-16 01:17:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16'] to hostname lwa1
2018-11-16 01:17:24 [DEBUG   ] spawn_process: at 2018-11-16 01:17:24 running ['/usr/local/bin/lwa1', '/lwa/software/bamx /lwa/test/bamx.tmp3 16']
2018-11-16 01:17:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17'] to hostname lwa5
2018-11-16 01:17:24 [DEBUG   ] spawn_process: at 2018-11-16 01:17:24 running ['/usr/local/bin/lwa5', '/lwa/software/bamx /lwa/test/bamx.tmp3 17']
2018-11-16 01:17:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18'] to hostname lwa25
2018-11-16 01:17:24 [DEBUG   ] spawn_process: at 2018-11-16 01:17:24 running ['/usr/local/bin/lwa25', '/lwa/software/bamx /lwa/test/bamx.tmp3 18']
2018-11-16 01:17:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19'] to hostname lwa35
2018-11-16 01:17:24 [DEBUG   ] spawn_process: at 2018-11-16 01:17:24 running ['/usr/local/bin/lwa35', '/lwa/software/bamx /lwa/test/bamx.tmp3 19']
2018-11-16 01:17:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20'] to hostname lwa19
2018-11-16 01:17:24 [DEBUG   ] spawn_process: at 2018-11-16 01:17:24 running ['/usr/local/bin/lwa19', '/lwa/software/bamx /lwa/test/bamx.tmp3 20']
2018-11-16 01:17:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21'] to hostname lwa21
2018-11-16 01:17:24 [DEBUG   ] spawn_process: at 2018-11-16 01:17:24 running ['/usr/local/bin/lwa21', '/lwa/software/bamx /lwa/test/bamx.tmp3 21']
2018-11-16 01:17:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22'] to hostname lwa6
2018-11-16 01:17:24 [DEBUG   ] spawn_process: at 2018-11-16 01:17:24 running ['/usr/local/bin/lwa6', '/lwa/software/bamx /lwa/test/bamx.tmp3 22']
2018-11-16 01:17:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23'] to hostname lwa7
2018-11-16 01:17:24 [DEBUG   ] spawn_process: at 2018-11-16 01:17:24 running ['/usr/local/bin/lwa7', '/lwa/software/bamx /lwa/test/bamx.tmp3 23']
2018-11-16 01:17:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24'] to hostname lwa33
2018-11-16 01:17:24 [DEBUG   ] spawn_process: at 2018-11-16 01:17:24 running ['/usr/local/bin/lwa33', '/lwa/software/bamx /lwa/test/bamx.tmp3 24']
2018-11-16 01:17:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25'] to hostname lwa15
2018-11-16 01:17:24 [DEBUG   ] spawn_process: at 2018-11-16 01:17:24 running ['/usr/local/bin/lwa15', '/lwa/software/bamx /lwa/test/bamx.tmp3 25']
2018-11-16 01:17:24 [INFO    ] SendBAM: Sent ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26'] to hostname lwa28
2018-11-16 01:17:24 [DEBUG   ] spawn_process: at 2018-11-16 01:17:24 running ['/usr/local/bin/lwa28', '/lwa/software/bamx /lwa/test/bamx.tmp3 26']
2018-11-16 01:17:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 01:18:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 01:18:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:18:08 [WARNING ] (13, 1, 'bot')
2018-11-16 01:18:08 [WARNING ] (13, 1, 'bot')
2018-11-16 01:18:08 [WARNING ] (13, 1, 'bot')
2018-11-16 01:18:08 [WARNING ] (13, 1, 'bot')
2018-11-16 01:18:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:18:08 [DEBUG   ] Finished updating board flags in 1.197 seconds
2018-11-16 01:18:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 01:18:28 [DEBUG   ] Got command RPT from MCS: ref #521323
2018-11-16 01:18:28 [DEBUG   ] summary = ERROR
2018-11-16 01:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521323  13 58438  4708597 A  ERRORERROR'
2018-11-16 01:18:28 [DEBUG   ] Got command RPT from MCS: ref #521324
2018-11-16 01:18:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 01:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521324  77 58438  4708801 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 01:18:28 [DEBUG   ] Got command RPT from MCS: ref #521325
2018-11-16 01:18:28 [DEBUG   ] summary = ERROR
2018-11-16 01:18:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521325  13 58438  4708993 A  ERRORERROR'
2018-11-16 01:18:29 [DEBUG   ] Got command RPT from MCS: ref #521327
2018-11-16 01:18:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 01:18:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521327  77 58438  4709197 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 01:18:29 [DEBUG   ] Got command RPT from MCS: ref #521328
2018-11-16 01:18:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 01:18:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521328  12 58438  4709401 A  ERRORBŸff'
2018-11-16 01:18:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 01:19:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 01:19:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:19:08 [WARNING ] (13, 1, 'bot')
2018-11-16 01:19:08 [WARNING ] (13, 1, 'bot')
2018-11-16 01:19:08 [WARNING ] (13, 1, 'bot')
2018-11-16 01:19:08 [WARNING ] (13, 1, 'bot')
2018-11-16 01:19:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:19:08 [DEBUG   ] Finished updating board flags in 1.029 seconds
2018-11-16 01:19:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 01:19:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 01:20:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 01:20:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:20:08 [WARNING ] (13, 1, 'bot')
2018-11-16 01:20:08 [WARNING ] (13, 1, 'bot')
2018-11-16 01:20:08 [WARNING ] (13, 1, 'bot')
2018-11-16 01:20:08 [WARNING ] (13, 1, 'bot')
2018-11-16 01:20:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:20:08 [DEBUG   ] Finished updating board flags in 1.023 seconds
2018-11-16 01:20:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 01:20:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 01:20:45 [DEBUG   ] Got command RPT from MCS: ref #521337
2018-11-16 01:20:45 [DEBUG   ] summary = ERROR
2018-11-16 01:20:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521337  13 58438  4845261 A  ERRORERROR'
2018-11-16 01:20:45 [DEBUG   ] Got command RPT from MCS: ref #521338
2018-11-16 01:20:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 01:20:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521338  77 58438  4845262 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 01:21:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 01:21:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:21:08 [WARNING ] (13, 1, 'bot')
2018-11-16 01:21:08 [WARNING ] (13, 1, 'bot')
2018-11-16 01:21:08 [WARNING ] (13, 1, 'bot')
2018-11-16 01:21:08 [WARNING ] (13, 1, 'bot')
2018-11-16 01:21:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:21:08 [DEBUG   ] Finished updating board flags in 0.957 seconds
2018-11-16 01:21:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 01:21:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 01:22:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 01:22:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:22:09 [WARNING ] (13, 1, 'bot')
2018-11-16 01:22:09 [WARNING ] (13, 1, 'bot')
2018-11-16 01:22:09 [WARNING ] (13, 1, 'bot')
2018-11-16 01:22:09 [WARNING ] (13, 1, 'bot')
2018-11-16 01:22:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:22:09 [DEBUG   ] Finished updating board flags in 1.428 seconds
2018-11-16 01:22:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 01:22:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 01:23:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 01:23:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:23:09 [WARNING ] (13, 1, 'bot')
2018-11-16 01:23:09 [WARNING ] (13, 1, 'bot')
2018-11-16 01:23:09 [WARNING ] (13, 1, 'bot')
2018-11-16 01:23:09 [WARNING ] (13, 1, 'bot')
2018-11-16 01:23:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:23:09 [DEBUG   ] Finished updating board flags in 1.383 seconds
2018-11-16 01:23:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 01:23:28 [DEBUG   ] Got command RPT from MCS: ref #521354
2018-11-16 01:23:28 [DEBUG   ] summary = ERROR
2018-11-16 01:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521354  13 58438  5008677 A  ERRORERROR'
2018-11-16 01:23:28 [DEBUG   ] Got command RPT from MCS: ref #521355
2018-11-16 01:23:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 01:23:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521355  77 58438  5008881 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 01:23:29 [DEBUG   ] Got command RPT from MCS: ref #521356
2018-11-16 01:23:29 [DEBUG   ] summary = ERROR
2018-11-16 01:23:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521356  13 58438  5009073 A  ERRORERROR'
2018-11-16 01:23:29 [DEBUG   ] Got command RPT from MCS: ref #521357
2018-11-16 01:23:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 01:23:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521357  77 58438  5009277 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 01:23:29 [DEBUG   ] Got command RPT from MCS: ref #521358
2018-11-16 01:23:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 01:23:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521358  12 58438  5009481 A  ERRORB™™š'
2018-11-16 01:23:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 01:24:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 01:24:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:24:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-16 01:24:09 [WARNING ] (13, 1, 'bot')
2018-11-16 01:24:09 [WARNING ] (13, 1, 'bot')
2018-11-16 01:24:09 [WARNING ] (13, 1, 'bot')
2018-11-16 01:24:09 [WARNING ] (13, 1, 'bot')
2018-11-16 01:24:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:24:09 [DEBUG   ] Finished updating board flags in 1.166 seconds
2018-11-16 01:24:24 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-16 01:24:44 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 01:25:04 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 01:25:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 01:25:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:25:10 [WARNING ] (13, 1, 'bot')
2018-11-16 01:25:10 [WARNING ] (13, 1, 'bot')
2018-11-16 01:25:10 [WARNING ] (13, 1, 'bot')
2018-11-16 01:25:10 [WARNING ] (13, 1, 'bot')
2018-11-16 01:25:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:25:10 [DEBUG   ] Finished updating board flags in 2.000 seconds
2018-11-16 01:25:24 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-16 01:25:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 01:25:45 [DEBUG   ] Got command RPT from MCS: ref #521363
2018-11-16 01:25:45 [DEBUG   ] summary = ERROR
2018-11-16 01:25:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521363  13 58438  5145270 A  ERRORERROR'
2018-11-16 01:25:45 [DEBUG   ] Got command RPT from MCS: ref #521364
2018-11-16 01:25:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 01:25:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521364  77 58438  5145270 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 01:26:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 01:26:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 01:26:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:26:09 [WARNING ] (13, 1, 'bot')
2018-11-16 01:26:09 [WARNING ] (13, 1, 'bot')
2018-11-16 01:26:09 [WARNING ] (13, 1, 'bot')
2018-11-16 01:26:09 [WARNING ] (13, 1, 'bot')
2018-11-16 01:26:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:26:09 [DEBUG   ] Finished updating board flags in 0.980 seconds
2018-11-16 01:26:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 01:26:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 01:27:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 01:27:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:27:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 01:27:09 [WARNING ] (13, 1, 'bot')
2018-11-16 01:27:09 [WARNING ] (13, 1, 'bot')
2018-11-16 01:27:09 [WARNING ] (13, 1, 'bot')
2018-11-16 01:27:09 [WARNING ] (13, 1, 'bot')
2018-11-16 01:27:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:27:09 [DEBUG   ] Finished updating board flags in 1.289 seconds
2018-11-16 01:27:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 01:27:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 01:28:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 01:28:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:28:09 [WARNING ] (13, 1, 'bot')
2018-11-16 01:28:09 [WARNING ] (13, 1, 'bot')
2018-11-16 01:28:09 [WARNING ] (13, 1, 'bot')
2018-11-16 01:28:09 [WARNING ] (13, 1, 'bot')
2018-11-16 01:28:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:28:09 [DEBUG   ] Finished updating board flags in 1.178 seconds
2018-11-16 01:28:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 01:28:28 [DEBUG   ] Got command RPT from MCS: ref #521386
2018-11-16 01:28:28 [DEBUG   ] summary = ERROR
2018-11-16 01:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521386  13 58438  5308753 A  ERRORERROR'
2018-11-16 01:28:28 [DEBUG   ] Got command RPT from MCS: ref #521387
2018-11-16 01:28:28 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 01:28:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521387  77 58438  5308957 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 01:28:29 [DEBUG   ] Got command RPT from MCS: ref #521388
2018-11-16 01:28:29 [DEBUG   ] summary = ERROR
2018-11-16 01:28:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521388  13 58438  5309161 A  ERRORERROR'
2018-11-16 01:28:29 [DEBUG   ] Got command RPT from MCS: ref #521390
2018-11-16 01:28:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 01:28:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521390  77 58438  5309365 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 01:28:29 [DEBUG   ] Got command RPT from MCS: ref #521391
2018-11-16 01:28:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 01:28:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521391  12 58438  5309557 A  ERRORB—™š'
2018-11-16 01:28:45 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 01:29:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 01:29:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:29:09 [WARNING ] (13, 1, 'bot')
2018-11-16 01:29:09 [WARNING ] (13, 1, 'bot')
2018-11-16 01:29:09 [WARNING ] (13, 1, 'bot')
2018-11-16 01:29:09 [WARNING ] (13, 1, 'bot')
2018-11-16 01:29:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:29:09 [DEBUG   ] Finished updating board flags in 1.031 seconds
2018-11-16 01:29:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 01:29:45 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 01:30:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 01:30:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-16 01:30:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:30:10 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 01:30:10 [WARNING ] (13, 1, 'bot')
2018-11-16 01:30:10 [WARNING ] (13, 1, 'bot')
2018-11-16 01:30:10 [WARNING ] (13, 1, 'bot')
2018-11-16 01:30:10 [WARNING ] (13, 1, 'bot')
2018-11-16 01:30:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:30:10 [DEBUG   ] Finished updating board flags in 1.548 seconds
2018-11-16 01:30:25 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-16 01:30:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 01:30:45 [DEBUG   ] Got command RPT from MCS: ref #521400
2018-11-16 01:30:45 [DEBUG   ] summary = ERROR
2018-11-16 01:30:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521400  13 58438  5445262 A  ERRORERROR'
2018-11-16 01:30:45 [DEBUG   ] Got command RPT from MCS: ref #521401
2018-11-16 01:30:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 01:30:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521401  77 58438  5445262 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 01:31:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 01:31:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 01:31:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-16 01:31:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:31:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-16 01:31:10 [WARNING ] (13, 1, 'bot')
2018-11-16 01:31:10 [WARNING ] (13, 1, 'bot')
2018-11-16 01:31:10 [WARNING ] (13, 1, 'bot')
2018-11-16 01:31:10 [WARNING ] (13, 1, 'bot')
2018-11-16 01:31:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:31:10 [DEBUG   ] Finished updating board flags in 1.361 seconds
2018-11-16 01:31:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 01:31:45 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-16 01:32:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 01:32:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:32:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-16 01:32:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-16 01:32:10 [WARNING ] (13, 1, 'bot')
2018-11-16 01:32:10 [WARNING ] (13, 1, 'bot')
2018-11-16 01:32:10 [WARNING ] (13, 1, 'bot')
2018-11-16 01:32:10 [WARNING ] (13, 1, 'bot')
2018-11-16 01:32:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:32:10 [DEBUG   ] Finished updating board flags in 1.216 seconds
2018-11-16 01:32:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 01:32:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 01:33:05 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-16 01:33:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:33:10 [WARNING ] (13, 1, 'bot')
2018-11-16 01:33:10 [WARNING ] (13, 1, 'bot')
2018-11-16 01:33:10 [WARNING ] (13, 1, 'bot')
2018-11-16 01:33:10 [WARNING ] (13, 1, 'bot')
2018-11-16 01:33:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:33:10 [DEBUG   ] Finished updating board flags in 1.245 seconds
2018-11-16 01:33:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 01:33:28 [DEBUG   ] Got command RPT from MCS: ref #521421
2018-11-16 01:33:28 [DEBUG   ] summary = ERROR
2018-11-16 01:33:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521421  13 58438  5608837 A  ERRORERROR'
2018-11-16 01:33:29 [DEBUG   ] Got command RPT from MCS: ref #521422
2018-11-16 01:33:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 01:33:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521422  77 58438  5609041 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 01:33:29 [DEBUG   ] Got command RPT from MCS: ref #521423
2018-11-16 01:33:29 [DEBUG   ] summary = ERROR
2018-11-16 01:33:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521423  13 58438  5609245 A  ERRORERROR'
2018-11-16 01:33:29 [DEBUG   ] Got command RPT from MCS: ref #521424
2018-11-16 01:33:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 01:33:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521424  77 58438  5609437 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 01:33:29 [DEBUG   ] Got command RPT from MCS: ref #521425
2018-11-16 01:33:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 01:33:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521425  12 58438  5609641 A  ERRORB™™š'
2018-11-16 01:33:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 01:34:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 01:34:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:34:10 [WARNING ] (13, 1, 'bot')
2018-11-16 01:34:10 [WARNING ] (13, 1, 'bot')
2018-11-16 01:34:10 [WARNING ] (13, 1, 'bot')
2018-11-16 01:34:10 [WARNING ] (13, 1, 'bot')
2018-11-16 01:34:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:34:10 [DEBUG   ] Finished updating board flags in 1.148 seconds
2018-11-16 01:34:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 01:34:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 01:35:05 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 01:35:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:35:10 [WARNING ] (13, 1, 'bot')
2018-11-16 01:35:10 [WARNING ] (13, 1, 'bot')
2018-11-16 01:35:10 [WARNING ] (13, 1, 'bot')
2018-11-16 01:35:10 [WARNING ] (13, 1, 'bot')
2018-11-16 01:35:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:35:10 [DEBUG   ] Finished updating board flags in 1.023 seconds
2018-11-16 01:35:25 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-16 01:35:45 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 01:35:45 [DEBUG   ] Got command RPT from MCS: ref #521430
2018-11-16 01:35:45 [DEBUG   ] summary = ERROR
2018-11-16 01:35:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521430  13 58438  5745270 A  ERRORERROR'
2018-11-16 01:35:45 [DEBUG   ] Got command RPT from MCS: ref #521431
2018-11-16 01:35:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 01:35:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521431  77 58438  5745270 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 01:36:05 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 01:36:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:36:10 [WARNING ] (13, 1, 'bot')
2018-11-16 01:36:10 [WARNING ] (13, 1, 'bot')
2018-11-16 01:36:10 [WARNING ] (13, 1, 'bot')
2018-11-16 01:36:10 [WARNING ] (13, 1, 'bot')
2018-11-16 01:36:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:36:10 [DEBUG   ] Finished updating board flags in 0.983 seconds
2018-11-16 01:36:25 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-16 01:36:45 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 01:37:05 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 01:37:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:37:11 [WARNING ] (13, 1, 'bot')
2018-11-16 01:37:11 [WARNING ] (13, 1, 'bot')
2018-11-16 01:37:11 [WARNING ] (13, 1, 'bot')
2018-11-16 01:37:11 [WARNING ] (13, 1, 'bot')
2018-11-16 01:37:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:37:11 [DEBUG   ] Finished updating board flags in 1.821 seconds
2018-11-16 01:37:25 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 01:37:45 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 01:38:00 [DEBUG   ] Got command TBN from MCS: ref #521447
2018-11-16 01:38:00 [DEBUG   ] spawn_process: at 2018-11-16 01:38:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1542332282']
2018-11-16 01:38:00 [DEBUG   ] spawn_process: at 2018-11-16 01:38:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1542332282']
2018-11-16 01:38:00 [DEBUG   ] tbn = exited with status True, code 0x00
2018-11-16 01:38:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN   521447   8 58438  5880837 A  ERROR'
2018-11-16 01:38:00 [DEBUG   ] spawn_process: at 2018-11-16 01:38:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1542332282']
2018-11-16 01:38:00 [DEBUG   ] spawn_process: at 2018-11-16 01:38:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1542332282']
2018-11-16 01:38:00 [DEBUG   ] spawn_process: at 2018-11-16 01:38:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1542332282']
2018-11-16 01:38:00 [DEBUG   ] spawn_process: at 2018-11-16 01:38:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1542332282']
2018-11-16 01:38:00 [DEBUG   ] spawn_process: at 2018-11-16 01:38:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1542332282']
2018-11-16 01:38:00 [DEBUG   ] spawn_process: at 2018-11-16 01:38:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1542332282']
2018-11-16 01:38:00 [DEBUG   ] spawn_process: at 2018-11-16 01:38:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1542332282']
2018-11-16 01:38:00 [DEBUG   ] spawn_process: at 2018-11-16 01:38:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1542332282']
2018-11-16 01:38:00 [DEBUG   ] spawn_process: at 2018-11-16 01:38:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1542332282']
2018-11-16 01:38:00 [DEBUG   ] spawn_process: at 2018-11-16 01:38:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1542332282']
2018-11-16 01:38:00 [DEBUG   ] spawn_process: at 2018-11-16 01:38:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1542332282']
2018-11-16 01:38:00 [DEBUG   ] spawn_process: at 2018-11-16 01:38:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1542332282']
2018-11-16 01:38:00 [DEBUG   ] spawn_process: at 2018-11-16 01:38:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1542332282']
2018-11-16 01:38:00 [DEBUG   ] spawn_process: at 2018-11-16 01:38:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1542332282']
2018-11-16 01:38:00 [DEBUG   ] spawn_process: at 2018-11-16 01:38:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1542332282']
2018-11-16 01:38:00 [DEBUG   ] spawn_process: at 2018-11-16 01:38:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1542332282']
2018-11-16 01:38:00 [DEBUG   ] spawn_process: at 2018-11-16 01:38:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1542332282']
2018-11-16 01:38:00 [DEBUG   ] spawn_process: at 2018-11-16 01:38:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1542332282']
2018-11-16 01:38:00 [DEBUG   ] spawn_process: at 2018-11-16 01:38:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1542332282']
2018-11-16 01:38:00 [DEBUG   ] spawn_process: at 2018-11-16 01:38:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1542332282']
2018-11-16 01:38:00 [DEBUG   ] spawn_process: at 2018-11-16 01:38:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1542332282']
2018-11-16 01:38:00 [DEBUG   ] spawn_process: at 2018-11-16 01:38:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1542332282']
2018-11-16 01:38:00 [DEBUG   ] spawn_process: at 2018-11-16 01:38:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1542332282']
2018-11-16 01:38:00 [DEBUG   ] spawn_process: at 2018-11-16 01:38:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1542332282']
2018-11-16 01:38:00 [INFO    ] Finished spawning TBN in 0.048 s
2018-11-16 01:38:05 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-16 01:38:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:38:11 [WARNING ] (13, 1, 'bot')
2018-11-16 01:38:11 [WARNING ] (13, 1, 'bot')
2018-11-16 01:38:11 [WARNING ] (13, 1, 'bot')
2018-11-16 01:38:11 [WARNING ] (13, 1, 'bot')
2018-11-16 01:38:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:38:11 [DEBUG   ] Finished updating board flags in 2.079 seconds
2018-11-16 01:38:25 [DEBUG   ] Finished updating ant stats in 0.468 seconds
2018-11-16 01:38:28 [DEBUG   ] Got command RPT from MCS: ref #521450
2018-11-16 01:38:28 [DEBUG   ] summary = ERROR
2018-11-16 01:38:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521450  13 58438  5908925 A  ERRORERROR'
2018-11-16 01:38:29 [DEBUG   ] Got command RPT from MCS: ref #521451
2018-11-16 01:38:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 01:38:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521451  77 58438  5909117 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 01:38:29 [DEBUG   ] Got command RPT from MCS: ref #521452
2018-11-16 01:38:29 [DEBUG   ] summary = ERROR
2018-11-16 01:38:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521452  13 58438  5909321 A  ERRORERROR'
2018-11-16 01:38:29 [DEBUG   ] Got command RPT from MCS: ref #521454
2018-11-16 01:38:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 01:38:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521454  77 58438  5909525 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 01:38:29 [DEBUG   ] Got command RPT from MCS: ref #521455
2018-11-16 01:38:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 01:38:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521455  12 58438  5909717 A  ERRORB˜™š'
2018-11-16 01:38:46 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-11-16 01:39:06 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-16 01:39:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:39:11 [WARNING ] (13, 1, 'bot')
2018-11-16 01:39:11 [WARNING ] (13, 1, 'bot')
2018-11-16 01:39:11 [WARNING ] (13, 1, 'bot')
2018-11-16 01:39:11 [WARNING ] (13, 1, 'bot')
2018-11-16 01:39:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:39:11 [DEBUG   ] Finished updating board flags in 1.926 seconds
2018-11-16 01:39:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 01:39:46 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 01:40:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 01:40:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:40:11 [WARNING ] (13, 1, 'bot')
2018-11-16 01:40:11 [WARNING ] (13, 1, 'bot')
2018-11-16 01:40:11 [WARNING ] (13, 1, 'bot')
2018-11-16 01:40:11 [WARNING ] (13, 1, 'bot')
2018-11-16 01:40:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:40:11 [DEBUG   ] Finished updating board flags in 1.827 seconds
2018-11-16 01:40:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 01:40:45 [DEBUG   ] Got command RPT from MCS: ref #521464
2018-11-16 01:40:45 [DEBUG   ] summary = ERROR
2018-11-16 01:40:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521464  13 58438  6045273 A  ERRORERROR'
2018-11-16 01:40:45 [DEBUG   ] Got command RPT from MCS: ref #521465
2018-11-16 01:40:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 01:40:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521465  77 58438  6045274 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 01:40:46 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-16 01:41:06 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 01:41:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:41:11 [WARNING ] (13, 1, 'bot')
2018-11-16 01:41:11 [WARNING ] (13, 1, 'bot')
2018-11-16 01:41:11 [WARNING ] (13, 1, 'bot')
2018-11-16 01:41:11 [WARNING ] (13, 1, 'bot')
2018-11-16 01:41:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:41:11 [DEBUG   ] Finished updating board flags in 1.789 seconds
2018-11-16 01:41:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 01:41:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 01:42:06 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 01:42:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:42:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 01:42:11 [WARNING ] (13, 1, 'bot')
2018-11-16 01:42:11 [WARNING ] (13, 1, 'bot')
2018-11-16 01:42:11 [WARNING ] (13, 1, 'bot')
2018-11-16 01:42:11 [WARNING ] (13, 1, 'bot')
2018-11-16 01:42:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:42:11 [DEBUG   ] Finished updating board flags in 1.659 seconds
2018-11-16 01:42:11 [DEBUG   ] Got command TBW from MCS: ref #521486
2018-11-16 01:42:11 [DEBUG   ] tbw = exited with status True, code 0x00
2018-11-16 01:42:11 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBW   521486   8 58438  6131902 A  ERROR'
2018-11-16 01:42:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa16 command /usr/local/bin/lwa16 pkill tbn
2018-11-16 01:42:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa27 command /usr/local/bin/lwa27 pkill tbn
2018-11-16 01:42:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa24 command /usr/local/bin/lwa24 pkill tbn
2018-11-16 01:42:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa23 command /usr/local/bin/lwa23 pkill tbn
2018-11-16 01:42:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa18 command /usr/local/bin/lwa18 pkill tbn
2018-11-16 01:42:13 [DEBUG   ] sendHostnameCommand - Sent hostname lwa10 command /usr/local/bin/lwa10 pkill tbn
2018-11-16 01:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa32 command /usr/local/bin/lwa32 pkill tbn
2018-11-16 01:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa11 command /usr/local/bin/lwa11 pkill tbn
2018-11-16 01:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa30 command /usr/local/bin/lwa30 pkill tbn
2018-11-16 01:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa12 command /usr/local/bin/lwa12 pkill tbn
2018-11-16 01:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa8 command /usr/local/bin/lwa8 pkill tbn
2018-11-16 01:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa13 command /usr/local/bin/lwa13 pkill tbn
2018-11-16 01:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa26 command /usr/local/bin/lwa26 pkill tbn
2018-11-16 01:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa14 command /usr/local/bin/lwa14 pkill tbn
2018-11-16 01:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa34 command /usr/local/bin/lwa34 pkill tbn
2018-11-16 01:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa22 command /usr/local/bin/lwa22 pkill tbn
2018-11-16 01:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa20 command /usr/local/bin/lwa20 pkill tbn
2018-11-16 01:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa1 command /usr/local/bin/lwa1 pkill tbn
2018-11-16 01:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa5 command /usr/local/bin/lwa5 pkill tbn
2018-11-16 01:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa25 command /usr/local/bin/lwa25 pkill tbn
2018-11-16 01:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa35 command /usr/local/bin/lwa35 pkill tbn
2018-11-16 01:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa19 command /usr/local/bin/lwa19 pkill tbn
2018-11-16 01:42:14 [DEBUG   ] sendHostnameCommand - Sent hostname lwa21 command /usr/local/bin/lwa21 pkill tbn
2018-11-16 01:42:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa6 command /usr/local/bin/lwa6 pkill tbn
2018-11-16 01:42:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa7 command /usr/local/bin/lwa7 pkill tbn
2018-11-16 01:42:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa33 command /usr/local/bin/lwa33 pkill tbn
2018-11-16 01:42:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa15 command /usr/local/bin/lwa15 pkill tbn
2018-11-16 01:42:15 [DEBUG   ] sendHostnameCommand - Sent hostname lwa28 command /usr/local/bin/lwa28 pkill tbn
2018-11-16 01:42:15 [DEBUG   ] spawn_process: at 2018-11-16 01:42:15 running ['/usr/local/bin/lwa27', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '1', '12000000']
2018-11-16 01:42:15 [DEBUG   ] spawn_process: at 2018-11-16 01:42:15 running ['/usr/local/bin/lwa24', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '2', '12000000']
2018-11-16 01:42:15 [DEBUG   ] spawn_process: at 2018-11-16 01:42:15 running ['/usr/local/bin/lwa23', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '3', '12000000']
2018-11-16 01:42:15 [DEBUG   ] spawn_process: at 2018-11-16 01:42:15 running ['/usr/local/bin/lwa18', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '4', '12000000']
2018-11-16 01:42:15 [DEBUG   ] spawn_process: at 2018-11-16 01:42:15 running ['/usr/local/bin/lwa10', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '5', '12000000']
2018-11-16 01:42:15 [DEBUG   ] spawn_process: at 2018-11-16 01:42:15 running ['/usr/local/bin/lwa32', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '6', '12000000']
2018-11-16 01:42:15 [DEBUG   ] spawn_process: at 2018-11-16 01:42:15 running ['/usr/local/bin/lwa11', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '7', '12000000']
2018-11-16 01:42:15 [DEBUG   ] spawn_process: at 2018-11-16 01:42:15 running ['/usr/local/bin/lwa30', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '8', '12000000']
2018-11-16 01:42:15 [DEBUG   ] spawn_process: at 2018-11-16 01:42:15 running ['/usr/local/bin/lwa12', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '9', '12000000']
2018-11-16 01:42:15 [DEBUG   ] spawn_process: at 2018-11-16 01:42:15 running ['/usr/local/bin/lwa8', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '10', '12000000']
2018-11-16 01:42:15 [DEBUG   ] spawn_process: at 2018-11-16 01:42:15 running ['/usr/local/bin/lwa13', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '11', '12000000']
2018-11-16 01:42:15 [DEBUG   ] spawn_process: at 2018-11-16 01:42:15 running ['/usr/local/bin/lwa26', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '12', '12000000']
2018-11-16 01:42:15 [DEBUG   ] spawn_process: at 2018-11-16 01:42:15 running ['/usr/local/bin/lwa14', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '13', '12000000']
2018-11-16 01:42:15 [DEBUG   ] spawn_process: at 2018-11-16 01:42:15 running ['/usr/local/bin/lwa22', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '14', '12000000']
2018-11-16 01:42:15 [DEBUG   ] spawn_process: at 2018-11-16 01:42:15 running ['/usr/local/bin/lwa20', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '15', '12000000']
2018-11-16 01:42:15 [DEBUG   ] spawn_process: at 2018-11-16 01:42:15 running ['/usr/local/bin/lwa1', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '16', '12000000']
2018-11-16 01:42:15 [DEBUG   ] spawn_process: at 2018-11-16 01:42:15 running ['/usr/local/bin/lwa5', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '17', '12000000']
2018-11-16 01:42:15 [DEBUG   ] spawn_process: at 2018-11-16 01:42:15 running ['/usr/local/bin/lwa25', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '18', '12000000']
2018-11-16 01:42:15 [DEBUG   ] spawn_process: at 2018-11-16 01:42:15 running ['/usr/local/bin/lwa35', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '19', '12000000']
2018-11-16 01:42:15 [DEBUG   ] spawn_process: at 2018-11-16 01:42:15 running ['/usr/local/bin/lwa19', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '20', '12000000']
2018-11-16 01:42:15 [DEBUG   ] spawn_process: at 2018-11-16 01:42:15 running ['/usr/local/bin/lwa21', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '21', '12000000']
2018-11-16 01:42:15 [DEBUG   ] spawn_process: at 2018-11-16 01:42:15 running ['/usr/local/bin/lwa6', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '22', '12000000']
2018-11-16 01:42:15 [DEBUG   ] spawn_process: at 2018-11-16 01:42:15 running ['/usr/local/bin/lwa7', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '23', '12000000']
2018-11-16 01:42:15 [DEBUG   ] spawn_process: at 2018-11-16 01:42:15 running ['/usr/local/bin/lwa33', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '24', '12000000']
2018-11-16 01:42:15 [DEBUG   ] spawn_process: at 2018-11-16 01:42:15 running ['/usr/local/bin/lwa15', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '25', '12000000']
2018-11-16 01:42:15 [DEBUG   ] spawn_process: at 2018-11-16 01:42:15 running ['/usr/local/bin/lwa28', '/lwa/software/tbw', '192.168.0.37', '10000', '12', '0', '26', '12000000']
2018-11-16 01:42:15 [INFO    ] Finished spawning TBW
2018-11-16 01:43:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:43:11 [WARNING ] (13, 1, 'bot')
2018-11-16 01:43:11 [WARNING ] (13, 1, 'bot')
2018-11-16 01:43:11 [WARNING ] (13, 1, 'bot')
2018-11-16 01:43:11 [WARNING ] (13, 1, 'bot')
2018-11-16 01:43:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:43:11 [DEBUG   ] Finished updating board flags in 1.439 seconds
2018-11-16 01:43:28 [DEBUG   ] Got command RPT from MCS: ref #521490
2018-11-16 01:43:28 [DEBUG   ] summary = ERROR
2018-11-16 01:43:28 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521490  13 58438  6208997 A  ERRORERROR'
2018-11-16 01:43:29 [DEBUG   ] Got command RPT from MCS: ref #521491
2018-11-16 01:43:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 01:43:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521491  77 58438  6209201 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 01:43:29 [DEBUG   ] Got command RPT from MCS: ref #521492
2018-11-16 01:43:29 [DEBUG   ] summary = ERROR
2018-11-16 01:43:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521492  13 58438  6209405 A  ERRORERROR'
2018-11-16 01:43:29 [DEBUG   ] Got command RPT from MCS: ref #521493
2018-11-16 01:43:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 01:43:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521493  77 58438  6209609 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 01:43:29 [DEBUG   ] Got command RPT from MCS: ref #521494
2018-11-16 01:43:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 01:43:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521494  12 58438  6209801 A  ERRORB˜™š'
2018-11-16 01:44:03 [INFO    ] __waitForTBW - TBW finished in 108.285 s
2018-11-16 01:44:04 [DEBUG   ] Finished updating ant stats in 0.580 seconds
2018-11-16 01:44:04 [INFO    ] Started antennas statistics background thread
2018-11-16 01:44:04 [INFO    ] Resuming TBN at 38.100 MHz after TBW acquisition
2018-11-16 01:44:04 [DEBUG   ] spawn_process: at 2018-11-16 01:44:04 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1542332646']
2018-11-16 01:44:04 [DEBUG   ] spawn_process: at 2018-11-16 01:44:04 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1542332646']
2018-11-16 01:44:04 [DEBUG   ] spawn_process: at 2018-11-16 01:44:04 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1542332646']
2018-11-16 01:44:04 [DEBUG   ] spawn_process: at 2018-11-16 01:44:04 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1542332646']
2018-11-16 01:44:04 [DEBUG   ] spawn_process: at 2018-11-16 01:44:04 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1542332646']
2018-11-16 01:44:04 [DEBUG   ] spawn_process: at 2018-11-16 01:44:04 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1542332646']
2018-11-16 01:44:04 [DEBUG   ] spawn_process: at 2018-11-16 01:44:04 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1542332646']
2018-11-16 01:44:04 [DEBUG   ] spawn_process: at 2018-11-16 01:44:04 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1542332646']
2018-11-16 01:44:04 [DEBUG   ] spawn_process: at 2018-11-16 01:44:04 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1542332646']
2018-11-16 01:44:04 [DEBUG   ] spawn_process: at 2018-11-16 01:44:04 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1542332646']
2018-11-16 01:44:04 [DEBUG   ] spawn_process: at 2018-11-16 01:44:04 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1542332646']
2018-11-16 01:44:04 [DEBUG   ] spawn_process: at 2018-11-16 01:44:04 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1542332646']
2018-11-16 01:44:04 [DEBUG   ] spawn_process: at 2018-11-16 01:44:04 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1542332646']
2018-11-16 01:44:04 [DEBUG   ] spawn_process: at 2018-11-16 01:44:04 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1542332646']
2018-11-16 01:44:04 [DEBUG   ] spawn_process: at 2018-11-16 01:44:04 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1542332646']
2018-11-16 01:44:04 [DEBUG   ] spawn_process: at 2018-11-16 01:44:04 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1542332646']
2018-11-16 01:44:04 [DEBUG   ] spawn_process: at 2018-11-16 01:44:04 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1542332646']
2018-11-16 01:44:04 [DEBUG   ] spawn_process: at 2018-11-16 01:44:04 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1542332646']
2018-11-16 01:44:04 [DEBUG   ] spawn_process: at 2018-11-16 01:44:04 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1542332646']
2018-11-16 01:44:04 [DEBUG   ] spawn_process: at 2018-11-16 01:44:04 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1542332646']
2018-11-16 01:44:04 [DEBUG   ] spawn_process: at 2018-11-16 01:44:04 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1542332646']
2018-11-16 01:44:04 [DEBUG   ] spawn_process: at 2018-11-16 01:44:04 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1542332646']
2018-11-16 01:44:04 [DEBUG   ] spawn_process: at 2018-11-16 01:44:04 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1542332646']
2018-11-16 01:44:04 [DEBUG   ] spawn_process: at 2018-11-16 01:44:04 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1542332646']
2018-11-16 01:44:04 [DEBUG   ] spawn_process: at 2018-11-16 01:44:04 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1542332646']
2018-11-16 01:44:04 [DEBUG   ] spawn_process: at 2018-11-16 01:44:04 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1542332646']
2018-11-16 01:44:04 [INFO    ] Finished spawning TBN in 0.047 s
2018-11-16 01:44:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:44:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 01:44:11 [WARNING ] (13, 1, 'bot')
2018-11-16 01:44:11 [WARNING ] (13, 1, 'bot')
2018-11-16 01:44:11 [WARNING ] (13, 1, 'bot')
2018-11-16 01:44:11 [WARNING ] (13, 1, 'bot')
2018-11-16 01:44:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:44:11 [DEBUG   ] Finished updating board flags in 1.592 seconds
2018-11-16 01:44:24 [DEBUG   ] Finished updating ant stats in 0.469 seconds
2018-11-16 01:44:45 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-16 01:45:05 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-16 01:45:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:45:11 [WARNING ] (13, 1, 'bot')
2018-11-16 01:45:11 [WARNING ] (13, 1, 'bot')
2018-11-16 01:45:11 [WARNING ] (13, 1, 'bot')
2018-11-16 01:45:11 [WARNING ] (13, 1, 'bot')
2018-11-16 01:45:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:45:11 [DEBUG   ] Finished updating board flags in 1.521 seconds
2018-11-16 01:45:25 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-11-16 01:45:45 [DEBUG   ] Got command RPT from MCS: ref #521503
2018-11-16 01:45:45 [DEBUG   ] summary = ERROR
2018-11-16 01:45:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521503  13 58438  6345273 A  ERRORERROR'
2018-11-16 01:45:45 [DEBUG   ] Got command RPT from MCS: ref #521504
2018-11-16 01:45:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 01:45:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521504  77 58438  6345274 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 01:45:45 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-16 01:46:05 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 01:46:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:46:12 [WARNING ] (13, 1, 'bot')
2018-11-16 01:46:12 [WARNING ] (13, 1, 'bot')
2018-11-16 01:46:12 [WARNING ] (13, 1, 'bot')
2018-11-16 01:46:12 [WARNING ] (13, 1, 'bot')
2018-11-16 01:46:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:46:12 [DEBUG   ] Finished updating board flags in 2.282 seconds
2018-11-16 01:46:25 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 01:46:45 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 01:47:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 01:47:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:47:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2018-11-16 01:47:12 [WARNING ] (13, 1, 'bot')
2018-11-16 01:47:12 [WARNING ] (13, 1, 'bot')
2018-11-16 01:47:12 [WARNING ] (13, 1, 'bot')
2018-11-16 01:47:12 [WARNING ] (13, 1, 'bot')
2018-11-16 01:47:12 [WARNING ] (25, 5, 'bot')
2018-11-16 01:47:12 [WARNING ] (25, 5, 'bot')
2018-11-16 01:47:12 [WARNING ] (25, 5, 'bot')
2018-11-16 01:47:12 [WARNING ] (25, 5, 'bot')
2018-11-16 01:47:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:47:12 [DEBUG   ] Finished updating board flags in 2.254 seconds
2018-11-16 01:47:25 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-16 01:47:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 01:48:05 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 01:48:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:48:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-16 01:48:12 [WARNING ] (13, 1, 'bot')
2018-11-16 01:48:12 [WARNING ] (13, 1, 'bot')
2018-11-16 01:48:12 [WARNING ] (13, 1, 'bot')
2018-11-16 01:48:12 [WARNING ] (13, 1, 'bot')
2018-11-16 01:48:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:48:12 [DEBUG   ] Finished updating board flags in 2.066 seconds
2018-11-16 01:48:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 01:48:29 [DEBUG   ] Got command RPT from MCS: ref #521526
2018-11-16 01:48:29 [DEBUG   ] summary = ERROR
2018-11-16 01:48:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521526  13 58438  6509085 A  ERRORERROR'
2018-11-16 01:48:29 [DEBUG   ] Got command RPT from MCS: ref #521527
2018-11-16 01:48:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 01:48:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521527  77 58438  6509277 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 01:48:29 [DEBUG   ] Got command RPT from MCS: ref #521528
2018-11-16 01:48:29 [DEBUG   ] summary = ERROR
2018-11-16 01:48:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521528  13 58438  6509481 A  ERRORERROR'
2018-11-16 01:48:29 [DEBUG   ] Got command RPT from MCS: ref #521530
2018-11-16 01:48:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 01:48:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521530  77 58438  6509685 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 01:48:29 [DEBUG   ] Got command RPT from MCS: ref #521531
2018-11-16 01:48:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 01:48:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521531  12 58438  6509889 A  ERRORB™™š'
2018-11-16 01:48:45 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 01:49:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 01:49:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:49:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa7, chip 3
2018-11-16 01:49:12 [WARNING ] (13, 1, 'bot')
2018-11-16 01:49:12 [WARNING ] (13, 1, 'bot')
2018-11-16 01:49:12 [WARNING ] (13, 1, 'bot')
2018-11-16 01:49:12 [WARNING ] (13, 1, 'bot')
2018-11-16 01:49:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:49:12 [DEBUG   ] Finished updating board flags in 2.009 seconds
2018-11-16 01:49:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 01:49:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 01:50:05 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 01:50:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:50:12 [WARNING ] (13, 1, 'bot')
2018-11-16 01:50:12 [WARNING ] (13, 1, 'bot')
2018-11-16 01:50:12 [WARNING ] (13, 1, 'bot')
2018-11-16 01:50:12 [WARNING ] (13, 1, 'bot')
2018-11-16 01:50:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:50:12 [DEBUG   ] Finished updating board flags in 1.986 seconds
2018-11-16 01:50:25 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-16 01:50:45 [DEBUG   ] Got command RPT from MCS: ref #521540
2018-11-16 01:50:45 [DEBUG   ] summary = ERROR
2018-11-16 01:50:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521540  13 58438  6645273 A  ERRORERROR'
2018-11-16 01:50:45 [DEBUG   ] Got command RPT from MCS: ref #521541
2018-11-16 01:50:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 01:50:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521541  77 58438  6645274 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 01:50:45 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-16 01:51:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 01:51:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 01:51:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:51:12 [WARNING ] (13, 1, 'bot')
2018-11-16 01:51:12 [WARNING ] (13, 1, 'bot')
2018-11-16 01:51:12 [WARNING ] (13, 1, 'bot')
2018-11-16 01:51:12 [WARNING ] (13, 1, 'bot')
2018-11-16 01:51:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:51:12 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-11-16 01:51:25 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 01:51:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 01:52:05 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-16 01:52:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:52:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 01:52:12 [WARNING ] (13, 1, 'bot')
2018-11-16 01:52:12 [WARNING ] (13, 1, 'bot')
2018-11-16 01:52:12 [WARNING ] (13, 1, 'bot')
2018-11-16 01:52:12 [WARNING ] (13, 1, 'bot')
2018-11-16 01:52:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:52:12 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-11-16 01:52:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 01:52:45 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 01:53:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 01:53:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 01:53:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:53:12 [WARNING ] (13, 1, 'bot')
2018-11-16 01:53:12 [WARNING ] (13, 1, 'bot')
2018-11-16 01:53:12 [WARNING ] (13, 1, 'bot')
2018-11-16 01:53:12 [WARNING ] (13, 1, 'bot')
2018-11-16 01:53:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:53:12 [DEBUG   ] Finished updating board flags in 1.864 seconds
2018-11-16 01:53:25 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-11-16 01:53:29 [DEBUG   ] Got command RPT from MCS: ref #521557
2018-11-16 01:53:29 [DEBUG   ] summary = ERROR
2018-11-16 01:53:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521557  13 58438  6809169 A  ERRORERROR'
2018-11-16 01:53:29 [DEBUG   ] Got command RPT from MCS: ref #521558
2018-11-16 01:53:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 01:53:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521558  77 58438  6809361 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 01:53:29 [DEBUG   ] Got command RPT from MCS: ref #521559
2018-11-16 01:53:29 [DEBUG   ] summary = ERROR
2018-11-16 01:53:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521559  13 58438  6809565 A  ERRORERROR'
2018-11-16 01:53:29 [DEBUG   ] Got command RPT from MCS: ref #521560
2018-11-16 01:53:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 01:53:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521560  77 58438  6809769 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 01:53:29 [DEBUG   ] Got command RPT from MCS: ref #521561
2018-11-16 01:53:29 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 01:53:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521561  12 58438  6809961 A  ERRORB™™š'
2018-11-16 01:53:45 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 01:54:06 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-11-16 01:54:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:54:12 [WARNING ] (13, 1, 'bot')
2018-11-16 01:54:12 [WARNING ] (13, 1, 'bot')
2018-11-16 01:54:12 [WARNING ] (13, 1, 'bot')
2018-11-16 01:54:12 [WARNING ] (13, 1, 'bot')
2018-11-16 01:54:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:54:12 [DEBUG   ] Finished updating board flags in 1.714 seconds
2018-11-16 01:54:26 [DEBUG   ] Finished updating ant stats in 1.210 seconds
2018-11-16 01:54:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 01:55:06 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-16 01:55:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 01:55:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:55:12 [WARNING ] (13, 1, 'bot')
2018-11-16 01:55:12 [WARNING ] (13, 1, 'bot')
2018-11-16 01:55:12 [WARNING ] (13, 1, 'bot')
2018-11-16 01:55:12 [WARNING ] (13, 1, 'bot')
2018-11-16 01:55:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:55:12 [DEBUG   ] Finished updating board flags in 1.603 seconds
2018-11-16 01:55:26 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-11-16 01:55:45 [DEBUG   ] Got command RPT from MCS: ref #521566
2018-11-16 01:55:45 [DEBUG   ] summary = ERROR
2018-11-16 01:55:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521566  13 58438  6945273 A  ERRORERROR'
2018-11-16 01:55:45 [DEBUG   ] Got command RPT from MCS: ref #521567
2018-11-16 01:55:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 01:55:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521567  77 58438  6945274 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 01:55:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 01:56:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 01:56:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:56:12 [WARNING ] (13, 1, 'bot')
2018-11-16 01:56:12 [WARNING ] (13, 1, 'bot')
2018-11-16 01:56:12 [WARNING ] (13, 1, 'bot')
2018-11-16 01:56:12 [WARNING ] (13, 1, 'bot')
2018-11-16 01:56:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:56:12 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-11-16 01:56:26 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-16 01:56:46 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 01:57:06 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 01:57:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:57:12 [WARNING ] (13, 1, 'bot')
2018-11-16 01:57:12 [WARNING ] (13, 1, 'bot')
2018-11-16 01:57:12 [WARNING ] (13, 1, 'bot')
2018-11-16 01:57:12 [WARNING ] (13, 1, 'bot')
2018-11-16 01:57:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:57:12 [DEBUG   ] Finished updating board flags in 1.591 seconds
2018-11-16 01:57:26 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-16 01:57:46 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 01:58:06 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-11-16 01:58:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:58:12 [WARNING ] (13, 1, 'bot')
2018-11-16 01:58:12 [WARNING ] (13, 1, 'bot')
2018-11-16 01:58:12 [WARNING ] (13, 1, 'bot')
2018-11-16 01:58:12 [WARNING ] (13, 1, 'bot')
2018-11-16 01:58:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:58:12 [DEBUG   ] Finished updating board flags in 1.417 seconds
2018-11-16 01:58:27 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-11-16 01:58:29 [DEBUG   ] Got command RPT from MCS: ref #521595
2018-11-16 01:58:29 [DEBUG   ] summary = ERROR
2018-11-16 01:58:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521595  13 58438  7109241 A  ERRORERROR'
2018-11-16 01:58:29 [DEBUG   ] Got command RPT from MCS: ref #521596
2018-11-16 01:58:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 01:58:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521596  77 58438  7109445 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 01:58:29 [DEBUG   ] Got command RPT from MCS: ref #521597
2018-11-16 01:58:29 [DEBUG   ] summary = ERROR
2018-11-16 01:58:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521597  13 58438  7109649 A  ERRORERROR'
2018-11-16 01:58:29 [DEBUG   ] Got command RPT from MCS: ref #521599
2018-11-16 01:58:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 01:58:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521599  77 58438  7109841 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 01:58:30 [DEBUG   ] Got command RPT from MCS: ref #521600
2018-11-16 01:58:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 01:58:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521600  12 58438  7110045 A  ERRORB˜™š'
2018-11-16 01:58:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 01:59:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 01:59:11 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 01:59:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 01:59:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 01:59:12 [WARNING ] (13, 1, 'bot')
2018-11-16 01:59:12 [WARNING ] (13, 1, 'bot')
2018-11-16 01:59:12 [WARNING ] (13, 1, 'bot')
2018-11-16 01:59:12 [WARNING ] (13, 1, 'bot')
2018-11-16 01:59:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 01:59:12 [DEBUG   ] Finished updating board flags in 1.383 seconds
2018-11-16 01:59:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 01:59:47 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-16 02:00:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 02:00:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:00:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 02:00:12 [WARNING ] (13, 1, 'bot')
2018-11-16 02:00:12 [WARNING ] (13, 1, 'bot')
2018-11-16 02:00:12 [WARNING ] (13, 1, 'bot')
2018-11-16 02:00:12 [WARNING ] (13, 1, 'bot')
2018-11-16 02:00:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:00:12 [DEBUG   ] Finished updating board flags in 1.408 seconds
2018-11-16 02:00:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 02:00:45 [DEBUG   ] Got command RPT from MCS: ref #521614
2018-11-16 02:00:45 [DEBUG   ] summary = ERROR
2018-11-16 02:00:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521614  13 58438  7245269 A  ERRORERROR'
2018-11-16 02:00:45 [DEBUG   ] Got command RPT from MCS: ref #521615
2018-11-16 02:00:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 02:00:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521615  77 58438  7245270 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 02:00:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 02:01:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 02:01:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:01:12 [WARNING ] (13, 1, 'bot')
2018-11-16 02:01:12 [WARNING ] (13, 1, 'bot')
2018-11-16 02:01:12 [WARNING ] (13, 1, 'bot')
2018-11-16 02:01:12 [WARNING ] (13, 1, 'bot')
2018-11-16 02:01:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:01:12 [DEBUG   ] Finished updating board flags in 1.385 seconds
2018-11-16 02:01:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 02:01:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 02:02:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 02:02:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:02:13 [WARNING ] (13, 1, 'bot')
2018-11-16 02:02:13 [WARNING ] (13, 1, 'bot')
2018-11-16 02:02:13 [WARNING ] (13, 1, 'bot')
2018-11-16 02:02:13 [WARNING ] (13, 1, 'bot')
2018-11-16 02:02:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:02:13 [DEBUG   ] Finished updating board flags in 2.053 seconds
2018-11-16 02:02:27 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 02:02:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 02:03:07 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 02:03:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:03:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 02:03:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2018-11-16 02:03:13 [WARNING ] (13, 1, 'bot')
2018-11-16 02:03:13 [WARNING ] (13, 1, 'bot')
2018-11-16 02:03:13 [WARNING ] (13, 1, 'bot')
2018-11-16 02:03:13 [WARNING ] (13, 1, 'bot')
2018-11-16 02:03:13 [WARNING ] (25, 5, 'bot')
2018-11-16 02:03:13 [WARNING ] (25, 5, 'bot')
2018-11-16 02:03:13 [WARNING ] (25, 5, 'bot')
2018-11-16 02:03:13 [WARNING ] (25, 5, 'bot')
2018-11-16 02:03:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:03:13 [DEBUG   ] Finished updating board flags in 2.053 seconds
2018-11-16 02:03:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 02:03:29 [DEBUG   ] Got command RPT from MCS: ref #521635
2018-11-16 02:03:29 [DEBUG   ] summary = ERROR
2018-11-16 02:03:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521635  13 58438  7409321 A  ERRORERROR'
2018-11-16 02:03:29 [DEBUG   ] Got command RPT from MCS: ref #521636
2018-11-16 02:03:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 02:03:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521636  77 58438  7409525 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 02:03:29 [DEBUG   ] Got command RPT from MCS: ref #521637
2018-11-16 02:03:29 [DEBUG   ] summary = ERROR
2018-11-16 02:03:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521637  13 58438  7409729 A  ERRORERROR'
2018-11-16 02:03:29 [DEBUG   ] Got command RPT from MCS: ref #521638
2018-11-16 02:03:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 02:03:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521638  77 58438  7409933 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 02:03:30 [DEBUG   ] Got command RPT from MCS: ref #521639
2018-11-16 02:03:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 02:03:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521639  12 58438  7410137 A  ERRORB—™š'
2018-11-16 02:03:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 02:04:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 02:04:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:04:13 [WARNING ] (13, 1, 'bot')
2018-11-16 02:04:13 [WARNING ] (13, 1, 'bot')
2018-11-16 02:04:13 [WARNING ] (13, 1, 'bot')
2018-11-16 02:04:13 [WARNING ] (13, 1, 'bot')
2018-11-16 02:04:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:04:13 [DEBUG   ] Finished updating board flags in 2.013 seconds
2018-11-16 02:04:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 02:04:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 02:05:07 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 02:05:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:05:13 [WARNING ] (13, 1, 'bot')
2018-11-16 02:05:13 [WARNING ] (13, 1, 'bot')
2018-11-16 02:05:13 [WARNING ] (13, 1, 'bot')
2018-11-16 02:05:13 [WARNING ] (13, 1, 'bot')
2018-11-16 02:05:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:05:13 [DEBUG   ] Finished updating board flags in 1.914 seconds
2018-11-16 02:05:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 02:05:45 [DEBUG   ] Got command RPT from MCS: ref #521644
2018-11-16 02:05:45 [DEBUG   ] summary = ERROR
2018-11-16 02:05:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521644  13 58438  7545273 A  ERRORERROR'
2018-11-16 02:05:45 [DEBUG   ] Got command RPT from MCS: ref #521645
2018-11-16 02:05:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 02:05:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521645  77 58438  7545274 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 02:05:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 02:06:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 02:06:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:06:14 [WARNING ] (13, 1, 'bot')
2018-11-16 02:06:14 [WARNING ] (13, 1, 'bot')
2018-11-16 02:06:14 [WARNING ] (13, 1, 'bot')
2018-11-16 02:06:14 [WARNING ] (13, 1, 'bot')
2018-11-16 02:06:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:06:14 [DEBUG   ] Finished updating board flags in 2.828 seconds
2018-11-16 02:06:27 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-16 02:06:47 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 02:07:07 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 02:07:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:07:13 [WARNING ] (13, 1, 'bot')
2018-11-16 02:07:13 [WARNING ] (13, 1, 'bot')
2018-11-16 02:07:13 [WARNING ] (13, 1, 'bot')
2018-11-16 02:07:13 [WARNING ] (13, 1, 'bot')
2018-11-16 02:07:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:07:13 [DEBUG   ] Finished updating board flags in 1.771 seconds
2018-11-16 02:07:27 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 02:07:47 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-16 02:08:07 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 02:08:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 02:08:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:08:13 [WARNING ] (13, 1, 'bot')
2018-11-16 02:08:13 [WARNING ] (13, 1, 'bot')
2018-11-16 02:08:13 [WARNING ] (13, 1, 'bot')
2018-11-16 02:08:13 [WARNING ] (13, 1, 'bot')
2018-11-16 02:08:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:08:13 [DEBUG   ] Finished updating board flags in 1.624 seconds
2018-11-16 02:08:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 02:08:29 [DEBUG   ] Got command RPT from MCS: ref #521663
2018-11-16 02:08:29 [DEBUG   ] summary = ERROR
2018-11-16 02:08:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521663  13 58438  7709406 A  ERRORERROR'
2018-11-16 02:08:29 [DEBUG   ] Got command RPT from MCS: ref #521664
2018-11-16 02:08:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 02:08:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521664  77 58438  7709609 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 02:08:29 [DEBUG   ] Got command RPT from MCS: ref #521665
2018-11-16 02:08:29 [DEBUG   ] summary = ERROR
2018-11-16 02:08:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521665  13 58438  7709813 A  ERRORERROR'
2018-11-16 02:08:30 [DEBUG   ] Got command RPT from MCS: ref #521667
2018-11-16 02:08:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 02:08:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521667  77 58438  7710005 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 02:08:30 [DEBUG   ] Got command RPT from MCS: ref #521669
2018-11-16 02:08:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 02:08:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521669  12 58438  7710210 A  ERRORB˜™š'
2018-11-16 02:08:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 02:09:07 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-16 02:09:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:09:13 [WARNING ] (13, 1, 'bot')
2018-11-16 02:09:13 [WARNING ] (13, 1, 'bot')
2018-11-16 02:09:13 [WARNING ] (13, 1, 'bot')
2018-11-16 02:09:13 [WARNING ] (13, 1, 'bot')
2018-11-16 02:09:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:09:13 [DEBUG   ] Finished updating board flags in 1.626 seconds
2018-11-16 02:09:27 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-16 02:09:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-16 02:10:07 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-16 02:10:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:10:13 [WARNING ] (13, 1, 'bot')
2018-11-16 02:10:13 [WARNING ] (13, 1, 'bot')
2018-11-16 02:10:13 [WARNING ] (13, 1, 'bot')
2018-11-16 02:10:13 [WARNING ] (13, 1, 'bot')
2018-11-16 02:10:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:10:13 [DEBUG   ] Finished updating board flags in 1.602 seconds
2018-11-16 02:10:27 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 02:10:45 [DEBUG   ] Got command RPT from MCS: ref #521677
2018-11-16 02:10:45 [DEBUG   ] summary = ERROR
2018-11-16 02:10:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521677  13 58438  7845273 A  ERRORERROR'
2018-11-16 02:10:45 [DEBUG   ] Got command RPT from MCS: ref #521678
2018-11-16 02:10:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 02:10:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521678  77 58438  7845274 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 02:10:47 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-16 02:11:07 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-16 02:11:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:11:13 [WARNING ] (13, 1, 'bot')
2018-11-16 02:11:13 [WARNING ] (13, 1, 'bot')
2018-11-16 02:11:13 [WARNING ] (13, 1, 'bot')
2018-11-16 02:11:13 [WARNING ] (13, 1, 'bot')
2018-11-16 02:11:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:11:13 [DEBUG   ] Finished updating board flags in 1.562 seconds
2018-11-16 02:11:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 02:11:47 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 02:12:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 02:12:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:12:13 [WARNING ] (13, 1, 'bot')
2018-11-16 02:12:13 [WARNING ] (13, 1, 'bot')
2018-11-16 02:12:13 [WARNING ] (13, 1, 'bot')
2018-11-16 02:12:13 [WARNING ] (13, 1, 'bot')
2018-11-16 02:12:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:12:13 [DEBUG   ] Finished updating board flags in 1.476 seconds
2018-11-16 02:12:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 02:12:47 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 02:13:07 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 02:13:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 02:13:12 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:13:13 [WARNING ] (13, 1, 'bot')
2018-11-16 02:13:13 [WARNING ] (13, 1, 'bot')
2018-11-16 02:13:13 [WARNING ] (13, 1, 'bot')
2018-11-16 02:13:13 [WARNING ] (13, 1, 'bot')
2018-11-16 02:13:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:13:13 [DEBUG   ] Finished updating board flags in 1.438 seconds
2018-11-16 02:13:27 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-16 02:13:29 [DEBUG   ] Got command RPT from MCS: ref #521698
2018-11-16 02:13:29 [DEBUG   ] summary = ERROR
2018-11-16 02:13:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521698  13 58438  8009493 A  ERRORERROR'
2018-11-16 02:13:29 [DEBUG   ] Got command RPT from MCS: ref #521699
2018-11-16 02:13:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 02:13:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521699  77 58438  8009697 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 02:13:29 [DEBUG   ] Got command RPT from MCS: ref #521700
2018-11-16 02:13:29 [DEBUG   ] summary = ERROR
2018-11-16 02:13:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521700  13 58438  8009889 A  ERRORERROR'
2018-11-16 02:13:30 [DEBUG   ] Got command RPT from MCS: ref #521701
2018-11-16 02:13:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 02:13:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521701  77 58438  8010093 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 02:13:30 [DEBUG   ] Got command RPT from MCS: ref #521702
2018-11-16 02:13:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 02:13:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521702  12 58438  8010297 A  ERRORB˜™š'
2018-11-16 02:13:47 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-16 02:14:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 02:14:12 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 02:14:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:14:13 [WARNING ] (13, 1, 'bot')
2018-11-16 02:14:13 [WARNING ] (13, 1, 'bot')
2018-11-16 02:14:13 [WARNING ] (13, 1, 'bot')
2018-11-16 02:14:13 [WARNING ] (13, 1, 'bot')
2018-11-16 02:14:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:14:13 [DEBUG   ] Finished updating board flags in 1.439 seconds
2018-11-16 02:14:27 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 02:14:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 02:15:07 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 02:15:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:15:13 [WARNING ] (13, 1, 'bot')
2018-11-16 02:15:13 [WARNING ] (13, 1, 'bot')
2018-11-16 02:15:13 [WARNING ] (13, 1, 'bot')
2018-11-16 02:15:13 [WARNING ] (13, 1, 'bot')
2018-11-16 02:15:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:15:13 [DEBUG   ] Finished updating board flags in 1.450 seconds
2018-11-16 02:15:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 02:15:45 [DEBUG   ] Got command RPT from MCS: ref #521707
2018-11-16 02:15:45 [DEBUG   ] summary = ERROR
2018-11-16 02:15:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521707  13 58438  8145269 A  ERRORERROR'
2018-11-16 02:15:45 [DEBUG   ] Got command RPT from MCS: ref #521708
2018-11-16 02:15:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 02:15:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521708  77 58438  8145270 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 02:15:47 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 02:16:07 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-16 02:16:12 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 02:16:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:16:13 [WARNING ] (13, 1, 'bot')
2018-11-16 02:16:13 [WARNING ] (13, 1, 'bot')
2018-11-16 02:16:13 [WARNING ] (13, 1, 'bot')
2018-11-16 02:16:13 [WARNING ] (13, 1, 'bot')
2018-11-16 02:16:13 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:16:13 [DEBUG   ] Finished updating board flags in 1.466 seconds
2018-11-16 02:16:28 [DEBUG   ] Finished updating ant stats in 1.389 seconds
2018-11-16 02:16:48 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-16 02:17:08 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-16 02:17:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:17:14 [WARNING ] (13, 1, 'bot')
2018-11-16 02:17:14 [WARNING ] (13, 1, 'bot')
2018-11-16 02:17:14 [WARNING ] (13, 1, 'bot')
2018-11-16 02:17:14 [WARNING ] (13, 1, 'bot')
2018-11-16 02:17:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:17:14 [DEBUG   ] Finished updating board flags in 2.227 seconds
2018-11-16 02:17:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 02:17:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 02:18:08 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 02:18:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:18:14 [WARNING ] (13, 1, 'bot')
2018-11-16 02:18:14 [WARNING ] (13, 1, 'bot')
2018-11-16 02:18:14 [WARNING ] (13, 1, 'bot')
2018-11-16 02:18:14 [WARNING ] (13, 1, 'bot')
2018-11-16 02:18:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:18:14 [DEBUG   ] Finished updating board flags in 2.108 seconds
2018-11-16 02:18:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 02:18:29 [DEBUG   ] Got command RPT from MCS: ref #521730
2018-11-16 02:18:29 [DEBUG   ] summary = ERROR
2018-11-16 02:18:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521730  13 58438  8309569 A  ERRORERROR'
2018-11-16 02:18:29 [DEBUG   ] Got command RPT from MCS: ref #521731
2018-11-16 02:18:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 02:18:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521731  77 58438  8309773 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 02:18:29 [DEBUG   ] Got command RPT from MCS: ref #521732
2018-11-16 02:18:29 [DEBUG   ] summary = ERROR
2018-11-16 02:18:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521732  13 58438  8309977 A  ERRORERROR'
2018-11-16 02:18:30 [DEBUG   ] Got command RPT from MCS: ref #521734
2018-11-16 02:18:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 02:18:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521734  77 58438  8310169 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 02:18:30 [DEBUG   ] Got command RPT from MCS: ref #521735
2018-11-16 02:18:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 02:18:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521735  12 58438  8310373 A  ERRORB—™š'
2018-11-16 02:18:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 02:19:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 02:19:13 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 02:19:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:19:14 [WARNING ] (13, 1, 'bot')
2018-11-16 02:19:14 [WARNING ] (13, 1, 'bot')
2018-11-16 02:19:14 [WARNING ] (13, 1, 'bot')
2018-11-16 02:19:14 [WARNING ] (13, 1, 'bot')
2018-11-16 02:19:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:19:14 [DEBUG   ] Finished updating board flags in 2.041 seconds
2018-11-16 02:19:28 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 02:19:48 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-16 02:20:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 02:20:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:20:14 [WARNING ] (13, 1, 'bot')
2018-11-16 02:20:14 [WARNING ] (13, 1, 'bot')
2018-11-16 02:20:14 [WARNING ] (13, 1, 'bot')
2018-11-16 02:20:14 [WARNING ] (13, 1, 'bot')
2018-11-16 02:20:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:20:14 [DEBUG   ] Finished updating board flags in 1.966 seconds
2018-11-16 02:20:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 02:20:45 [DEBUG   ] Got command RPT from MCS: ref #521744
2018-11-16 02:20:45 [DEBUG   ] summary = ERROR
2018-11-16 02:20:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521744  13 58438  8445269 A  ERRORERROR'
2018-11-16 02:20:45 [DEBUG   ] Got command RPT from MCS: ref #521745
2018-11-16 02:20:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 02:20:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521745  77 58438  8445270 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 02:20:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 02:21:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 02:21:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:21:14 [WARNING ] (13, 1, 'bot')
2018-11-16 02:21:14 [WARNING ] (13, 1, 'bot')
2018-11-16 02:21:14 [WARNING ] (13, 1, 'bot')
2018-11-16 02:21:14 [WARNING ] (13, 1, 'bot')
2018-11-16 02:21:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:21:14 [DEBUG   ] Finished updating board flags in 1.807 seconds
2018-11-16 02:21:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 02:21:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 02:22:08 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 02:22:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:22:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 02:22:14 [WARNING ] (13, 1, 'bot')
2018-11-16 02:22:14 [WARNING ] (13, 1, 'bot')
2018-11-16 02:22:14 [WARNING ] (13, 1, 'bot')
2018-11-16 02:22:14 [WARNING ] (13, 1, 'bot')
2018-11-16 02:22:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:22:14 [DEBUG   ] Finished updating board flags in 1.819 seconds
2018-11-16 02:22:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 02:22:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 02:23:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 02:23:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:23:14 [WARNING ] (13, 1, 'bot')
2018-11-16 02:23:14 [WARNING ] (13, 1, 'bot')
2018-11-16 02:23:14 [WARNING ] (13, 1, 'bot')
2018-11-16 02:23:14 [WARNING ] (13, 1, 'bot')
2018-11-16 02:23:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:23:14 [DEBUG   ] Finished updating board flags in 1.861 seconds
2018-11-16 02:23:28 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 02:23:29 [DEBUG   ] Got command RPT from MCS: ref #521761
2018-11-16 02:23:29 [DEBUG   ] summary = ERROR
2018-11-16 02:23:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521761  13 58438  8609653 A  ERRORERROR'
2018-11-16 02:23:29 [DEBUG   ] Got command RPT from MCS: ref #521762
2018-11-16 02:23:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 02:23:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521762  77 58438  8609857 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 02:23:30 [DEBUG   ] Got command RPT from MCS: ref #521763
2018-11-16 02:23:30 [DEBUG   ] summary = ERROR
2018-11-16 02:23:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521763  13 58438  8610049 A  ERRORERROR'
2018-11-16 02:23:30 [DEBUG   ] Got command RPT from MCS: ref #521764
2018-11-16 02:23:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 02:23:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521764  77 58438  8610253 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 02:23:30 [DEBUG   ] Got command RPT from MCS: ref #521765
2018-11-16 02:23:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 02:23:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521765  12 58438  8610457 A  ERRORB™™š'
2018-11-16 02:23:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 02:24:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 02:24:13 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 02:24:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:24:14 [WARNING ] (13, 1, 'bot')
2018-11-16 02:24:14 [WARNING ] (13, 1, 'bot')
2018-11-16 02:24:14 [WARNING ] (13, 1, 'bot')
2018-11-16 02:24:14 [WARNING ] (13, 1, 'bot')
2018-11-16 02:24:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:24:14 [DEBUG   ] Finished updating board flags in 1.835 seconds
2018-11-16 02:24:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 02:24:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 02:25:08 [DEBUG   ] Finished updating ant stats in 0.790 seconds
2018-11-16 02:25:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:25:14 [WARNING ] (13, 1, 'bot')
2018-11-16 02:25:14 [WARNING ] (13, 1, 'bot')
2018-11-16 02:25:14 [WARNING ] (13, 1, 'bot')
2018-11-16 02:25:14 [WARNING ] (13, 1, 'bot')
2018-11-16 02:25:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:25:14 [DEBUG   ] Finished updating board flags in 1.788 seconds
2018-11-16 02:25:28 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-16 02:25:45 [DEBUG   ] Got command RPT from MCS: ref #521770
2018-11-16 02:25:45 [DEBUG   ] summary = ERROR
2018-11-16 02:25:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521770  13 58438  8745277 A  ERRORERROR'
2018-11-16 02:25:45 [DEBUG   ] Got command RPT from MCS: ref #521771
2018-11-16 02:25:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 02:25:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521771  77 58438  8745278 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 02:25:48 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-16 02:26:09 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-16 02:26:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:26:14 [WARNING ] (13, 1, 'bot')
2018-11-16 02:26:14 [WARNING ] (13, 1, 'bot')
2018-11-16 02:26:14 [WARNING ] (13, 1, 'bot')
2018-11-16 02:26:14 [WARNING ] (13, 1, 'bot')
2018-11-16 02:26:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:26:14 [DEBUG   ] Finished updating board flags in 1.508 seconds
2018-11-16 02:26:29 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-16 02:26:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 02:27:09 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-16 02:27:13 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:27:14 [WARNING ] (13, 1, 'bot')
2018-11-16 02:27:14 [WARNING ] (13, 1, 'bot')
2018-11-16 02:27:14 [WARNING ] (13, 1, 'bot')
2018-11-16 02:27:14 [WARNING ] (13, 1, 'bot')
2018-11-16 02:27:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:27:14 [DEBUG   ] Finished updating board flags in 1.398 seconds
2018-11-16 02:27:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 02:27:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 02:28:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 02:28:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:28:14 [WARNING ] (13, 1, 'bot')
2018-11-16 02:28:14 [WARNING ] (13, 1, 'bot')
2018-11-16 02:28:14 [WARNING ] (13, 1, 'bot')
2018-11-16 02:28:14 [WARNING ] (13, 1, 'bot')
2018-11-16 02:28:14 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:28:14 [DEBUG   ] Finished updating board flags in 1.395 seconds
2018-11-16 02:28:29 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-16 02:28:29 [DEBUG   ] Got command RPT from MCS: ref #521793
2018-11-16 02:28:29 [DEBUG   ] summary = ERROR
2018-11-16 02:28:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521793  13 58438  8909725 A  ERRORERROR'
2018-11-16 02:28:29 [DEBUG   ] Got command RPT from MCS: ref #521794
2018-11-16 02:28:29 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 02:28:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521794  77 58438  8909929 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 02:28:30 [DEBUG   ] Got command RPT from MCS: ref #521795
2018-11-16 02:28:30 [DEBUG   ] summary = ERROR
2018-11-16 02:28:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521795  13 58438  8910133 A  ERRORERROR'
2018-11-16 02:28:30 [DEBUG   ] Got command RPT from MCS: ref #521796
2018-11-16 02:28:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 02:28:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521796  77 58438  8910337 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 02:28:30 [DEBUG   ] Got command RPT from MCS: ref #521799
2018-11-16 02:28:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 02:28:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521799  12 58438  8910529 A  ERRORB—™š'
2018-11-16 02:28:49 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-16 02:29:09 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 02:29:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:29:15 [WARNING ] (13, 1, 'bot')
2018-11-16 02:29:15 [WARNING ] (13, 1, 'bot')
2018-11-16 02:29:15 [WARNING ] (13, 1, 'bot')
2018-11-16 02:29:15 [WARNING ] (13, 1, 'bot')
2018-11-16 02:29:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:29:15 [DEBUG   ] Finished updating board flags in 2.026 seconds
2018-11-16 02:29:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 02:29:49 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 02:30:00 [DEBUG   ] Got command TBN from MCS: ref #521807
2018-11-16 02:30:00 [DEBUG   ] spawn_process: at 2018-11-16 02:30:00 running ['/usr/local/bin/lwa27', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '1', '1542335402']
2018-11-16 02:30:00 [DEBUG   ] spawn_process: at 2018-11-16 02:30:00 running ['/usr/local/bin/lwa24', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '2', '1542335402']
2018-11-16 02:30:00 [DEBUG   ] tbn = exited with status True, code 0x00
2018-11-16 02:30:00 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_TBN   521807   8 58438  9000682 A  ERROR'
2018-11-16 02:30:00 [DEBUG   ] spawn_process: at 2018-11-16 02:30:00 running ['/usr/local/bin/lwa23', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '3', '1542335402']
2018-11-16 02:30:00 [DEBUG   ] spawn_process: at 2018-11-16 02:30:00 running ['/usr/local/bin/lwa18', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '4', '1542335402']
2018-11-16 02:30:00 [DEBUG   ] spawn_process: at 2018-11-16 02:30:00 running ['/usr/local/bin/lwa10', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '5', '1542335402']
2018-11-16 02:30:00 [DEBUG   ] spawn_process: at 2018-11-16 02:30:00 running ['/usr/local/bin/lwa32', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '6', '1542335402']
2018-11-16 02:30:00 [DEBUG   ] spawn_process: at 2018-11-16 02:30:00 running ['/usr/local/bin/lwa11', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '7', '1542335402']
2018-11-16 02:30:00 [DEBUG   ] spawn_process: at 2018-11-16 02:30:00 running ['/usr/local/bin/lwa30', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '8', '1542335402']
2018-11-16 02:30:00 [DEBUG   ] spawn_process: at 2018-11-16 02:30:00 running ['/usr/local/bin/lwa12', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '9', '1542335402']
2018-11-16 02:30:00 [DEBUG   ] spawn_process: at 2018-11-16 02:30:00 running ['/usr/local/bin/lwa8', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '10', '1542335402']
2018-11-16 02:30:00 [DEBUG   ] spawn_process: at 2018-11-16 02:30:00 running ['/usr/local/bin/lwa13', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '11', '1542335402']
2018-11-16 02:30:00 [DEBUG   ] spawn_process: at 2018-11-16 02:30:00 running ['/usr/local/bin/lwa26', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '12', '1542335402']
2018-11-16 02:30:00 [DEBUG   ] spawn_process: at 2018-11-16 02:30:00 running ['/usr/local/bin/lwa14', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '13', '1542335402']
2018-11-16 02:30:00 [DEBUG   ] spawn_process: at 2018-11-16 02:30:00 running ['/usr/local/bin/lwa22', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '14', '1542335402']
2018-11-16 02:30:00 [DEBUG   ] spawn_process: at 2018-11-16 02:30:00 running ['/usr/local/bin/lwa20', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '15', '1542335402']
2018-11-16 02:30:00 [DEBUG   ] spawn_process: at 2018-11-16 02:30:00 running ['/usr/local/bin/lwa1', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '16', '1542335402']
2018-11-16 02:30:00 [DEBUG   ] spawn_process: at 2018-11-16 02:30:00 running ['/usr/local/bin/lwa5', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '17', '1542335402']
2018-11-16 02:30:00 [DEBUG   ] spawn_process: at 2018-11-16 02:30:00 running ['/usr/local/bin/lwa25', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '18', '1542335402']
2018-11-16 02:30:00 [DEBUG   ] spawn_process: at 2018-11-16 02:30:00 running ['/usr/local/bin/lwa35', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '19', '1542335402']
2018-11-16 02:30:00 [DEBUG   ] spawn_process: at 2018-11-16 02:30:00 running ['/usr/local/bin/lwa19', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '20', '1542335402']
2018-11-16 02:30:00 [DEBUG   ] spawn_process: at 2018-11-16 02:30:00 running ['/usr/local/bin/lwa21', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '21', '1542335402']
2018-11-16 02:30:00 [DEBUG   ] spawn_process: at 2018-11-16 02:30:00 running ['/usr/local/bin/lwa6', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '22', '1542335402']
2018-11-16 02:30:00 [DEBUG   ] spawn_process: at 2018-11-16 02:30:00 running ['/usr/local/bin/lwa7', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '23', '1542335402']
2018-11-16 02:30:00 [DEBUG   ] spawn_process: at 2018-11-16 02:30:00 running ['/usr/local/bin/lwa33', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '24', '1542335402']
2018-11-16 02:30:00 [DEBUG   ] spawn_process: at 2018-11-16 02:30:00 running ['/usr/local/bin/lwa15', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '25', '1542335402']
2018-11-16 02:30:00 [DEBUG   ] spawn_process: at 2018-11-16 02:30:00 running ['/usr/local/bin/lwa28', '/lwa/software/tbn', '192.168.0.37', '10000', '38100000.0', '7', '20', '0', '26', '1542335402']
2018-11-16 02:30:00 [INFO    ] Finished spawning TBN in 0.056 s
2018-11-16 02:30:09 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-16 02:30:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:30:15 [WARNING ] (13, 1, 'bot')
2018-11-16 02:30:15 [WARNING ] (13, 1, 'bot')
2018-11-16 02:30:15 [WARNING ] (13, 1, 'bot')
2018-11-16 02:30:15 [WARNING ] (13, 1, 'bot')
2018-11-16 02:30:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:30:15 [DEBUG   ] Finished updating board flags in 1.991 seconds
2018-11-16 02:30:29 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2018-11-16 02:30:45 [DEBUG   ] Got command RPT from MCS: ref #521808
2018-11-16 02:30:45 [DEBUG   ] summary = ERROR
2018-11-16 02:30:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521808  13 58438  9045273 A  ERRORERROR'
2018-11-16 02:30:45 [DEBUG   ] Got command RPT from MCS: ref #521809
2018-11-16 02:30:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 02:30:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521809  77 58438  9045274 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 02:30:49 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 02:31:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 02:31:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:31:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-16 02:31:15 [WARNING ] (13, 1, 'bot')
2018-11-16 02:31:15 [WARNING ] (13, 1, 'bot')
2018-11-16 02:31:15 [WARNING ] (13, 1, 'bot')
2018-11-16 02:31:15 [WARNING ] (13, 1, 'bot')
2018-11-16 02:31:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:31:15 [DEBUG   ] Finished updating board flags in 1.802 seconds
2018-11-16 02:31:29 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 02:31:49 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-16 02:32:09 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 02:32:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:32:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-16 02:32:15 [WARNING ] (13, 1, 'bot')
2018-11-16 02:32:15 [WARNING ] (13, 1, 'bot')
2018-11-16 02:32:15 [WARNING ] (13, 1, 'bot')
2018-11-16 02:32:15 [WARNING ] (13, 1, 'bot')
2018-11-16 02:32:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:32:15 [DEBUG   ] Finished updating board flags in 1.795 seconds
2018-11-16 02:32:29 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-16 02:32:50 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 02:33:10 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 02:33:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-16 02:33:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:33:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-16 02:33:15 [WARNING ] (13, 1, 'bot')
2018-11-16 02:33:15 [WARNING ] (13, 1, 'bot')
2018-11-16 02:33:15 [WARNING ] (13, 1, 'bot')
2018-11-16 02:33:15 [WARNING ] (13, 1, 'bot')
2018-11-16 02:33:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:33:15 [DEBUG   ] Finished updating board flags in 1.616 seconds
2018-11-16 02:33:29 [DEBUG   ] Got command RPT from MCS: ref #521829
2018-11-16 02:33:29 [DEBUG   ] summary = ERROR
2018-11-16 02:33:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521829  13 58438  9209809 A  ERRORERROR'
2018-11-16 02:33:30 [DEBUG   ] Got command RPT from MCS: ref #521830
2018-11-16 02:33:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 02:33:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521830  77 58438  9210013 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 02:33:30 [DEBUG   ] Got command RPT from MCS: ref #521831
2018-11-16 02:33:30 [DEBUG   ] summary = ERROR
2018-11-16 02:33:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521831  13 58438  9210217 A  ERRORERROR'
2018-11-16 02:33:30 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-16 02:33:30 [DEBUG   ] Got command RPT from MCS: ref #521832
2018-11-16 02:33:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 02:33:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521832  77 58438  9210409 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 02:33:30 [DEBUG   ] Got command RPT from MCS: ref #521833
2018-11-16 02:33:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 02:33:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521833  12 58438  9210613 A  ERRORB˜™š'
2018-11-16 02:33:50 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-16 02:34:10 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-11-16 02:34:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:34:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 02:34:15 [WARNING ] (13, 1, 'bot')
2018-11-16 02:34:15 [WARNING ] (13, 1, 'bot')
2018-11-16 02:34:15 [WARNING ] (13, 1, 'bot')
2018-11-16 02:34:15 [WARNING ] (13, 1, 'bot')
2018-11-16 02:34:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:34:15 [DEBUG   ] Finished updating board flags in 1.593 seconds
2018-11-16 02:34:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 02:34:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 02:35:10 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 02:35:14 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-16 02:35:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:35:15 [WARNING ] (13, 1, 'bot')
2018-11-16 02:35:15 [WARNING ] (13, 1, 'bot')
2018-11-16 02:35:15 [WARNING ] (13, 1, 'bot')
2018-11-16 02:35:15 [WARNING ] (13, 1, 'bot')
2018-11-16 02:35:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:35:15 [DEBUG   ] Finished updating board flags in 1.412 seconds
2018-11-16 02:35:30 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-16 02:35:45 [DEBUG   ] Got command RPT from MCS: ref #521838
2018-11-16 02:35:45 [DEBUG   ] summary = ERROR
2018-11-16 02:35:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521838  13 58438  9345273 A  ERRORERROR'
2018-11-16 02:35:45 [DEBUG   ] Got command RPT from MCS: ref #521839
2018-11-16 02:35:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 02:35:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521839  77 58438  9345274 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 02:35:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 02:36:10 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 02:36:14 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:36:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 02:36:15 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-16 02:36:15 [WARNING ] (13, 1, 'bot')
2018-11-16 02:36:15 [WARNING ] (13, 1, 'bot')
2018-11-16 02:36:15 [WARNING ] (13, 1, 'bot')
2018-11-16 02:36:15 [WARNING ] (13, 1, 'bot')
2018-11-16 02:36:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:36:15 [DEBUG   ] Finished updating board flags in 1.388 seconds
2018-11-16 02:36:30 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-11-16 02:36:51 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-11-16 02:37:11 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-16 02:37:14 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 02:37:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:37:15 [WARNING ] (13, 1, 'bot')
2018-11-16 02:37:15 [WARNING ] (13, 1, 'bot')
2018-11-16 02:37:15 [WARNING ] (13, 1, 'bot')
2018-11-16 02:37:15 [WARNING ] (13, 1, 'bot')
2018-11-16 02:37:15 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:37:15 [DEBUG   ] Finished updating board flags in 1.354 seconds
2018-11-16 02:37:31 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-16 02:37:51 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-16 02:38:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 02:38:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:38:16 [WARNING ] (13, 1, 'bot')
2018-11-16 02:38:16 [WARNING ] (13, 1, 'bot')
2018-11-16 02:38:16 [WARNING ] (13, 1, 'bot')
2018-11-16 02:38:16 [WARNING ] (13, 1, 'bot')
2018-11-16 02:38:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:38:16 [DEBUG   ] Finished updating board flags in 2.064 seconds
2018-11-16 02:38:29 [DEBUG   ] Got command RPT from MCS: ref #521857
2018-11-16 02:38:29 [DEBUG   ] summary = ERROR
2018-11-16 02:38:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521857  13 58438  9509897 A  ERRORERROR'
2018-11-16 02:38:30 [DEBUG   ] Got command RPT from MCS: ref #521858
2018-11-16 02:38:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 02:38:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521858  77 58438  9510089 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 02:38:30 [DEBUG   ] Got command RPT from MCS: ref #521859
2018-11-16 02:38:30 [DEBUG   ] summary = ERROR
2018-11-16 02:38:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521859  13 58438  9510293 A  ERRORERROR'
2018-11-16 02:38:30 [DEBUG   ] Got command RPT from MCS: ref #521861
2018-11-16 02:38:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 02:38:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521861  77 58438  9510497 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 02:38:30 [DEBUG   ] Got command RPT from MCS: ref #521863
2018-11-16 02:38:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 02:38:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521863  12 58438  9510701 A  ERRORB˜™š'
2018-11-16 02:38:31 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 02:38:51 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-16 02:39:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 02:39:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:39:16 [WARNING ] (13, 1, 'bot')
2018-11-16 02:39:16 [WARNING ] (13, 1, 'bot')
2018-11-16 02:39:16 [WARNING ] (13, 1, 'bot')
2018-11-16 02:39:16 [WARNING ] (13, 1, 'bot')
2018-11-16 02:39:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:39:16 [DEBUG   ] Finished updating board flags in 1.987 seconds
2018-11-16 02:39:31 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 02:39:51 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 02:40:11 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 02:40:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:40:16 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 02:40:16 [WARNING ] (13, 1, 'bot')
2018-11-16 02:40:16 [WARNING ] (13, 1, 'bot')
2018-11-16 02:40:16 [WARNING ] (13, 1, 'bot')
2018-11-16 02:40:16 [WARNING ] (13, 1, 'bot')
2018-11-16 02:40:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:40:16 [DEBUG   ] Finished updating board flags in 1.892 seconds
2018-11-16 02:40:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 02:40:45 [DEBUG   ] Got command RPT from MCS: ref #521871
2018-11-16 02:40:45 [DEBUG   ] summary = ERROR
2018-11-16 02:40:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521871  13 58438  9645277 A  ERRORERROR'
2018-11-16 02:40:45 [DEBUG   ] Got command RPT from MCS: ref #521872
2018-11-16 02:40:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 02:40:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521872  77 58438  9645278 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 02:40:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 02:41:11 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 02:41:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:41:16 [WARNING ] (13, 1, 'bot')
2018-11-16 02:41:16 [WARNING ] (13, 1, 'bot')
2018-11-16 02:41:16 [WARNING ] (13, 1, 'bot')
2018-11-16 02:41:16 [WARNING ] (13, 1, 'bot')
2018-11-16 02:41:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:41:16 [DEBUG   ] Finished updating board flags in 1.718 seconds
2018-11-16 02:41:31 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-16 02:41:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 02:42:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 02:42:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:42:16 [WARNING ] (13, 1, 'bot')
2018-11-16 02:42:16 [WARNING ] (13, 1, 'bot')
2018-11-16 02:42:16 [WARNING ] (13, 1, 'bot')
2018-11-16 02:42:16 [WARNING ] (13, 1, 'bot')
2018-11-16 02:42:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:42:16 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-11-16 02:42:31 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 02:42:51 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-16 02:43:12 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-16 02:43:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:43:16 [WARNING ] (13, 1, 'bot')
2018-11-16 02:43:16 [WARNING ] (13, 1, 'bot')
2018-11-16 02:43:16 [WARNING ] (13, 1, 'bot')
2018-11-16 02:43:16 [WARNING ] (13, 1, 'bot')
2018-11-16 02:43:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:43:16 [DEBUG   ] Finished updating board flags in 1.584 seconds
2018-11-16 02:43:29 [DEBUG   ] Got command RPT from MCS: ref #521892
2018-11-16 02:43:29 [DEBUG   ] summary = ERROR
2018-11-16 02:43:29 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521892  13 58438  9809973 A  ERRORERROR'
2018-11-16 02:43:30 [DEBUG   ] Got command RPT from MCS: ref #521893
2018-11-16 02:43:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 02:43:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521893  77 58438  9810177 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 02:43:30 [DEBUG   ] Got command RPT from MCS: ref #521894
2018-11-16 02:43:30 [DEBUG   ] summary = ERROR
2018-11-16 02:43:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521894  13 58438  9810369 A  ERRORERROR'
2018-11-16 02:43:30 [DEBUG   ] Got command RPT from MCS: ref #521895
2018-11-16 02:43:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 02:43:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521895  77 58438  9810573 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 02:43:30 [DEBUG   ] Got command RPT from MCS: ref #521896
2018-11-16 02:43:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 02:43:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521896  12 58438  9810777 A  ERRORB—™š'
2018-11-16 02:43:32 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-16 02:43:52 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-16 02:44:12 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 02:44:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:44:16 [WARNING ] (13, 1, 'bot')
2018-11-16 02:44:16 [WARNING ] (13, 1, 'bot')
2018-11-16 02:44:16 [WARNING ] (13, 1, 'bot')
2018-11-16 02:44:16 [WARNING ] (13, 1, 'bot')
2018-11-16 02:44:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:44:16 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-11-16 02:44:32 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 02:44:52 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-16 02:45:12 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-16 02:45:15 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-16 02:45:15 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:45:16 [WARNING ] (13, 1, 'bot')
2018-11-16 02:45:16 [WARNING ] (13, 1, 'bot')
2018-11-16 02:45:16 [WARNING ] (13, 1, 'bot')
2018-11-16 02:45:16 [WARNING ] (13, 1, 'bot')
2018-11-16 02:45:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:45:16 [DEBUG   ] Finished updating board flags in 1.393 seconds
2018-11-16 02:45:32 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-16 02:45:45 [DEBUG   ] Got command RPT from MCS: ref #521901
2018-11-16 02:45:45 [DEBUG   ] summary = ERROR
2018-11-16 02:45:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521901  13 58438  9945278 A  ERRORERROR'
2018-11-16 02:45:45 [DEBUG   ] Got command RPT from MCS: ref #521902
2018-11-16 02:45:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 02:45:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521902  77 58438  9945278 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 02:45:52 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 02:46:13 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-16 02:46:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:46:16 [WARNING ] (13, 1, 'bot')
2018-11-16 02:46:16 [WARNING ] (13, 1, 'bot')
2018-11-16 02:46:16 [WARNING ] (13, 1, 'bot')
2018-11-16 02:46:16 [WARNING ] (13, 1, 'bot')
2018-11-16 02:46:16 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:46:16 [DEBUG   ] Finished updating board flags in 1.360 seconds
2018-11-16 02:46:33 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-16 02:46:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 02:47:13 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-16 02:47:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:47:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-16 02:47:17 [WARNING ] (13, 1, 'bot')
2018-11-16 02:47:17 [WARNING ] (13, 1, 'bot')
2018-11-16 02:47:17 [WARNING ] (13, 1, 'bot')
2018-11-16 02:47:17 [WARNING ] (13, 1, 'bot')
2018-11-16 02:47:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:47:17 [DEBUG   ] Finished updating board flags in 2.057 seconds
2018-11-16 02:47:33 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-16 02:47:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 02:48:13 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 02:48:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-16 02:48:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:48:17 [WARNING ] (13, 1, 'bot')
2018-11-16 02:48:17 [WARNING ] (13, 1, 'bot')
2018-11-16 02:48:17 [WARNING ] (13, 1, 'bot')
2018-11-16 02:48:17 [WARNING ] (13, 1, 'bot')
2018-11-16 02:48:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:48:17 [DEBUG   ] Finished updating board flags in 2.002 seconds
2018-11-16 02:48:30 [DEBUG   ] Got command RPT from MCS: ref #521924
2018-11-16 02:48:30 [DEBUG   ] summary = ERROR
2018-11-16 02:48:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521924  13 58438 10110053 A  ERRORERROR'
2018-11-16 02:48:30 [DEBUG   ] Got command RPT from MCS: ref #521925
2018-11-16 02:48:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 02:48:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521925  77 58438 10110257 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 02:48:30 [DEBUG   ] Got command RPT from MCS: ref #521926
2018-11-16 02:48:30 [DEBUG   ] summary = ERROR
2018-11-16 02:48:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521926  13 58438 10110449 A  ERRORERROR'
2018-11-16 02:48:30 [DEBUG   ] Got command RPT from MCS: ref #521928
2018-11-16 02:48:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 02:48:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521928  77 58438 10110653 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 02:48:30 [DEBUG   ] Got command RPT from MCS: ref #521929
2018-11-16 02:48:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 02:48:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521929  12 58438 10110857 A  ERRORB™™š'
2018-11-16 02:48:33 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 02:48:53 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 02:49:13 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 02:49:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:49:17 [WARNING ] (13, 1, 'bot')
2018-11-16 02:49:17 [WARNING ] (13, 1, 'bot')
2018-11-16 02:49:17 [WARNING ] (13, 1, 'bot')
2018-11-16 02:49:17 [WARNING ] (13, 1, 'bot')
2018-11-16 02:49:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:49:17 [DEBUG   ] Finished updating board flags in 2.028 seconds
2018-11-16 02:49:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 02:49:53 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 02:50:13 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-16 02:50:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:50:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 02:50:17 [WARNING ] (13, 1, 'bot')
2018-11-16 02:50:17 [WARNING ] (13, 1, 'bot')
2018-11-16 02:50:17 [WARNING ] (13, 1, 'bot')
2018-11-16 02:50:17 [WARNING ] (13, 1, 'bot')
2018-11-16 02:50:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:50:17 [DEBUG   ] Finished updating board flags in 1.976 seconds
2018-11-16 02:50:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 02:50:45 [DEBUG   ] Got command RPT from MCS: ref #521938
2018-11-16 02:50:45 [DEBUG   ] summary = ERROR
2018-11-16 02:50:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521938  13 58438 10245277 A  ERRORERROR'
2018-11-16 02:50:45 [DEBUG   ] Got command RPT from MCS: ref #521939
2018-11-16 02:50:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 02:50:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521939  77 58438 10245278 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 02:50:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 02:51:13 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 02:51:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:51:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-16 02:51:17 [WARNING ] (13, 1, 'bot')
2018-11-16 02:51:17 [WARNING ] (13, 1, 'bot')
2018-11-16 02:51:17 [WARNING ] (13, 1, 'bot')
2018-11-16 02:51:17 [WARNING ] (13, 1, 'bot')
2018-11-16 02:51:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:51:17 [DEBUG   ] Finished updating board flags in 1.803 seconds
2018-11-16 02:51:33 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-16 02:51:53 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 02:52:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 02:52:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:52:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 02:52:17 [WARNING ] (13, 1, 'bot')
2018-11-16 02:52:17 [WARNING ] (13, 1, 'bot')
2018-11-16 02:52:17 [WARNING ] (13, 1, 'bot')
2018-11-16 02:52:17 [WARNING ] (13, 1, 'bot')
2018-11-16 02:52:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:52:17 [DEBUG   ] Finished updating board flags in 1.815 seconds
2018-11-16 02:52:33 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 02:52:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 02:53:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 02:53:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:53:17 [WARNING ] (13, 1, 'bot')
2018-11-16 02:53:17 [WARNING ] (13, 1, 'bot')
2018-11-16 02:53:17 [WARNING ] (13, 1, 'bot')
2018-11-16 02:53:17 [WARNING ] (13, 1, 'bot')
2018-11-16 02:53:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:53:17 [DEBUG   ] Finished updating board flags in 1.784 seconds
2018-11-16 02:53:30 [DEBUG   ] Got command RPT from MCS: ref #521955
2018-11-16 02:53:30 [DEBUG   ] summary = ERROR
2018-11-16 02:53:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521955  13 58438 10410125 A  ERRORERROR'
2018-11-16 02:53:30 [DEBUG   ] Got command RPT from MCS: ref #521956
2018-11-16 02:53:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 02:53:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521956  77 58438 10410329 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 02:53:30 [DEBUG   ] Got command RPT from MCS: ref #521957
2018-11-16 02:53:30 [DEBUG   ] summary = ERROR
2018-11-16 02:53:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521957  13 58438 10410533 A  ERRORERROR'
2018-11-16 02:53:30 [DEBUG   ] Got command RPT from MCS: ref #521958
2018-11-16 02:53:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 02:53:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521958  77 58438 10410737 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 02:53:30 [DEBUG   ] Got command RPT from MCS: ref #521959
2018-11-16 02:53:30 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 02:53:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521959  12 58438 10410929 A  ERRORB˜™š'
2018-11-16 02:53:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 02:53:53 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 02:54:13 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-11-16 02:54:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:54:17 [WARNING ] (13, 1, 'bot')
2018-11-16 02:54:17 [WARNING ] (13, 1, 'bot')
2018-11-16 02:54:17 [WARNING ] (13, 1, 'bot')
2018-11-16 02:54:17 [WARNING ] (13, 1, 'bot')
2018-11-16 02:54:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:54:17 [DEBUG   ] Finished updating board flags in 1.689 seconds
2018-11-16 02:54:33 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 02:54:53 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 02:55:13 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-11-16 02:55:16 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 02:55:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:55:17 [WARNING ] (13, 1, 'bot')
2018-11-16 02:55:17 [WARNING ] (13, 1, 'bot')
2018-11-16 02:55:17 [WARNING ] (13, 1, 'bot')
2018-11-16 02:55:17 [WARNING ] (13, 1, 'bot')
2018-11-16 02:55:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:55:17 [DEBUG   ] Finished updating board flags in 1.510 seconds
2018-11-16 02:55:34 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-11-16 02:55:45 [DEBUG   ] Got command RPT from MCS: ref #521964
2018-11-16 02:55:45 [DEBUG   ] summary = ERROR
2018-11-16 02:55:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521964  13 58438 10545281 A  ERRORERROR'
2018-11-16 02:55:45 [DEBUG   ] Got command RPT from MCS: ref #521965
2018-11-16 02:55:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 02:55:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521965  77 58438 10545282 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 02:55:54 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-16 02:56:14 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-16 02:56:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:56:17 [WARNING ] (13, 1, 'bot')
2018-11-16 02:56:17 [WARNING ] (13, 1, 'bot')
2018-11-16 02:56:17 [WARNING ] (13, 1, 'bot')
2018-11-16 02:56:17 [WARNING ] (13, 1, 'bot')
2018-11-16 02:56:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:56:17 [DEBUG   ] Finished updating board flags in 1.420 seconds
2018-11-16 02:56:34 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2018-11-16 02:56:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 02:57:14 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 02:57:16 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:57:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 02:57:17 [WARNING ] (13, 1, 'bot')
2018-11-16 02:57:17 [WARNING ] (13, 1, 'bot')
2018-11-16 02:57:17 [WARNING ] (13, 1, 'bot')
2018-11-16 02:57:17 [WARNING ] (13, 1, 'bot')
2018-11-16 02:57:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:57:17 [DEBUG   ] Finished updating board flags in 1.384 seconds
2018-11-16 02:57:34 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 02:57:54 [DEBUG   ] Finished updating ant stats in 0.997 seconds
2018-11-16 02:58:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 02:58:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:58:17 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 02:58:17 [WARNING ] (13, 1, 'bot')
2018-11-16 02:58:17 [WARNING ] (13, 1, 'bot')
2018-11-16 02:58:17 [WARNING ] (13, 1, 'bot')
2018-11-16 02:58:17 [WARNING ] (13, 1, 'bot')
2018-11-16 02:58:17 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:58:17 [DEBUG   ] Finished updating board flags in 1.385 seconds
2018-11-16 02:58:30 [DEBUG   ] Got command RPT from MCS: ref #521987
2018-11-16 02:58:30 [DEBUG   ] summary = ERROR
2018-11-16 02:58:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521987  13 58438 10710217 A  ERRORERROR'
2018-11-16 02:58:30 [DEBUG   ] Got command RPT from MCS: ref #521988
2018-11-16 02:58:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 02:58:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521988  77 58438 10710409 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 02:58:30 [DEBUG   ] Got command RPT from MCS: ref #521989
2018-11-16 02:58:30 [DEBUG   ] summary = ERROR
2018-11-16 02:58:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521989  13 58438 10710613 A  ERRORERROR'
2018-11-16 02:58:30 [DEBUG   ] Got command RPT from MCS: ref #521991
2018-11-16 02:58:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 02:58:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521991  77 58438 10710817 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 02:58:31 [DEBUG   ] Got command RPT from MCS: ref #521993
2018-11-16 02:58:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 02:58:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   521993  12 58438 10711021 A  ERRORB˜™š'
2018-11-16 02:58:34 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 02:58:54 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 02:59:14 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-16 02:59:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 02:59:18 [WARNING ] (13, 1, 'bot')
2018-11-16 02:59:18 [WARNING ] (13, 1, 'bot')
2018-11-16 02:59:18 [WARNING ] (13, 1, 'bot')
2018-11-16 02:59:18 [WARNING ] (13, 1, 'bot')
2018-11-16 02:59:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 02:59:18 [DEBUG   ] Finished updating board flags in 2.037 seconds
2018-11-16 02:59:34 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 02:59:54 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 03:00:14 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 03:00:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:00:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 03:00:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-16 03:00:18 [WARNING ] (13, 1, 'bot')
2018-11-16 03:00:18 [WARNING ] (13, 1, 'bot')
2018-11-16 03:00:18 [WARNING ] (13, 1, 'bot')
2018-11-16 03:00:18 [WARNING ] (13, 1, 'bot')
2018-11-16 03:00:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:00:18 [DEBUG   ] Finished updating board flags in 1.994 seconds
2018-11-16 03:00:34 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-16 03:00:45 [DEBUG   ] Got command RPT from MCS: ref #522001
2018-11-16 03:00:45 [DEBUG   ] summary = ERROR
2018-11-16 03:00:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522001  13 58438 10845289 A  ERRORERROR'
2018-11-16 03:00:45 [DEBUG   ] Got command RPT from MCS: ref #522002
2018-11-16 03:00:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 03:00:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522002  77 58438 10845290 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 03:00:55 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-16 03:01:14 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-16 03:01:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:01:18 [WARNING ] (13, 1, 'bot')
2018-11-16 03:01:18 [WARNING ] (13, 1, 'bot')
2018-11-16 03:01:18 [WARNING ] (13, 1, 'bot')
2018-11-16 03:01:18 [WARNING ] (13, 1, 'bot')
2018-11-16 03:01:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:01:18 [DEBUG   ] Finished updating board flags in 1.791 seconds
2018-11-16 03:01:35 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-16 03:01:55 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-16 03:02:15 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-16 03:02:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:02:18 [WARNING ] (13, 1, 'bot')
2018-11-16 03:02:18 [WARNING ] (13, 1, 'bot')
2018-11-16 03:02:18 [WARNING ] (13, 1, 'bot')
2018-11-16 03:02:18 [WARNING ] (13, 1, 'bot')
2018-11-16 03:02:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:02:18 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-11-16 03:02:35 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-16 03:02:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 03:03:15 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 03:03:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-16 03:03:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:03:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 03:03:18 [WARNING ] (13, 1, 'bot')
2018-11-16 03:03:18 [WARNING ] (13, 1, 'bot')
2018-11-16 03:03:18 [WARNING ] (13, 1, 'bot')
2018-11-16 03:03:18 [WARNING ] (13, 1, 'bot')
2018-11-16 03:03:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:03:18 [DEBUG   ] Finished updating board flags in 1.604 seconds
2018-11-16 03:03:30 [DEBUG   ] Got command RPT from MCS: ref #522022
2018-11-16 03:03:30 [DEBUG   ] summary = ERROR
2018-11-16 03:03:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522022  13 58438 11010289 A  ERRORERROR'
2018-11-16 03:03:30 [DEBUG   ] Got command RPT from MCS: ref #522023
2018-11-16 03:03:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 03:03:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522023  77 58438 11010493 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 03:03:30 [DEBUG   ] Got command RPT from MCS: ref #522024
2018-11-16 03:03:30 [DEBUG   ] summary = ERROR
2018-11-16 03:03:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522024  13 58438 11010697 A  ERRORERROR'
2018-11-16 03:03:30 [DEBUG   ] Got command RPT from MCS: ref #522025
2018-11-16 03:03:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 03:03:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522025  77 58438 11010901 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 03:03:31 [DEBUG   ] Got command RPT from MCS: ref #522026
2018-11-16 03:03:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 03:03:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522026  12 58438 11011093 A  ERRORB˜™š'
2018-11-16 03:03:35 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 03:03:55 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-16 03:04:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 03:04:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:04:18 [WARNING ] (13, 1, 'bot')
2018-11-16 03:04:18 [WARNING ] (13, 1, 'bot')
2018-11-16 03:04:18 [WARNING ] (13, 1, 'bot')
2018-11-16 03:04:18 [WARNING ] (13, 1, 'bot')
2018-11-16 03:04:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:04:18 [DEBUG   ] Finished updating board flags in 1.599 seconds
2018-11-16 03:04:35 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 03:04:55 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 03:05:15 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-16 03:05:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 03:05:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:05:18 [WARNING ] (13, 1, 'bot')
2018-11-16 03:05:18 [WARNING ] (13, 1, 'bot')
2018-11-16 03:05:18 [WARNING ] (13, 1, 'bot')
2018-11-16 03:05:18 [WARNING ] (13, 1, 'bot')
2018-11-16 03:05:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:05:18 [DEBUG   ] Finished updating board flags in 1.416 seconds
2018-11-16 03:05:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 03:05:45 [DEBUG   ] Got command RPT from MCS: ref #522031
2018-11-16 03:05:45 [DEBUG   ] summary = ERROR
2018-11-16 03:05:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522031  13 58438 11145289 A  ERRORERROR'
2018-11-16 03:05:45 [DEBUG   ] Got command RPT from MCS: ref #522032
2018-11-16 03:05:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 03:05:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522032  77 58438 11145290 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 03:05:55 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-16 03:06:15 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-16 03:06:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 03:06:17 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:06:17 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa14, chip 4
2018-11-16 03:06:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 03:06:18 [WARNING ] (13, 1, 'bot')
2018-11-16 03:06:18 [WARNING ] (13, 1, 'bot')
2018-11-16 03:06:18 [WARNING ] (13, 1, 'bot')
2018-11-16 03:06:18 [WARNING ] (13, 1, 'bot')
2018-11-16 03:06:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:06:18 [DEBUG   ] Finished updating board flags in 1.381 seconds
2018-11-16 03:06:36 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-11-16 03:06:56 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-16 03:07:16 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 03:07:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:07:18 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 03:07:18 [WARNING ] (13, 1, 'bot')
2018-11-16 03:07:18 [WARNING ] (13, 1, 'bot')
2018-11-16 03:07:18 [WARNING ] (13, 1, 'bot')
2018-11-16 03:07:18 [WARNING ] (13, 1, 'bot')
2018-11-16 03:07:18 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:07:18 [DEBUG   ] Finished updating board flags in 1.377 seconds
2018-11-16 03:07:36 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-16 03:07:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 03:08:16 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 03:08:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:08:19 [WARNING ] (13, 1, 'bot')
2018-11-16 03:08:19 [WARNING ] (13, 1, 'bot')
2018-11-16 03:08:19 [WARNING ] (13, 1, 'bot')
2018-11-16 03:08:19 [WARNING ] (13, 1, 'bot')
2018-11-16 03:08:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:08:19 [DEBUG   ] Finished updating board flags in 2.037 seconds
2018-11-16 03:08:30 [DEBUG   ] Got command RPT from MCS: ref #522050
2018-11-16 03:08:30 [DEBUG   ] summary = ERROR
2018-11-16 03:08:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522050  13 58438 11310373 A  ERRORERROR'
2018-11-16 03:08:30 [DEBUG   ] Got command RPT from MCS: ref #522051
2018-11-16 03:08:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 03:08:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522051  77 58438 11310577 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 03:08:30 [DEBUG   ] Got command RPT from MCS: ref #522052
2018-11-16 03:08:30 [DEBUG   ] summary = ERROR
2018-11-16 03:08:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522052  13 58438 11310769 A  ERRORERROR'
2018-11-16 03:08:30 [DEBUG   ] Got command RPT from MCS: ref #522054
2018-11-16 03:08:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 03:08:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522054  77 58438 11310973 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 03:08:31 [DEBUG   ] Got command RPT from MCS: ref #522056
2018-11-16 03:08:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 03:08:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522056  12 58438 11311177 A  ERRORB—™š'
2018-11-16 03:08:36 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-11-16 03:08:56 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-16 03:09:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 03:09:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:09:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 03:09:19 [WARNING ] (13, 1, 'bot')
2018-11-16 03:09:19 [WARNING ] (13, 1, 'bot')
2018-11-16 03:09:19 [WARNING ] (13, 1, 'bot')
2018-11-16 03:09:19 [WARNING ] (13, 1, 'bot')
2018-11-16 03:09:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:09:19 [DEBUG   ] Finished updating board flags in 1.992 seconds
2018-11-16 03:09:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 03:09:56 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 03:10:16 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-16 03:10:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:10:19 [WARNING ] (13, 1, 'bot')
2018-11-16 03:10:19 [WARNING ] (13, 1, 'bot')
2018-11-16 03:10:19 [WARNING ] (13, 1, 'bot')
2018-11-16 03:10:19 [WARNING ] (13, 1, 'bot')
2018-11-16 03:10:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:10:19 [DEBUG   ] Finished updating board flags in 1.826 seconds
2018-11-16 03:10:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 03:10:45 [DEBUG   ] Got command RPT from MCS: ref #522064
2018-11-16 03:10:45 [DEBUG   ] summary = ERROR
2018-11-16 03:10:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522064  13 58438 11445281 A  ERRORERROR'
2018-11-16 03:10:45 [DEBUG   ] Got command RPT from MCS: ref #522065
2018-11-16 03:10:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 03:10:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522065  77 58438 11445282 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 03:10:56 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 03:11:16 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 03:11:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-16 03:11:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:11:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-16 03:11:19 [WARNING ] (13, 1, 'bot')
2018-11-16 03:11:19 [WARNING ] (13, 1, 'bot')
2018-11-16 03:11:19 [WARNING ] (13, 1, 'bot')
2018-11-16 03:11:19 [WARNING ] (13, 1, 'bot')
2018-11-16 03:11:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:11:19 [DEBUG   ] Finished updating board flags in 1.777 seconds
2018-11-16 03:11:36 [DEBUG   ] Finished updating ant stats in 0.587 seconds
2018-11-16 03:11:56 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-16 03:12:16 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-16 03:12:18 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 03:12:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:12:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-16 03:12:19 [WARNING ] (13, 1, 'bot')
2018-11-16 03:12:19 [WARNING ] (13, 1, 'bot')
2018-11-16 03:12:19 [WARNING ] (13, 1, 'bot')
2018-11-16 03:12:19 [WARNING ] (13, 1, 'bot')
2018-11-16 03:12:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:12:19 [DEBUG   ] Finished updating board flags in 1.616 seconds
2018-11-16 03:12:37 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-16 03:12:57 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-16 03:13:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 03:13:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:13:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-16 03:13:19 [WARNING ] (13, 1, 'bot')
2018-11-16 03:13:19 [WARNING ] (13, 1, 'bot')
2018-11-16 03:13:19 [WARNING ] (13, 1, 'bot')
2018-11-16 03:13:19 [WARNING ] (13, 1, 'bot')
2018-11-16 03:13:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:13:19 [DEBUG   ] Finished updating board flags in 1.588 seconds
2018-11-16 03:13:30 [DEBUG   ] Got command RPT from MCS: ref #522085
2018-11-16 03:13:30 [DEBUG   ] summary = ERROR
2018-11-16 03:13:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522085  13 58438 11610453 A  ERRORERROR'
2018-11-16 03:13:30 [DEBUG   ] Got command RPT from MCS: ref #522086
2018-11-16 03:13:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 03:13:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522086  77 58438 11610657 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 03:13:30 [DEBUG   ] Got command RPT from MCS: ref #522087
2018-11-16 03:13:30 [DEBUG   ] summary = ERROR
2018-11-16 03:13:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522087  13 58438 11610861 A  ERRORERROR'
2018-11-16 03:13:31 [DEBUG   ] Got command RPT from MCS: ref #522088
2018-11-16 03:13:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 03:13:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522088  77 58438 11611053 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 03:13:31 [DEBUG   ] Got command RPT from MCS: ref #522089
2018-11-16 03:13:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 03:13:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522089  12 58438 11611257 A  ERRORB˜™š'
2018-11-16 03:13:37 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-16 03:13:57 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-16 03:14:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 03:14:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:14:19 [WARNING ] (13, 1, 'bot')
2018-11-16 03:14:19 [WARNING ] (13, 1, 'bot')
2018-11-16 03:14:19 [WARNING ] (13, 1, 'bot')
2018-11-16 03:14:19 [WARNING ] (13, 1, 'bot')
2018-11-16 03:14:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:14:19 [DEBUG   ] Finished updating board flags in 1.421 seconds
2018-11-16 03:14:37 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 03:14:57 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-11-16 03:15:17 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-16 03:15:18 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:15:19 [WARNING ] (13, 1, 'bot')
2018-11-16 03:15:19 [WARNING ] (13, 1, 'bot')
2018-11-16 03:15:19 [WARNING ] (13, 1, 'bot')
2018-11-16 03:15:19 [WARNING ] (13, 1, 'bot')
2018-11-16 03:15:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:15:19 [DEBUG   ] Finished updating board flags in 1.387 seconds
2018-11-16 03:15:37 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-16 03:15:45 [DEBUG   ] Got command RPT from MCS: ref #522094
2018-11-16 03:15:45 [DEBUG   ] summary = ERROR
2018-11-16 03:15:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522094  13 58438 11745293 A  ERRORERROR'
2018-11-16 03:15:45 [DEBUG   ] Got command RPT from MCS: ref #522095
2018-11-16 03:15:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 03:15:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522095  77 58438 11745294 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 03:15:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 03:16:17 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 03:16:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:16:19 [WARNING ] (13, 1, 'bot')
2018-11-16 03:16:19 [WARNING ] (13, 1, 'bot')
2018-11-16 03:16:19 [WARNING ] (13, 1, 'bot')
2018-11-16 03:16:19 [WARNING ] (13, 1, 'bot')
2018-11-16 03:16:19 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:16:19 [DEBUG   ] Finished updating board flags in 1.377 seconds
2018-11-16 03:16:37 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-16 03:16:58 [DEBUG   ] Finished updating ant stats in 1.404 seconds
2018-11-16 03:17:17 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-16 03:17:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:17:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:17:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:17:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:17:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:17:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:17:20 [DEBUG   ] Finished updating board flags in 2.045 seconds
2018-11-16 03:17:38 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2018-11-16 03:17:57 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-16 03:18:18 [DEBUG   ] Finished updating ant stats in 1.404 seconds
2018-11-16 03:18:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:18:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 03:18:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:18:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:18:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:18:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:18:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:18:20 [DEBUG   ] Finished updating board flags in 1.982 seconds
2018-11-16 03:18:30 [DEBUG   ] Got command RPT from MCS: ref #522117
2018-11-16 03:18:30 [DEBUG   ] summary = ERROR
2018-11-16 03:18:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522117  13 58438 11910533 A  ERRORERROR'
2018-11-16 03:18:30 [DEBUG   ] Got command RPT from MCS: ref #522118
2018-11-16 03:18:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 03:18:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522118  77 58438 11910737 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 03:18:30 [DEBUG   ] Got command RPT from MCS: ref #522119
2018-11-16 03:18:30 [DEBUG   ] summary = ERROR
2018-11-16 03:18:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522119  13 58438 11910941 A  ERRORERROR'
2018-11-16 03:18:31 [DEBUG   ] Got command RPT from MCS: ref #522121
2018-11-16 03:18:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 03:18:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522121  77 58438 11911133 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 03:18:31 [DEBUG   ] Got command RPT from MCS: ref #522122
2018-11-16 03:18:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 03:18:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522122  12 58438 11911337 A  ERRORB˜™š'
2018-11-16 03:18:37 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-16 03:18:58 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2018-11-16 03:19:17 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-16 03:19:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:19:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:19:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:19:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:19:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:19:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:19:20 [DEBUG   ] Finished updating board flags in 1.845 seconds
2018-11-16 03:19:38 [DEBUG   ] Finished updating ant stats in 1.403 seconds
2018-11-16 03:19:57 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-16 03:20:18 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2018-11-16 03:20:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:20:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:20:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:20:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:20:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:20:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:20:20 [DEBUG   ] Finished updating board flags in 1.811 seconds
2018-11-16 03:20:37 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-16 03:20:45 [DEBUG   ] Got command RPT from MCS: ref #522131
2018-11-16 03:20:45 [DEBUG   ] summary = ERROR
2018-11-16 03:20:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522131  13 58438 12045285 A  ERRORERROR'
2018-11-16 03:20:45 [DEBUG   ] Got command RPT from MCS: ref #522132
2018-11-16 03:20:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 03:20:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522132  77 58438 12045286 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 03:20:58 [DEBUG   ] Finished updating ant stats in 1.403 seconds
2018-11-16 03:21:17 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 03:21:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:21:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2018-11-16 03:21:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:21:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:21:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:21:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:21:20 [WARNING ] (25, 5, 'bot')
2018-11-16 03:21:20 [WARNING ] (25, 5, 'bot')
2018-11-16 03:21:20 [WARNING ] (25, 5, 'bot')
2018-11-16 03:21:20 [WARNING ] (25, 5, 'bot')
2018-11-16 03:21:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:21:20 [DEBUG   ] Finished updating board flags in 1.900 seconds
2018-11-16 03:21:38 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-11-16 03:21:57 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-16 03:22:18 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-16 03:22:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:22:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:22:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:22:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:22:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:22:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:22:20 [DEBUG   ] Finished updating board flags in 1.811 seconds
2018-11-16 03:22:38 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-16 03:22:58 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-11-16 03:23:18 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 03:23:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:23:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:23:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:23:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:23:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:23:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:23:20 [DEBUG   ] Finished updating board flags in 1.647 seconds
2018-11-16 03:23:30 [DEBUG   ] Got command RPT from MCS: ref #522148
2018-11-16 03:23:30 [DEBUG   ] summary = ERROR
2018-11-16 03:23:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522148  13 58438 12210613 A  ERRORERROR'
2018-11-16 03:23:30 [DEBUG   ] Got command RPT from MCS: ref #522149
2018-11-16 03:23:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 03:23:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522149  77 58438 12210817 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 03:23:31 [DEBUG   ] Got command RPT from MCS: ref #522150
2018-11-16 03:23:31 [DEBUG   ] summary = ERROR
2018-11-16 03:23:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522150  13 58438 12211021 A  ERRORERROR'
2018-11-16 03:23:31 [DEBUG   ] Got command RPT from MCS: ref #522151
2018-11-16 03:23:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 03:23:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522151  77 58438 12211213 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 03:23:31 [DEBUG   ] Got command RPT from MCS: ref #522152
2018-11-16 03:23:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 03:23:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522152  12 58438 12211417 A  ERRORB˜™š'
2018-11-16 03:23:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 03:23:58 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 03:24:18 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-16 03:24:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:24:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:24:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:24:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:24:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:24:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:24:20 [DEBUG   ] Finished updating board flags in 1.620 seconds
2018-11-16 03:24:38 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-16 03:24:58 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 03:25:18 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 03:25:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 03:25:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:25:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:25:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:25:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:25:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:25:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:25:20 [DEBUG   ] Finished updating board flags in 1.604 seconds
2018-11-16 03:25:38 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-16 03:25:45 [DEBUG   ] Got command RPT from MCS: ref #522157
2018-11-16 03:25:45 [DEBUG   ] summary = ERROR
2018-11-16 03:25:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522157  13 58438 12345285 A  ERRORERROR'
2018-11-16 03:25:45 [DEBUG   ] Got command RPT from MCS: ref #522158
2018-11-16 03:25:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 03:25:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522158  77 58438 12345286 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 03:25:58 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-16 03:26:18 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-16 03:26:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 03:26:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:26:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:26:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:26:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:26:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:26:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:26:20 [DEBUG   ] Finished updating board flags in 1.575 seconds
2018-11-16 03:26:39 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-16 03:26:59 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-16 03:27:19 [DEBUG   ] Finished updating ant stats in 1.255 seconds
2018-11-16 03:27:19 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-16 03:27:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:27:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-16 03:27:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:27:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:27:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:27:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:27:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:27:20 [DEBUG   ] Finished updating board flags in 1.442 seconds
2018-11-16 03:27:39 [DEBUG   ] Finished updating ant stats in 1.151 seconds
2018-11-16 03:27:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 03:28:19 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 03:28:19 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:28:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 03:28:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:28:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:28:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:28:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:28:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:28:20 [DEBUG   ] Finished updating board flags in 1.429 seconds
2018-11-16 03:28:30 [DEBUG   ] Got command RPT from MCS: ref #522180
2018-11-16 03:28:30 [DEBUG   ] summary = ERROR
2018-11-16 03:28:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522180  13 58438 12510697 A  ERRORERROR'
2018-11-16 03:28:30 [DEBUG   ] Got command RPT from MCS: ref #522181
2018-11-16 03:28:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 03:28:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522181  77 58438 12510889 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 03:28:31 [DEBUG   ] Got command RPT from MCS: ref #522182
2018-11-16 03:28:31 [DEBUG   ] summary = ERROR
2018-11-16 03:28:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522182  13 58438 12511093 A  ERRORERROR'
2018-11-16 03:28:31 [DEBUG   ] Got command RPT from MCS: ref #522184
2018-11-16 03:28:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 03:28:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522184  77 58438 12511297 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 03:28:31 [DEBUG   ] Got command RPT from MCS: ref #522185
2018-11-16 03:28:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 03:28:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522185  12 58438 12511501 A  ERRORB˜™š'
2018-11-16 03:28:39 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 03:28:59 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-16 03:29:19 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 03:29:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:29:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:29:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:29:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:29:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:29:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:29:20 [DEBUG   ] Finished updating board flags in 1.433 seconds
2018-11-16 03:29:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 03:29:59 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 03:30:19 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-16 03:30:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:30:20 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 03:30:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:30:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:30:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:30:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:30:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:30:20 [DEBUG   ] Finished updating board flags in 1.443 seconds
2018-11-16 03:30:39 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 03:30:45 [DEBUG   ] Got command RPT from MCS: ref #522194
2018-11-16 03:30:45 [DEBUG   ] summary = ERROR
2018-11-16 03:30:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522194  13 58438 12645289 A  ERRORERROR'
2018-11-16 03:30:45 [DEBUG   ] Got command RPT from MCS: ref #522195
2018-11-16 03:30:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 03:30:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522195  77 58438 12645290 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 03:30:59 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 03:31:19 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 03:31:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:31:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:31:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:31:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:31:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:31:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:31:20 [DEBUG   ] Finished updating board flags in 1.433 seconds
2018-11-16 03:31:39 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-16 03:32:00 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-16 03:32:19 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 03:32:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:32:20 [DEBUG   ] Finished updating ant stats in 1.254 seconds
2018-11-16 03:32:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:32:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:32:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:32:20 [WARNING ] (13, 1, 'bot')
2018-11-16 03:32:20 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:32:20 [DEBUG   ] Finished updating board flags in 1.492 seconds
2018-11-16 03:32:40 [DEBUG   ] Finished updating ant stats in 1.155 seconds
2018-11-16 03:33:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 03:33:20 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 03:33:20 [DEBUG   ] Finished updating ant stats in 1.060 seconds
2018-11-16 03:33:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:33:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 03:33:21 [WARNING ] (13, 1, 'bot')
2018-11-16 03:33:21 [WARNING ] (13, 1, 'bot')
2018-11-16 03:33:21 [WARNING ] (13, 1, 'bot')
2018-11-16 03:33:21 [WARNING ] (13, 1, 'bot')
2018-11-16 03:33:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:33:21 [DEBUG   ] Finished updating board flags in 2.157 seconds
2018-11-16 03:33:30 [DEBUG   ] Got command RPT from MCS: ref #522215
2018-11-16 03:33:30 [DEBUG   ] summary = ERROR
2018-11-16 03:33:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522215  13 58438 12810782 A  ERRORERROR'
2018-11-16 03:33:30 [DEBUG   ] Got command RPT from MCS: ref #522216
2018-11-16 03:33:30 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 03:33:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522216  77 58438 12810973 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 03:33:31 [DEBUG   ] Got command RPT from MCS: ref #522217
2018-11-16 03:33:31 [DEBUG   ] summary = ERROR
2018-11-16 03:33:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522217  13 58438 12811177 A  ERRORERROR'
2018-11-16 03:33:31 [DEBUG   ] Got command RPT from MCS: ref #522218
2018-11-16 03:33:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 03:33:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522218  77 58438 12811381 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 03:33:31 [DEBUG   ] Got command RPT from MCS: ref #522219
2018-11-16 03:33:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 03:33:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522219  12 58438 12811573 A  ERRORB—™š'
2018-11-16 03:33:40 [DEBUG   ] Finished updating ant stats in 0.944 seconds
2018-11-16 03:34:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 03:34:20 [DEBUG   ] Finished updating ant stats in 0.849 seconds
2018-11-16 03:34:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:34:21 [WARNING ] (13, 1, 'bot')
2018-11-16 03:34:21 [WARNING ] (13, 1, 'bot')
2018-11-16 03:34:21 [WARNING ] (13, 1, 'bot')
2018-11-16 03:34:21 [WARNING ] (13, 1, 'bot')
2018-11-16 03:34:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:34:21 [DEBUG   ] Finished updating board flags in 1.987 seconds
2018-11-16 03:34:40 [DEBUG   ] Finished updating ant stats in 0.757 seconds
2018-11-16 03:35:00 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-16 03:35:20 [DEBUG   ] Finished updating ant stats in 0.647 seconds
2018-11-16 03:35:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:35:21 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 03:35:21 [WARNING ] (13, 1, 'bot')
2018-11-16 03:35:21 [WARNING ] (13, 1, 'bot')
2018-11-16 03:35:21 [WARNING ] (13, 1, 'bot')
2018-11-16 03:35:21 [WARNING ] (13, 1, 'bot')
2018-11-16 03:35:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:35:21 [DEBUG   ] Finished updating board flags in 1.811 seconds
2018-11-16 03:35:40 [DEBUG   ] Finished updating ant stats in 0.554 seconds
2018-11-16 03:35:45 [DEBUG   ] Got command RPT from MCS: ref #522224
2018-11-16 03:35:45 [DEBUG   ] summary = ERROR
2018-11-16 03:35:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522224  13 58438 12945297 A  ERRORERROR'
2018-11-16 03:35:45 [DEBUG   ] Got command RPT from MCS: ref #522225
2018-11-16 03:35:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 03:35:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522225  77 58438 12945298 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 03:36:01 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-16 03:36:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:36:21 [DEBUG   ] Finished updating ant stats in 1.252 seconds
2018-11-16 03:36:21 [WARNING ] (13, 1, 'bot')
2018-11-16 03:36:21 [WARNING ] (13, 1, 'bot')
2018-11-16 03:36:21 [WARNING ] (13, 1, 'bot')
2018-11-16 03:36:21 [WARNING ] (13, 1, 'bot')
2018-11-16 03:36:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:36:21 [DEBUG   ] Finished updating board flags in 1.850 seconds
2018-11-16 03:36:41 [DEBUG   ] Finished updating ant stats in 1.154 seconds
2018-11-16 03:37:01 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-11-16 03:37:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:37:21 [DEBUG   ] Finished updating ant stats in 1.043 seconds
2018-11-16 03:37:21 [WARNING ] (13, 1, 'bot')
2018-11-16 03:37:21 [WARNING ] (13, 1, 'bot')
2018-11-16 03:37:21 [WARNING ] (13, 1, 'bot')
2018-11-16 03:37:21 [WARNING ] (13, 1, 'bot')
2018-11-16 03:37:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:37:21 [DEBUG   ] Finished updating board flags in 1.819 seconds
2018-11-16 03:37:41 [DEBUG   ] Finished updating ant stats in 0.959 seconds
2018-11-16 03:38:01 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 03:38:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:38:21 [DEBUG   ] Finished updating ant stats in 0.845 seconds
2018-11-16 03:38:21 [WARNING ] (13, 1, 'bot')
2018-11-16 03:38:21 [WARNING ] (13, 1, 'bot')
2018-11-16 03:38:21 [WARNING ] (13, 1, 'bot')
2018-11-16 03:38:21 [WARNING ] (13, 1, 'bot')
2018-11-16 03:38:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:38:21 [DEBUG   ] Finished updating board flags in 1.778 seconds
2018-11-16 03:38:30 [DEBUG   ] Got command RPT from MCS: ref #522243
2018-11-16 03:38:30 [DEBUG   ] summary = ERROR
2018-11-16 03:38:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522243  13 58438 13110857 A  ERRORERROR'
2018-11-16 03:38:31 [DEBUG   ] Got command RPT from MCS: ref #522244
2018-11-16 03:38:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 03:38:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522244  77 58438 13111050 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 03:38:31 [DEBUG   ] Got command RPT from MCS: ref #522245
2018-11-16 03:38:31 [DEBUG   ] summary = ERROR
2018-11-16 03:38:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522245  13 58438 13111253 A  ERRORERROR'
2018-11-16 03:38:31 [DEBUG   ] Got command RPT from MCS: ref #522247
2018-11-16 03:38:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 03:38:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522247  77 58438 13111457 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 03:38:31 [DEBUG   ] Got command RPT from MCS: ref #522248
2018-11-16 03:38:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 03:38:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522248  12 58438 13111661 A  ERRORB™™š'
2018-11-16 03:38:41 [DEBUG   ] Finished updating ant stats in 0.760 seconds
2018-11-16 03:39:01 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-11-16 03:39:20 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 03:39:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:39:21 [WARNING ] MonitorFlags: VCCINT 0.979 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 03:39:21 [DEBUG   ] Finished updating ant stats in 0.641 seconds
2018-11-16 03:39:21 [WARNING ] (13, 1, 'bot')
2018-11-16 03:39:21 [WARNING ] (13, 1, 'bot')
2018-11-16 03:39:21 [WARNING ] (13, 1, 'bot')
2018-11-16 03:39:21 [WARNING ] (13, 1, 'bot')
2018-11-16 03:39:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:39:21 [DEBUG   ] Finished updating board flags in 1.630 seconds
2018-11-16 03:39:41 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2018-11-16 03:40:02 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-16 03:40:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:40:21 [WARNING ] (13, 1, 'bot')
2018-11-16 03:40:21 [WARNING ] (13, 1, 'bot')
2018-11-16 03:40:21 [WARNING ] (13, 1, 'bot')
2018-11-16 03:40:21 [WARNING ] (13, 1, 'bot')
2018-11-16 03:40:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:40:21 [DEBUG   ] Finished updating board flags in 1.562 seconds
2018-11-16 03:40:22 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-16 03:40:42 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-16 03:40:45 [DEBUG   ] Got command RPT from MCS: ref #522257
2018-11-16 03:40:45 [DEBUG   ] summary = ERROR
2018-11-16 03:40:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522257  13 58438 13245297 A  ERRORERROR'
2018-11-16 03:40:45 [DEBUG   ] Got command RPT from MCS: ref #522258
2018-11-16 03:40:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 03:40:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522258  77 58438 13245298 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 03:41:02 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-16 03:41:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:41:21 [WARNING ] (13, 1, 'bot')
2018-11-16 03:41:21 [WARNING ] (13, 1, 'bot')
2018-11-16 03:41:21 [WARNING ] (13, 1, 'bot')
2018-11-16 03:41:21 [WARNING ] (13, 1, 'bot')
2018-11-16 03:41:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:41:21 [DEBUG   ] Finished updating board flags in 1.421 seconds
2018-11-16 03:41:22 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2018-11-16 03:41:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 03:42:02 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 03:42:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:42:21 [WARNING ] (13, 1, 'bot')
2018-11-16 03:42:21 [WARNING ] (13, 1, 'bot')
2018-11-16 03:42:21 [WARNING ] (13, 1, 'bot')
2018-11-16 03:42:21 [WARNING ] (13, 1, 'bot')
2018-11-16 03:42:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:42:21 [DEBUG   ] Finished updating board flags in 1.443 seconds
2018-11-16 03:42:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 03:42:42 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 03:43:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 03:43:20 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:43:21 [WARNING ] (13, 1, 'bot')
2018-11-16 03:43:21 [WARNING ] (13, 1, 'bot')
2018-11-16 03:43:21 [WARNING ] (13, 1, 'bot')
2018-11-16 03:43:21 [WARNING ] (13, 1, 'bot')
2018-11-16 03:43:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:43:21 [DEBUG   ] Finished updating board flags in 1.466 seconds
2018-11-16 03:43:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 03:43:30 [DEBUG   ] Got command RPT from MCS: ref #522278
2018-11-16 03:43:30 [DEBUG   ] summary = ERROR
2018-11-16 03:43:30 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522278  13 58438 13410937 A  ERRORERROR'
2018-11-16 03:43:31 [DEBUG   ] Got command RPT from MCS: ref #522279
2018-11-16 03:43:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 03:43:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522279  77 58438 13411129 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 03:43:31 [DEBUG   ] Got command RPT from MCS: ref #522280
2018-11-16 03:43:31 [DEBUG   ] summary = ERROR
2018-11-16 03:43:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522280  13 58438 13411333 A  ERRORERROR'
2018-11-16 03:43:31 [DEBUG   ] Got command RPT from MCS: ref #522281
2018-11-16 03:43:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 03:43:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522281  77 58438 13411537 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 03:43:31 [DEBUG   ] Got command RPT from MCS: ref #522282
2018-11-16 03:43:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 03:43:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522282  12 58438 13411741 A  ERRORB˜™š'
2018-11-16 03:43:42 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 03:44:02 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-16 03:44:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:44:21 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 03:44:21 [WARNING ] (13, 1, 'bot')
2018-11-16 03:44:21 [WARNING ] (13, 1, 'bot')
2018-11-16 03:44:21 [WARNING ] (13, 1, 'bot')
2018-11-16 03:44:21 [WARNING ] (13, 1, 'bot')
2018-11-16 03:44:21 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:44:21 [DEBUG   ] Finished updating board flags in 1.515 seconds
2018-11-16 03:44:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 03:44:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 03:45:02 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 03:45:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:45:22 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 03:45:22 [DEBUG   ] Finished updating ant stats in 0.842 seconds
2018-11-16 03:45:22 [WARNING ] (13, 1, 'bot')
2018-11-16 03:45:22 [WARNING ] (13, 1, 'bot')
2018-11-16 03:45:22 [WARNING ] (13, 1, 'bot')
2018-11-16 03:45:22 [WARNING ] (13, 1, 'bot')
2018-11-16 03:45:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:45:22 [DEBUG   ] Finished updating board flags in 2.220 seconds
2018-11-16 03:45:42 [DEBUG   ] Finished updating ant stats in 0.758 seconds
2018-11-16 03:45:45 [DEBUG   ] Got command RPT from MCS: ref #522287
2018-11-16 03:45:45 [DEBUG   ] summary = ERROR
2018-11-16 03:45:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522287  13 58438 13545289 A  ERRORERROR'
2018-11-16 03:45:45 [DEBUG   ] Got command RPT from MCS: ref #522288
2018-11-16 03:45:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 03:45:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522288  77 58438 13545290 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 03:46:02 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 03:46:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:46:22 [DEBUG   ] Finished updating ant stats in 0.643 seconds
2018-11-16 03:46:22 [WARNING ] (13, 1, 'bot')
2018-11-16 03:46:22 [WARNING ] (13, 1, 'bot')
2018-11-16 03:46:22 [WARNING ] (13, 1, 'bot')
2018-11-16 03:46:22 [WARNING ] (13, 1, 'bot')
2018-11-16 03:46:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:46:22 [DEBUG   ] Finished updating board flags in 2.175 seconds
2018-11-16 03:46:42 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2018-11-16 03:47:03 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-16 03:47:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:47:22 [WARNING ] (13, 1, 'bot')
2018-11-16 03:47:22 [WARNING ] (13, 1, 'bot')
2018-11-16 03:47:22 [WARNING ] (13, 1, 'bot')
2018-11-16 03:47:22 [WARNING ] (13, 1, 'bot')
2018-11-16 03:47:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:47:22 [DEBUG   ] Finished updating board flags in 2.009 seconds
2018-11-16 03:47:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 03:47:43 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 03:48:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 03:48:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:48:22 [WARNING ] (13, 1, 'bot')
2018-11-16 03:48:22 [WARNING ] (13, 1, 'bot')
2018-11-16 03:48:22 [WARNING ] (13, 1, 'bot')
2018-11-16 03:48:22 [WARNING ] (13, 1, 'bot')
2018-11-16 03:48:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:48:22 [DEBUG   ] Finished updating board flags in 1.996 seconds
2018-11-16 03:48:23 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 03:48:31 [DEBUG   ] Got command RPT from MCS: ref #522310
2018-11-16 03:48:31 [DEBUG   ] summary = ERROR
2018-11-16 03:48:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522310  13 58438 13711013 A  ERRORERROR'
2018-11-16 03:48:31 [DEBUG   ] Got command RPT from MCS: ref #522311
2018-11-16 03:48:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 03:48:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522311  77 58438 13711217 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 03:48:31 [DEBUG   ] Got command RPT from MCS: ref #522312
2018-11-16 03:48:31 [DEBUG   ] summary = ERROR
2018-11-16 03:48:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522312  13 58438 13711421 A  ERRORERROR'
2018-11-16 03:48:31 [DEBUG   ] Got command RPT from MCS: ref #522314
2018-11-16 03:48:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 03:48:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522314  77 58438 13711613 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 03:48:31 [DEBUG   ] Got command RPT from MCS: ref #522316
2018-11-16 03:48:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 03:48:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522316  12 58438 13711817 A  ERRORB—™š'
2018-11-16 03:48:43 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 03:49:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 03:49:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:49:22 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 03:49:22 [WARNING ] (13, 1, 'bot')
2018-11-16 03:49:22 [WARNING ] (13, 1, 'bot')
2018-11-16 03:49:22 [WARNING ] (13, 1, 'bot')
2018-11-16 03:49:22 [WARNING ] (13, 1, 'bot')
2018-11-16 03:49:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:49:22 [DEBUG   ] Finished updating board flags in 1.832 seconds
2018-11-16 03:49:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 03:49:43 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-16 03:50:03 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-16 03:50:21 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 03:50:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:50:22 [WARNING ] (13, 1, 'bot')
2018-11-16 03:50:22 [WARNING ] (13, 1, 'bot')
2018-11-16 03:50:22 [WARNING ] (13, 1, 'bot')
2018-11-16 03:50:22 [WARNING ] (13, 1, 'bot')
2018-11-16 03:50:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:50:22 [DEBUG   ] Finished updating board flags in 1.726 seconds
2018-11-16 03:50:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 03:50:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 03:50:45 [DEBUG   ] Got command RPT from MCS: ref #522324
2018-11-16 03:50:45 [DEBUG   ] summary = ERROR
2018-11-16 03:50:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522324  13 58438 13845297 A  ERRORERROR'
2018-11-16 03:50:45 [DEBUG   ] Got command RPT from MCS: ref #522325
2018-11-16 03:50:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 03:50:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522325  77 58438 13845298 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 03:51:03 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 03:51:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:51:22 [WARNING ] (13, 1, 'bot')
2018-11-16 03:51:22 [WARNING ] (13, 1, 'bot')
2018-11-16 03:51:22 [WARNING ] (13, 1, 'bot')
2018-11-16 03:51:22 [WARNING ] (13, 1, 'bot')
2018-11-16 03:51:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:51:22 [DEBUG   ] Finished updating board flags in 1.619 seconds
2018-11-16 03:51:23 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-16 03:51:43 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 03:52:03 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 03:52:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:52:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 03:52:22 [WARNING ] (13, 1, 'bot')
2018-11-16 03:52:22 [WARNING ] (13, 1, 'bot')
2018-11-16 03:52:22 [WARNING ] (13, 1, 'bot')
2018-11-16 03:52:22 [WARNING ] (13, 1, 'bot')
2018-11-16 03:52:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:52:22 [DEBUG   ] Finished updating board flags in 1.573 seconds
2018-11-16 03:52:23 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-16 03:52:43 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-16 03:53:03 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 03:53:21 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:53:22 [WARNING ] (13, 1, 'bot')
2018-11-16 03:53:22 [WARNING ] (13, 1, 'bot')
2018-11-16 03:53:22 [WARNING ] (13, 1, 'bot')
2018-11-16 03:53:22 [WARNING ] (13, 1, 'bot')
2018-11-16 03:53:22 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:53:22 [DEBUG   ] Finished updating board flags in 1.398 seconds
2018-11-16 03:53:23 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-16 03:53:31 [DEBUG   ] Got command RPT from MCS: ref #522341
2018-11-16 03:53:31 [DEBUG   ] summary = ERROR
2018-11-16 03:53:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522341  13 58438 14011093 A  ERRORERROR'
2018-11-16 03:53:31 [DEBUG   ] Got command RPT from MCS: ref #522342
2018-11-16 03:53:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 03:53:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522342  77 58438 14011297 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 03:53:31 [DEBUG   ] Got command RPT from MCS: ref #522343
2018-11-16 03:53:31 [DEBUG   ] summary = ERROR
2018-11-16 03:53:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522343  13 58438 14011501 A  ERRORERROR'
2018-11-16 03:53:31 [DEBUG   ] Got command RPT from MCS: ref #522344
2018-11-16 03:53:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 03:53:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522344  77 58438 14011693 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 03:53:31 [DEBUG   ] Got command RPT from MCS: ref #522345
2018-11-16 03:53:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 03:53:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522345  12 58438 14011897 A  ERRORB˜™š'
2018-11-16 03:53:44 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-16 03:54:04 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-16 03:54:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:54:23 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 03:54:23 [WARNING ] (13, 1, 'bot')
2018-11-16 03:54:23 [WARNING ] (13, 1, 'bot')
2018-11-16 03:54:23 [WARNING ] (13, 1, 'bot')
2018-11-16 03:54:23 [WARNING ] (13, 1, 'bot')
2018-11-16 03:54:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:54:23 [DEBUG   ] Finished updating board flags in 2.231 seconds
2018-11-16 03:54:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 03:54:44 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-16 03:55:04 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-16 03:55:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:55:23 [WARNING ] (13, 1, 'bot')
2018-11-16 03:55:23 [WARNING ] (13, 1, 'bot')
2018-11-16 03:55:23 [WARNING ] (13, 1, 'bot')
2018-11-16 03:55:23 [WARNING ] (13, 1, 'bot')
2018-11-16 03:55:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:55:23 [DEBUG   ] Finished updating board flags in 2.202 seconds
2018-11-16 03:55:24 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 03:55:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 03:55:45 [DEBUG   ] Got command RPT from MCS: ref #522350
2018-11-16 03:55:45 [DEBUG   ] summary = ERROR
2018-11-16 03:55:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522350  13 58438 14145301 A  ERRORERROR'
2018-11-16 03:55:45 [DEBUG   ] Got command RPT from MCS: ref #522351
2018-11-16 03:55:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 03:55:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522351  77 58438 14145302 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 03:56:04 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 03:56:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:56:23 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 03:56:23 [WARNING ] (13, 1, 'bot')
2018-11-16 03:56:23 [WARNING ] (13, 1, 'bot')
2018-11-16 03:56:23 [WARNING ] (13, 1, 'bot')
2018-11-16 03:56:23 [WARNING ] (13, 1, 'bot')
2018-11-16 03:56:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:56:23 [DEBUG   ] Finished updating board flags in 2.196 seconds
2018-11-16 03:56:24 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-16 03:56:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 03:57:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 03:57:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:57:23 [WARNING ] (13, 1, 'bot')
2018-11-16 03:57:23 [WARNING ] (13, 1, 'bot')
2018-11-16 03:57:23 [WARNING ] (13, 1, 'bot')
2018-11-16 03:57:23 [WARNING ] (13, 1, 'bot')
2018-11-16 03:57:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:57:23 [DEBUG   ] Finished updating board flags in 1.985 seconds
2018-11-16 03:57:24 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-16 03:57:44 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-16 03:58:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 03:58:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:58:23 [WARNING ] (13, 1, 'bot')
2018-11-16 03:58:23 [WARNING ] (13, 1, 'bot')
2018-11-16 03:58:23 [WARNING ] (13, 1, 'bot')
2018-11-16 03:58:23 [WARNING ] (13, 1, 'bot')
2018-11-16 03:58:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:58:23 [DEBUG   ] Finished updating board flags in 1.792 seconds
2018-11-16 03:58:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 03:58:31 [DEBUG   ] Got command RPT from MCS: ref #522373
2018-11-16 03:58:31 [DEBUG   ] summary = ERROR
2018-11-16 03:58:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522373  13 58438 14311173 A  ERRORERROR'
2018-11-16 03:58:31 [DEBUG   ] Got command RPT from MCS: ref #522374
2018-11-16 03:58:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 03:58:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522374  77 58438 14311377 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 03:58:31 [DEBUG   ] Got command RPT from MCS: ref #522375
2018-11-16 03:58:31 [DEBUG   ] summary = ERROR
2018-11-16 03:58:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522375  13 58438 14311581 A  ERRORERROR'
2018-11-16 03:58:31 [DEBUG   ] Got command RPT from MCS: ref #522377
2018-11-16 03:58:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 03:58:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522377  77 58438 14311773 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 03:58:31 [DEBUG   ] Got command RPT from MCS: ref #522378
2018-11-16 03:58:31 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 03:58:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522378  12 58438 14311977 A  ERRORB˜™š'
2018-11-16 03:58:44 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 03:59:04 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-16 03:59:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 03:59:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 03:59:23 [WARNING ] (13, 1, 'bot')
2018-11-16 03:59:23 [WARNING ] (13, 1, 'bot')
2018-11-16 03:59:23 [WARNING ] (13, 1, 'bot')
2018-11-16 03:59:23 [WARNING ] (13, 1, 'bot')
2018-11-16 03:59:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 03:59:23 [DEBUG   ] Finished updating board flags in 1.603 seconds
2018-11-16 03:59:24 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-16 03:59:45 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-16 04:00:05 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-16 04:00:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:00:23 [WARNING ] (13, 1, 'bot')
2018-11-16 04:00:23 [WARNING ] (13, 1, 'bot')
2018-11-16 04:00:23 [WARNING ] (13, 1, 'bot')
2018-11-16 04:00:23 [WARNING ] (13, 1, 'bot')
2018-11-16 04:00:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:00:23 [DEBUG   ] Finished updating board flags in 1.624 seconds
2018-11-16 04:00:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 04:00:45 [DEBUG   ] Got command RPT from MCS: ref #522387
2018-11-16 04:00:45 [DEBUG   ] summary = ERROR
2018-11-16 04:00:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522387  13 58438 14445297 A  ERRORERROR'
2018-11-16 04:00:45 [DEBUG   ] Got command RPT from MCS: ref #522388
2018-11-16 04:00:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 04:00:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522388  77 58438 14445298 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 04:00:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 04:01:05 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-16 04:01:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:01:23 [WARNING ] (13, 1, 'bot')
2018-11-16 04:01:23 [WARNING ] (13, 1, 'bot')
2018-11-16 04:01:23 [WARNING ] (13, 1, 'bot')
2018-11-16 04:01:23 [WARNING ] (13, 1, 'bot')
2018-11-16 04:01:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:01:23 [DEBUG   ] Finished updating board flags in 1.563 seconds
2018-11-16 04:01:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 04:01:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 04:02:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 04:02:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:02:23 [WARNING ] (13, 1, 'bot')
2018-11-16 04:02:23 [WARNING ] (13, 1, 'bot')
2018-11-16 04:02:23 [WARNING ] (13, 1, 'bot')
2018-11-16 04:02:23 [WARNING ] (13, 1, 'bot')
2018-11-16 04:02:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:02:23 [DEBUG   ] Finished updating board flags in 1.434 seconds
2018-11-16 04:02:25 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-16 04:02:45 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-16 04:03:05 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 04:03:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:03:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 04:03:23 [WARNING ] (13, 1, 'bot')
2018-11-16 04:03:23 [WARNING ] (13, 1, 'bot')
2018-11-16 04:03:23 [WARNING ] (13, 1, 'bot')
2018-11-16 04:03:23 [WARNING ] (13, 1, 'bot')
2018-11-16 04:03:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:03:23 [DEBUG   ] Finished updating board flags in 1.416 seconds
2018-11-16 04:03:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 04:03:31 [DEBUG   ] Got command RPT from MCS: ref #522408
2018-11-16 04:03:31 [DEBUG   ] summary = ERROR
2018-11-16 04:03:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522408  13 58438 14611250 A  ERRORERROR'
2018-11-16 04:03:31 [DEBUG   ] Got command RPT from MCS: ref #522409
2018-11-16 04:03:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 04:03:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522409  77 58438 14611453 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 04:03:31 [DEBUG   ] Got command RPT from MCS: ref #522410
2018-11-16 04:03:31 [DEBUG   ] summary = ERROR
2018-11-16 04:03:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522410  13 58438 14611657 A  ERRORERROR'
2018-11-16 04:03:31 [DEBUG   ] Got command RPT from MCS: ref #522411
2018-11-16 04:03:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 04:03:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522411  77 58438 14611861 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 04:03:32 [DEBUG   ] Got command RPT from MCS: ref #522412
2018-11-16 04:03:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 04:03:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522412  12 58438 14612054 A  ERRORB˜™š'
2018-11-16 04:03:45 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-11-16 04:04:05 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-16 04:04:22 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 04:04:22 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:04:23 [WARNING ] (13, 1, 'bot')
2018-11-16 04:04:23 [WARNING ] (13, 1, 'bot')
2018-11-16 04:04:23 [WARNING ] (13, 1, 'bot')
2018-11-16 04:04:23 [WARNING ] (13, 1, 'bot')
2018-11-16 04:04:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:04:23 [DEBUG   ] Finished updating board flags in 1.446 seconds
2018-11-16 04:04:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 04:04:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 04:05:05 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 04:05:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:05:23 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 04:05:23 [WARNING ] (13, 1, 'bot')
2018-11-16 04:05:23 [WARNING ] (13, 1, 'bot')
2018-11-16 04:05:23 [WARNING ] (13, 1, 'bot')
2018-11-16 04:05:23 [WARNING ] (13, 1, 'bot')
2018-11-16 04:05:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:05:23 [DEBUG   ] Finished updating board flags in 1.433 seconds
2018-11-16 04:05:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 04:05:45 [DEBUG   ] Got command RPT from MCS: ref #522417
2018-11-16 04:05:45 [DEBUG   ] summary = ERROR
2018-11-16 04:05:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522417  13 58438 14745301 A  ERRORERROR'
2018-11-16 04:05:45 [DEBUG   ] Got command RPT from MCS: ref #522418
2018-11-16 04:05:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 04:05:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522418  77 58438 14745302 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 04:05:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 04:06:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 04:06:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:06:23 [WARNING ] (13, 1, 'bot')
2018-11-16 04:06:23 [WARNING ] (13, 1, 'bot')
2018-11-16 04:06:23 [WARNING ] (13, 1, 'bot')
2018-11-16 04:06:23 [WARNING ] (13, 1, 'bot')
2018-11-16 04:06:23 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:06:23 [DEBUG   ] Finished updating board flags in 1.568 seconds
2018-11-16 04:06:25 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 04:06:45 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-16 04:07:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 04:07:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:07:24 [WARNING ] (13, 1, 'bot')
2018-11-16 04:07:24 [WARNING ] (13, 1, 'bot')
2018-11-16 04:07:24 [WARNING ] (13, 1, 'bot')
2018-11-16 04:07:24 [WARNING ] (13, 1, 'bot')
2018-11-16 04:07:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:07:24 [DEBUG   ] Finished updating board flags in 2.221 seconds
2018-11-16 04:07:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 04:07:45 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 04:08:05 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 04:08:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:08:24 [WARNING ] (13, 1, 'bot')
2018-11-16 04:08:24 [WARNING ] (13, 1, 'bot')
2018-11-16 04:08:24 [WARNING ] (13, 1, 'bot')
2018-11-16 04:08:24 [WARNING ] (13, 1, 'bot')
2018-11-16 04:08:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:08:24 [DEBUG   ] Finished updating board flags in 2.125 seconds
2018-11-16 04:08:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 04:08:31 [DEBUG   ] Got command RPT from MCS: ref #522436
2018-11-16 04:08:31 [DEBUG   ] summary = ERROR
2018-11-16 04:08:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522436  13 58438 14911329 A  ERRORERROR'
2018-11-16 04:08:31 [DEBUG   ] Got command RPT from MCS: ref #522437
2018-11-16 04:08:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 04:08:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522437  77 58438 14911533 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 04:08:31 [DEBUG   ] Got command RPT from MCS: ref #522438
2018-11-16 04:08:31 [DEBUG   ] summary = ERROR
2018-11-16 04:08:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522438  13 58438 14911737 A  ERRORERROR'
2018-11-16 04:08:31 [DEBUG   ] Got command RPT from MCS: ref #522440
2018-11-16 04:08:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 04:08:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522440  77 58438 14911941 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 04:08:32 [DEBUG   ] Got command RPT from MCS: ref #522441
2018-11-16 04:08:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 04:08:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522441  12 58438 14912133 A  ERRORB˜™š'
2018-11-16 04:08:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 04:09:05 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 04:09:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:09:24 [WARNING ] (13, 1, 'bot')
2018-11-16 04:09:24 [WARNING ] (13, 1, 'bot')
2018-11-16 04:09:24 [WARNING ] (13, 1, 'bot')
2018-11-16 04:09:24 [WARNING ] (13, 1, 'bot')
2018-11-16 04:09:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:09:24 [DEBUG   ] Finished updating board flags in 2.004 seconds
2018-11-16 04:09:25 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-16 04:09:46 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-16 04:10:06 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-16 04:10:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:10:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 04:10:24 [WARNING ] (13, 1, 'bot')
2018-11-16 04:10:24 [WARNING ] (13, 1, 'bot')
2018-11-16 04:10:24 [WARNING ] (13, 1, 'bot')
2018-11-16 04:10:24 [WARNING ] (13, 1, 'bot')
2018-11-16 04:10:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:10:24 [DEBUG   ] Finished updating board flags in 1.978 seconds
2018-11-16 04:10:26 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2018-11-16 04:10:45 [DEBUG   ] Got command RPT from MCS: ref #522450
2018-11-16 04:10:45 [DEBUG   ] summary = ERROR
2018-11-16 04:10:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522450  13 58438 15045297 A  ERRORERROR'
2018-11-16 04:10:45 [DEBUG   ] Got command RPT from MCS: ref #522451
2018-11-16 04:10:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 04:10:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522451  77 58438 15045298 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 04:10:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 04:11:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 04:11:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:11:24 [WARNING ] (13, 1, 'bot')
2018-11-16 04:11:24 [WARNING ] (13, 1, 'bot')
2018-11-16 04:11:24 [WARNING ] (13, 1, 'bot')
2018-11-16 04:11:24 [WARNING ] (13, 1, 'bot')
2018-11-16 04:11:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:11:24 [DEBUG   ] Finished updating board flags in 1.797 seconds
2018-11-16 04:11:26 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-11-16 04:11:46 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-16 04:12:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 04:12:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:12:24 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 04:12:24 [WARNING ] (13, 1, 'bot')
2018-11-16 04:12:24 [WARNING ] (13, 1, 'bot')
2018-11-16 04:12:24 [WARNING ] (13, 1, 'bot')
2018-11-16 04:12:24 [WARNING ] (13, 1, 'bot')
2018-11-16 04:12:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:12:24 [DEBUG   ] Finished updating board flags in 1.613 seconds
2018-11-16 04:12:26 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 04:12:46 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-16 04:13:06 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-16 04:13:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:13:24 [WARNING ] (13, 1, 'bot')
2018-11-16 04:13:24 [WARNING ] (13, 1, 'bot')
2018-11-16 04:13:24 [WARNING ] (13, 1, 'bot')
2018-11-16 04:13:24 [WARNING ] (13, 1, 'bot')
2018-11-16 04:13:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:13:24 [DEBUG   ] Finished updating board flags in 1.593 seconds
2018-11-16 04:13:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 04:13:31 [DEBUG   ] Got command RPT from MCS: ref #522471
2018-11-16 04:13:31 [DEBUG   ] summary = ERROR
2018-11-16 04:13:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522471  13 58438 15211413 A  ERRORERROR'
2018-11-16 04:13:31 [DEBUG   ] Got command RPT from MCS: ref #522472
2018-11-16 04:13:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 04:13:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522472  77 58438 15211617 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 04:13:31 [DEBUG   ] Got command RPT from MCS: ref #522473
2018-11-16 04:13:31 [DEBUG   ] summary = ERROR
2018-11-16 04:13:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522473  13 58438 15211809 A  ERRORERROR'
2018-11-16 04:13:32 [DEBUG   ] Got command RPT from MCS: ref #522474
2018-11-16 04:13:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 04:13:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522474  77 58438 15212013 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 04:13:32 [DEBUG   ] Got command RPT from MCS: ref #522475
2018-11-16 04:13:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 04:13:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522475  12 58438 15212217 A  ERRORB—™š'
2018-11-16 04:13:46 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 04:14:06 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 04:14:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:14:24 [WARNING ] (13, 1, 'bot')
2018-11-16 04:14:24 [WARNING ] (13, 1, 'bot')
2018-11-16 04:14:24 [WARNING ] (13, 1, 'bot')
2018-11-16 04:14:24 [WARNING ] (13, 1, 'bot')
2018-11-16 04:14:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:14:24 [DEBUG   ] Finished updating board flags in 1.401 seconds
2018-11-16 04:14:26 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-16 04:14:47 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-16 04:15:06 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-16 04:15:23 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:15:24 [WARNING ] (13, 1, 'bot')
2018-11-16 04:15:24 [WARNING ] (13, 1, 'bot')
2018-11-16 04:15:24 [WARNING ] (13, 1, 'bot')
2018-11-16 04:15:24 [WARNING ] (13, 1, 'bot')
2018-11-16 04:15:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:15:24 [DEBUG   ] Finished updating board flags in 1.386 seconds
2018-11-16 04:15:27 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-16 04:15:45 [DEBUG   ] Got command RPT from MCS: ref #522480
2018-11-16 04:15:45 [DEBUG   ] summary = ERROR
2018-11-16 04:15:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522480  13 58438 15345297 A  ERRORERROR'
2018-11-16 04:15:45 [DEBUG   ] Got command RPT from MCS: ref #522481
2018-11-16 04:15:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 04:15:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522481  77 58438 15345298 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 04:15:47 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-16 04:16:07 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-16 04:16:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:16:24 [WARNING ] (13, 1, 'bot')
2018-11-16 04:16:24 [WARNING ] (13, 1, 'bot')
2018-11-16 04:16:24 [WARNING ] (13, 1, 'bot')
2018-11-16 04:16:24 [WARNING ] (13, 1, 'bot')
2018-11-16 04:16:24 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:16:24 [DEBUG   ] Finished updating board flags in 1.364 seconds
2018-11-16 04:16:27 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-16 04:16:47 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 04:17:07 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-11-16 04:17:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:17:25 [WARNING ] (13, 1, 'bot')
2018-11-16 04:17:25 [WARNING ] (13, 1, 'bot')
2018-11-16 04:17:25 [WARNING ] (13, 1, 'bot')
2018-11-16 04:17:25 [WARNING ] (13, 1, 'bot')
2018-11-16 04:17:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:17:25 [DEBUG   ] Finished updating board flags in 2.064 seconds
2018-11-16 04:17:27 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-16 04:17:47 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-16 04:18:07 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 04:18:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:18:25 [WARNING ] (13, 1, 'bot')
2018-11-16 04:18:25 [WARNING ] (13, 1, 'bot')
2018-11-16 04:18:25 [WARNING ] (13, 1, 'bot')
2018-11-16 04:18:25 [WARNING ] (13, 1, 'bot')
2018-11-16 04:18:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:18:25 [DEBUG   ] Finished updating board flags in 1.982 seconds
2018-11-16 04:18:27 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 04:18:31 [DEBUG   ] Got command RPT from MCS: ref #522503
2018-11-16 04:18:31 [DEBUG   ] summary = ERROR
2018-11-16 04:18:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522503  13 58438 15511485 A  ERRORERROR'
2018-11-16 04:18:31 [DEBUG   ] Got command RPT from MCS: ref #522504
2018-11-16 04:18:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 04:18:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522504  77 58438 15511689 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 04:18:31 [DEBUG   ] Got command RPT from MCS: ref #522505
2018-11-16 04:18:31 [DEBUG   ] summary = ERROR
2018-11-16 04:18:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522505  13 58438 15511893 A  ERRORERROR'
2018-11-16 04:18:32 [DEBUG   ] Got command RPT from MCS: ref #522506
2018-11-16 04:18:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 04:18:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522506  77 58438 15512097 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 04:18:32 [DEBUG   ] Got command RPT from MCS: ref #522508
2018-11-16 04:18:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 04:18:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522508  12 58438 15512289 A  ERRORB˜™š'
2018-11-16 04:18:47 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 04:19:07 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-16 04:19:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:19:25 [WARNING ] (13, 1, 'bot')
2018-11-16 04:19:25 [WARNING ] (13, 1, 'bot')
2018-11-16 04:19:25 [WARNING ] (13, 1, 'bot')
2018-11-16 04:19:25 [WARNING ] (13, 1, 'bot')
2018-11-16 04:19:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:19:25 [DEBUG   ] Finished updating board flags in 1.817 seconds
2018-11-16 04:19:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 04:19:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 04:20:07 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-11-16 04:20:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:20:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 04:20:25 [WARNING ] (13, 1, 'bot')
2018-11-16 04:20:25 [WARNING ] (13, 1, 'bot')
2018-11-16 04:20:25 [WARNING ] (13, 1, 'bot')
2018-11-16 04:20:25 [WARNING ] (13, 1, 'bot')
2018-11-16 04:20:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:20:25 [DEBUG   ] Finished updating board flags in 1.807 seconds
2018-11-16 04:20:27 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-16 04:20:45 [DEBUG   ] Got command RPT from MCS: ref #522517
2018-11-16 04:20:45 [DEBUG   ] summary = ERROR
2018-11-16 04:20:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522517  13 58438 15645305 A  ERRORERROR'
2018-11-16 04:20:45 [DEBUG   ] Got command RPT from MCS: ref #522518
2018-11-16 04:20:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 04:20:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522518  77 58438 15645306 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 04:20:48 [DEBUG   ] Finished updating ant stats in 1.403 seconds
2018-11-16 04:21:07 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-16 04:21:24 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 04:21:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:21:25 [WARNING ] (13, 1, 'bot')
2018-11-16 04:21:25 [WARNING ] (13, 1, 'bot')
2018-11-16 04:21:25 [WARNING ] (13, 1, 'bot')
2018-11-16 04:21:25 [WARNING ] (13, 1, 'bot')
2018-11-16 04:21:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:21:25 [DEBUG   ] Finished updating board flags in 1.789 seconds
2018-11-16 04:21:28 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-16 04:21:48 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-16 04:22:08 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-16 04:22:24 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 04:22:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:22:25 [WARNING ] (13, 1, 'bot')
2018-11-16 04:22:25 [WARNING ] (13, 1, 'bot')
2018-11-16 04:22:25 [WARNING ] (13, 1, 'bot')
2018-11-16 04:22:25 [WARNING ] (13, 1, 'bot')
2018-11-16 04:22:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:22:25 [DEBUG   ] Finished updating board flags in 1.604 seconds
2018-11-16 04:22:28 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-16 04:22:48 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-16 04:23:08 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 04:23:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:23:25 [WARNING ] (13, 1, 'bot')
2018-11-16 04:23:25 [WARNING ] (13, 1, 'bot')
2018-11-16 04:23:25 [WARNING ] (13, 1, 'bot')
2018-11-16 04:23:25 [WARNING ] (13, 1, 'bot')
2018-11-16 04:23:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:23:25 [DEBUG   ] Finished updating board flags in 1.597 seconds
2018-11-16 04:23:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 04:23:31 [DEBUG   ] Got command RPT from MCS: ref #522534
2018-11-16 04:23:31 [DEBUG   ] summary = ERROR
2018-11-16 04:23:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522534  13 58438 15811573 A  ERRORERROR'
2018-11-16 04:23:31 [DEBUG   ] Got command RPT from MCS: ref #522535
2018-11-16 04:23:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 04:23:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522535  77 58438 15811777 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 04:23:31 [DEBUG   ] Got command RPT from MCS: ref #522536
2018-11-16 04:23:31 [DEBUG   ] summary = ERROR
2018-11-16 04:23:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522536  13 58438 15811969 A  ERRORERROR'
2018-11-16 04:23:32 [DEBUG   ] Got command RPT from MCS: ref #522537
2018-11-16 04:23:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 04:23:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522537  77 58438 15812173 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 04:23:32 [DEBUG   ] Got command RPT from MCS: ref #522538
2018-11-16 04:23:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 04:23:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522538  12 58438 15812377 A  ERRORB˜™š'
2018-11-16 04:23:48 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 04:24:08 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-16 04:24:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:24:25 [WARNING ] (13, 1, 'bot')
2018-11-16 04:24:25 [WARNING ] (13, 1, 'bot')
2018-11-16 04:24:25 [WARNING ] (13, 1, 'bot')
2018-11-16 04:24:25 [WARNING ] (13, 1, 'bot')
2018-11-16 04:24:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:24:25 [DEBUG   ] Finished updating board flags in 1.452 seconds
2018-11-16 04:24:28 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 04:24:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 04:25:08 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 04:25:24 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:25:25 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-16 04:25:25 [WARNING ] (13, 1, 'bot')
2018-11-16 04:25:25 [WARNING ] (13, 1, 'bot')
2018-11-16 04:25:25 [WARNING ] (13, 1, 'bot')
2018-11-16 04:25:25 [WARNING ] (13, 1, 'bot')
2018-11-16 04:25:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:25:25 [DEBUG   ] Finished updating board flags in 1.356 seconds
2018-11-16 04:25:28 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-16 04:25:45 [DEBUG   ] Got command RPT from MCS: ref #522543
2018-11-16 04:25:45 [DEBUG   ] summary = ERROR
2018-11-16 04:25:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522543  13 58438 15945305 A  ERRORERROR'
2018-11-16 04:25:45 [DEBUG   ] Got command RPT from MCS: ref #522544
2018-11-16 04:25:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 04:25:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522544  77 58438 15945306 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 04:25:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 04:26:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 04:26:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:26:25 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 04:26:25 [WARNING ] (13, 1, 'bot')
2018-11-16 04:26:25 [WARNING ] (13, 1, 'bot')
2018-11-16 04:26:25 [WARNING ] (13, 1, 'bot')
2018-11-16 04:26:25 [WARNING ] (13, 1, 'bot')
2018-11-16 04:26:25 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:26:25 [DEBUG   ] Finished updating board flags in 1.368 seconds
2018-11-16 04:26:28 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-11-16 04:26:48 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-11-16 04:27:08 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 04:27:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:27:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-16 04:27:26 [WARNING ] (13, 1, 'bot')
2018-11-16 04:27:26 [WARNING ] (13, 1, 'bot')
2018-11-16 04:27:26 [WARNING ] (13, 1, 'bot')
2018-11-16 04:27:26 [WARNING ] (13, 1, 'bot')
2018-11-16 04:27:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:27:26 [DEBUG   ] Finished updating board flags in 2.053 seconds
2018-11-16 04:27:29 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-11-16 04:27:48 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-16 04:28:09 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-11-16 04:28:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:28:26 [WARNING ] (13, 1, 'bot')
2018-11-16 04:28:26 [WARNING ] (13, 1, 'bot')
2018-11-16 04:28:26 [WARNING ] (13, 1, 'bot')
2018-11-16 04:28:26 [WARNING ] (13, 1, 'bot')
2018-11-16 04:28:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:28:26 [DEBUG   ] Finished updating board flags in 1.980 seconds
2018-11-16 04:28:29 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-16 04:28:31 [DEBUG   ] Got command RPT from MCS: ref #522566
2018-11-16 04:28:31 [DEBUG   ] summary = ERROR
2018-11-16 04:28:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522566  13 58438 16111649 A  ERRORERROR'
2018-11-16 04:28:31 [DEBUG   ] Got command RPT from MCS: ref #522567
2018-11-16 04:28:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 04:28:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522567  77 58438 16111853 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 04:28:32 [DEBUG   ] Got command RPT from MCS: ref #522568
2018-11-16 04:28:32 [DEBUG   ] summary = ERROR
2018-11-16 04:28:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522568  13 58438 16112057 A  ERRORERROR'
2018-11-16 04:28:32 [DEBUG   ] Got command RPT from MCS: ref #522570
2018-11-16 04:28:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 04:28:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522570  77 58438 16112249 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 04:28:32 [DEBUG   ] Got command RPT from MCS: ref #522571
2018-11-16 04:28:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 04:28:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522571  12 58438 16112453 A  ERRORB˜™š'
2018-11-16 04:28:49 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-16 04:29:09 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-16 04:29:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:29:26 [WARNING ] (13, 1, 'bot')
2018-11-16 04:29:26 [WARNING ] (13, 1, 'bot')
2018-11-16 04:29:26 [WARNING ] (13, 1, 'bot')
2018-11-16 04:29:26 [WARNING ] (13, 1, 'bot')
2018-11-16 04:29:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:29:26 [DEBUG   ] Finished updating board flags in 1.807 seconds
2018-11-16 04:29:29 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 04:29:49 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 04:30:09 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-11-16 04:30:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:30:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-16 04:30:26 [WARNING ] (13, 1, 'bot')
2018-11-16 04:30:26 [WARNING ] (13, 1, 'bot')
2018-11-16 04:30:26 [WARNING ] (13, 1, 'bot')
2018-11-16 04:30:26 [WARNING ] (13, 1, 'bot')
2018-11-16 04:30:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:30:26 [DEBUG   ] Finished updating board flags in 1.818 seconds
2018-11-16 04:30:29 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-16 04:30:45 [DEBUG   ] Got command RPT from MCS: ref #522580
2018-11-16 04:30:45 [DEBUG   ] summary = ERROR
2018-11-16 04:30:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522580  13 58438 16245309 A  ERRORERROR'
2018-11-16 04:30:45 [DEBUG   ] Got command RPT from MCS: ref #522581
2018-11-16 04:30:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 04:30:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522581  77 58438 16245310 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 04:30:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 04:31:09 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 04:31:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:31:26 [WARNING ] (13, 1, 'bot')
2018-11-16 04:31:26 [WARNING ] (13, 1, 'bot')
2018-11-16 04:31:26 [WARNING ] (13, 1, 'bot')
2018-11-16 04:31:26 [WARNING ] (13, 1, 'bot')
2018-11-16 04:31:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:31:26 [DEBUG   ] Finished updating board flags in 1.773 seconds
2018-11-16 04:31:29 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 04:31:49 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-16 04:32:09 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 04:32:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:32:26 [WARNING ] (13, 1, 'bot')
2018-11-16 04:32:26 [WARNING ] (13, 1, 'bot')
2018-11-16 04:32:26 [WARNING ] (13, 1, 'bot')
2018-11-16 04:32:26 [WARNING ] (13, 1, 'bot')
2018-11-16 04:32:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:32:26 [DEBUG   ] Finished updating board flags in 1.623 seconds
2018-11-16 04:32:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 04:32:49 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 04:33:09 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 04:33:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:33:26 [WARNING ] (13, 1, 'bot')
2018-11-16 04:33:26 [WARNING ] (13, 1, 'bot')
2018-11-16 04:33:26 [WARNING ] (13, 1, 'bot')
2018-11-16 04:33:26 [WARNING ] (13, 1, 'bot')
2018-11-16 04:33:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:33:26 [DEBUG   ] Finished updating board flags in 1.664 seconds
2018-11-16 04:33:29 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-16 04:33:31 [DEBUG   ] Got command RPT from MCS: ref #522601
2018-11-16 04:33:31 [DEBUG   ] summary = ERROR
2018-11-16 04:33:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522601  13 58438 16411737 A  ERRORERROR'
2018-11-16 04:33:31 [DEBUG   ] Got command RPT from MCS: ref #522602
2018-11-16 04:33:31 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 04:33:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522602  77 58438 16411929 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 04:33:32 [DEBUG   ] Got command RPT from MCS: ref #522603
2018-11-16 04:33:32 [DEBUG   ] summary = ERROR
2018-11-16 04:33:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522603  13 58438 16412133 A  ERRORERROR'
2018-11-16 04:33:32 [DEBUG   ] Got command RPT from MCS: ref #522604
2018-11-16 04:33:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 04:33:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522604  77 58438 16412337 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 04:33:32 [DEBUG   ] Got command RPT from MCS: ref #522605
2018-11-16 04:33:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 04:33:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522605  12 58438 16412529 A  ERRORB˜™š'
2018-11-16 04:33:50 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-16 04:34:09 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-11-16 04:34:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:34:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 04:34:26 [WARNING ] (13, 1, 'bot')
2018-11-16 04:34:26 [WARNING ] (13, 1, 'bot')
2018-11-16 04:34:26 [WARNING ] (13, 1, 'bot')
2018-11-16 04:34:26 [WARNING ] (13, 1, 'bot')
2018-11-16 04:34:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:34:26 [DEBUG   ] Finished updating board flags in 1.533 seconds
2018-11-16 04:34:30 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-11-16 04:34:50 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-16 04:35:10 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-16 04:35:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:35:26 [WARNING ] (13, 1, 'bot')
2018-11-16 04:35:26 [WARNING ] (13, 1, 'bot')
2018-11-16 04:35:26 [WARNING ] (13, 1, 'bot')
2018-11-16 04:35:26 [WARNING ] (13, 1, 'bot')
2018-11-16 04:35:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:35:26 [DEBUG   ] Finished updating board flags in 1.410 seconds
2018-11-16 04:35:30 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-16 04:35:45 [DEBUG   ] Got command RPT from MCS: ref #522610
2018-11-16 04:35:45 [DEBUG   ] summary = ERROR
2018-11-16 04:35:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522610  13 58438 16545301 A  ERRORERROR'
2018-11-16 04:35:45 [DEBUG   ] Got command RPT from MCS: ref #522611
2018-11-16 04:35:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 04:35:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522611  77 58438 16545302 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 04:35:50 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 04:36:10 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2018-11-16 04:36:25 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:36:26 [WARNING ] (13, 1, 'bot')
2018-11-16 04:36:26 [WARNING ] (13, 1, 'bot')
2018-11-16 04:36:26 [WARNING ] (13, 1, 'bot')
2018-11-16 04:36:26 [WARNING ] (13, 1, 'bot')
2018-11-16 04:36:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:36:26 [DEBUG   ] Finished updating board flags in 1.387 seconds
2018-11-16 04:36:30 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 04:36:50 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-16 04:37:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 04:37:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:37:26 [WARNING ] (13, 1, 'bot')
2018-11-16 04:37:26 [WARNING ] (13, 1, 'bot')
2018-11-16 04:37:26 [WARNING ] (13, 1, 'bot')
2018-11-16 04:37:26 [WARNING ] (13, 1, 'bot')
2018-11-16 04:37:26 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:37:26 [DEBUG   ] Finished updating board flags in 1.393 seconds
2018-11-16 04:37:30 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-16 04:37:50 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-16 04:38:10 [DEBUG   ] Finished updating ant stats in 0.398 seconds
2018-11-16 04:38:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:38:27 [WARNING ] (13, 1, 'bot')
2018-11-16 04:38:27 [WARNING ] (13, 1, 'bot')
2018-11-16 04:38:27 [WARNING ] (13, 1, 'bot')
2018-11-16 04:38:27 [WARNING ] (13, 1, 'bot')
2018-11-16 04:38:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:38:27 [DEBUG   ] Finished updating board flags in 2.029 seconds
2018-11-16 04:38:31 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-16 04:38:31 [DEBUG   ] Got command RPT from MCS: ref #522629
2018-11-16 04:38:31 [DEBUG   ] summary = ERROR
2018-11-16 04:38:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522629  13 58438 16711805 A  ERRORERROR'
2018-11-16 04:38:32 [DEBUG   ] Got command RPT from MCS: ref #522630
2018-11-16 04:38:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 04:38:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522630  77 58438 16712009 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 04:38:32 [DEBUG   ] Got command RPT from MCS: ref #522631
2018-11-16 04:38:32 [DEBUG   ] summary = ERROR
2018-11-16 04:38:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522631  13 58438 16712213 A  ERRORERROR'
2018-11-16 04:38:32 [DEBUG   ] Got command RPT from MCS: ref #522633
2018-11-16 04:38:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 04:38:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522633  77 58438 16712417 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 04:38:32 [DEBUG   ] Got command RPT from MCS: ref #522635
2018-11-16 04:38:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 04:38:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522635  12 58438 16712609 A  ERRORB—™š'
2018-11-16 04:38:51 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-16 04:39:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 04:39:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:39:27 [WARNING ] (13, 1, 'bot')
2018-11-16 04:39:27 [WARNING ] (13, 1, 'bot')
2018-11-16 04:39:27 [WARNING ] (13, 1, 'bot')
2018-11-16 04:39:27 [WARNING ] (13, 1, 'bot')
2018-11-16 04:39:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:39:27 [DEBUG   ] Finished updating board flags in 1.986 seconds
2018-11-16 04:39:31 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 04:39:51 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 04:40:11 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2018-11-16 04:40:26 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 04:40:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:40:27 [WARNING ] (13, 1, 'bot')
2018-11-16 04:40:27 [WARNING ] (13, 1, 'bot')
2018-11-16 04:40:27 [WARNING ] (13, 1, 'bot')
2018-11-16 04:40:27 [WARNING ] (13, 1, 'bot')
2018-11-16 04:40:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:40:27 [DEBUG   ] Finished updating board flags in 1.809 seconds
2018-11-16 04:40:31 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-16 04:40:45 [DEBUG   ] Got command RPT from MCS: ref #522643
2018-11-16 04:40:45 [DEBUG   ] summary = ERROR
2018-11-16 04:40:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522643  13 58438 16845305 A  ERRORERROR'
2018-11-16 04:40:45 [DEBUG   ] Got command RPT from MCS: ref #522644
2018-11-16 04:40:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 04:40:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522644  77 58438 16845306 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 04:40:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 04:41:11 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 04:41:26 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 04:41:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:41:27 [WARNING ] (13, 1, 'bot')
2018-11-16 04:41:27 [WARNING ] (13, 1, 'bot')
2018-11-16 04:41:27 [WARNING ] (13, 1, 'bot')
2018-11-16 04:41:27 [WARNING ] (13, 1, 'bot')
2018-11-16 04:41:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:41:27 [DEBUG   ] Finished updating board flags in 1.792 seconds
2018-11-16 04:41:31 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-16 04:41:51 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 04:42:12 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-16 04:42:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:42:27 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 04:42:27 [WARNING ] (13, 1, 'bot')
2018-11-16 04:42:27 [WARNING ] (13, 1, 'bot')
2018-11-16 04:42:27 [WARNING ] (13, 1, 'bot')
2018-11-16 04:42:27 [WARNING ] (13, 1, 'bot')
2018-11-16 04:42:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:42:27 [DEBUG   ] Finished updating board flags in 1.616 seconds
2018-11-16 04:42:32 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 04:42:52 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 04:43:12 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 04:43:26 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 04:43:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:43:27 [WARNING ] (13, 1, 'bot')
2018-11-16 04:43:27 [WARNING ] (13, 1, 'bot')
2018-11-16 04:43:27 [WARNING ] (13, 1, 'bot')
2018-11-16 04:43:27 [WARNING ] (13, 1, 'bot')
2018-11-16 04:43:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:43:27 [DEBUG   ] Finished updating board flags in 1.592 seconds
2018-11-16 04:43:31 [DEBUG   ] Got command RPT from MCS: ref #522664
2018-11-16 04:43:31 [DEBUG   ] summary = ERROR
2018-11-16 04:43:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522664  13 58438 17011889 A  ERRORERROR'
2018-11-16 04:43:32 [DEBUG   ] Got command RPT from MCS: ref #522665
2018-11-16 04:43:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 04:43:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522665  77 58438 17012093 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 04:43:32 [DEBUG   ] Got command RPT from MCS: ref #522666
2018-11-16 04:43:32 [DEBUG   ] summary = ERROR
2018-11-16 04:43:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522666  13 58438 17012297 A  ERRORERROR'
2018-11-16 04:43:32 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-16 04:43:32 [DEBUG   ] Got command RPT from MCS: ref #522667
2018-11-16 04:43:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 04:43:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522667  77 58438 17012489 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 04:43:32 [DEBUG   ] Got command RPT from MCS: ref #522668
2018-11-16 04:43:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 04:43:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522668  12 58438 17012693 A  ERRORB—™š'
2018-11-16 04:43:52 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-16 04:44:12 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 04:44:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:44:27 [WARNING ] (13, 1, 'bot')
2018-11-16 04:44:27 [WARNING ] (13, 1, 'bot')
2018-11-16 04:44:27 [WARNING ] (13, 1, 'bot')
2018-11-16 04:44:27 [WARNING ] (13, 1, 'bot')
2018-11-16 04:44:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:44:27 [DEBUG   ] Finished updating board flags in 1.416 seconds
2018-11-16 04:44:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 04:44:52 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 04:45:12 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-16 04:45:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:45:27 [WARNING ] (13, 1, 'bot')
2018-11-16 04:45:27 [WARNING ] (13, 1, 'bot')
2018-11-16 04:45:27 [WARNING ] (13, 1, 'bot')
2018-11-16 04:45:27 [WARNING ] (13, 1, 'bot')
2018-11-16 04:45:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:45:27 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-11-16 04:45:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 04:45:45 [DEBUG   ] Got command RPT from MCS: ref #522673
2018-11-16 04:45:45 [DEBUG   ] summary = ERROR
2018-11-16 04:45:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522673  13 58438 17145305 A  ERRORERROR'
2018-11-16 04:45:45 [DEBUG   ] Got command RPT from MCS: ref #522674
2018-11-16 04:45:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 04:45:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522674  77 58438 17145306 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 04:45:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 04:46:12 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 04:46:26 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:46:27 [WARNING ] (13, 1, 'bot')
2018-11-16 04:46:27 [WARNING ] (13, 1, 'bot')
2018-11-16 04:46:27 [WARNING ] (13, 1, 'bot')
2018-11-16 04:46:27 [WARNING ] (13, 1, 'bot')
2018-11-16 04:46:27 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:46:27 [DEBUG   ] Finished updating board flags in 1.382 seconds
2018-11-16 04:46:32 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-16 04:46:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 04:47:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 04:47:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:47:28 [WARNING ] (13, 1, 'bot')
2018-11-16 04:47:28 [WARNING ] (13, 1, 'bot')
2018-11-16 04:47:28 [WARNING ] (13, 1, 'bot')
2018-11-16 04:47:28 [WARNING ] (13, 1, 'bot')
2018-11-16 04:47:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:47:28 [DEBUG   ] Finished updating board flags in 2.211 seconds
2018-11-16 04:47:32 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 04:47:52 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 04:48:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 04:48:27 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 04:48:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:48:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 04:48:28 [WARNING ] (13, 1, 'bot')
2018-11-16 04:48:28 [WARNING ] (13, 1, 'bot')
2018-11-16 04:48:28 [WARNING ] (13, 1, 'bot')
2018-11-16 04:48:28 [WARNING ] (13, 1, 'bot')
2018-11-16 04:48:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:48:28 [DEBUG   ] Finished updating board flags in 2.188 seconds
2018-11-16 04:48:31 [DEBUG   ] Got command RPT from MCS: ref #522696
2018-11-16 04:48:31 [DEBUG   ] summary = ERROR
2018-11-16 04:48:31 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522696  13 58438 17311973 A  ERRORERROR'
2018-11-16 04:48:32 [DEBUG   ] Got command RPT from MCS: ref #522697
2018-11-16 04:48:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 04:48:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522697  77 58438 17312177 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 04:48:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 04:48:32 [DEBUG   ] Got command RPT from MCS: ref #522698
2018-11-16 04:48:32 [DEBUG   ] summary = ERROR
2018-11-16 04:48:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522698  13 58438 17312369 A  ERRORERROR'
2018-11-16 04:48:32 [DEBUG   ] Got command RPT from MCS: ref #522700
2018-11-16 04:48:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 04:48:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522700  77 58438 17312573 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 04:48:32 [DEBUG   ] Got command RPT from MCS: ref #522702
2018-11-16 04:48:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 04:48:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522702  12 58438 17312777 A  ERRORB–™š'
2018-11-16 04:48:52 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 04:49:12 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 04:49:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:49:28 [WARNING ] (13, 1, 'bot')
2018-11-16 04:49:28 [WARNING ] (13, 1, 'bot')
2018-11-16 04:49:28 [WARNING ] (13, 1, 'bot')
2018-11-16 04:49:28 [WARNING ] (13, 1, 'bot')
2018-11-16 04:49:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:49:28 [DEBUG   ] Finished updating board flags in 2.069 seconds
2018-11-16 04:49:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 04:49:52 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 04:50:12 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-11-16 04:50:27 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 04:50:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:50:28 [WARNING ] (13, 1, 'bot')
2018-11-16 04:50:28 [WARNING ] (13, 1, 'bot')
2018-11-16 04:50:28 [WARNING ] (13, 1, 'bot')
2018-11-16 04:50:28 [WARNING ] (13, 1, 'bot')
2018-11-16 04:50:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:50:28 [DEBUG   ] Finished updating board flags in 2.011 seconds
2018-11-16 04:50:33 [DEBUG   ] Finished updating ant stats in 1.386 seconds
2018-11-16 04:50:45 [DEBUG   ] Got command RPT from MCS: ref #522710
2018-11-16 04:50:45 [DEBUG   ] summary = ERROR
2018-11-16 04:50:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522710  13 58438 17445309 A  ERRORERROR'
2018-11-16 04:50:45 [DEBUG   ] Got command RPT from MCS: ref #522711
2018-11-16 04:50:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 04:50:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522711  77 58438 17445310 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 04:50:53 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-16 04:51:13 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-16 04:51:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:51:28 [WARNING ] (13, 1, 'bot')
2018-11-16 04:51:28 [WARNING ] (13, 1, 'bot')
2018-11-16 04:51:28 [WARNING ] (13, 1, 'bot')
2018-11-16 04:51:28 [WARNING ] (13, 1, 'bot')
2018-11-16 04:51:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:51:28 [DEBUG   ] Finished updating board flags in 1.919 seconds
2018-11-16 04:51:33 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-16 04:51:53 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-16 04:52:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 04:52:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:52:28 [WARNING ] (13, 1, 'bot')
2018-11-16 04:52:28 [WARNING ] (13, 1, 'bot')
2018-11-16 04:52:28 [WARNING ] (13, 1, 'bot')
2018-11-16 04:52:28 [WARNING ] (13, 1, 'bot')
2018-11-16 04:52:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:52:28 [DEBUG   ] Finished updating board flags in 1.816 seconds
2018-11-16 04:52:33 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 04:52:53 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 04:53:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 04:53:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:53:28 [WARNING ] (13, 1, 'bot')
2018-11-16 04:53:28 [WARNING ] (13, 1, 'bot')
2018-11-16 04:53:28 [WARNING ] (13, 1, 'bot')
2018-11-16 04:53:28 [WARNING ] (13, 1, 'bot')
2018-11-16 04:53:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:53:28 [DEBUG   ] Finished updating board flags in 1.805 seconds
2018-11-16 04:53:32 [DEBUG   ] Got command RPT from MCS: ref #522727
2018-11-16 04:53:32 [DEBUG   ] summary = ERROR
2018-11-16 04:53:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522727  13 58438 17612053 A  ERRORERROR'
2018-11-16 04:53:32 [DEBUG   ] Got command RPT from MCS: ref #522728
2018-11-16 04:53:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 04:53:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522728  77 58438 17612257 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 04:53:32 [DEBUG   ] Got command RPT from MCS: ref #522729
2018-11-16 04:53:32 [DEBUG   ] summary = ERROR
2018-11-16 04:53:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522729  13 58438 17612449 A  ERRORERROR'
2018-11-16 04:53:32 [DEBUG   ] Got command RPT from MCS: ref #522730
2018-11-16 04:53:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 04:53:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522730  77 58438 17612653 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 04:53:32 [DEBUG   ] Got command RPT from MCS: ref #522731
2018-11-16 04:53:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 04:53:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522731  12 58438 17612857 A  ERRORB—™š'
2018-11-16 04:53:33 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 04:53:53 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 04:54:13 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-16 04:54:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:54:28 [WARNING ] (13, 1, 'bot')
2018-11-16 04:54:28 [WARNING ] (13, 1, 'bot')
2018-11-16 04:54:28 [WARNING ] (13, 1, 'bot')
2018-11-16 04:54:28 [WARNING ] (13, 1, 'bot')
2018-11-16 04:54:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:54:28 [DEBUG   ] Finished updating board flags in 1.816 seconds
2018-11-16 04:54:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 04:54:53 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 04:55:13 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 04:55:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:55:28 [WARNING ] (13, 1, 'bot')
2018-11-16 04:55:28 [WARNING ] (13, 1, 'bot')
2018-11-16 04:55:28 [WARNING ] (13, 1, 'bot')
2018-11-16 04:55:28 [WARNING ] (13, 1, 'bot')
2018-11-16 04:55:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:55:28 [DEBUG   ] Finished updating board flags in 1.780 seconds
2018-11-16 04:55:33 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-16 04:55:45 [DEBUG   ] Got command RPT from MCS: ref #522736
2018-11-16 04:55:45 [DEBUG   ] summary = ERROR
2018-11-16 04:55:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522736  13 58438 17745313 A  ERRORERROR'
2018-11-16 04:55:45 [DEBUG   ] Got command RPT from MCS: ref #522737
2018-11-16 04:55:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 04:55:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522737  77 58438 17745314 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 04:55:54 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-16 04:56:14 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-16 04:56:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:56:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-16 04:56:28 [WARNING ] (13, 1, 'bot')
2018-11-16 04:56:28 [WARNING ] (13, 1, 'bot')
2018-11-16 04:56:28 [WARNING ] (13, 1, 'bot')
2018-11-16 04:56:28 [WARNING ] (13, 1, 'bot')
2018-11-16 04:56:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:56:28 [DEBUG   ] Finished updating board flags in 1.592 seconds
2018-11-16 04:56:34 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-16 04:56:54 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 04:57:14 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-16 04:57:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:57:28 [WARNING ] (13, 1, 'bot')
2018-11-16 04:57:28 [WARNING ] (13, 1, 'bot')
2018-11-16 04:57:28 [WARNING ] (13, 1, 'bot')
2018-11-16 04:57:28 [WARNING ] (13, 1, 'bot')
2018-11-16 04:57:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:57:28 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-11-16 04:57:34 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-16 04:57:54 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-16 04:58:14 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 04:58:27 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:58:28 [WARNING ] (13, 1, 'bot')
2018-11-16 04:58:28 [WARNING ] (13, 1, 'bot')
2018-11-16 04:58:28 [WARNING ] (13, 1, 'bot')
2018-11-16 04:58:28 [WARNING ] (13, 1, 'bot')
2018-11-16 04:58:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:58:28 [DEBUG   ] Finished updating board flags in 1.386 seconds
2018-11-16 04:58:32 [DEBUG   ] Got command RPT from MCS: ref #522759
2018-11-16 04:58:32 [DEBUG   ] summary = ERROR
2018-11-16 04:58:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522759  13 58438 17912129 A  ERRORERROR'
2018-11-16 04:58:32 [DEBUG   ] Got command RPT from MCS: ref #522760
2018-11-16 04:58:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 04:58:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522760  77 58438 17912333 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 04:58:32 [DEBUG   ] Got command RPT from MCS: ref #522761
2018-11-16 04:58:32 [DEBUG   ] summary = ERROR
2018-11-16 04:58:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522761  13 58438 17912537 A  ERRORERROR'
2018-11-16 04:58:32 [DEBUG   ] Got command RPT from MCS: ref #522763
2018-11-16 04:58:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 04:58:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522763  77 58438 17912741 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 04:58:32 [DEBUG   ] Got command RPT from MCS: ref #522764
2018-11-16 04:58:32 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 04:58:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522764  12 58438 17912933 A  ERRORB–™š'
2018-11-16 04:58:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 04:58:54 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 04:59:14 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-16 04:59:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 04:59:28 [WARNING ] (13, 1, 'bot')
2018-11-16 04:59:28 [WARNING ] (13, 1, 'bot')
2018-11-16 04:59:28 [WARNING ] (13, 1, 'bot')
2018-11-16 04:59:28 [WARNING ] (13, 1, 'bot')
2018-11-16 04:59:28 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 04:59:28 [DEBUG   ] Finished updating board flags in 1.447 seconds
2018-11-16 04:59:34 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 04:59:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 05:00:14 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-16 05:00:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:00:29 [WARNING ] (13, 1, 'bot')
2018-11-16 05:00:29 [WARNING ] (13, 1, 'bot')
2018-11-16 05:00:29 [WARNING ] (13, 1, 'bot')
2018-11-16 05:00:29 [WARNING ] (13, 1, 'bot')
2018-11-16 05:00:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:00:29 [DEBUG   ] Finished updating board flags in 2.226 seconds
2018-11-16 05:00:34 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-16 05:00:45 [DEBUG   ] Got command RPT from MCS: ref #522773
2018-11-16 05:00:45 [DEBUG   ] summary = ERROR
2018-11-16 05:00:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522773  13 58438 18045309 A  ERRORERROR'
2018-11-16 05:00:45 [DEBUG   ] Got command RPT from MCS: ref #522774
2018-11-16 05:00:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 05:00:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522774  77 58438 18045310 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 05:00:54 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 05:01:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 05:01:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:01:29 [WARNING ] (13, 1, 'bot')
2018-11-16 05:01:29 [WARNING ] (13, 1, 'bot')
2018-11-16 05:01:29 [WARNING ] (13, 1, 'bot')
2018-11-16 05:01:29 [WARNING ] (13, 1, 'bot')
2018-11-16 05:01:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:01:29 [DEBUG   ] Finished updating board flags in 2.164 seconds
2018-11-16 05:01:34 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-11-16 05:01:54 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-11-16 05:02:15 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-16 05:02:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:02:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 05:02:29 [WARNING ] (13, 1, 'bot')
2018-11-16 05:02:29 [WARNING ] (13, 1, 'bot')
2018-11-16 05:02:29 [WARNING ] (13, 1, 'bot')
2018-11-16 05:02:29 [WARNING ] (13, 1, 'bot')
2018-11-16 05:02:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:02:29 [DEBUG   ] Finished updating board flags in 1.988 seconds
2018-11-16 05:02:35 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-11-16 05:02:55 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-16 05:03:15 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 05:03:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-16 05:03:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:03:29 [WARNING ] (13, 1, 'bot')
2018-11-16 05:03:29 [WARNING ] (13, 1, 'bot')
2018-11-16 05:03:29 [WARNING ] (13, 1, 'bot')
2018-11-16 05:03:29 [WARNING ] (13, 1, 'bot')
2018-11-16 05:03:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:03:29 [DEBUG   ] Finished updating board flags in 1.811 seconds
2018-11-16 05:03:32 [DEBUG   ] Got command RPT from MCS: ref #522794
2018-11-16 05:03:32 [DEBUG   ] summary = ERROR
2018-11-16 05:03:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522794  13 58438 18212217 A  ERRORERROR'
2018-11-16 05:03:32 [DEBUG   ] Got command RPT from MCS: ref #522795
2018-11-16 05:03:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 05:03:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522795  77 58438 18212421 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 05:03:32 [DEBUG   ] Got command RPT from MCS: ref #522796
2018-11-16 05:03:32 [DEBUG   ] summary = ERROR
2018-11-16 05:03:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522796  13 58438 18212613 A  ERRORERROR'
2018-11-16 05:03:32 [DEBUG   ] Got command RPT from MCS: ref #522797
2018-11-16 05:03:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 05:03:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522797  77 58438 18212817 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 05:03:33 [DEBUG   ] Got command RPT from MCS: ref #522798
2018-11-16 05:03:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 05:03:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522798  12 58438 18213021 A  ERRORB—™š'
2018-11-16 05:03:35 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-16 05:03:55 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-16 05:04:15 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 05:04:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 05:04:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:04:29 [WARNING ] (13, 1, 'bot')
2018-11-16 05:04:29 [WARNING ] (13, 1, 'bot')
2018-11-16 05:04:29 [WARNING ] (13, 1, 'bot')
2018-11-16 05:04:29 [WARNING ] (13, 1, 'bot')
2018-11-16 05:04:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:04:29 [DEBUG   ] Finished updating board flags in 1.793 seconds
2018-11-16 05:04:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 05:04:55 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-16 05:05:15 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-16 05:05:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:05:29 [WARNING ] (13, 1, 'bot')
2018-11-16 05:05:29 [WARNING ] (13, 1, 'bot')
2018-11-16 05:05:29 [WARNING ] (13, 1, 'bot')
2018-11-16 05:05:29 [WARNING ] (13, 1, 'bot')
2018-11-16 05:05:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:05:29 [DEBUG   ] Finished updating board flags in 1.610 seconds
2018-11-16 05:05:35 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 05:05:45 [DEBUG   ] Got command RPT from MCS: ref #522803
2018-11-16 05:05:45 [DEBUG   ] summary = ERROR
2018-11-16 05:05:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522803  13 58438 18345313 A  ERRORERROR'
2018-11-16 05:05:45 [DEBUG   ] Got command RPT from MCS: ref #522804
2018-11-16 05:05:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 05:05:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522804  77 58438 18345314 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 05:05:55 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 05:06:15 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-11-16 05:06:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 05:06:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:06:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 05:06:29 [WARNING ] (13, 1, 'bot')
2018-11-16 05:06:29 [WARNING ] (13, 1, 'bot')
2018-11-16 05:06:29 [WARNING ] (13, 1, 'bot')
2018-11-16 05:06:29 [WARNING ] (13, 1, 'bot')
2018-11-16 05:06:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:06:29 [DEBUG   ] Finished updating board flags in 1.590 seconds
2018-11-16 05:06:35 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-16 05:06:55 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 05:07:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 05:07:28 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 05:07:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:07:29 [WARNING ] (13, 1, 'bot')
2018-11-16 05:07:29 [WARNING ] (13, 1, 'bot')
2018-11-16 05:07:29 [WARNING ] (13, 1, 'bot')
2018-11-16 05:07:29 [WARNING ] (13, 1, 'bot')
2018-11-16 05:07:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:07:29 [DEBUG   ] Finished updating board flags in 1.413 seconds
2018-11-16 05:07:35 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 05:07:55 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-16 05:08:16 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-16 05:08:28 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:08:29 [WARNING ] (13, 1, 'bot')
2018-11-16 05:08:29 [WARNING ] (13, 1, 'bot')
2018-11-16 05:08:29 [WARNING ] (13, 1, 'bot')
2018-11-16 05:08:29 [WARNING ] (13, 1, 'bot')
2018-11-16 05:08:29 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:08:29 [DEBUG   ] Finished updating board flags in 1.393 seconds
2018-11-16 05:08:32 [DEBUG   ] Got command RPT from MCS: ref #522822
2018-11-16 05:08:32 [DEBUG   ] summary = ERROR
2018-11-16 05:08:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522822  13 58438 18512301 A  ERRORERROR'
2018-11-16 05:08:32 [DEBUG   ] Got command RPT from MCS: ref #522823
2018-11-16 05:08:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 05:08:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522823  77 58438 18512493 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 05:08:32 [DEBUG   ] Got command RPT from MCS: ref #522824
2018-11-16 05:08:32 [DEBUG   ] summary = ERROR
2018-11-16 05:08:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522824  13 58438 18512697 A  ERRORERROR'
2018-11-16 05:08:32 [DEBUG   ] Got command RPT from MCS: ref #522826
2018-11-16 05:08:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 05:08:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522826  77 58438 18512901 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 05:08:33 [DEBUG   ] Got command RPT from MCS: ref #522828
2018-11-16 05:08:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 05:08:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522828  12 58438 18513093 A  ERRORB—™š'
2018-11-16 05:08:36 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-16 05:08:56 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-16 05:09:16 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 05:09:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:09:30 [WARNING ] (13, 1, 'bot')
2018-11-16 05:09:30 [WARNING ] (13, 1, 'bot')
2018-11-16 05:09:30 [WARNING ] (13, 1, 'bot')
2018-11-16 05:09:30 [WARNING ] (13, 1, 'bot')
2018-11-16 05:09:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:09:30 [DEBUG   ] Finished updating board flags in 2.207 seconds
2018-11-16 05:09:36 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 05:09:56 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 05:10:16 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-16 05:10:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:10:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-16 05:10:30 [WARNING ] (13, 1, 'bot')
2018-11-16 05:10:30 [WARNING ] (13, 1, 'bot')
2018-11-16 05:10:30 [WARNING ] (13, 1, 'bot')
2018-11-16 05:10:30 [WARNING ] (13, 1, 'bot')
2018-11-16 05:10:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:10:30 [DEBUG   ] Finished updating board flags in 2.219 seconds
2018-11-16 05:10:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 05:10:45 [DEBUG   ] Got command RPT from MCS: ref #522836
2018-11-16 05:10:45 [DEBUG   ] summary = ERROR
2018-11-16 05:10:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522836  13 58438 18645309 A  ERRORERROR'
2018-11-16 05:10:45 [DEBUG   ] Got command RPT from MCS: ref #522837
2018-11-16 05:10:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 05:10:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522837  77 58438 18645310 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 05:10:56 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 05:11:16 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-16 05:11:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:11:30 [WARNING ] (13, 1, 'bot')
2018-11-16 05:11:30 [WARNING ] (13, 1, 'bot')
2018-11-16 05:11:30 [WARNING ] (13, 1, 'bot')
2018-11-16 05:11:30 [WARNING ] (13, 1, 'bot')
2018-11-16 05:11:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:11:30 [DEBUG   ] Finished updating board flags in 2.174 seconds
2018-11-16 05:11:36 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-11-16 05:11:56 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 05:12:16 [DEBUG   ] Finished updating ant stats in 0.400 seconds
2018-11-16 05:12:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:12:30 [WARNING ] (13, 1, 'bot')
2018-11-16 05:12:30 [WARNING ] (13, 1, 'bot')
2018-11-16 05:12:30 [WARNING ] (13, 1, 'bot')
2018-11-16 05:12:30 [WARNING ] (13, 1, 'bot')
2018-11-16 05:12:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:12:30 [DEBUG   ] Finished updating board flags in 2.021 seconds
2018-11-16 05:12:37 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-11-16 05:12:57 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-16 05:13:17 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 05:13:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:13:30 [WARNING ] (13, 1, 'bot')
2018-11-16 05:13:30 [WARNING ] (13, 1, 'bot')
2018-11-16 05:13:30 [WARNING ] (13, 1, 'bot')
2018-11-16 05:13:30 [WARNING ] (13, 1, 'bot')
2018-11-16 05:13:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:13:30 [DEBUG   ] Finished updating board flags in 1.986 seconds
2018-11-16 05:13:32 [DEBUG   ] Got command RPT from MCS: ref #522857
2018-11-16 05:13:32 [DEBUG   ] summary = ERROR
2018-11-16 05:13:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522857  13 58438 18812377 A  ERRORERROR'
2018-11-16 05:13:32 [DEBUG   ] Got command RPT from MCS: ref #522858
2018-11-16 05:13:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 05:13:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522858  77 58438 18812581 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 05:13:32 [DEBUG   ] Got command RPT from MCS: ref #522859
2018-11-16 05:13:32 [DEBUG   ] summary = ERROR
2018-11-16 05:13:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522859  13 58438 18812785 A  ERRORERROR'
2018-11-16 05:13:32 [DEBUG   ] Got command RPT from MCS: ref #522860
2018-11-16 05:13:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 05:13:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522860  77 58438 18812977 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 05:13:33 [DEBUG   ] Got command RPT from MCS: ref #522861
2018-11-16 05:13:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 05:13:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522861  12 58438 18813181 A  ERRORB–™š'
2018-11-16 05:13:37 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 05:13:57 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-16 05:14:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 05:14:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:14:30 [WARNING ] (13, 1, 'bot')
2018-11-16 05:14:30 [WARNING ] (13, 1, 'bot')
2018-11-16 05:14:30 [WARNING ] (13, 1, 'bot')
2018-11-16 05:14:30 [WARNING ] (13, 1, 'bot')
2018-11-16 05:14:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:14:30 [DEBUG   ] Finished updating board flags in 1.816 seconds
2018-11-16 05:14:37 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 05:14:57 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 05:15:17 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-16 05:15:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:15:30 [WARNING ] (13, 1, 'bot')
2018-11-16 05:15:30 [WARNING ] (13, 1, 'bot')
2018-11-16 05:15:30 [WARNING ] (13, 1, 'bot')
2018-11-16 05:15:30 [WARNING ] (13, 1, 'bot')
2018-11-16 05:15:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:15:30 [DEBUG   ] Finished updating board flags in 1.793 seconds
2018-11-16 05:15:37 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-16 05:15:45 [DEBUG   ] Got command RPT from MCS: ref #522866
2018-11-16 05:15:45 [DEBUG   ] summary = ERROR
2018-11-16 05:15:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522866  13 58438 18945309 A  ERRORERROR'
2018-11-16 05:15:45 [DEBUG   ] Got command RPT from MCS: ref #522867
2018-11-16 05:15:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 05:15:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522867  77 58438 18945310 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 05:15:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 05:16:17 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 05:16:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:16:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 05:16:30 [WARNING ] (13, 1, 'bot')
2018-11-16 05:16:30 [WARNING ] (13, 1, 'bot')
2018-11-16 05:16:30 [WARNING ] (13, 1, 'bot')
2018-11-16 05:16:30 [WARNING ] (13, 1, 'bot')
2018-11-16 05:16:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:16:30 [DEBUG   ] Finished updating board flags in 1.624 seconds
2018-11-16 05:16:37 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-16 05:16:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 05:17:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 05:17:29 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 05:17:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:17:30 [WARNING ] (13, 1, 'bot')
2018-11-16 05:17:30 [WARNING ] (13, 1, 'bot')
2018-11-16 05:17:30 [WARNING ] (13, 1, 'bot')
2018-11-16 05:17:30 [WARNING ] (13, 1, 'bot')
2018-11-16 05:17:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:17:30 [DEBUG   ] Finished updating board flags in 1.573 seconds
2018-11-16 05:17:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 05:17:57 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 05:18:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 05:18:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:18:30 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 05:18:30 [WARNING ] (13, 1, 'bot')
2018-11-16 05:18:30 [WARNING ] (13, 1, 'bot')
2018-11-16 05:18:30 [WARNING ] (13, 1, 'bot')
2018-11-16 05:18:30 [WARNING ] (13, 1, 'bot')
2018-11-16 05:18:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:18:30 [DEBUG   ] Finished updating board flags in 1.419 seconds
2018-11-16 05:18:32 [DEBUG   ] Got command RPT from MCS: ref #522889
2018-11-16 05:18:32 [DEBUG   ] summary = ERROR
2018-11-16 05:18:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522889  13 58438 19112453 A  ERRORERROR'
2018-11-16 05:18:32 [DEBUG   ] Got command RPT from MCS: ref #522890
2018-11-16 05:18:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 05:18:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522890  77 58438 19112657 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 05:18:32 [DEBUG   ] Got command RPT from MCS: ref #522891
2018-11-16 05:18:32 [DEBUG   ] summary = ERROR
2018-11-16 05:18:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522891  13 58438 19112861 A  ERRORERROR'
2018-11-16 05:18:33 [DEBUG   ] Got command RPT from MCS: ref #522893
2018-11-16 05:18:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 05:18:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522893  77 58438 19113065 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 05:18:33 [DEBUG   ] Got command RPT from MCS: ref #522894
2018-11-16 05:18:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 05:18:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522894  12 58438 19113257 A  ERRORB—™š'
2018-11-16 05:18:37 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 05:18:57 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 05:19:17 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 05:19:29 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:19:30 [WARNING ] (13, 1, 'bot')
2018-11-16 05:19:30 [WARNING ] (13, 1, 'bot')
2018-11-16 05:19:30 [WARNING ] (13, 1, 'bot')
2018-11-16 05:19:30 [WARNING ] (13, 1, 'bot')
2018-11-16 05:19:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:19:30 [DEBUG   ] Finished updating board flags in 1.513 seconds
2018-11-16 05:19:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 05:19:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 05:20:17 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 05:20:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:20:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 05:20:30 [WARNING ] (13, 1, 'bot')
2018-11-16 05:20:30 [WARNING ] (13, 1, 'bot')
2018-11-16 05:20:30 [WARNING ] (13, 1, 'bot')
2018-11-16 05:20:30 [WARNING ] (13, 1, 'bot')
2018-11-16 05:20:30 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:20:30 [DEBUG   ] Finished updating board flags in 1.547 seconds
2018-11-16 05:20:37 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-16 05:20:45 [DEBUG   ] Got command RPT from MCS: ref #522903
2018-11-16 05:20:45 [DEBUG   ] summary = ERROR
2018-11-16 05:20:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522903  13 58438 19245321 A  ERRORERROR'
2018-11-16 05:20:45 [DEBUG   ] Got command RPT from MCS: ref #522904
2018-11-16 05:20:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 05:20:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522904  77 58438 19245322 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 05:20:57 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-16 05:21:17 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-16 05:21:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:21:31 [WARNING ] (13, 1, 'bot')
2018-11-16 05:21:31 [WARNING ] (13, 1, 'bot')
2018-11-16 05:21:31 [WARNING ] (13, 1, 'bot')
2018-11-16 05:21:31 [WARNING ] (13, 1, 'bot')
2018-11-16 05:21:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:21:31 [DEBUG   ] Finished updating board flags in 2.229 seconds
2018-11-16 05:21:37 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-11-16 05:21:57 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-11-16 05:22:18 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 05:22:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:22:31 [WARNING ] (13, 1, 'bot')
2018-11-16 05:22:31 [WARNING ] (13, 1, 'bot')
2018-11-16 05:22:31 [WARNING ] (13, 1, 'bot')
2018-11-16 05:22:31 [WARNING ] (13, 1, 'bot')
2018-11-16 05:22:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:22:31 [DEBUG   ] Finished updating board flags in 2.168 seconds
2018-11-16 05:22:38 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-16 05:22:58 [DEBUG   ] Finished updating ant stats in 1.186 seconds
2018-11-16 05:23:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 05:23:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:23:31 [WARNING ] (13, 1, 'bot')
2018-11-16 05:23:31 [WARNING ] (13, 1, 'bot')
2018-11-16 05:23:31 [WARNING ] (13, 1, 'bot')
2018-11-16 05:23:31 [WARNING ] (13, 1, 'bot')
2018-11-16 05:23:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:23:31 [DEBUG   ] Finished updating board flags in 1.938 seconds
2018-11-16 05:23:32 [DEBUG   ] Got command RPT from MCS: ref #522920
2018-11-16 05:23:32 [DEBUG   ] summary = ERROR
2018-11-16 05:23:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522920  13 58438 19412537 A  ERRORERROR'
2018-11-16 05:23:32 [DEBUG   ] Got command RPT from MCS: ref #522921
2018-11-16 05:23:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 05:23:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522921  77 58438 19412741 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 05:23:32 [DEBUG   ] Got command RPT from MCS: ref #522922
2018-11-16 05:23:32 [DEBUG   ] summary = ERROR
2018-11-16 05:23:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522922  13 58438 19412945 A  ERRORERROR'
2018-11-16 05:23:33 [DEBUG   ] Got command RPT from MCS: ref #522923
2018-11-16 05:23:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 05:23:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522923  77 58438 19413137 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 05:23:33 [DEBUG   ] Got command RPT from MCS: ref #522924
2018-11-16 05:23:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 05:23:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522924  12 58438 19413341 A  ERRORB—™š'
2018-11-16 05:23:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 05:23:58 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 05:24:18 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-16 05:24:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 05:24:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:24:31 [WARNING ] (13, 1, 'bot')
2018-11-16 05:24:31 [WARNING ] (13, 1, 'bot')
2018-11-16 05:24:31 [WARNING ] (13, 1, 'bot')
2018-11-16 05:24:31 [WARNING ] (13, 1, 'bot')
2018-11-16 05:24:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:24:31 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-11-16 05:24:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 05:24:58 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 05:25:18 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-16 05:25:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:25:31 [WARNING ] (13, 1, 'bot')
2018-11-16 05:25:31 [WARNING ] (13, 1, 'bot')
2018-11-16 05:25:31 [WARNING ] (13, 1, 'bot')
2018-11-16 05:25:31 [WARNING ] (13, 1, 'bot')
2018-11-16 05:25:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:25:31 [DEBUG   ] Finished updating board flags in 1.782 seconds
2018-11-16 05:25:38 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-16 05:25:45 [DEBUG   ] Got command RPT from MCS: ref #522929
2018-11-16 05:25:45 [DEBUG   ] summary = ERROR
2018-11-16 05:25:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522929  13 58438 19545321 A  ERRORERROR'
2018-11-16 05:25:45 [DEBUG   ] Got command RPT from MCS: ref #522930
2018-11-16 05:25:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 05:25:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522930  77 58438 19545322 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 05:25:58 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 05:26:18 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 05:26:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:26:31 [WARNING ] (13, 1, 'bot')
2018-11-16 05:26:31 [WARNING ] (13, 1, 'bot')
2018-11-16 05:26:31 [WARNING ] (13, 1, 'bot')
2018-11-16 05:26:31 [WARNING ] (13, 1, 'bot')
2018-11-16 05:26:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:26:31 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-11-16 05:26:38 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 05:26:58 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-16 05:27:19 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-16 05:27:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:27:31 [WARNING ] (13, 1, 'bot')
2018-11-16 05:27:31 [WARNING ] (13, 1, 'bot')
2018-11-16 05:27:31 [WARNING ] (13, 1, 'bot')
2018-11-16 05:27:31 [WARNING ] (13, 1, 'bot')
2018-11-16 05:27:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:27:31 [DEBUG   ] Finished updating board flags in 1.591 seconds
2018-11-16 05:27:39 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-16 05:27:59 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 05:28:19 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 05:28:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:28:31 [WARNING ] (13, 1, 'bot')
2018-11-16 05:28:31 [WARNING ] (13, 1, 'bot')
2018-11-16 05:28:31 [WARNING ] (13, 1, 'bot')
2018-11-16 05:28:31 [WARNING ] (13, 1, 'bot')
2018-11-16 05:28:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:28:31 [DEBUG   ] Finished updating board flags in 1.403 seconds
2018-11-16 05:28:32 [DEBUG   ] Got command RPT from MCS: ref #522952
2018-11-16 05:28:32 [DEBUG   ] summary = ERROR
2018-11-16 05:28:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522952  13 58438 19712613 A  ERRORERROR'
2018-11-16 05:28:32 [DEBUG   ] Got command RPT from MCS: ref #522953
2018-11-16 05:28:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 05:28:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522953  77 58438 19712817 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 05:28:33 [DEBUG   ] Got command RPT from MCS: ref #522954
2018-11-16 05:28:33 [DEBUG   ] summary = ERROR
2018-11-16 05:28:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522954  13 58438 19713021 A  ERRORERROR'
2018-11-16 05:28:33 [DEBUG   ] Got command RPT from MCS: ref #522956
2018-11-16 05:28:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 05:28:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522956  77 58438 19713213 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 05:28:33 [DEBUG   ] Got command RPT from MCS: ref #522958
2018-11-16 05:28:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 05:28:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522958  12 58438 19713417 A  ERRORB•™š'
2018-11-16 05:28:39 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-16 05:28:59 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-16 05:29:19 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-16 05:29:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:29:31 [WARNING ] (13, 1, 'bot')
2018-11-16 05:29:31 [WARNING ] (13, 1, 'bot')
2018-11-16 05:29:31 [WARNING ] (13, 1, 'bot')
2018-11-16 05:29:31 [WARNING ] (13, 1, 'bot')
2018-11-16 05:29:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:29:31 [DEBUG   ] Finished updating board flags in 1.412 seconds
2018-11-16 05:29:39 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 05:29:59 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 05:30:19 [DEBUG   ] Finished updating ant stats in 0.995 seconds
2018-11-16 05:30:30 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 05:30:30 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:30:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 05:30:31 [WARNING ] (13, 1, 'bot')
2018-11-16 05:30:31 [WARNING ] (13, 1, 'bot')
2018-11-16 05:30:31 [WARNING ] (13, 1, 'bot')
2018-11-16 05:30:31 [WARNING ] (13, 1, 'bot')
2018-11-16 05:30:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:30:31 [DEBUG   ] Finished updating board flags in 1.382 seconds
2018-11-16 05:30:39 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-16 05:30:45 [DEBUG   ] Got command RPT from MCS: ref #522966
2018-11-16 05:30:45 [DEBUG   ] summary = ERROR
2018-11-16 05:30:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522966  13 58438 19845317 A  ERRORERROR'
2018-11-16 05:30:45 [DEBUG   ] Got command RPT from MCS: ref #522967
2018-11-16 05:30:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 05:30:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522967  77 58438 19845318 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 05:30:59 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 05:31:19 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 05:31:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:31:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 05:31:31 [WARNING ] (13, 1, 'bot')
2018-11-16 05:31:31 [WARNING ] (13, 1, 'bot')
2018-11-16 05:31:31 [WARNING ] (13, 1, 'bot')
2018-11-16 05:31:31 [WARNING ] (13, 1, 'bot')
2018-11-16 05:31:31 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:31:31 [DEBUG   ] Finished updating board flags in 1.358 seconds
2018-11-16 05:31:39 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-16 05:31:59 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 05:32:20 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-11-16 05:32:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:32:32 [WARNING ] (13, 1, 'bot')
2018-11-16 05:32:32 [WARNING ] (13, 1, 'bot')
2018-11-16 05:32:32 [WARNING ] (13, 1, 'bot')
2018-11-16 05:32:32 [WARNING ] (13, 1, 'bot')
2018-11-16 05:32:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:32:32 [DEBUG   ] Finished updating board flags in 2.066 seconds
2018-11-16 05:32:39 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-16 05:32:59 [DEBUG   ] Finished updating ant stats in 0.399 seconds
2018-11-16 05:33:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 05:33:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:33:32 [WARNING ] (13, 1, 'bot')
2018-11-16 05:33:32 [WARNING ] (13, 1, 'bot')
2018-11-16 05:33:32 [WARNING ] (13, 1, 'bot')
2018-11-16 05:33:32 [WARNING ] (13, 1, 'bot')
2018-11-16 05:33:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:33:32 [DEBUG   ] Finished updating board flags in 1.980 seconds
2018-11-16 05:33:32 [DEBUG   ] Got command RPT from MCS: ref #522987
2018-11-16 05:33:32 [DEBUG   ] summary = ERROR
2018-11-16 05:33:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522987  13 58438 20012693 A  ERRORERROR'
2018-11-16 05:33:32 [DEBUG   ] Got command RPT from MCS: ref #522988
2018-11-16 05:33:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 05:33:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522988  77 58438 20012897 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 05:33:33 [DEBUG   ] Got command RPT from MCS: ref #522989
2018-11-16 05:33:33 [DEBUG   ] summary = ERROR
2018-11-16 05:33:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522989  13 58438 20013101 A  ERRORERROR'
2018-11-16 05:33:33 [DEBUG   ] Got command RPT from MCS: ref #522990
2018-11-16 05:33:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 05:33:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522990  77 58438 20013305 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 05:33:33 [DEBUG   ] Got command RPT from MCS: ref #522991
2018-11-16 05:33:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 05:33:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522991  12 58438 20013497 A  ERRORB—™š'
2018-11-16 05:33:40 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-16 05:34:00 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-16 05:34:20 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 05:34:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:34:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 05:34:32 [WARNING ] (13, 1, 'bot')
2018-11-16 05:34:32 [WARNING ] (13, 1, 'bot')
2018-11-16 05:34:32 [WARNING ] (13, 1, 'bot')
2018-11-16 05:34:32 [WARNING ] (13, 1, 'bot')
2018-11-16 05:34:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:34:32 [DEBUG   ] Finished updating board flags in 1.821 seconds
2018-11-16 05:34:40 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 05:35:00 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-16 05:35:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 05:35:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:35:32 [WARNING ] (13, 1, 'bot')
2018-11-16 05:35:32 [WARNING ] (13, 1, 'bot')
2018-11-16 05:35:32 [WARNING ] (13, 1, 'bot')
2018-11-16 05:35:32 [WARNING ] (13, 1, 'bot')
2018-11-16 05:35:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:35:32 [DEBUG   ] Finished updating board flags in 1.800 seconds
2018-11-16 05:35:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 05:35:45 [DEBUG   ] Got command RPT from MCS: ref #522996
2018-11-16 05:35:45 [DEBUG   ] summary = ERROR
2018-11-16 05:35:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522996  13 58438 20145325 A  ERRORERROR'
2018-11-16 05:35:45 [DEBUG   ] Got command RPT from MCS: ref #522997
2018-11-16 05:35:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 05:35:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   522997  77 58438 20145326 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 05:36:00 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 05:36:20 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-16 05:36:31 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 05:36:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:36:32 [WARNING ] (13, 1, 'bot')
2018-11-16 05:36:32 [WARNING ] (13, 1, 'bot')
2018-11-16 05:36:32 [WARNING ] (13, 1, 'bot')
2018-11-16 05:36:32 [WARNING ] (13, 1, 'bot')
2018-11-16 05:36:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:36:32 [DEBUG   ] Finished updating board flags in 1.880 seconds
2018-11-16 05:36:40 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 05:37:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 05:37:20 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 05:37:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:37:32 [WARNING ] (13, 1, 'bot')
2018-11-16 05:37:32 [WARNING ] (13, 1, 'bot')
2018-11-16 05:37:32 [WARNING ] (13, 1, 'bot')
2018-11-16 05:37:32 [WARNING ] (13, 1, 'bot')
2018-11-16 05:37:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:37:32 [DEBUG   ] Finished updating board flags in 1.718 seconds
2018-11-16 05:37:40 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 05:38:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 05:38:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 05:38:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:38:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-16 05:38:32 [WARNING ] (13, 1, 'bot')
2018-11-16 05:38:32 [WARNING ] (13, 1, 'bot')
2018-11-16 05:38:32 [WARNING ] (13, 1, 'bot')
2018-11-16 05:38:32 [WARNING ] (13, 1, 'bot')
2018-11-16 05:38:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:38:32 [DEBUG   ] Finished updating board flags in 1.650 seconds
2018-11-16 05:38:32 [DEBUG   ] Got command RPT from MCS: ref #523015
2018-11-16 05:38:32 [DEBUG   ] summary = ERROR
2018-11-16 05:38:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523015  13 58438 20312773 A  ERRORERROR'
2018-11-16 05:38:32 [DEBUG   ] Got command RPT from MCS: ref #523016
2018-11-16 05:38:32 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 05:38:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523016  77 58438 20312977 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 05:38:33 [DEBUG   ] Got command RPT from MCS: ref #523017
2018-11-16 05:38:33 [DEBUG   ] summary = ERROR
2018-11-16 05:38:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523017  13 58438 20313181 A  ERRORERROR'
2018-11-16 05:38:33 [DEBUG   ] Got command RPT from MCS: ref #523019
2018-11-16 05:38:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 05:38:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523019  77 58438 20313385 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 05:38:33 [DEBUG   ] Got command RPT from MCS: ref #523020
2018-11-16 05:38:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 05:38:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523020  12 58438 20313577 A  ERRORB—™š'
2018-11-16 05:38:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 05:39:00 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 05:39:20 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-16 05:39:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:39:32 [WARNING ] (13, 1, 'bot')
2018-11-16 05:39:32 [WARNING ] (13, 1, 'bot')
2018-11-16 05:39:32 [WARNING ] (13, 1, 'bot')
2018-11-16 05:39:32 [WARNING ] (13, 1, 'bot')
2018-11-16 05:39:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:39:32 [DEBUG   ] Finished updating board flags in 1.561 seconds
2018-11-16 05:39:41 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-11-16 05:40:01 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2018-11-16 05:40:21 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-16 05:40:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:40:32 [WARNING ] (13, 1, 'bot')
2018-11-16 05:40:32 [WARNING ] (13, 1, 'bot')
2018-11-16 05:40:32 [WARNING ] (13, 1, 'bot')
2018-11-16 05:40:32 [WARNING ] (13, 1, 'bot')
2018-11-16 05:40:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:40:32 [DEBUG   ] Finished updating board flags in 1.413 seconds
2018-11-16 05:40:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 05:40:45 [DEBUG   ] Got command RPT from MCS: ref #523029
2018-11-16 05:40:45 [DEBUG   ] summary = ERROR
2018-11-16 05:40:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523029  13 58438 20445321 A  ERRORERROR'
2018-11-16 05:40:45 [DEBUG   ] Got command RPT from MCS: ref #523030
2018-11-16 05:40:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 05:40:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523030  77 58438 20445322 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 05:41:01 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-11-16 05:41:21 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-16 05:41:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:41:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-16 05:41:32 [WARNING ] (13, 1, 'bot')
2018-11-16 05:41:32 [WARNING ] (13, 1, 'bot')
2018-11-16 05:41:32 [WARNING ] (13, 1, 'bot')
2018-11-16 05:41:32 [WARNING ] (13, 1, 'bot')
2018-11-16 05:41:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:41:32 [DEBUG   ] Finished updating board flags in 1.410 seconds
2018-11-16 05:41:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 05:42:01 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 05:42:21 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 05:42:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:42:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-16 05:42:32 [WARNING ] (13, 1, 'bot')
2018-11-16 05:42:32 [WARNING ] (13, 1, 'bot')
2018-11-16 05:42:32 [WARNING ] (13, 1, 'bot')
2018-11-16 05:42:32 [WARNING ] (13, 1, 'bot')
2018-11-16 05:42:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:42:32 [DEBUG   ] Finished updating board flags in 1.404 seconds
2018-11-16 05:42:41 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 05:43:01 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-16 05:43:21 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-16 05:43:31 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:43:32 [WARNING ] (13, 1, 'bot')
2018-11-16 05:43:32 [WARNING ] (13, 1, 'bot')
2018-11-16 05:43:32 [WARNING ] (13, 1, 'bot')
2018-11-16 05:43:32 [WARNING ] (13, 1, 'bot')
2018-11-16 05:43:32 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:43:32 [DEBUG   ] Finished updating board flags in 1.377 seconds
2018-11-16 05:43:32 [DEBUG   ] Got command RPT from MCS: ref #523050
2018-11-16 05:43:32 [DEBUG   ] summary = ERROR
2018-11-16 05:43:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523050  13 58438 20612853 A  ERRORERROR'
2018-11-16 05:43:33 [DEBUG   ] Got command RPT from MCS: ref #523051
2018-11-16 05:43:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 05:43:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523051  77 58438 20613057 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 05:43:33 [DEBUG   ] Got command RPT from MCS: ref #523052
2018-11-16 05:43:33 [DEBUG   ] summary = ERROR
2018-11-16 05:43:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523052  13 58438 20613261 A  ERRORERROR'
2018-11-16 05:43:33 [DEBUG   ] Got command RPT from MCS: ref #523053
2018-11-16 05:43:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 05:43:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523053  77 58438 20613465 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 05:43:33 [DEBUG   ] Got command RPT from MCS: ref #523054
2018-11-16 05:43:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 05:43:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523054  12 58438 20613657 A  ERRORB–™š'
2018-11-16 05:43:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 05:44:01 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-11-16 05:44:21 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-16 05:44:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:44:33 [WARNING ] (13, 1, 'bot')
2018-11-16 05:44:33 [WARNING ] (13, 1, 'bot')
2018-11-16 05:44:33 [WARNING ] (13, 1, 'bot')
2018-11-16 05:44:33 [WARNING ] (13, 1, 'bot')
2018-11-16 05:44:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:44:33 [DEBUG   ] Finished updating board flags in 2.206 seconds
2018-11-16 05:44:41 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 05:45:02 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-16 05:45:22 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-16 05:45:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:45:33 [WARNING ] (13, 1, 'bot')
2018-11-16 05:45:33 [WARNING ] (13, 1, 'bot')
2018-11-16 05:45:33 [WARNING ] (13, 1, 'bot')
2018-11-16 05:45:33 [WARNING ] (13, 1, 'bot')
2018-11-16 05:45:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:45:33 [DEBUG   ] Finished updating board flags in 2.192 seconds
2018-11-16 05:45:42 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-16 05:45:45 [DEBUG   ] Got command RPT from MCS: ref #523059
2018-11-16 05:45:45 [DEBUG   ] summary = ERROR
2018-11-16 05:45:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523059  13 58438 20745325 A  ERRORERROR'
2018-11-16 05:45:45 [DEBUG   ] Got command RPT from MCS: ref #523060
2018-11-16 05:45:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 05:45:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523060  77 58438 20745326 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 05:46:02 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 05:46:22 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-16 05:46:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:46:33 [WARNING ] (13, 1, 'bot')
2018-11-16 05:46:33 [WARNING ] (13, 1, 'bot')
2018-11-16 05:46:33 [WARNING ] (13, 1, 'bot')
2018-11-16 05:46:33 [WARNING ] (13, 1, 'bot')
2018-11-16 05:46:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:46:33 [DEBUG   ] Finished updating board flags in 2.010 seconds
2018-11-16 05:46:42 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-16 05:47:02 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 05:47:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 05:47:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:47:33 [WARNING ] (13, 1, 'bot')
2018-11-16 05:47:33 [WARNING ] (13, 1, 'bot')
2018-11-16 05:47:33 [WARNING ] (13, 1, 'bot')
2018-11-16 05:47:33 [WARNING ] (13, 1, 'bot')
2018-11-16 05:47:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:47:33 [DEBUG   ] Finished updating board flags in 2.005 seconds
2018-11-16 05:47:42 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 05:48:02 [DEBUG   ] Finished updating ant stats in 0.986 seconds
2018-11-16 05:48:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 05:48:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 05:48:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:48:32 [DEBUG   ] Got command RPT from MCS: ref #523082
2018-11-16 05:48:32 [DEBUG   ] summary = ERROR
2018-11-16 05:48:32 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523082  13 58438 20912941 A  ERRORERROR'
2018-11-16 05:48:33 [DEBUG   ] Got command RPT from MCS: ref #523083
2018-11-16 05:48:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 05:48:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523083  77 58438 20913137 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 05:48:33 [DEBUG   ] Got command RPT from MCS: ref #523084
2018-11-16 05:48:33 [DEBUG   ] summary = ERROR
2018-11-16 05:48:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523084  13 58438 20913341 A  ERRORERROR'
2018-11-16 05:48:33 [DEBUG   ] Got command RPT from MCS: ref #523086
2018-11-16 05:48:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 05:48:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523086  77 58438 20913545 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 05:48:33 [WARNING ] (13, 1, 'bot')
2018-11-16 05:48:33 [WARNING ] (13, 1, 'bot')
2018-11-16 05:48:33 [WARNING ] (13, 1, 'bot')
2018-11-16 05:48:33 [WARNING ] (13, 1, 'bot')
2018-11-16 05:48:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:48:33 [DEBUG   ] Finished updating board flags in 1.989 seconds
2018-11-16 05:48:33 [DEBUG   ] Got command RPT from MCS: ref #523088
2018-11-16 05:48:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 05:48:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523088  12 58438 20913737 A  ERRORB—™š'
2018-11-16 05:48:42 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 05:49:02 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 05:49:22 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-16 05:49:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:49:33 [WARNING ] (13, 1, 'bot')
2018-11-16 05:49:33 [WARNING ] (13, 1, 'bot')
2018-11-16 05:49:33 [WARNING ] (13, 1, 'bot')
2018-11-16 05:49:33 [WARNING ] (13, 1, 'bot')
2018-11-16 05:49:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:49:33 [DEBUG   ] Finished updating board flags in 1.799 seconds
2018-11-16 05:49:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 05:50:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 05:50:22 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 05:50:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:50:33 [WARNING ] (13, 1, 'bot')
2018-11-16 05:50:33 [WARNING ] (13, 1, 'bot')
2018-11-16 05:50:33 [WARNING ] (13, 1, 'bot')
2018-11-16 05:50:33 [WARNING ] (13, 1, 'bot')
2018-11-16 05:50:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:50:33 [DEBUG   ] Finished updating board flags in 1.589 seconds
2018-11-16 05:50:42 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-16 05:50:45 [DEBUG   ] Got command RPT from MCS: ref #523096
2018-11-16 05:50:45 [DEBUG   ] summary = ERROR
2018-11-16 05:50:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523096  13 58438 21045325 A  ERRORERROR'
2018-11-16 05:50:45 [DEBUG   ] Got command RPT from MCS: ref #523097
2018-11-16 05:50:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 05:50:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523097  77 58438 21045326 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 05:51:03 [DEBUG   ] Finished updating ant stats in 1.405 seconds
2018-11-16 05:51:23 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-11-16 05:51:32 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 05:51:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:51:33 [WARNING ] (13, 1, 'bot')
2018-11-16 05:51:33 [WARNING ] (13, 1, 'bot')
2018-11-16 05:51:33 [WARNING ] (13, 1, 'bot')
2018-11-16 05:51:33 [WARNING ] (13, 1, 'bot')
2018-11-16 05:51:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:51:33 [DEBUG   ] Finished updating board flags in 1.407 seconds
2018-11-16 05:51:43 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-16 05:52:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 05:52:23 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-16 05:52:32 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:52:33 [WARNING ] (13, 1, 'bot')
2018-11-16 05:52:33 [WARNING ] (13, 1, 'bot')
2018-11-16 05:52:33 [WARNING ] (13, 1, 'bot')
2018-11-16 05:52:33 [WARNING ] (13, 1, 'bot')
2018-11-16 05:52:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:52:33 [DEBUG   ] Finished updating board flags in 1.398 seconds
2018-11-16 05:52:43 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-16 05:53:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 05:53:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 05:53:33 [DEBUG   ] Got command RPT from MCS: ref #523113
2018-11-16 05:53:33 [DEBUG   ] summary = ERROR
2018-11-16 05:53:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523113  13 58438 21213021 A  ERRORERROR'
2018-11-16 05:53:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:53:33 [DEBUG   ] Got command RPT from MCS: ref #523114
2018-11-16 05:53:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 05:53:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523114  77 58438 21213218 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 05:53:33 [DEBUG   ] Got command RPT from MCS: ref #523115
2018-11-16 05:53:33 [DEBUG   ] summary = ERROR
2018-11-16 05:53:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523115  13 58438 21213422 A  ERRORERROR'
2018-11-16 05:53:33 [DEBUG   ] Got command RPT from MCS: ref #523116
2018-11-16 05:53:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 05:53:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523116  77 58438 21213626 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 05:53:33 [WARNING ] (13, 1, 'bot')
2018-11-16 05:53:33 [WARNING ] (13, 1, 'bot')
2018-11-16 05:53:33 [WARNING ] (13, 1, 'bot')
2018-11-16 05:53:33 [WARNING ] (13, 1, 'bot')
2018-11-16 05:53:33 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:53:33 [DEBUG   ] Finished updating board flags in 1.356 seconds
2018-11-16 05:53:33 [DEBUG   ] Got command RPT from MCS: ref #523117
2018-11-16 05:53:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 05:53:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523117  12 58438 21213821 A  ERRORB—™š'
2018-11-16 05:53:43 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-11-16 05:54:03 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-16 05:54:23 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 05:54:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 05:54:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:54:34 [WARNING ] (13, 1, 'bot')
2018-11-16 05:54:34 [WARNING ] (13, 1, 'bot')
2018-11-16 05:54:34 [WARNING ] (13, 1, 'bot')
2018-11-16 05:54:34 [WARNING ] (13, 1, 'bot')
2018-11-16 05:54:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:54:34 [DEBUG   ] Finished updating board flags in 2.061 seconds
2018-11-16 05:54:43 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 05:55:03 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-16 05:55:23 [DEBUG   ] Finished updating ant stats in 0.796 seconds
2018-11-16 05:55:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:55:34 [WARNING ] (13, 1, 'bot')
2018-11-16 05:55:34 [WARNING ] (13, 1, 'bot')
2018-11-16 05:55:34 [WARNING ] (13, 1, 'bot')
2018-11-16 05:55:34 [WARNING ] (13, 1, 'bot')
2018-11-16 05:55:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:55:34 [DEBUG   ] Finished updating board flags in 1.986 seconds
2018-11-16 05:55:43 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-16 05:55:45 [DEBUG   ] Got command RPT from MCS: ref #523122
2018-11-16 05:55:45 [DEBUG   ] summary = ERROR
2018-11-16 05:55:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523122  13 58438 21345325 A  ERRORERROR'
2018-11-16 05:55:45 [DEBUG   ] Got command RPT from MCS: ref #523123
2018-11-16 05:55:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 05:55:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523123  77 58438 21345326 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 05:56:03 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-16 05:56:24 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-16 05:56:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:56:34 [WARNING ] (13, 1, 'bot')
2018-11-16 05:56:34 [WARNING ] (13, 1, 'bot')
2018-11-16 05:56:34 [WARNING ] (13, 1, 'bot')
2018-11-16 05:56:34 [WARNING ] (13, 1, 'bot')
2018-11-16 05:56:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:56:34 [DEBUG   ] Finished updating board flags in 1.820 seconds
2018-11-16 05:56:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 05:57:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 05:57:24 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-16 05:57:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:57:34 [WARNING ] (13, 1, 'bot')
2018-11-16 05:57:34 [WARNING ] (13, 1, 'bot')
2018-11-16 05:57:34 [WARNING ] (13, 1, 'bot')
2018-11-16 05:57:34 [WARNING ] (13, 1, 'bot')
2018-11-16 05:57:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:57:34 [DEBUG   ] Finished updating board flags in 1.809 seconds
2018-11-16 05:57:44 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-16 05:58:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 05:58:24 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 05:58:33 [DEBUG   ] Got command RPT from MCS: ref #523145
2018-11-16 05:58:33 [DEBUG   ] summary = ERROR
2018-11-16 05:58:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523145  13 58438 21513093 A  ERRORERROR'
2018-11-16 05:58:33 [DEBUG   ] Got command RPT from MCS: ref #523146
2018-11-16 05:58:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 05:58:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523146  77 58438 21513297 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 05:58:33 [DEBUG   ] Got command RPT from MCS: ref #523147
2018-11-16 05:58:33 [DEBUG   ] summary = ERROR
2018-11-16 05:58:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523147  13 58438 21513502 A  ERRORERROR'
2018-11-16 05:58:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:58:33 [DEBUG   ] Got command RPT from MCS: ref #523149
2018-11-16 05:58:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 05:58:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523149  77 58438 21513705 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 05:58:33 [DEBUG   ] Got command RPT from MCS: ref #523150
2018-11-16 05:58:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 05:58:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523150  12 58438 21513897 A  ERRORB‹ÌÍ'
2018-11-16 05:58:34 [WARNING ] (13, 1, 'bot')
2018-11-16 05:58:34 [WARNING ] (13, 1, 'bot')
2018-11-16 05:58:34 [WARNING ] (13, 1, 'bot')
2018-11-16 05:58:34 [WARNING ] (13, 1, 'bot')
2018-11-16 05:58:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:58:34 [DEBUG   ] Finished updating board flags in 1.778 seconds
2018-11-16 05:58:44 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 05:59:04 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-16 05:59:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 05:59:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 05:59:34 [WARNING ] (13, 1, 'bot')
2018-11-16 05:59:34 [WARNING ] (13, 1, 'bot')
2018-11-16 05:59:34 [WARNING ] (13, 1, 'bot')
2018-11-16 05:59:34 [WARNING ] (13, 1, 'bot')
2018-11-16 05:59:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 05:59:34 [DEBUG   ] Finished updating board flags in 1.607 seconds
2018-11-16 05:59:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 06:00:04 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 06:00:24 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-16 06:00:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:00:34 [WARNING ] (13, 1, 'bot')
2018-11-16 06:00:34 [WARNING ] (13, 1, 'bot')
2018-11-16 06:00:34 [WARNING ] (13, 1, 'bot')
2018-11-16 06:00:34 [WARNING ] (13, 1, 'bot')
2018-11-16 06:00:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:00:34 [DEBUG   ] Finished updating board flags in 1.691 seconds
2018-11-16 06:00:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 06:00:45 [DEBUG   ] Got command RPT from MCS: ref #523159
2018-11-16 06:00:45 [DEBUG   ] summary = ERROR
2018-11-16 06:00:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523159  13 58438 21645329 A  ERRORERROR'
2018-11-16 06:00:45 [DEBUG   ] Got command RPT from MCS: ref #523160
2018-11-16 06:00:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 06:00:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523160  77 58438 21645330 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 06:01:04 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 06:01:24 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-11-16 06:01:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:01:34 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-16 06:01:34 [WARNING ] (13, 1, 'bot')
2018-11-16 06:01:34 [WARNING ] (13, 1, 'bot')
2018-11-16 06:01:34 [WARNING ] (13, 1, 'bot')
2018-11-16 06:01:34 [WARNING ] (13, 1, 'bot')
2018-11-16 06:01:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:01:34 [DEBUG   ] Finished updating board flags in 1.507 seconds
2018-11-16 06:01:45 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-11-16 06:02:05 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-16 06:02:25 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-16 06:02:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:02:34 [WARNING ] (13, 1, 'bot')
2018-11-16 06:02:34 [WARNING ] (13, 1, 'bot')
2018-11-16 06:02:34 [WARNING ] (13, 1, 'bot')
2018-11-16 06:02:34 [WARNING ] (13, 1, 'bot')
2018-11-16 06:02:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:02:34 [DEBUG   ] Finished updating board flags in 1.420 seconds
2018-11-16 06:02:45 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-16 06:03:05 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-16 06:03:25 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 06:03:33 [DEBUG   ] Got command RPT from MCS: ref #523180
2018-11-16 06:03:33 [DEBUG   ] summary = ERROR
2018-11-16 06:03:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523180  13 58438 21813173 A  ERRORERROR'
2018-11-16 06:03:33 [DEBUG   ] Got command RPT from MCS: ref #523181
2018-11-16 06:03:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 06:03:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523181  77 58438 21813378 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 06:03:33 [DEBUG   ] Got command RPT from MCS: ref #523182
2018-11-16 06:03:33 [DEBUG   ] summary = ERROR
2018-11-16 06:03:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523182  13 58438 21813582 A  ERRORERROR'
2018-11-16 06:03:33 [DEBUG   ] Got command RPT from MCS: ref #523183
2018-11-16 06:03:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 06:03:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523183  77 58438 21813785 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 06:03:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:03:33 [DEBUG   ] Got command RPT from MCS: ref #523184
2018-11-16 06:03:33 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 06:03:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523184  12 58438 21813977 A  ERRORB‹ÌÍ'
2018-11-16 06:03:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-16 06:03:34 [WARNING ] (13, 1, 'bot')
2018-11-16 06:03:34 [WARNING ] (13, 1, 'bot')
2018-11-16 06:03:34 [WARNING ] (13, 1, 'bot')
2018-11-16 06:03:34 [WARNING ] (13, 1, 'bot')
2018-11-16 06:03:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:03:34 [DEBUG   ] Finished updating board flags in 1.421 seconds
2018-11-16 06:03:45 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-16 06:04:05 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-16 06:04:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 06:04:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:04:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-16 06:04:34 [WARNING ] (13, 1, 'bot')
2018-11-16 06:04:34 [WARNING ] (13, 1, 'bot')
2018-11-16 06:04:34 [WARNING ] (13, 1, 'bot')
2018-11-16 06:04:34 [WARNING ] (13, 1, 'bot')
2018-11-16 06:04:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:04:34 [DEBUG   ] Finished updating board flags in 1.416 seconds
2018-11-16 06:04:45 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-16 06:05:05 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-16 06:05:26 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-11-16 06:05:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:05:34 [WARNING ] (13, 1, 'bot')
2018-11-16 06:05:34 [WARNING ] (13, 1, 'bot')
2018-11-16 06:05:34 [WARNING ] (13, 1, 'bot')
2018-11-16 06:05:34 [WARNING ] (13, 1, 'bot')
2018-11-16 06:05:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:05:34 [DEBUG   ] Finished updating board flags in 1.414 seconds
2018-11-16 06:05:45 [DEBUG   ] Got command RPT from MCS: ref #523189
2018-11-16 06:05:45 [DEBUG   ] summary = ERROR
2018-11-16 06:05:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523189  13 58438 21945330 A  ERRORERROR'
2018-11-16 06:05:45 [DEBUG   ] Got command RPT from MCS: ref #523190
2018-11-16 06:05:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 06:05:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523190  77 58438 21945330 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 06:05:46 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-16 06:06:06 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-16 06:06:26 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-16 06:06:33 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:06:34 [WARNING ] (13, 1, 'bot')
2018-11-16 06:06:34 [WARNING ] (13, 1, 'bot')
2018-11-16 06:06:34 [WARNING ] (13, 1, 'bot')
2018-11-16 06:06:34 [WARNING ] (13, 1, 'bot')
2018-11-16 06:06:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:06:34 [DEBUG   ] Finished updating board flags in 1.422 seconds
2018-11-16 06:06:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 06:07:06 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 06:07:26 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-16 06:07:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-16 06:07:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:07:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 06:07:34 [WARNING ] (13, 1, 'bot')
2018-11-16 06:07:34 [WARNING ] (13, 1, 'bot')
2018-11-16 06:07:34 [WARNING ] (13, 1, 'bot')
2018-11-16 06:07:34 [WARNING ] (13, 1, 'bot')
2018-11-16 06:07:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:07:34 [DEBUG   ] Finished updating board flags in 1.418 seconds
2018-11-16 06:07:46 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-16 06:08:06 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 06:08:26 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 06:08:33 [DEBUG   ] Got command RPT from MCS: ref #523208
2018-11-16 06:08:33 [DEBUG   ] summary = ERROR
2018-11-16 06:08:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523208  13 58438 22113257 A  ERRORERROR'
2018-11-16 06:08:33 [DEBUG   ] Got command RPT from MCS: ref #523209
2018-11-16 06:08:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 06:08:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523209  77 58438 22113462 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 06:08:33 [DEBUG   ] Got command RPT from MCS: ref #523210
2018-11-16 06:08:33 [DEBUG   ] summary = ERROR
2018-11-16 06:08:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523210  13 58438 22113653 A  ERRORERROR'
2018-11-16 06:08:33 [DEBUG   ] Got command RPT from MCS: ref #523212
2018-11-16 06:08:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 06:08:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523212  77 58438 22113857 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 06:08:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:08:34 [DEBUG   ] Got command RPT from MCS: ref #523214
2018-11-16 06:08:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 06:08:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523214  12 58438 22114061 A  ERRORBŽÌÍ'
2018-11-16 06:08:34 [WARNING ] (13, 1, 'bot')
2018-11-16 06:08:34 [WARNING ] (13, 1, 'bot')
2018-11-16 06:08:34 [WARNING ] (13, 1, 'bot')
2018-11-16 06:08:34 [WARNING ] (13, 1, 'bot')
2018-11-16 06:08:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:08:34 [DEBUG   ] Finished updating board flags in 1.431 seconds
2018-11-16 06:08:46 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-16 06:09:06 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-16 06:09:26 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 06:09:33 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 06:09:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:09:34 [WARNING ] (13, 1, 'bot')
2018-11-16 06:09:34 [WARNING ] (13, 1, 'bot')
2018-11-16 06:09:34 [WARNING ] (13, 1, 'bot')
2018-11-16 06:09:34 [WARNING ] (13, 1, 'bot')
2018-11-16 06:09:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:09:34 [DEBUG   ] Finished updating board flags in 1.422 seconds
2018-11-16 06:09:46 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 06:10:06 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 06:10:26 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-16 06:10:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:10:34 [WARNING ] (13, 1, 'bot')
2018-11-16 06:10:34 [WARNING ] (13, 1, 'bot')
2018-11-16 06:10:34 [WARNING ] (13, 1, 'bot')
2018-11-16 06:10:34 [WARNING ] (13, 1, 'bot')
2018-11-16 06:10:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:10:34 [DEBUG   ] Finished updating board flags in 1.419 seconds
2018-11-16 06:10:45 [DEBUG   ] Got command RPT from MCS: ref #523222
2018-11-16 06:10:45 [DEBUG   ] summary = ERROR
2018-11-16 06:10:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523222  13 58438 22245325 A  ERRORERROR'
2018-11-16 06:10:45 [DEBUG   ] Got command RPT from MCS: ref #523223
2018-11-16 06:10:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 06:10:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523223  77 58438 22245326 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 06:10:46 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-16 06:11:07 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-16 06:11:27 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-16 06:11:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:11:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 06:11:34 [WARNING ] (13, 1, 'bot')
2018-11-16 06:11:34 [WARNING ] (13, 1, 'bot')
2018-11-16 06:11:34 [WARNING ] (13, 1, 'bot')
2018-11-16 06:11:34 [WARNING ] (13, 1, 'bot')
2018-11-16 06:11:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:11:34 [DEBUG   ] Finished updating board flags in 1.427 seconds
2018-11-16 06:11:47 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 06:12:07 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-16 06:12:27 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-16 06:12:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:12:34 [WARNING ] (13, 1, 'bot')
2018-11-16 06:12:34 [WARNING ] (13, 1, 'bot')
2018-11-16 06:12:34 [WARNING ] (13, 1, 'bot')
2018-11-16 06:12:34 [WARNING ] (13, 1, 'bot')
2018-11-16 06:12:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:12:34 [DEBUG   ] Finished updating board flags in 1.420 seconds
2018-11-16 06:12:47 [DEBUG   ] Finished updating ant stats in 0.930 seconds
2018-11-16 06:13:07 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 06:13:27 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-11-16 06:13:33 [DEBUG   ] Got command RPT from MCS: ref #523243
2018-11-16 06:13:33 [DEBUG   ] summary = ERROR
2018-11-16 06:13:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523243  13 58438 22413337 A  ERRORERROR'
2018-11-16 06:13:33 [DEBUG   ] Got command RPT from MCS: ref #523244
2018-11-16 06:13:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 06:13:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523244  77 58438 22413541 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 06:13:33 [DEBUG   ] Got command RPT from MCS: ref #523245
2018-11-16 06:13:33 [DEBUG   ] summary = ERROR
2018-11-16 06:13:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523245  13 58438 22413745 A  ERRORERROR'
2018-11-16 06:13:33 [DEBUG   ] Got command RPT from MCS: ref #523246
2018-11-16 06:13:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 06:13:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523246  77 58438 22413937 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 06:13:34 [DEBUG   ] Got command RPT from MCS: ref #523247
2018-11-16 06:13:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 06:13:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523247  12 58438 22414142 A  ERRORB�'
2018-11-16 06:13:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:13:35 [WARNING ] (13, 1, 'bot')
2018-11-16 06:13:35 [WARNING ] (13, 1, 'bot')
2018-11-16 06:13:35 [WARNING ] (13, 1, 'bot')
2018-11-16 06:13:35 [WARNING ] (13, 1, 'bot')
2018-11-16 06:13:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:13:35 [DEBUG   ] Finished updating board flags in 2.204 seconds
2018-11-16 06:13:47 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-16 06:14:07 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 06:14:27 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 06:14:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:14:34 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-16 06:14:34 [WARNING ] (13, 1, 'bot')
2018-11-16 06:14:34 [WARNING ] (13, 1, 'bot')
2018-11-16 06:14:34 [WARNING ] (13, 1, 'bot')
2018-11-16 06:14:34 [WARNING ] (13, 1, 'bot')
2018-11-16 06:14:34 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:14:34 [DEBUG   ] Finished updating board flags in 1.315 seconds
2018-11-16 06:14:47 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 06:15:07 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-16 06:15:28 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-16 06:15:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:15:35 [WARNING ] (13, 1, 'bot')
2018-11-16 06:15:35 [WARNING ] (13, 1, 'bot')
2018-11-16 06:15:35 [WARNING ] (13, 1, 'bot')
2018-11-16 06:15:35 [WARNING ] (13, 1, 'bot')
2018-11-16 06:15:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:15:35 [DEBUG   ] Finished updating board flags in 2.084 seconds
2018-11-16 06:15:45 [DEBUG   ] Got command RPT from MCS: ref #523252
2018-11-16 06:15:45 [DEBUG   ] summary = ERROR
2018-11-16 06:15:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523252  13 58438 22545333 A  ERRORERROR'
2018-11-16 06:15:45 [DEBUG   ] Got command RPT from MCS: ref #523253
2018-11-16 06:15:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 06:15:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523253  77 58438 22545334 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 06:15:48 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-16 06:16:08 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-16 06:16:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 06:16:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:16:35 [WARNING ] (13, 1, 'bot')
2018-11-16 06:16:35 [WARNING ] (13, 1, 'bot')
2018-11-16 06:16:35 [WARNING ] (13, 1, 'bot')
2018-11-16 06:16:35 [WARNING ] (13, 1, 'bot')
2018-11-16 06:16:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:16:35 [DEBUG   ] Finished updating board flags in 2.006 seconds
2018-11-16 06:16:48 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 06:17:08 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-16 06:17:28 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-16 06:17:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:17:35 [WARNING ] (13, 1, 'bot')
2018-11-16 06:17:35 [WARNING ] (13, 1, 'bot')
2018-11-16 06:17:35 [WARNING ] (13, 1, 'bot')
2018-11-16 06:17:35 [WARNING ] (13, 1, 'bot')
2018-11-16 06:17:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:17:35 [DEBUG   ] Finished updating board flags in 2.037 seconds
2018-11-16 06:17:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 06:18:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 06:18:28 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 06:18:33 [DEBUG   ] Got command RPT from MCS: ref #523275
2018-11-16 06:18:33 [DEBUG   ] summary = ERROR
2018-11-16 06:18:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523275  13 58438 22713421 A  ERRORERROR'
2018-11-16 06:18:33 [DEBUG   ] Got command RPT from MCS: ref #523276
2018-11-16 06:18:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 06:18:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523276  77 58438 22713613 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 06:18:33 [DEBUG   ] Got command RPT from MCS: ref #523277
2018-11-16 06:18:33 [DEBUG   ] summary = ERROR
2018-11-16 06:18:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523277  13 58438 22713817 A  ERRORERROR'
2018-11-16 06:18:34 [DEBUG   ] Got command RPT from MCS: ref #523279
2018-11-16 06:18:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 06:18:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523279  77 58438 22714025 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 06:18:34 [DEBUG   ] Got command RPT from MCS: ref #523280
2018-11-16 06:18:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 06:18:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523280  12 58438 22714221 A  ERRORB�'
2018-11-16 06:18:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:18:35 [WARNING ] (13, 1, 'bot')
2018-11-16 06:18:35 [WARNING ] (13, 1, 'bot')
2018-11-16 06:18:35 [WARNING ] (13, 1, 'bot')
2018-11-16 06:18:35 [WARNING ] (13, 1, 'bot')
2018-11-16 06:18:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:18:35 [DEBUG   ] Finished updating board flags in 2.009 seconds
2018-11-16 06:18:48 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-16 06:19:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 06:19:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 06:19:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:19:35 [WARNING ] (13, 1, 'bot')
2018-11-16 06:19:35 [WARNING ] (13, 1, 'bot')
2018-11-16 06:19:35 [WARNING ] (13, 1, 'bot')
2018-11-16 06:19:35 [WARNING ] (13, 1, 'bot')
2018-11-16 06:19:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:19:35 [DEBUG   ] Finished updating board flags in 1.954 seconds
2018-11-16 06:19:48 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 06:20:08 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-11-16 06:20:29 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-16 06:20:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:20:35 [WARNING ] (13, 1, 'bot')
2018-11-16 06:20:35 [WARNING ] (13, 1, 'bot')
2018-11-16 06:20:35 [WARNING ] (13, 1, 'bot')
2018-11-16 06:20:35 [WARNING ] (13, 1, 'bot')
2018-11-16 06:20:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:20:35 [DEBUG   ] Finished updating board flags in 1.821 seconds
2018-11-16 06:20:45 [DEBUG   ] Got command RPT from MCS: ref #523289
2018-11-16 06:20:45 [DEBUG   ] summary = ERROR
2018-11-16 06:20:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523289  13 58438 22845325 A  ERRORERROR'
2018-11-16 06:20:45 [DEBUG   ] Got command RPT from MCS: ref #523290
2018-11-16 06:20:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 06:20:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523290  77 58438 22845326 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 06:20:49 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-16 06:21:09 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-16 06:21:29 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-16 06:21:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:21:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 06:21:35 [WARNING ] (13, 1, 'bot')
2018-11-16 06:21:35 [WARNING ] (13, 1, 'bot')
2018-11-16 06:21:35 [WARNING ] (13, 1, 'bot')
2018-11-16 06:21:35 [WARNING ] (13, 1, 'bot')
2018-11-16 06:21:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:21:35 [DEBUG   ] Finished updating board flags in 1.783 seconds
2018-11-16 06:21:49 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 06:22:09 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-11-16 06:22:29 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-16 06:22:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:22:35 [WARNING ] (13, 1, 'bot')
2018-11-16 06:22:35 [WARNING ] (13, 1, 'bot')
2018-11-16 06:22:35 [WARNING ] (13, 1, 'bot')
2018-11-16 06:22:35 [WARNING ] (13, 1, 'bot')
2018-11-16 06:22:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:22:35 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-11-16 06:22:49 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 06:23:09 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 06:23:29 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-11-16 06:23:33 [DEBUG   ] Got command RPT from MCS: ref #523306
2018-11-16 06:23:33 [DEBUG   ] summary = ERROR
2018-11-16 06:23:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523306  13 58438 23013493 A  ERRORERROR'
2018-11-16 06:23:33 [DEBUG   ] Got command RPT from MCS: ref #523307
2018-11-16 06:23:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 06:23:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523307  77 58438 23013697 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 06:23:33 [DEBUG   ] Got command RPT from MCS: ref #523308
2018-11-16 06:23:33 [DEBUG   ] summary = ERROR
2018-11-16 06:23:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523308  13 58438 23013901 A  ERRORERROR'
2018-11-16 06:23:34 [DEBUG   ] Got command RPT from MCS: ref #523309
2018-11-16 06:23:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 06:23:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523309  77 58438 23014110 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 06:23:34 [DEBUG   ] Got command RPT from MCS: ref #523310
2018-11-16 06:23:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 06:23:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523310  12 58438 23014302 A  ERRORB„'
2018-11-16 06:23:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:23:35 [WARNING ] (13, 1, 'bot')
2018-11-16 06:23:35 [WARNING ] (13, 1, 'bot')
2018-11-16 06:23:35 [WARNING ] (13, 1, 'bot')
2018-11-16 06:23:35 [WARNING ] (13, 1, 'bot')
2018-11-16 06:23:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:23:35 [DEBUG   ] Finished updating board flags in 1.593 seconds
2018-11-16 06:23:49 [DEBUG   ] Finished updating ant stats in 0.596 seconds
2018-11-16 06:24:10 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-11-16 06:24:30 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-16 06:24:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:24:35 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 06:24:35 [WARNING ] (13, 1, 'bot')
2018-11-16 06:24:35 [WARNING ] (13, 1, 'bot')
2018-11-16 06:24:35 [WARNING ] (13, 1, 'bot')
2018-11-16 06:24:35 [WARNING ] (13, 1, 'bot')
2018-11-16 06:24:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:24:35 [DEBUG   ] Finished updating board flags in 1.411 seconds
2018-11-16 06:24:50 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-16 06:25:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 06:25:30 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-11-16 06:25:34 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:25:35 [WARNING ] (13, 1, 'bot')
2018-11-16 06:25:35 [WARNING ] (13, 1, 'bot')
2018-11-16 06:25:35 [WARNING ] (13, 1, 'bot')
2018-11-16 06:25:35 [WARNING ] (13, 1, 'bot')
2018-11-16 06:25:35 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:25:35 [DEBUG   ] Finished updating board flags in 1.350 seconds
2018-11-16 06:25:45 [DEBUG   ] Got command RPT from MCS: ref #523315
2018-11-16 06:25:45 [DEBUG   ] summary = ERROR
2018-11-16 06:25:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523315  13 58438 23145325 A  ERRORERROR'
2018-11-16 06:25:45 [DEBUG   ] Got command RPT from MCS: ref #523316
2018-11-16 06:25:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 06:25:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523316  77 58438 23145326 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 06:25:50 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-16 06:26:10 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-16 06:26:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 06:26:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:26:36 [WARNING ] (13, 1, 'bot')
2018-11-16 06:26:36 [WARNING ] (13, 1, 'bot')
2018-11-16 06:26:36 [WARNING ] (13, 1, 'bot')
2018-11-16 06:26:36 [WARNING ] (13, 1, 'bot')
2018-11-16 06:26:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:26:36 [DEBUG   ] Finished updating board flags in 2.154 seconds
2018-11-16 06:26:50 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-11-16 06:27:10 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 06:27:30 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-16 06:27:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:27:36 [WARNING ] (13, 1, 'bot')
2018-11-16 06:27:36 [WARNING ] (13, 1, 'bot')
2018-11-16 06:27:36 [WARNING ] (13, 1, 'bot')
2018-11-16 06:27:36 [WARNING ] (13, 1, 'bot')
2018-11-16 06:27:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:27:36 [DEBUG   ] Finished updating board flags in 2.019 seconds
2018-11-16 06:27:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 06:28:10 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 06:28:30 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-16 06:28:33 [DEBUG   ] Got command RPT from MCS: ref #523338
2018-11-16 06:28:33 [DEBUG   ] summary = ERROR
2018-11-16 06:28:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523338  13 58438 23313581 A  ERRORERROR'
2018-11-16 06:28:33 [DEBUG   ] Got command RPT from MCS: ref #523339
2018-11-16 06:28:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 06:28:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523339  77 58438 23313785 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 06:28:33 [DEBUG   ] Got command RPT from MCS: ref #523340
2018-11-16 06:28:33 [DEBUG   ] summary = ERROR
2018-11-16 06:28:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523340  13 58438 23313977 A  ERRORERROR'
2018-11-16 06:28:34 [DEBUG   ] Got command RPT from MCS: ref #523342
2018-11-16 06:28:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 06:28:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523342  77 58438 23314181 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 06:28:34 [DEBUG   ] Got command RPT from MCS: ref #523343
2018-11-16 06:28:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 06:28:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523343  12 58438 23314385 A  ERRORB—™š'
2018-11-16 06:28:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:28:36 [WARNING ] (13, 1, 'bot')
2018-11-16 06:28:36 [WARNING ] (13, 1, 'bot')
2018-11-16 06:28:36 [WARNING ] (13, 1, 'bot')
2018-11-16 06:28:36 [WARNING ] (13, 1, 'bot')
2018-11-16 06:28:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:28:36 [DEBUG   ] Finished updating board flags in 1.980 seconds
2018-11-16 06:28:50 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-16 06:29:10 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-16 06:29:31 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-16 06:29:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:29:36 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-16 06:29:36 [WARNING ] (13, 1, 'bot')
2018-11-16 06:29:36 [WARNING ] (13, 1, 'bot')
2018-11-16 06:29:36 [WARNING ] (13, 1, 'bot')
2018-11-16 06:29:36 [WARNING ] (13, 1, 'bot')
2018-11-16 06:29:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:29:36 [DEBUG   ] Finished updating board flags in 1.815 seconds
2018-11-16 06:29:51 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-16 06:30:11 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 06:30:31 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-16 06:30:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:30:36 [WARNING ] (13, 1, 'bot')
2018-11-16 06:30:36 [WARNING ] (13, 1, 'bot')
2018-11-16 06:30:36 [WARNING ] (13, 1, 'bot')
2018-11-16 06:30:36 [WARNING ] (13, 1, 'bot')
2018-11-16 06:30:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:30:36 [DEBUG   ] Finished updating board flags in 1.789 seconds
2018-11-16 06:30:45 [DEBUG   ] Got command RPT from MCS: ref #523352
2018-11-16 06:30:45 [DEBUG   ] summary = ERROR
2018-11-16 06:30:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523352  13 58438 23445329 A  ERRORERROR'
2018-11-16 06:30:45 [DEBUG   ] Got command RPT from MCS: ref #523353
2018-11-16 06:30:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 06:30:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523353  77 58438 23445330 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 06:30:51 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-16 06:31:11 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 06:31:31 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 06:31:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:31:36 [WARNING ] (13, 1, 'bot')
2018-11-16 06:31:36 [WARNING ] (13, 1, 'bot')
2018-11-16 06:31:36 [WARNING ] (13, 1, 'bot')
2018-11-16 06:31:36 [WARNING ] (13, 1, 'bot')
2018-11-16 06:31:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:31:36 [DEBUG   ] Finished updating board flags in 1.613 seconds
2018-11-16 06:31:51 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-11-16 06:32:11 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-16 06:32:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 06:32:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:32:36 [WARNING ] (13, 1, 'bot')
2018-11-16 06:32:36 [WARNING ] (13, 1, 'bot')
2018-11-16 06:32:36 [WARNING ] (13, 1, 'bot')
2018-11-16 06:32:36 [WARNING ] (13, 1, 'bot')
2018-11-16 06:32:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:32:36 [DEBUG   ] Finished updating board flags in 1.587 seconds
2018-11-16 06:32:51 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 06:33:11 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 06:33:31 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-16 06:33:33 [DEBUG   ] Got command RPT from MCS: ref #523373
2018-11-16 06:33:33 [DEBUG   ] summary = ERROR
2018-11-16 06:33:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523373  13 58438 23613665 A  ERRORERROR'
2018-11-16 06:33:33 [DEBUG   ] Got command RPT from MCS: ref #523374
2018-11-16 06:33:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 06:33:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523374  77 58438 23613857 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 06:33:34 [DEBUG   ] Got command RPT from MCS: ref #523375
2018-11-16 06:33:34 [DEBUG   ] summary = ERROR
2018-11-16 06:33:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523375  13 58438 23614061 A  ERRORERROR'
2018-11-16 06:33:34 [DEBUG   ] Got command RPT from MCS: ref #523376
2018-11-16 06:33:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 06:33:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523376  77 58438 23614265 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 06:33:34 [DEBUG   ] Got command RPT from MCS: ref #523377
2018-11-16 06:33:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 06:33:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523377  12 58438 23614469 A  ERRORB•™š'
2018-11-16 06:33:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:33:36 [WARNING ] (13, 1, 'bot')
2018-11-16 06:33:36 [WARNING ] (13, 1, 'bot')
2018-11-16 06:33:36 [WARNING ] (13, 1, 'bot')
2018-11-16 06:33:36 [WARNING ] (13, 1, 'bot')
2018-11-16 06:33:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:33:36 [DEBUG   ] Finished updating board flags in 1.417 seconds
2018-11-16 06:33:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 06:34:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 06:34:31 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 06:34:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:34:36 [WARNING ] (13, 1, 'bot')
2018-11-16 06:34:36 [WARNING ] (13, 1, 'bot')
2018-11-16 06:34:36 [WARNING ] (13, 1, 'bot')
2018-11-16 06:34:36 [WARNING ] (13, 1, 'bot')
2018-11-16 06:34:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:34:36 [DEBUG   ] Finished updating board flags in 1.406 seconds
2018-11-16 06:34:51 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-11-16 06:35:12 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-11-16 06:35:32 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-16 06:35:35 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:35:36 [WARNING ] (13, 1, 'bot')
2018-11-16 06:35:36 [WARNING ] (13, 1, 'bot')
2018-11-16 06:35:36 [WARNING ] (13, 1, 'bot')
2018-11-16 06:35:36 [WARNING ] (13, 1, 'bot')
2018-11-16 06:35:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:35:36 [DEBUG   ] Finished updating board flags in 1.384 seconds
2018-11-16 06:35:45 [DEBUG   ] Got command RPT from MCS: ref #523382
2018-11-16 06:35:45 [DEBUG   ] summary = ERROR
2018-11-16 06:35:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523382  13 58438 23745333 A  ERRORERROR'
2018-11-16 06:35:45 [DEBUG   ] Got command RPT from MCS: ref #523383
2018-11-16 06:35:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 06:35:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523383  77 58438 23745334 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 06:35:52 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-16 06:36:12 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-16 06:36:32 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 06:36:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:36:36 [WARNING ] (13, 1, 'bot')
2018-11-16 06:36:36 [WARNING ] (13, 1, 'bot')
2018-11-16 06:36:36 [WARNING ] (13, 1, 'bot')
2018-11-16 06:36:36 [WARNING ] (13, 1, 'bot')
2018-11-16 06:36:36 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:36:36 [DEBUG   ] Finished updating board flags in 1.350 seconds
2018-11-16 06:36:52 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 06:37:12 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-16 06:37:32 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 06:37:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:37:37 [WARNING ] (13, 1, 'bot')
2018-11-16 06:37:37 [WARNING ] (13, 1, 'bot')
2018-11-16 06:37:37 [WARNING ] (13, 1, 'bot')
2018-11-16 06:37:37 [WARNING ] (13, 1, 'bot')
2018-11-16 06:37:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:37:37 [DEBUG   ] Finished updating board flags in 2.062 seconds
2018-11-16 06:37:52 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 06:38:12 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-16 06:38:32 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-16 06:38:33 [DEBUG   ] Got command RPT from MCS: ref #523401
2018-11-16 06:38:33 [DEBUG   ] summary = ERROR
2018-11-16 06:38:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523401  13 58438 23913741 A  ERRORERROR'
2018-11-16 06:38:33 [DEBUG   ] Got command RPT from MCS: ref #523402
2018-11-16 06:38:33 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 06:38:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523402  77 58438 23913945 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 06:38:34 [DEBUG   ] Got command RPT from MCS: ref #523403
2018-11-16 06:38:34 [DEBUG   ] summary = ERROR
2018-11-16 06:38:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523403  13 58438 23914137 A  ERRORERROR'
2018-11-16 06:38:34 [DEBUG   ] Got command RPT from MCS: ref #523405
2018-11-16 06:38:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 06:38:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523405  77 58438 23914341 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 06:38:34 [DEBUG   ] Got command RPT from MCS: ref #523406
2018-11-16 06:38:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 06:38:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523406  12 58438 23914545 A  ERRORB–™š'
2018-11-16 06:38:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:38:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 06:38:37 [WARNING ] (13, 1, 'bot')
2018-11-16 06:38:37 [WARNING ] (13, 1, 'bot')
2018-11-16 06:38:37 [WARNING ] (13, 1, 'bot')
2018-11-16 06:38:37 [WARNING ] (13, 1, 'bot')
2018-11-16 06:38:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:38:37 [DEBUG   ] Finished updating board flags in 2.011 seconds
2018-11-16 06:38:52 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-16 06:39:13 [DEBUG   ] Finished updating ant stats in 1.404 seconds
2018-11-16 06:39:33 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-11-16 06:39:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:39:37 [WARNING ] (13, 1, 'bot')
2018-11-16 06:39:37 [WARNING ] (13, 1, 'bot')
2018-11-16 06:39:37 [WARNING ] (13, 1, 'bot')
2018-11-16 06:39:37 [WARNING ] (13, 1, 'bot')
2018-11-16 06:39:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:39:37 [DEBUG   ] Finished updating board flags in 1.989 seconds
2018-11-16 06:39:53 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-16 06:40:13 [DEBUG   ] Finished updating ant stats in 1.238 seconds
2018-11-16 06:40:33 [DEBUG   ] Finished updating ant stats in 1.168 seconds
2018-11-16 06:40:36 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 06:40:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:40:37 [WARNING ] (13, 1, 'bot')
2018-11-16 06:40:37 [WARNING ] (13, 1, 'bot')
2018-11-16 06:40:37 [WARNING ] (13, 1, 'bot')
2018-11-16 06:40:37 [WARNING ] (13, 1, 'bot')
2018-11-16 06:40:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:40:37 [DEBUG   ] Finished updating board flags in 1.817 seconds
2018-11-16 06:40:45 [DEBUG   ] Got command RPT from MCS: ref #523415
2018-11-16 06:40:45 [DEBUG   ] summary = ERROR
2018-11-16 06:40:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523415  13 58438 24045329 A  ERRORERROR'
2018-11-16 06:40:45 [DEBUG   ] Got command RPT from MCS: ref #523416
2018-11-16 06:40:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 06:40:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523416  77 58438 24045330 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 06:40:53 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-16 06:41:13 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-16 06:41:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 06:41:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:41:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 06:41:37 [WARNING ] (13, 1, 'bot')
2018-11-16 06:41:37 [WARNING ] (13, 1, 'bot')
2018-11-16 06:41:37 [WARNING ] (13, 1, 'bot')
2018-11-16 06:41:37 [WARNING ] (13, 1, 'bot')
2018-11-16 06:41:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:41:37 [DEBUG   ] Finished updating board flags in 1.798 seconds
2018-11-16 06:41:53 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 06:42:13 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-16 06:42:34 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-16 06:42:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:42:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 06:42:37 [WARNING ] (13, 1, 'bot')
2018-11-16 06:42:37 [WARNING ] (13, 1, 'bot')
2018-11-16 06:42:37 [WARNING ] (13, 1, 'bot')
2018-11-16 06:42:37 [WARNING ] (13, 1, 'bot')
2018-11-16 06:42:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:42:37 [DEBUG   ] Finished updating board flags in 1.598 seconds
2018-11-16 06:42:53 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-16 06:43:13 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-11-16 06:43:33 [DEBUG   ] Got command RPT from MCS: ref #523436
2018-11-16 06:43:33 [DEBUG   ] summary = ERROR
2018-11-16 06:43:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523436  13 58438 24213817 A  ERRORERROR'
2018-11-16 06:43:34 [DEBUG   ] Got command RPT from MCS: ref #523437
2018-11-16 06:43:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 06:43:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523437  77 58438 24214021 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 06:43:34 [DEBUG   ] Got command RPT from MCS: ref #523438
2018-11-16 06:43:34 [DEBUG   ] summary = ERROR
2018-11-16 06:43:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523438  13 58438 24214225 A  ERRORERROR'
2018-11-16 06:43:34 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-11-16 06:43:34 [DEBUG   ] Got command RPT from MCS: ref #523439
2018-11-16 06:43:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 06:43:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523439  77 58438 24214417 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 06:43:34 [DEBUG   ] Got command RPT from MCS: ref #523440
2018-11-16 06:43:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 06:43:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523440  12 58438 24214621 A  ERRORB—™š'
2018-11-16 06:43:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:43:37 [WARNING ] (13, 1, 'bot')
2018-11-16 06:43:37 [WARNING ] (13, 1, 'bot')
2018-11-16 06:43:37 [WARNING ] (13, 1, 'bot')
2018-11-16 06:43:37 [WARNING ] (13, 1, 'bot')
2018-11-16 06:43:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:43:37 [DEBUG   ] Finished updating board flags in 1.448 seconds
2018-11-16 06:43:54 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-16 06:44:14 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-16 06:44:34 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-16 06:44:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:44:37 [WARNING ] (13, 1, 'bot')
2018-11-16 06:44:37 [WARNING ] (13, 1, 'bot')
2018-11-16 06:44:37 [WARNING ] (13, 1, 'bot')
2018-11-16 06:44:37 [WARNING ] (13, 1, 'bot')
2018-11-16 06:44:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:44:37 [DEBUG   ] Finished updating board flags in 1.426 seconds
2018-11-16 06:44:54 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 06:45:15 [DEBUG   ] Finished updating ant stats in 2.282 seconds
2018-11-16 06:45:34 [DEBUG   ] Finished updating ant stats in 0.924 seconds
2018-11-16 06:45:36 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:45:37 [WARNING ] (13, 1, 'bot')
2018-11-16 06:45:37 [WARNING ] (13, 1, 'bot')
2018-11-16 06:45:37 [WARNING ] (13, 1, 'bot')
2018-11-16 06:45:37 [WARNING ] (13, 1, 'bot')
2018-11-16 06:45:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:45:37 [DEBUG   ] Finished updating board flags in 1.425 seconds
2018-11-16 06:45:45 [DEBUG   ] Got command RPT from MCS: ref #523445
2018-11-16 06:45:45 [DEBUG   ] summary = ERROR
2018-11-16 06:45:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523445  13 58438 24345329 A  ERRORERROR'
2018-11-16 06:45:45 [DEBUG   ] Got command RPT from MCS: ref #523446
2018-11-16 06:45:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 06:45:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523446  77 58438 24345330 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 06:45:54 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-16 06:46:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 06:46:34 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 06:46:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:46:37 [WARNING ] (13, 1, 'bot')
2018-11-16 06:46:37 [WARNING ] (13, 1, 'bot')
2018-11-16 06:46:37 [WARNING ] (13, 1, 'bot')
2018-11-16 06:46:37 [WARNING ] (13, 1, 'bot')
2018-11-16 06:46:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:46:37 [DEBUG   ] Finished updating board flags in 1.423 seconds
2018-11-16 06:46:54 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-16 06:47:14 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-16 06:47:34 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-16 06:47:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:47:37 [WARNING ] (13, 1, 'bot')
2018-11-16 06:47:37 [WARNING ] (13, 1, 'bot')
2018-11-16 06:47:37 [WARNING ] (13, 1, 'bot')
2018-11-16 06:47:37 [WARNING ] (13, 1, 'bot')
2018-11-16 06:47:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:47:37 [DEBUG   ] Finished updating board flags in 1.421 seconds
2018-11-16 06:47:54 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-16 06:48:14 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-16 06:48:33 [DEBUG   ] Got command RPT from MCS: ref #523468
2018-11-16 06:48:33 [DEBUG   ] summary = ERROR
2018-11-16 06:48:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523468  13 58438 24513897 A  ERRORERROR'
2018-11-16 06:48:34 [DEBUG   ] Got command RPT from MCS: ref #523469
2018-11-16 06:48:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 06:48:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523469  77 58438 24514101 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 06:48:34 [DEBUG   ] Got command RPT from MCS: ref #523470
2018-11-16 06:48:34 [DEBUG   ] summary = ERROR
2018-11-16 06:48:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523470  13 58438 24514301 A  ERRORERROR'
2018-11-16 06:48:34 [DEBUG   ] Got command RPT from MCS: ref #523472
2018-11-16 06:48:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 06:48:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523472  77 58438 24514505 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 06:48:34 [DEBUG   ] Got command RPT from MCS: ref #523474
2018-11-16 06:48:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 06:48:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523474  12 58438 24514709 A  ERRORB–™š'
2018-11-16 06:48:35 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-11-16 06:48:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:48:37 [WARNING ] (13, 1, 'bot')
2018-11-16 06:48:37 [WARNING ] (13, 1, 'bot')
2018-11-16 06:48:37 [WARNING ] (13, 1, 'bot')
2018-11-16 06:48:37 [WARNING ] (13, 1, 'bot')
2018-11-16 06:48:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:48:37 [DEBUG   ] Finished updating board flags in 1.433 seconds
2018-11-16 06:48:55 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-16 06:49:15 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-16 06:49:35 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 06:49:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:49:37 [WARNING ] (13, 1, 'bot')
2018-11-16 06:49:37 [WARNING ] (13, 1, 'bot')
2018-11-16 06:49:37 [WARNING ] (13, 1, 'bot')
2018-11-16 06:49:37 [WARNING ] (13, 1, 'bot')
2018-11-16 06:49:37 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:49:37 [DEBUG   ] Finished updating board flags in 1.435 seconds
2018-11-16 06:49:55 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 06:50:15 [DEBUG   ] Finished updating ant stats in 1.332 seconds
2018-11-16 06:50:35 [DEBUG   ] Finished updating ant stats in 0.867 seconds
2018-11-16 06:50:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:50:38 [WARNING ] (13, 1, 'bot')
2018-11-16 06:50:38 [WARNING ] (13, 1, 'bot')
2018-11-16 06:50:38 [WARNING ] (13, 1, 'bot')
2018-11-16 06:50:38 [WARNING ] (13, 1, 'bot')
2018-11-16 06:50:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:50:38 [DEBUG   ] Finished updating board flags in 2.255 seconds
2018-11-16 06:50:45 [DEBUG   ] Got command RPT from MCS: ref #523482
2018-11-16 06:50:45 [DEBUG   ] summary = ERROR
2018-11-16 06:50:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523482  13 58438 24645341 A  ERRORERROR'
2018-11-16 06:50:45 [DEBUG   ] Got command RPT from MCS: ref #523483
2018-11-16 06:50:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 06:50:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523483  77 58438 24645342 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 06:50:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 06:51:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 06:51:35 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 06:51:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:51:38 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-16 06:51:38 [WARNING ] (13, 1, 'bot')
2018-11-16 06:51:38 [WARNING ] (13, 1, 'bot')
2018-11-16 06:51:38 [WARNING ] (13, 1, 'bot')
2018-11-16 06:51:38 [WARNING ] (13, 1, 'bot')
2018-11-16 06:51:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:51:38 [DEBUG   ] Finished updating board flags in 2.210 seconds
2018-11-16 06:51:55 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-16 06:52:15 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 06:52:35 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 06:52:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:52:38 [WARNING ] (13, 1, 'bot')
2018-11-16 06:52:38 [WARNING ] (13, 1, 'bot')
2018-11-16 06:52:38 [WARNING ] (13, 1, 'bot')
2018-11-16 06:52:38 [WARNING ] (13, 1, 'bot')
2018-11-16 06:52:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:52:38 [DEBUG   ] Finished updating board flags in 2.134 seconds
2018-11-16 06:52:55 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-11-16 06:53:15 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-16 06:53:33 [DEBUG   ] Got command RPT from MCS: ref #523499
2018-11-16 06:53:33 [DEBUG   ] summary = ERROR
2018-11-16 06:53:33 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523499  13 58438 24813985 A  ERRORERROR'
2018-11-16 06:53:34 [DEBUG   ] Got command RPT from MCS: ref #523500
2018-11-16 06:53:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 06:53:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523500  77 58438 24814177 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 06:53:34 [DEBUG   ] Got command RPT from MCS: ref #523501
2018-11-16 06:53:34 [DEBUG   ] summary = ERROR
2018-11-16 06:53:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523501  13 58438 24814381 A  ERRORERROR'
2018-11-16 06:53:34 [DEBUG   ] Got command RPT from MCS: ref #523502
2018-11-16 06:53:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 06:53:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523502  77 58438 24814585 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 06:53:34 [DEBUG   ] Got command RPT from MCS: ref #523503
2018-11-16 06:53:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 06:53:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523503  12 58438 24814789 A  ERRORB•™š'
2018-11-16 06:53:36 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-16 06:53:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:53:38 [WARNING ] (13, 1, 'bot')
2018-11-16 06:53:38 [WARNING ] (13, 1, 'bot')
2018-11-16 06:53:38 [WARNING ] (13, 1, 'bot')
2018-11-16 06:53:38 [WARNING ] (13, 1, 'bot')
2018-11-16 06:53:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:53:38 [DEBUG   ] Finished updating board flags in 2.016 seconds
2018-11-16 06:53:56 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-16 06:54:16 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-16 06:54:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 06:54:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:54:38 [WARNING ] (13, 1, 'bot')
2018-11-16 06:54:38 [WARNING ] (13, 1, 'bot')
2018-11-16 06:54:38 [WARNING ] (13, 1, 'bot')
2018-11-16 06:54:38 [WARNING ] (13, 1, 'bot')
2018-11-16 06:54:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:54:38 [DEBUG   ] Finished updating board flags in 2.010 seconds
2018-11-16 06:54:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 06:55:16 [DEBUG   ] Finished updating ant stats in 1.114 seconds
2018-11-16 06:55:36 [DEBUG   ] Finished updating ant stats in 0.891 seconds
2018-11-16 06:55:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:55:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-16 06:55:38 [WARNING ] (13, 1, 'bot')
2018-11-16 06:55:38 [WARNING ] (13, 1, 'bot')
2018-11-16 06:55:38 [WARNING ] (13, 1, 'bot')
2018-11-16 06:55:38 [WARNING ] (13, 1, 'bot')
2018-11-16 06:55:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:55:38 [DEBUG   ] Finished updating board flags in 1.974 seconds
2018-11-16 06:55:45 [DEBUG   ] Got command RPT from MCS: ref #523508
2018-11-16 06:55:45 [DEBUG   ] summary = ERROR
2018-11-16 06:55:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523508  13 58438 24945333 A  ERRORERROR'
2018-11-16 06:55:45 [DEBUG   ] Got command RPT from MCS: ref #523509
2018-11-16 06:55:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 06:55:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523509  77 58438 24945334 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 06:55:56 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 06:56:16 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 06:56:36 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 06:56:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:56:38 [WARNING ] (13, 1, 'bot')
2018-11-16 06:56:38 [WARNING ] (13, 1, 'bot')
2018-11-16 06:56:38 [WARNING ] (13, 1, 'bot')
2018-11-16 06:56:38 [WARNING ] (13, 1, 'bot')
2018-11-16 06:56:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:56:38 [DEBUG   ] Finished updating board flags in 1.823 seconds
2018-11-16 06:56:56 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-16 06:57:16 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2018-11-16 06:57:36 [DEBUG   ] Finished updating ant stats in 0.405 seconds
2018-11-16 06:57:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:57:38 [WARNING ] (13, 1, 'bot')
2018-11-16 06:57:38 [WARNING ] (13, 1, 'bot')
2018-11-16 06:57:38 [WARNING ] (13, 1, 'bot')
2018-11-16 06:57:38 [WARNING ] (13, 1, 'bot')
2018-11-16 06:57:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:57:38 [DEBUG   ] Finished updating board flags in 1.789 seconds
2018-11-16 06:57:57 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-11-16 06:58:17 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-16 06:58:34 [DEBUG   ] Got command RPT from MCS: ref #523531
2018-11-16 06:58:34 [DEBUG   ] summary = ERROR
2018-11-16 06:58:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523531  13 58438 25114057 A  ERRORERROR'
2018-11-16 06:58:34 [DEBUG   ] Got command RPT from MCS: ref #523532
2018-11-16 06:58:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 06:58:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523532  77 58438 25114261 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 06:58:34 [DEBUG   ] Got command RPT from MCS: ref #523533
2018-11-16 06:58:34 [DEBUG   ] summary = ERROR
2018-11-16 06:58:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523533  13 58438 25114465 A  ERRORERROR'
2018-11-16 06:58:34 [DEBUG   ] Got command RPT from MCS: ref #523534
2018-11-16 06:58:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 06:58:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523534  77 58438 25114657 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 06:58:34 [DEBUG   ] Got command RPT from MCS: ref #523536
2018-11-16 06:58:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 06:58:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523536  12 58438 25114861 A  ERRORB—™š'
2018-11-16 06:58:37 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 06:58:37 [DEBUG   ] Finished updating ant stats in 1.252 seconds
2018-11-16 06:58:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:58:38 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 06:58:38 [WARNING ] (13, 1, 'bot')
2018-11-16 06:58:38 [WARNING ] (13, 1, 'bot')
2018-11-16 06:58:38 [WARNING ] (13, 1, 'bot')
2018-11-16 06:58:38 [WARNING ] (13, 1, 'bot')
2018-11-16 06:58:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:58:38 [DEBUG   ] Finished updating board flags in 1.607 seconds
2018-11-16 06:58:57 [DEBUG   ] Finished updating ant stats in 1.157 seconds
2018-11-16 06:59:17 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-16 06:59:37 [DEBUG   ] Finished updating ant stats in 0.845 seconds
2018-11-16 06:59:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 06:59:38 [WARNING ] (13, 1, 'bot')
2018-11-16 06:59:38 [WARNING ] (13, 1, 'bot')
2018-11-16 06:59:38 [WARNING ] (13, 1, 'bot')
2018-11-16 06:59:38 [WARNING ] (13, 1, 'bot')
2018-11-16 06:59:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 06:59:38 [DEBUG   ] Finished updating board flags in 1.613 seconds
2018-11-16 06:59:57 [DEBUG   ] Finished updating ant stats in 0.755 seconds
2018-11-16 07:00:17 [DEBUG   ] Finished updating ant stats in 0.859 seconds
2018-11-16 07:00:37 [DEBUG   ] Finished updating ant stats in 0.594 seconds
2018-11-16 07:00:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:00:38 [WARNING ] (13, 1, 'bot')
2018-11-16 07:00:38 [WARNING ] (13, 1, 'bot')
2018-11-16 07:00:38 [WARNING ] (13, 1, 'bot')
2018-11-16 07:00:38 [WARNING ] (13, 1, 'bot')
2018-11-16 07:00:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:00:38 [DEBUG   ] Finished updating board flags in 1.579 seconds
2018-11-16 07:00:45 [DEBUG   ] Got command RPT from MCS: ref #523545
2018-11-16 07:00:45 [DEBUG   ] summary = ERROR
2018-11-16 07:00:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523545  13 58438 25245337 A  ERRORERROR'
2018-11-16 07:00:45 [DEBUG   ] Got command RPT from MCS: ref #523546
2018-11-16 07:00:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 07:00:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523546  77 58438 25245338 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 07:00:58 [DEBUG   ] Finished updating ant stats in 1.356 seconds
2018-11-16 07:01:18 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 07:01:37 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 07:01:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:01:38 [DEBUG   ] Finished updating ant stats in 1.243 seconds
2018-11-16 07:01:38 [WARNING ] (13, 1, 'bot')
2018-11-16 07:01:38 [WARNING ] (13, 1, 'bot')
2018-11-16 07:01:38 [WARNING ] (13, 1, 'bot')
2018-11-16 07:01:38 [WARNING ] (13, 1, 'bot')
2018-11-16 07:01:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:01:38 [DEBUG   ] Finished updating board flags in 1.466 seconds
2018-11-16 07:01:58 [DEBUG   ] Finished updating ant stats in 1.159 seconds
2018-11-16 07:02:18 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 07:02:37 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:02:38 [DEBUG   ] Finished updating ant stats in 1.044 seconds
2018-11-16 07:02:38 [WARNING ] (13, 1, 'bot')
2018-11-16 07:02:38 [WARNING ] (13, 1, 'bot')
2018-11-16 07:02:38 [WARNING ] (13, 1, 'bot')
2018-11-16 07:02:38 [WARNING ] (13, 1, 'bot')
2018-11-16 07:02:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:02:38 [DEBUG   ] Finished updating board flags in 1.449 seconds
2018-11-16 07:02:58 [DEBUG   ] Finished updating ant stats in 0.955 seconds
2018-11-16 07:03:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 07:03:34 [DEBUG   ] Got command RPT from MCS: ref #523566
2018-11-16 07:03:34 [DEBUG   ] summary = ERROR
2018-11-16 07:03:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523566  13 58438 25414145 A  ERRORERROR'
2018-11-16 07:03:34 [DEBUG   ] Got command RPT from MCS: ref #523567
2018-11-16 07:03:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 07:03:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523567  77 58438 25414337 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 07:03:34 [DEBUG   ] Got command RPT from MCS: ref #523568
2018-11-16 07:03:34 [DEBUG   ] summary = ERROR
2018-11-16 07:03:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523568  13 58438 25414541 A  ERRORERROR'
2018-11-16 07:03:34 [DEBUG   ] Got command RPT from MCS: ref #523569
2018-11-16 07:03:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 07:03:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523569  77 58438 25414745 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 07:03:34 [DEBUG   ] Got command RPT from MCS: ref #523570
2018-11-16 07:03:34 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 07:03:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523570  12 58438 25414937 A  ERRORB—™š'
2018-11-16 07:03:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:03:38 [DEBUG   ] Finished updating ant stats in 0.848 seconds
2018-11-16 07:03:38 [WARNING ] (13, 1, 'bot')
2018-11-16 07:03:38 [WARNING ] (13, 1, 'bot')
2018-11-16 07:03:38 [WARNING ] (13, 1, 'bot')
2018-11-16 07:03:38 [WARNING ] (13, 1, 'bot')
2018-11-16 07:03:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:03:38 [DEBUG   ] Finished updating board flags in 1.451 seconds
2018-11-16 07:03:58 [DEBUG   ] Finished updating ant stats in 0.761 seconds
2018-11-16 07:04:18 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-16 07:04:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:04:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa7, chip 5, bottom port
2018-11-16 07:04:38 [WARNING ] (13, 1, 'bot')
2018-11-16 07:04:38 [WARNING ] (13, 1, 'bot')
2018-11-16 07:04:38 [WARNING ] (13, 1, 'bot')
2018-11-16 07:04:38 [WARNING ] (13, 1, 'bot')
2018-11-16 07:04:38 [WARNING ] (25, 5, 'bot')
2018-11-16 07:04:38 [WARNING ] (25, 5, 'bot')
2018-11-16 07:04:38 [WARNING ] (25, 5, 'bot')
2018-11-16 07:04:38 [WARNING ] (25, 5, 'bot')
2018-11-16 07:04:38 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:04:38 [DEBUG   ] Finished updating board flags in 1.489 seconds
2018-11-16 07:04:39 [DEBUG   ] Finished updating ant stats in 1.403 seconds
2018-11-16 07:04:59 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-16 07:05:19 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 07:05:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:05:39 [DEBUG   ] Finished updating ant stats in 1.246 seconds
2018-11-16 07:05:39 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-16 07:05:39 [WARNING ] (13, 1, 'bot')
2018-11-16 07:05:39 [WARNING ] (13, 1, 'bot')
2018-11-16 07:05:39 [WARNING ] (13, 1, 'bot')
2018-11-16 07:05:39 [WARNING ] (13, 1, 'bot')
2018-11-16 07:05:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:05:39 [DEBUG   ] Finished updating board flags in 2.216 seconds
2018-11-16 07:05:45 [DEBUG   ] Got command RPT from MCS: ref #523575
2018-11-16 07:05:45 [DEBUG   ] summary = ERROR
2018-11-16 07:05:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523575  13 58438 25545337 A  ERRORERROR'
2018-11-16 07:05:45 [DEBUG   ] Got command RPT from MCS: ref #523576
2018-11-16 07:05:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 07:05:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523576  77 58438 25545338 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 07:05:59 [DEBUG   ] Finished updating ant stats in 1.161 seconds
2018-11-16 07:06:19 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-16 07:06:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:06:39 [DEBUG   ] Finished updating ant stats in 0.847 seconds
2018-11-16 07:06:39 [WARNING ] (13, 1, 'bot')
2018-11-16 07:06:39 [WARNING ] (13, 1, 'bot')
2018-11-16 07:06:39 [WARNING ] (13, 1, 'bot')
2018-11-16 07:06:39 [WARNING ] (13, 1, 'bot')
2018-11-16 07:06:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:06:39 [DEBUG   ] Finished updating board flags in 2.221 seconds
2018-11-16 07:06:59 [DEBUG   ] Finished updating ant stats in 0.759 seconds
2018-11-16 07:07:19 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-11-16 07:07:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:07:39 [DEBUG   ] Finished updating ant stats in 0.642 seconds
2018-11-16 07:07:39 [WARNING ] (13, 1, 'bot')
2018-11-16 07:07:39 [WARNING ] (13, 1, 'bot')
2018-11-16 07:07:39 [WARNING ] (13, 1, 'bot')
2018-11-16 07:07:39 [WARNING ] (13, 1, 'bot')
2018-11-16 07:07:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:07:39 [DEBUG   ] Finished updating board flags in 2.171 seconds
2018-11-16 07:07:59 [DEBUG   ] Finished updating ant stats in 0.558 seconds
2018-11-16 07:08:20 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-11-16 07:08:34 [DEBUG   ] Got command RPT from MCS: ref #523594
2018-11-16 07:08:34 [DEBUG   ] summary = ERROR
2018-11-16 07:08:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523594  13 58438 25714221 A  ERRORERROR'
2018-11-16 07:08:34 [DEBUG   ] Got command RPT from MCS: ref #523595
2018-11-16 07:08:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 07:08:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523595  77 58438 25714425 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 07:08:34 [DEBUG   ] Got command RPT from MCS: ref #523596
2018-11-16 07:08:34 [DEBUG   ] summary = ERROR
2018-11-16 07:08:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523596  13 58438 25714617 A  ERRORERROR'
2018-11-16 07:08:34 [DEBUG   ] Got command RPT from MCS: ref #523598
2018-11-16 07:08:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 07:08:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523598  77 58438 25714821 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 07:08:35 [DEBUG   ] Got command RPT from MCS: ref #523600
2018-11-16 07:08:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 07:08:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523600  12 58438 25715025 A  ERRORB•™š'
2018-11-16 07:08:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:08:39 [DEBUG   ] Finished updating ant stats in 0.448 seconds
2018-11-16 07:08:39 [WARNING ] (13, 1, 'bot')
2018-11-16 07:08:39 [WARNING ] (13, 1, 'bot')
2018-11-16 07:08:39 [WARNING ] (13, 1, 'bot')
2018-11-16 07:08:39 [WARNING ] (13, 1, 'bot')
2018-11-16 07:08:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:08:39 [DEBUG   ] Finished updating board flags in 2.030 seconds
2018-11-16 07:09:00 [DEBUG   ] Finished updating ant stats in 1.355 seconds
2018-11-16 07:09:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 07:09:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:09:39 [WARNING ] (13, 1, 'bot')
2018-11-16 07:09:39 [WARNING ] (13, 1, 'bot')
2018-11-16 07:09:39 [WARNING ] (13, 1, 'bot')
2018-11-16 07:09:39 [WARNING ] (13, 1, 'bot')
2018-11-16 07:09:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:09:39 [DEBUG   ] Finished updating board flags in 1.978 seconds
2018-11-16 07:09:40 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-16 07:10:00 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-16 07:10:20 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 07:10:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:10:40 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-16 07:10:40 [WARNING ] (13, 1, 'bot')
2018-11-16 07:10:40 [WARNING ] (13, 1, 'bot')
2018-11-16 07:10:40 [WARNING ] (13, 1, 'bot')
2018-11-16 07:10:40 [WARNING ] (13, 1, 'bot')
2018-11-16 07:10:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:10:40 [DEBUG   ] Finished updating board flags in 2.719 seconds
2018-11-16 07:10:45 [DEBUG   ] Got command RPT from MCS: ref #523608
2018-11-16 07:10:45 [DEBUG   ] summary = ERROR
2018-11-16 07:10:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523608  13 58438 25845337 A  ERRORERROR'
2018-11-16 07:10:45 [DEBUG   ] Got command RPT from MCS: ref #523609
2018-11-16 07:10:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 07:10:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523609  77 58438 25845338 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 07:11:00 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-16 07:11:20 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-16 07:11:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 07:11:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-16 07:11:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:11:39 [WARNING ] (13, 1, 'bot')
2018-11-16 07:11:39 [WARNING ] (13, 1, 'bot')
2018-11-16 07:11:39 [WARNING ] (13, 1, 'bot')
2018-11-16 07:11:39 [WARNING ] (13, 1, 'bot')
2018-11-16 07:11:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:11:39 [DEBUG   ] Finished updating board flags in 1.713 seconds
2018-11-16 07:11:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 07:12:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 07:12:20 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-11-16 07:12:38 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-16 07:12:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:12:39 [WARNING ] (13, 1, 'bot')
2018-11-16 07:12:39 [WARNING ] (13, 1, 'bot')
2018-11-16 07:12:39 [WARNING ] (13, 1, 'bot')
2018-11-16 07:12:39 [WARNING ] (13, 1, 'bot')
2018-11-16 07:12:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:12:39 [DEBUG   ] Finished updating board flags in 1.592 seconds
2018-11-16 07:12:40 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-16 07:13:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 07:13:20 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 07:13:34 [DEBUG   ] Got command RPT from MCS: ref #523629
2018-11-16 07:13:34 [DEBUG   ] summary = ERROR
2018-11-16 07:13:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523629  13 58438 26014297 A  ERRORERROR'
2018-11-16 07:13:34 [DEBUG   ] Got command RPT from MCS: ref #523630
2018-11-16 07:13:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 07:13:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523630  77 58438 26014501 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 07:13:34 [DEBUG   ] Got command RPT from MCS: ref #523631
2018-11-16 07:13:34 [DEBUG   ] summary = ERROR
2018-11-16 07:13:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523631  13 58438 26014705 A  ERRORERROR'
2018-11-16 07:13:34 [DEBUG   ] Got command RPT from MCS: ref #523632
2018-11-16 07:13:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 07:13:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523632  77 58438 26014909 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 07:13:35 [DEBUG   ] Got command RPT from MCS: ref #523633
2018-11-16 07:13:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 07:13:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523633  12 58438 26015101 A  ERRORB—™š'
2018-11-16 07:13:38 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:13:39 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 07:13:39 [WARNING ] (13, 1, 'bot')
2018-11-16 07:13:39 [WARNING ] (13, 1, 'bot')
2018-11-16 07:13:39 [WARNING ] (13, 1, 'bot')
2018-11-16 07:13:39 [WARNING ] (13, 1, 'bot')
2018-11-16 07:13:39 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:13:39 [DEBUG   ] Finished updating board flags in 1.392 seconds
2018-11-16 07:13:40 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-11-16 07:14:00 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-16 07:14:21 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-16 07:14:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:14:40 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 07:14:40 [WARNING ] (13, 1, 'bot')
2018-11-16 07:14:40 [WARNING ] (13, 1, 'bot')
2018-11-16 07:14:40 [WARNING ] (13, 1, 'bot')
2018-11-16 07:14:40 [WARNING ] (13, 1, 'bot')
2018-11-16 07:14:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:14:40 [DEBUG   ] Finished updating board flags in 2.219 seconds
2018-11-16 07:14:41 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-16 07:15:01 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-16 07:15:21 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-16 07:15:39 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 07:15:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:15:40 [WARNING ] (13, 1, 'bot')
2018-11-16 07:15:40 [WARNING ] (13, 1, 'bot')
2018-11-16 07:15:40 [WARNING ] (13, 1, 'bot')
2018-11-16 07:15:40 [WARNING ] (13, 1, 'bot')
2018-11-16 07:15:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:15:40 [DEBUG   ] Finished updating board flags in 2.189 seconds
2018-11-16 07:15:41 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 07:15:45 [DEBUG   ] Got command RPT from MCS: ref #523638
2018-11-16 07:15:45 [DEBUG   ] summary = ERROR
2018-11-16 07:15:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523638  13 58438 26145345 A  ERRORERROR'
2018-11-16 07:15:45 [DEBUG   ] Got command RPT from MCS: ref #523639
2018-11-16 07:15:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 07:15:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523639  77 58438 26145346 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 07:16:01 [DEBUG   ] Finished updating ant stats in 1.006 seconds
2018-11-16 07:16:21 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-16 07:16:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:16:40 [WARNING ] (13, 1, 'bot')
2018-11-16 07:16:40 [WARNING ] (13, 1, 'bot')
2018-11-16 07:16:40 [WARNING ] (13, 1, 'bot')
2018-11-16 07:16:40 [WARNING ] (13, 1, 'bot')
2018-11-16 07:16:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:16:40 [DEBUG   ] Finished updating board flags in 2.027 seconds
2018-11-16 07:16:41 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-16 07:17:01 [DEBUG   ] Finished updating ant stats in 0.677 seconds
2018-11-16 07:17:21 [DEBUG   ] Finished updating ant stats in 0.529 seconds
2018-11-16 07:17:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:17:40 [WARNING ] (13, 1, 'bot')
2018-11-16 07:17:40 [WARNING ] (13, 1, 'bot')
2018-11-16 07:17:40 [WARNING ] (13, 1, 'bot')
2018-11-16 07:17:40 [WARNING ] (13, 1, 'bot')
2018-11-16 07:17:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:17:40 [DEBUG   ] Finished updating board flags in 1.953 seconds
2018-11-16 07:17:42 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-11-16 07:18:02 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-16 07:18:22 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 07:18:34 [DEBUG   ] Got command RPT from MCS: ref #523661
2018-11-16 07:18:34 [DEBUG   ] summary = ERROR
2018-11-16 07:18:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523661  13 58438 26314377 A  ERRORERROR'
2018-11-16 07:18:34 [DEBUG   ] Got command RPT from MCS: ref #523662
2018-11-16 07:18:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 07:18:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523662  77 58438 26314581 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 07:18:34 [DEBUG   ] Got command RPT from MCS: ref #523663
2018-11-16 07:18:34 [DEBUG   ] summary = ERROR
2018-11-16 07:18:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523663  13 58438 26314785 A  ERRORERROR'
2018-11-16 07:18:34 [DEBUG   ] Got command RPT from MCS: ref #523665
2018-11-16 07:18:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 07:18:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523665  77 58438 26314989 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 07:18:35 [DEBUG   ] Got command RPT from MCS: ref #523666
2018-11-16 07:18:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 07:18:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523666  12 58438 26315181 A  ERRORB—™š'
2018-11-16 07:18:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:18:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 07:18:40 [WARNING ] (13, 1, 'bot')
2018-11-16 07:18:40 [WARNING ] (13, 1, 'bot')
2018-11-16 07:18:40 [WARNING ] (13, 1, 'bot')
2018-11-16 07:18:40 [WARNING ] (13, 1, 'bot')
2018-11-16 07:18:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:18:40 [DEBUG   ] Finished updating board flags in 1.784 seconds
2018-11-16 07:18:42 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-16 07:19:02 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 07:19:22 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 07:19:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:19:40 [WARNING ] (13, 1, 'bot')
2018-11-16 07:19:40 [WARNING ] (13, 1, 'bot')
2018-11-16 07:19:40 [WARNING ] (13, 1, 'bot')
2018-11-16 07:19:40 [WARNING ] (13, 1, 'bot')
2018-11-16 07:19:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:19:40 [DEBUG   ] Finished updating board flags in 1.611 seconds
2018-11-16 07:19:42 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-11-16 07:20:03 [DEBUG   ] Finished updating ant stats in 2.360 seconds
2018-11-16 07:20:22 [DEBUG   ] Finished updating ant stats in 0.839 seconds
2018-11-16 07:20:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:20:40 [WARNING ] (13, 1, 'bot')
2018-11-16 07:20:40 [WARNING ] (13, 1, 'bot')
2018-11-16 07:20:40 [WARNING ] (13, 1, 'bot')
2018-11-16 07:20:40 [WARNING ] (13, 1, 'bot')
2018-11-16 07:20:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:20:40 [DEBUG   ] Finished updating board flags in 1.574 seconds
2018-11-16 07:20:42 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 07:20:45 [DEBUG   ] Got command RPT from MCS: ref #523675
2018-11-16 07:20:45 [DEBUG   ] summary = ERROR
2018-11-16 07:20:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523675  13 58438 26445337 A  ERRORERROR'
2018-11-16 07:20:45 [DEBUG   ] Got command RPT from MCS: ref #523676
2018-11-16 07:20:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 07:20:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523676  77 58438 26445338 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 07:21:02 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 07:21:22 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-16 07:21:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:21:40 [WARNING ] (13, 1, 'bot')
2018-11-16 07:21:40 [WARNING ] (13, 1, 'bot')
2018-11-16 07:21:40 [WARNING ] (13, 1, 'bot')
2018-11-16 07:21:40 [WARNING ] (13, 1, 'bot')
2018-11-16 07:21:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:21:40 [DEBUG   ] Finished updating board flags in 1.419 seconds
2018-11-16 07:21:42 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 07:22:02 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 07:22:22 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-11-16 07:22:39 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:22:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-16 07:22:40 [WARNING ] (13, 1, 'bot')
2018-11-16 07:22:40 [WARNING ] (13, 1, 'bot')
2018-11-16 07:22:40 [WARNING ] (13, 1, 'bot')
2018-11-16 07:22:40 [WARNING ] (13, 1, 'bot')
2018-11-16 07:22:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:22:40 [DEBUG   ] Finished updating board flags in 1.384 seconds
2018-11-16 07:22:42 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-16 07:23:03 [DEBUG   ] Finished updating ant stats in 1.404 seconds
2018-11-16 07:23:23 [DEBUG   ] Finished updating ant stats in 1.396 seconds
2018-11-16 07:23:34 [DEBUG   ] Got command RPT from MCS: ref #523692
2018-11-16 07:23:34 [DEBUG   ] summary = ERROR
2018-11-16 07:23:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523692  13 58438 26614457 A  ERRORERROR'
2018-11-16 07:23:34 [DEBUG   ] Got command RPT from MCS: ref #523693
2018-11-16 07:23:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 07:23:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523693  77 58438 26614661 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 07:23:34 [DEBUG   ] Got command RPT from MCS: ref #523694
2018-11-16 07:23:34 [DEBUG   ] summary = ERROR
2018-11-16 07:23:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523694  13 58438 26614865 A  ERRORERROR'
2018-11-16 07:23:35 [DEBUG   ] Got command RPT from MCS: ref #523695
2018-11-16 07:23:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 07:23:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523695  77 58438 26615069 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 07:23:35 [DEBUG   ] Got command RPT from MCS: ref #523696
2018-11-16 07:23:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 07:23:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523696  12 58438 26615261 A  ERRORB–™š'
2018-11-16 07:23:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:23:40 [WARNING ] (13, 1, 'bot')
2018-11-16 07:23:40 [WARNING ] (13, 1, 'bot')
2018-11-16 07:23:40 [WARNING ] (13, 1, 'bot')
2018-11-16 07:23:40 [WARNING ] (13, 1, 'bot')
2018-11-16 07:23:40 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:23:40 [DEBUG   ] Finished updating board flags in 1.359 seconds
2018-11-16 07:23:43 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-16 07:24:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 07:24:23 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-16 07:24:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:24:41 [WARNING ] (13, 1, 'bot')
2018-11-16 07:24:41 [WARNING ] (13, 1, 'bot')
2018-11-16 07:24:41 [WARNING ] (13, 1, 'bot')
2018-11-16 07:24:41 [WARNING ] (13, 1, 'bot')
2018-11-16 07:24:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:24:41 [DEBUG   ] Finished updating board flags in 2.068 seconds
2018-11-16 07:24:43 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-16 07:25:03 [DEBUG   ] Finished updating ant stats in 1.357 seconds
2018-11-16 07:25:23 [DEBUG   ] Finished updating ant stats in 0.844 seconds
2018-11-16 07:25:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:25:41 [WARNING ] (13, 1, 'bot')
2018-11-16 07:25:41 [WARNING ] (13, 1, 'bot')
2018-11-16 07:25:41 [WARNING ] (13, 1, 'bot')
2018-11-16 07:25:41 [WARNING ] (13, 1, 'bot')
2018-11-16 07:25:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:25:41 [DEBUG   ] Finished updating board flags in 1.991 seconds
2018-11-16 07:25:43 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-11-16 07:25:45 [DEBUG   ] Got command RPT from MCS: ref #523701
2018-11-16 07:25:45 [DEBUG   ] summary = ERROR
2018-11-16 07:25:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523701  13 58438 26745345 A  ERRORERROR'
2018-11-16 07:25:45 [DEBUG   ] Got command RPT from MCS: ref #523702
2018-11-16 07:25:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 07:25:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523702  77 58438 26745346 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 07:26:03 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-16 07:26:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 07:26:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:26:41 [WARNING ] (13, 1, 'bot')
2018-11-16 07:26:41 [WARNING ] (13, 1, 'bot')
2018-11-16 07:26:41 [WARNING ] (13, 1, 'bot')
2018-11-16 07:26:41 [WARNING ] (13, 1, 'bot')
2018-11-16 07:26:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:26:41 [DEBUG   ] Finished updating board flags in 1.808 seconds
2018-11-16 07:26:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 07:27:03 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-11-16 07:27:23 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-16 07:27:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:27:41 [WARNING ] (13, 1, 'bot')
2018-11-16 07:27:41 [WARNING ] (13, 1, 'bot')
2018-11-16 07:27:41 [WARNING ] (13, 1, 'bot')
2018-11-16 07:27:41 [WARNING ] (13, 1, 'bot')
2018-11-16 07:27:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:27:41 [DEBUG   ] Finished updating board flags in 1.846 seconds
2018-11-16 07:27:44 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-16 07:28:04 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2018-11-16 07:28:24 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-16 07:28:34 [DEBUG   ] Got command RPT from MCS: ref #523724
2018-11-16 07:28:34 [DEBUG   ] summary = ERROR
2018-11-16 07:28:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523724  13 58438 26914545 A  ERRORERROR'
2018-11-16 07:28:34 [DEBUG   ] Got command RPT from MCS: ref #523725
2018-11-16 07:28:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 07:28:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523725  77 58438 26914737 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 07:28:34 [DEBUG   ] Got command RPT from MCS: ref #523726
2018-11-16 07:28:34 [DEBUG   ] summary = ERROR
2018-11-16 07:28:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523726  13 58438 26914941 A  ERRORERROR'
2018-11-16 07:28:35 [DEBUG   ] Got command RPT from MCS: ref #523727
2018-11-16 07:28:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 07:28:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523727  77 58438 26915145 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 07:28:35 [DEBUG   ] Got command RPT from MCS: ref #523729
2018-11-16 07:28:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 07:28:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523729  12 58438 26915349 A  ERRORB•™š'
2018-11-16 07:28:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:28:41 [WARNING ] (13, 1, 'bot')
2018-11-16 07:28:41 [WARNING ] (13, 1, 'bot')
2018-11-16 07:28:41 [WARNING ] (13, 1, 'bot')
2018-11-16 07:28:41 [WARNING ] (13, 1, 'bot')
2018-11-16 07:28:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:28:41 [DEBUG   ] Finished updating board flags in 1.728 seconds
2018-11-16 07:28:44 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 07:29:04 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-11-16 07:29:24 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-16 07:29:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:29:41 [WARNING ] (13, 1, 'bot')
2018-11-16 07:29:41 [WARNING ] (13, 1, 'bot')
2018-11-16 07:29:41 [WARNING ] (13, 1, 'bot')
2018-11-16 07:29:41 [WARNING ] (13, 1, 'bot')
2018-11-16 07:29:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:29:41 [DEBUG   ] Finished updating board flags in 1.540 seconds
2018-11-16 07:29:44 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-16 07:30:04 [DEBUG   ] Finished updating ant stats in 0.809 seconds
2018-11-16 07:30:24 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2018-11-16 07:30:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:30:41 [WARNING ] (13, 1, 'bot')
2018-11-16 07:30:41 [WARNING ] (13, 1, 'bot')
2018-11-16 07:30:41 [WARNING ] (13, 1, 'bot')
2018-11-16 07:30:41 [WARNING ] (13, 1, 'bot')
2018-11-16 07:30:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:30:41 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-11-16 07:30:44 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 07:30:45 [DEBUG   ] Got command RPT from MCS: ref #523738
2018-11-16 07:30:45 [DEBUG   ] summary = ERROR
2018-11-16 07:30:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523738  13 58438 27045337 A  ERRORERROR'
2018-11-16 07:30:45 [DEBUG   ] Got command RPT from MCS: ref #523739
2018-11-16 07:30:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 07:30:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523739  77 58438 27045338 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 07:31:04 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-16 07:31:25 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-16 07:31:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:31:41 [WARNING ] (13, 1, 'bot')
2018-11-16 07:31:41 [WARNING ] (13, 1, 'bot')
2018-11-16 07:31:41 [WARNING ] (13, 1, 'bot')
2018-11-16 07:31:41 [WARNING ] (13, 1, 'bot')
2018-11-16 07:31:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:31:41 [DEBUG   ] Finished updating board flags in 1.410 seconds
2018-11-16 07:31:45 [DEBUG   ] Finished updating ant stats in 1.209 seconds
2018-11-16 07:32:05 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-16 07:32:25 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-16 07:32:40 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:32:41 [WARNING ] (13, 1, 'bot')
2018-11-16 07:32:41 [WARNING ] (13, 1, 'bot')
2018-11-16 07:32:41 [WARNING ] (13, 1, 'bot')
2018-11-16 07:32:41 [WARNING ] (13, 1, 'bot')
2018-11-16 07:32:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:32:41 [DEBUG   ] Finished updating board flags in 1.390 seconds
2018-11-16 07:32:45 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-16 07:33:05 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-11-16 07:33:25 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-11-16 07:33:34 [DEBUG   ] Got command RPT from MCS: ref #523759
2018-11-16 07:33:34 [DEBUG   ] summary = ERROR
2018-11-16 07:33:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523759  13 58438 27214621 A  ERRORERROR'
2018-11-16 07:33:34 [DEBUG   ] Got command RPT from MCS: ref #523760
2018-11-16 07:33:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 07:33:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523760  77 58438 27214825 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 07:33:35 [DEBUG   ] Got command RPT from MCS: ref #523761
2018-11-16 07:33:35 [DEBUG   ] summary = ERROR
2018-11-16 07:33:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523761  13 58438 27215017 A  ERRORERROR'
2018-11-16 07:33:35 [DEBUG   ] Got command RPT from MCS: ref #523762
2018-11-16 07:33:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 07:33:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523762  77 58438 27215221 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 07:33:35 [DEBUG   ] Got command RPT from MCS: ref #523763
2018-11-16 07:33:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 07:33:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523763  12 58438 27215425 A  ERRORB–™š'
2018-11-16 07:33:40 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 07:33:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:33:41 [WARNING ] (13, 1, 'bot')
2018-11-16 07:33:41 [WARNING ] (13, 1, 'bot')
2018-11-16 07:33:41 [WARNING ] (13, 1, 'bot')
2018-11-16 07:33:41 [WARNING ] (13, 1, 'bot')
2018-11-16 07:33:41 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:33:41 [DEBUG   ] Finished updating board flags in 1.356 seconds
2018-11-16 07:33:46 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-11-16 07:34:06 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-16 07:34:26 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-16 07:34:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:34:42 [WARNING ] (13, 1, 'bot')
2018-11-16 07:34:42 [WARNING ] (13, 1, 'bot')
2018-11-16 07:34:42 [WARNING ] (13, 1, 'bot')
2018-11-16 07:34:42 [WARNING ] (13, 1, 'bot')
2018-11-16 07:34:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:34:42 [DEBUG   ] Finished updating board flags in 2.065 seconds
2018-11-16 07:34:46 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-16 07:35:06 [DEBUG   ] Finished updating ant stats in 0.813 seconds
2018-11-16 07:35:26 [DEBUG   ] Finished updating ant stats in 0.793 seconds
2018-11-16 07:35:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:35:42 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 07:35:42 [WARNING ] (13, 1, 'bot')
2018-11-16 07:35:42 [WARNING ] (13, 1, 'bot')
2018-11-16 07:35:42 [WARNING ] (13, 1, 'bot')
2018-11-16 07:35:42 [WARNING ] (13, 1, 'bot')
2018-11-16 07:35:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:35:42 [DEBUG   ] Finished updating board flags in 1.980 seconds
2018-11-16 07:35:45 [DEBUG   ] Got command RPT from MCS: ref #523768
2018-11-16 07:35:45 [DEBUG   ] summary = ERROR
2018-11-16 07:35:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523768  13 58438 27345341 A  ERRORERROR'
2018-11-16 07:35:45 [DEBUG   ] Got command RPT from MCS: ref #523769
2018-11-16 07:35:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 07:35:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523769  77 58438 27345342 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 07:35:46 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-16 07:36:06 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-16 07:36:27 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-16 07:36:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:36:42 [WARNING ] (13, 1, 'bot')
2018-11-16 07:36:42 [WARNING ] (13, 1, 'bot')
2018-11-16 07:36:42 [WARNING ] (13, 1, 'bot')
2018-11-16 07:36:42 [WARNING ] (13, 1, 'bot')
2018-11-16 07:36:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:36:42 [DEBUG   ] Finished updating board flags in 1.812 seconds
2018-11-16 07:36:47 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-16 07:37:07 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-16 07:37:27 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 07:37:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:37:42 [WARNING ] (13, 1, 'bot')
2018-11-16 07:37:42 [WARNING ] (13, 1, 'bot')
2018-11-16 07:37:42 [WARNING ] (13, 1, 'bot')
2018-11-16 07:37:42 [WARNING ] (13, 1, 'bot')
2018-11-16 07:37:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:37:42 [DEBUG   ] Finished updating board flags in 1.809 seconds
2018-11-16 07:37:47 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-16 07:38:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 07:38:27 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 07:38:34 [DEBUG   ] Got command RPT from MCS: ref #523787
2018-11-16 07:38:34 [DEBUG   ] summary = ERROR
2018-11-16 07:38:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523787  13 58438 27514693 A  ERRORERROR'
2018-11-16 07:38:34 [DEBUG   ] Got command RPT from MCS: ref #523788
2018-11-16 07:38:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 07:38:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523788  77 58438 27514897 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 07:38:35 [DEBUG   ] Got command RPT from MCS: ref #523789
2018-11-16 07:38:35 [DEBUG   ] summary = ERROR
2018-11-16 07:38:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523789  13 58438 27515101 A  ERRORERROR'
2018-11-16 07:38:35 [DEBUG   ] Got command RPT from MCS: ref #523791
2018-11-16 07:38:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 07:38:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523791  77 58438 27515305 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 07:38:35 [DEBUG   ] Got command RPT from MCS: ref #523793
2018-11-16 07:38:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 07:38:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523793  12 58438 27515497 A  ERRORB—™š'
2018-11-16 07:38:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:38:42 [WARNING ] (13, 1, 'bot')
2018-11-16 07:38:42 [WARNING ] (13, 1, 'bot')
2018-11-16 07:38:42 [WARNING ] (13, 1, 'bot')
2018-11-16 07:38:42 [WARNING ] (13, 1, 'bot')
2018-11-16 07:38:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:38:42 [DEBUG   ] Finished updating board flags in 1.779 seconds
2018-11-16 07:38:47 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 07:39:07 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-16 07:39:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 07:39:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:39:42 [WARNING ] (13, 1, 'bot')
2018-11-16 07:39:42 [WARNING ] (13, 1, 'bot')
2018-11-16 07:39:42 [WARNING ] (13, 1, 'bot')
2018-11-16 07:39:42 [WARNING ] (13, 1, 'bot')
2018-11-16 07:39:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:39:42 [DEBUG   ] Finished updating board flags in 1.622 seconds
2018-11-16 07:39:47 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 07:40:07 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-16 07:40:27 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-16 07:40:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:40:42 [WARNING ] (13, 1, 'bot')
2018-11-16 07:40:42 [WARNING ] (13, 1, 'bot')
2018-11-16 07:40:42 [WARNING ] (13, 1, 'bot')
2018-11-16 07:40:42 [WARNING ] (13, 1, 'bot')
2018-11-16 07:40:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:40:42 [DEBUG   ] Finished updating board flags in 1.634 seconds
2018-11-16 07:40:45 [DEBUG   ] Got command RPT from MCS: ref #523801
2018-11-16 07:40:45 [DEBUG   ] summary = ERROR
2018-11-16 07:40:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523801  13 58438 27645341 A  ERRORERROR'
2018-11-16 07:40:45 [DEBUG   ] Got command RPT from MCS: ref #523802
2018-11-16 07:40:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 07:40:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523802  77 58438 27645342 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 07:40:47 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 07:41:07 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 07:41:27 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-11-16 07:41:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:41:42 [WARNING ] (13, 1, 'bot')
2018-11-16 07:41:42 [WARNING ] (13, 1, 'bot')
2018-11-16 07:41:42 [WARNING ] (13, 1, 'bot')
2018-11-16 07:41:42 [WARNING ] (13, 1, 'bot')
2018-11-16 07:41:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:41:42 [DEBUG   ] Finished updating board flags in 1.562 seconds
2018-11-16 07:41:47 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-16 07:42:08 [DEBUG   ] Finished updating ant stats in 1.403 seconds
2018-11-16 07:42:27 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-16 07:42:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:42:42 [WARNING ] (13, 1, 'bot')
2018-11-16 07:42:42 [WARNING ] (13, 1, 'bot')
2018-11-16 07:42:42 [WARNING ] (13, 1, 'bot')
2018-11-16 07:42:42 [WARNING ] (13, 1, 'bot')
2018-11-16 07:42:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:42:42 [DEBUG   ] Finished updating board flags in 1.414 seconds
2018-11-16 07:42:48 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-16 07:43:08 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-16 07:43:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 07:43:34 [DEBUG   ] Got command RPT from MCS: ref #523822
2018-11-16 07:43:34 [DEBUG   ] summary = ERROR
2018-11-16 07:43:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523822  13 58438 27814777 A  ERRORERROR'
2018-11-16 07:43:34 [DEBUG   ] Got command RPT from MCS: ref #523823
2018-11-16 07:43:34 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 07:43:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523823  77 58438 27814981 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 07:43:35 [DEBUG   ] Got command RPT from MCS: ref #523824
2018-11-16 07:43:35 [DEBUG   ] summary = ERROR
2018-11-16 07:43:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523824  13 58438 27815185 A  ERRORERROR'
2018-11-16 07:43:35 [DEBUG   ] Got command RPT from MCS: ref #523825
2018-11-16 07:43:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 07:43:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523825  77 58438 27815389 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 07:43:35 [DEBUG   ] Got command RPT from MCS: ref #523826
2018-11-16 07:43:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 07:43:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523826  12 58438 27815581 A  ERRORB–™š'
2018-11-16 07:43:41 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:43:42 [WARNING ] (13, 1, 'bot')
2018-11-16 07:43:42 [WARNING ] (13, 1, 'bot')
2018-11-16 07:43:42 [WARNING ] (13, 1, 'bot')
2018-11-16 07:43:42 [WARNING ] (13, 1, 'bot')
2018-11-16 07:43:42 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:43:42 [DEBUG   ] Finished updating board flags in 1.392 seconds
2018-11-16 07:43:48 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-16 07:44:08 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-16 07:44:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 07:44:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:44:43 [WARNING ] (13, 1, 'bot')
2018-11-16 07:44:43 [WARNING ] (13, 1, 'bot')
2018-11-16 07:44:43 [WARNING ] (13, 1, 'bot')
2018-11-16 07:44:43 [WARNING ] (13, 1, 'bot')
2018-11-16 07:44:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:44:43 [DEBUG   ] Finished updating board flags in 2.210 seconds
2018-11-16 07:44:48 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 07:45:08 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 07:45:28 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-16 07:45:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:45:43 [WARNING ] (13, 1, 'bot')
2018-11-16 07:45:43 [WARNING ] (13, 1, 'bot')
2018-11-16 07:45:43 [WARNING ] (13, 1, 'bot')
2018-11-16 07:45:43 [WARNING ] (13, 1, 'bot')
2018-11-16 07:45:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:45:43 [DEBUG   ] Finished updating board flags in 2.225 seconds
2018-11-16 07:45:45 [DEBUG   ] Got command RPT from MCS: ref #523831
2018-11-16 07:45:45 [DEBUG   ] summary = ERROR
2018-11-16 07:45:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523831  13 58438 27945349 A  ERRORERROR'
2018-11-16 07:45:45 [DEBUG   ] Got command RPT from MCS: ref #523832
2018-11-16 07:45:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 07:45:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523832  77 58438 27945350 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 07:45:48 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 07:46:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 07:46:28 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 07:46:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:46:43 [WARNING ] (13, 1, 'bot')
2018-11-16 07:46:43 [WARNING ] (13, 1, 'bot')
2018-11-16 07:46:43 [WARNING ] (13, 1, 'bot')
2018-11-16 07:46:43 [WARNING ] (13, 1, 'bot')
2018-11-16 07:46:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:46:43 [DEBUG   ] Finished updating board flags in 2.166 seconds
2018-11-16 07:46:48 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-16 07:47:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 07:47:28 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 07:47:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:47:43 [WARNING ] (13, 1, 'bot')
2018-11-16 07:47:43 [WARNING ] (13, 1, 'bot')
2018-11-16 07:47:43 [WARNING ] (13, 1, 'bot')
2018-11-16 07:47:43 [WARNING ] (13, 1, 'bot')
2018-11-16 07:47:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:47:43 [DEBUG   ] Finished updating board flags in 2.008 seconds
2018-11-16 07:47:48 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-16 07:48:08 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2018-11-16 07:48:29 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-11-16 07:48:34 [DEBUG   ] Got command RPT from MCS: ref #523854
2018-11-16 07:48:34 [DEBUG   ] summary = ERROR
2018-11-16 07:48:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523854  13 58438 28114865 A  ERRORERROR'
2018-11-16 07:48:35 [DEBUG   ] Got command RPT from MCS: ref #523855
2018-11-16 07:48:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 07:48:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523855  77 58438 28115057 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 07:48:35 [DEBUG   ] Got command RPT from MCS: ref #523856
2018-11-16 07:48:35 [DEBUG   ] summary = ERROR
2018-11-16 07:48:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523856  13 58438 28115261 A  ERRORERROR'
2018-11-16 07:48:35 [DEBUG   ] Got command RPT from MCS: ref #523858
2018-11-16 07:48:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 07:48:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523858  77 58438 28115465 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 07:48:35 [DEBUG   ] Got command RPT from MCS: ref #523859
2018-11-16 07:48:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 07:48:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523859  12 58438 28115669 A  ERRORB•™š'
2018-11-16 07:48:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:48:43 [WARNING ] (13, 1, 'bot')
2018-11-16 07:48:43 [WARNING ] (13, 1, 'bot')
2018-11-16 07:48:43 [WARNING ] (13, 1, 'bot')
2018-11-16 07:48:43 [WARNING ] (13, 1, 'bot')
2018-11-16 07:48:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:48:43 [DEBUG   ] Finished updating board flags in 1.999 seconds
2018-11-16 07:48:49 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-16 07:49:09 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-16 07:49:29 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 07:49:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:49:43 [WARNING ] (13, 1, 'bot')
2018-11-16 07:49:43 [WARNING ] (13, 1, 'bot')
2018-11-16 07:49:43 [WARNING ] (13, 1, 'bot')
2018-11-16 07:49:43 [WARNING ] (13, 1, 'bot')
2018-11-16 07:49:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:49:43 [DEBUG   ] Finished updating board flags in 1.795 seconds
2018-11-16 07:49:49 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 07:50:09 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-11-16 07:50:29 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-16 07:50:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:50:43 [WARNING ] (13, 1, 'bot')
2018-11-16 07:50:43 [WARNING ] (13, 1, 'bot')
2018-11-16 07:50:43 [WARNING ] (13, 1, 'bot')
2018-11-16 07:50:43 [WARNING ] (13, 1, 'bot')
2018-11-16 07:50:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:50:43 [DEBUG   ] Finished updating board flags in 1.621 seconds
2018-11-16 07:50:45 [DEBUG   ] Got command RPT from MCS: ref #523868
2018-11-16 07:50:45 [DEBUG   ] summary = ERROR
2018-11-16 07:50:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523868  13 58438 28245345 A  ERRORERROR'
2018-11-16 07:50:45 [DEBUG   ] Got command RPT from MCS: ref #523869
2018-11-16 07:50:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 07:50:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523869  77 58438 28245346 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 07:50:49 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-16 07:51:09 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 07:51:29 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-11-16 07:51:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:51:43 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-16 07:51:43 [WARNING ] (13, 1, 'bot')
2018-11-16 07:51:43 [WARNING ] (13, 1, 'bot')
2018-11-16 07:51:43 [WARNING ] (13, 1, 'bot')
2018-11-16 07:51:43 [WARNING ] (13, 1, 'bot')
2018-11-16 07:51:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:51:43 [DEBUG   ] Finished updating board flags in 1.587 seconds
2018-11-16 07:51:49 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-16 07:52:09 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 07:52:29 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 07:52:42 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-16 07:52:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:52:43 [WARNING ] (13, 1, 'bot')
2018-11-16 07:52:43 [WARNING ] (13, 1, 'bot')
2018-11-16 07:52:43 [WARNING ] (13, 1, 'bot')
2018-11-16 07:52:43 [WARNING ] (13, 1, 'bot')
2018-11-16 07:52:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:52:43 [DEBUG   ] Finished updating board flags in 1.404 seconds
2018-11-16 07:52:49 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-11-16 07:53:09 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-16 07:53:29 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-16 07:53:34 [DEBUG   ] Got command RPT from MCS: ref #523885
2018-11-16 07:53:34 [DEBUG   ] summary = ERROR
2018-11-16 07:53:34 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523885  13 58438 28414941 A  ERRORERROR'
2018-11-16 07:53:35 [DEBUG   ] Got command RPT from MCS: ref #523886
2018-11-16 07:53:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 07:53:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523886  77 58438 28415145 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 07:53:35 [DEBUG   ] Got command RPT from MCS: ref #523887
2018-11-16 07:53:35 [DEBUG   ] summary = ERROR
2018-11-16 07:53:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523887  13 58438 28415349 A  ERRORERROR'
2018-11-16 07:53:35 [DEBUG   ] Got command RPT from MCS: ref #523888
2018-11-16 07:53:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 07:53:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523888  77 58438 28415541 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 07:53:35 [DEBUG   ] Got command RPT from MCS: ref #523889
2018-11-16 07:53:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 07:53:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523889  12 58438 28415745 A  ERRORB–™š'
2018-11-16 07:53:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:53:43 [WARNING ] (13, 1, 'bot')
2018-11-16 07:53:43 [WARNING ] (13, 1, 'bot')
2018-11-16 07:53:43 [WARNING ] (13, 1, 'bot')
2018-11-16 07:53:43 [WARNING ] (13, 1, 'bot')
2018-11-16 07:53:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:53:43 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-11-16 07:53:49 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 07:54:10 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-16 07:54:30 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-16 07:54:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:54:43 [WARNING ] (13, 1, 'bot')
2018-11-16 07:54:43 [WARNING ] (13, 1, 'bot')
2018-11-16 07:54:43 [WARNING ] (13, 1, 'bot')
2018-11-16 07:54:43 [WARNING ] (13, 1, 'bot')
2018-11-16 07:54:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:54:43 [DEBUG   ] Finished updating board flags in 1.452 seconds
2018-11-16 07:54:50 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 07:55:10 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-16 07:55:30 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-16 07:55:42 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:55:43 [WARNING ] (13, 1, 'bot')
2018-11-16 07:55:43 [WARNING ] (13, 1, 'bot')
2018-11-16 07:55:43 [WARNING ] (13, 1, 'bot')
2018-11-16 07:55:43 [WARNING ] (13, 1, 'bot')
2018-11-16 07:55:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:55:43 [DEBUG   ] Finished updating board flags in 1.329 seconds
2018-11-16 07:55:45 [DEBUG   ] Got command RPT from MCS: ref #523894
2018-11-16 07:55:45 [DEBUG   ] summary = ERROR
2018-11-16 07:55:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523894  13 58438 28545341 A  ERRORERROR'
2018-11-16 07:55:45 [DEBUG   ] Got command RPT from MCS: ref #523895
2018-11-16 07:55:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 07:55:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523895  77 58438 28545342 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 07:55:50 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 07:56:10 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 07:56:30 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 07:56:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:56:43 [WARNING ] (13, 1, 'bot')
2018-11-16 07:56:43 [WARNING ] (13, 1, 'bot')
2018-11-16 07:56:43 [WARNING ] (13, 1, 'bot')
2018-11-16 07:56:43 [WARNING ] (13, 1, 'bot')
2018-11-16 07:56:43 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:56:43 [DEBUG   ] Finished updating board flags in 1.358 seconds
2018-11-16 07:56:50 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-16 07:57:10 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 07:57:30 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 07:57:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:57:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 07:57:44 [WARNING ] (13, 1, 'bot')
2018-11-16 07:57:44 [WARNING ] (13, 1, 'bot')
2018-11-16 07:57:44 [WARNING ] (13, 1, 'bot')
2018-11-16 07:57:44 [WARNING ] (13, 1, 'bot')
2018-11-16 07:57:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:57:44 [DEBUG   ] Finished updating board flags in 2.057 seconds
2018-11-16 07:57:50 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 07:58:10 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-16 07:58:30 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 07:58:35 [DEBUG   ] Got command RPT from MCS: ref #523917
2018-11-16 07:58:35 [DEBUG   ] summary = ERROR
2018-11-16 07:58:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523917  13 58438 28715029 A  ERRORERROR'
2018-11-16 07:58:35 [DEBUG   ] Got command RPT from MCS: ref #523918
2018-11-16 07:58:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 07:58:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523918  77 58438 28715221 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 07:58:35 [DEBUG   ] Got command RPT from MCS: ref #523919
2018-11-16 07:58:35 [DEBUG   ] summary = ERROR
2018-11-16 07:58:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523919  13 58438 28715425 A  ERRORERROR'
2018-11-16 07:58:35 [DEBUG   ] Got command RPT from MCS: ref #523921
2018-11-16 07:58:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 07:58:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523921  77 58438 28715629 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 07:58:35 [DEBUG   ] Got command RPT from MCS: ref #523923
2018-11-16 07:58:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 07:58:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523923  12 58438 28715821 A  ERRORB—™š'
2018-11-16 07:58:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:58:44 [WARNING ] (13, 1, 'bot')
2018-11-16 07:58:44 [WARNING ] (13, 1, 'bot')
2018-11-16 07:58:44 [WARNING ] (13, 1, 'bot')
2018-11-16 07:58:44 [WARNING ] (13, 1, 'bot')
2018-11-16 07:58:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:58:44 [DEBUG   ] Finished updating board flags in 2.002 seconds
2018-11-16 07:58:50 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 07:59:10 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 07:59:30 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-16 07:59:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 07:59:44 [WARNING ] (13, 1, 'bot')
2018-11-16 07:59:44 [WARNING ] (13, 1, 'bot')
2018-11-16 07:59:44 [WARNING ] (13, 1, 'bot')
2018-11-16 07:59:44 [WARNING ] (13, 1, 'bot')
2018-11-16 07:59:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 07:59:44 [DEBUG   ] Finished updating board flags in 2.003 seconds
2018-11-16 07:59:50 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-16 08:00:11 [DEBUG   ] Finished updating ant stats in 1.392 seconds
2018-11-16 08:00:31 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-16 08:00:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:00:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 08:00:44 [WARNING ] (13, 1, 'bot')
2018-11-16 08:00:44 [WARNING ] (13, 1, 'bot')
2018-11-16 08:00:44 [WARNING ] (13, 1, 'bot')
2018-11-16 08:00:44 [WARNING ] (13, 1, 'bot')
2018-11-16 08:00:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:00:44 [DEBUG   ] Finished updating board flags in 2.025 seconds
2018-11-16 08:00:45 [DEBUG   ] Got command RPT from MCS: ref #523931
2018-11-16 08:00:45 [DEBUG   ] summary = ERROR
2018-11-16 08:00:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523931  13 58438 28845341 A  ERRORERROR'
2018-11-16 08:00:45 [DEBUG   ] Got command RPT from MCS: ref #523932
2018-11-16 08:00:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 08:00:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523932  77 58438 28845342 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 08:00:51 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-16 08:01:11 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-16 08:01:31 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-16 08:01:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:01:44 [WARNING ] (13, 1, 'bot')
2018-11-16 08:01:44 [WARNING ] (13, 1, 'bot')
2018-11-16 08:01:44 [WARNING ] (13, 1, 'bot')
2018-11-16 08:01:44 [WARNING ] (13, 1, 'bot')
2018-11-16 08:01:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:01:44 [DEBUG   ] Finished updating board flags in 1.966 seconds
2018-11-16 08:01:51 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 08:02:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 08:02:31 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 08:02:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:02:44 [WARNING ] (13, 1, 'bot')
2018-11-16 08:02:44 [WARNING ] (13, 1, 'bot')
2018-11-16 08:02:44 [WARNING ] (13, 1, 'bot')
2018-11-16 08:02:44 [WARNING ] (13, 1, 'bot')
2018-11-16 08:02:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:02:44 [DEBUG   ] Finished updating board flags in 1.812 seconds
2018-11-16 08:02:51 [DEBUG   ] Finished updating ant stats in 0.996 seconds
2018-11-16 08:03:11 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 08:03:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 08:03:35 [DEBUG   ] Got command RPT from MCS: ref #523952
2018-11-16 08:03:35 [DEBUG   ] summary = ERROR
2018-11-16 08:03:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523952  13 58438 29015105 A  ERRORERROR'
2018-11-16 08:03:35 [DEBUG   ] Got command RPT from MCS: ref #523953
2018-11-16 08:03:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 08:03:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523953  77 58438 29015309 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 08:03:35 [DEBUG   ] Got command RPT from MCS: ref #523954
2018-11-16 08:03:35 [DEBUG   ] summary = ERROR
2018-11-16 08:03:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523954  13 58438 29015501 A  ERRORERROR'
2018-11-16 08:03:35 [DEBUG   ] Got command RPT from MCS: ref #523955
2018-11-16 08:03:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 08:03:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523955  77 58438 29015705 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 08:03:35 [DEBUG   ] Got command RPT from MCS: ref #523956
2018-11-16 08:03:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 08:03:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523956  12 58438 29015909 A  ERRORB–™š'
2018-11-16 08:03:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:03:44 [WARNING ] (13, 1, 'bot')
2018-11-16 08:03:44 [WARNING ] (13, 1, 'bot')
2018-11-16 08:03:44 [WARNING ] (13, 1, 'bot')
2018-11-16 08:03:44 [WARNING ] (13, 1, 'bot')
2018-11-16 08:03:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:03:44 [DEBUG   ] Finished updating board flags in 1.787 seconds
2018-11-16 08:03:51 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 08:04:11 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-16 08:04:31 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 08:04:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:04:44 [WARNING ] (13, 1, 'bot')
2018-11-16 08:04:44 [WARNING ] (13, 1, 'bot')
2018-11-16 08:04:44 [WARNING ] (13, 1, 'bot')
2018-11-16 08:04:44 [WARNING ] (13, 1, 'bot')
2018-11-16 08:04:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:04:44 [DEBUG   ] Finished updating board flags in 1.619 seconds
2018-11-16 08:04:51 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 08:05:11 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-11-16 08:05:31 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-16 08:05:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:05:44 [WARNING ] (13, 1, 'bot')
2018-11-16 08:05:44 [WARNING ] (13, 1, 'bot')
2018-11-16 08:05:44 [WARNING ] (13, 1, 'bot')
2018-11-16 08:05:44 [WARNING ] (13, 1, 'bot')
2018-11-16 08:05:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:05:44 [DEBUG   ] Finished updating board flags in 1.619 seconds
2018-11-16 08:05:45 [DEBUG   ] Got command RPT from MCS: ref #523961
2018-11-16 08:05:45 [DEBUG   ] summary = ERROR
2018-11-16 08:05:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523961  13 58438 29145349 A  ERRORERROR'
2018-11-16 08:05:45 [DEBUG   ] Got command RPT from MCS: ref #523962
2018-11-16 08:05:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 08:05:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523962  77 58438 29145350 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 08:05:51 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 08:06:11 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 08:06:31 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-16 08:06:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:06:44 [WARNING ] (13, 1, 'bot')
2018-11-16 08:06:44 [WARNING ] (13, 1, 'bot')
2018-11-16 08:06:44 [WARNING ] (13, 1, 'bot')
2018-11-16 08:06:44 [WARNING ] (13, 1, 'bot')
2018-11-16 08:06:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:06:44 [DEBUG   ] Finished updating board flags in 1.570 seconds
2018-11-16 08:06:52 [DEBUG   ] Finished updating ant stats in 1.395 seconds
2018-11-16 08:07:12 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-16 08:07:32 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-16 08:07:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:07:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 08:07:44 [WARNING ] (13, 1, 'bot')
2018-11-16 08:07:44 [WARNING ] (13, 1, 'bot')
2018-11-16 08:07:44 [WARNING ] (13, 1, 'bot')
2018-11-16 08:07:44 [WARNING ] (13, 1, 'bot')
2018-11-16 08:07:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:07:44 [DEBUG   ] Finished updating board flags in 1.417 seconds
2018-11-16 08:07:52 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-16 08:08:12 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-16 08:08:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 08:08:35 [DEBUG   ] Got command RPT from MCS: ref #523980
2018-11-16 08:08:35 [DEBUG   ] summary = ERROR
2018-11-16 08:08:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523980  13 58438 29315181 A  ERRORERROR'
2018-11-16 08:08:35 [DEBUG   ] Got command RPT from MCS: ref #523981
2018-11-16 08:08:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 08:08:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523981  77 58438 29315385 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 08:08:35 [DEBUG   ] Got command RPT from MCS: ref #523982
2018-11-16 08:08:35 [DEBUG   ] summary = ERROR
2018-11-16 08:08:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523982  13 58438 29315589 A  ERRORERROR'
2018-11-16 08:08:35 [DEBUG   ] Got command RPT from MCS: ref #523984
2018-11-16 08:08:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 08:08:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523984  77 58438 29315781 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 08:08:35 [DEBUG   ] Got command RPT from MCS: ref #523985
2018-11-16 08:08:35 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 08:08:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523985  12 58438 29315985 A  ERRORB–™š'
2018-11-16 08:08:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:08:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 08:08:44 [WARNING ] (13, 1, 'bot')
2018-11-16 08:08:44 [WARNING ] (13, 1, 'bot')
2018-11-16 08:08:44 [WARNING ] (13, 1, 'bot')
2018-11-16 08:08:44 [WARNING ] (13, 1, 'bot')
2018-11-16 08:08:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:08:44 [DEBUG   ] Finished updating board flags in 1.410 seconds
2018-11-16 08:08:52 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-16 08:09:12 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-16 08:09:32 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 08:09:43 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:09:44 [WARNING ] (13, 1, 'bot')
2018-11-16 08:09:44 [WARNING ] (13, 1, 'bot')
2018-11-16 08:09:44 [WARNING ] (13, 1, 'bot')
2018-11-16 08:09:44 [WARNING ] (13, 1, 'bot')
2018-11-16 08:09:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:09:44 [DEBUG   ] Finished updating board flags in 1.380 seconds
2018-11-16 08:09:52 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-11-16 08:10:12 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-16 08:10:32 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2018-11-16 08:10:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:10:44 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-16 08:10:44 [WARNING ] (13, 1, 'bot')
2018-11-16 08:10:44 [WARNING ] (13, 1, 'bot')
2018-11-16 08:10:44 [WARNING ] (13, 1, 'bot')
2018-11-16 08:10:44 [WARNING ] (13, 1, 'bot')
2018-11-16 08:10:44 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:10:44 [DEBUG   ] Finished updating board flags in 1.358 seconds
2018-11-16 08:10:45 [DEBUG   ] Got command RPT from MCS: ref #523994
2018-11-16 08:10:45 [DEBUG   ] summary = ERROR
2018-11-16 08:10:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523994  13 58438 29445345 A  ERRORERROR'
2018-11-16 08:10:45 [DEBUG   ] Got command RPT from MCS: ref #523995
2018-11-16 08:10:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 08:10:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   523995  77 58438 29445346 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 08:10:53 [DEBUG   ] Finished updating ant stats in 1.402 seconds
2018-11-16 08:11:13 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-16 08:11:33 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-16 08:11:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:11:45 [WARNING ] (13, 1, 'bot')
2018-11-16 08:11:45 [WARNING ] (13, 1, 'bot')
2018-11-16 08:11:45 [WARNING ] (13, 1, 'bot')
2018-11-16 08:11:45 [WARNING ] (13, 1, 'bot')
2018-11-16 08:11:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:11:45 [DEBUG   ] Finished updating board flags in 2.066 seconds
2018-11-16 08:11:53 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 08:12:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 08:12:33 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-16 08:12:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:12:45 [WARNING ] (13, 1, 'bot')
2018-11-16 08:12:45 [WARNING ] (13, 1, 'bot')
2018-11-16 08:12:45 [WARNING ] (13, 1, 'bot')
2018-11-16 08:12:45 [WARNING ] (13, 1, 'bot')
2018-11-16 08:12:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:12:45 [DEBUG   ] Finished updating board flags in 2.016 seconds
2018-11-16 08:12:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 08:13:13 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 08:13:33 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 08:13:35 [DEBUG   ] Got command RPT from MCS: ref #524015
2018-11-16 08:13:35 [DEBUG   ] summary = ERROR
2018-11-16 08:13:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524015  13 58438 29615257 A  ERRORERROR'
2018-11-16 08:13:35 [DEBUG   ] Got command RPT from MCS: ref #524016
2018-11-16 08:13:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 08:13:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524016  77 58438 29615461 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 08:13:35 [DEBUG   ] Got command RPT from MCS: ref #524017
2018-11-16 08:13:35 [DEBUG   ] summary = ERROR
2018-11-16 08:13:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524017  13 58438 29615665 A  ERRORERROR'
2018-11-16 08:13:35 [DEBUG   ] Got command RPT from MCS: ref #524018
2018-11-16 08:13:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 08:13:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524018  77 58438 29615869 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 08:13:36 [DEBUG   ] Got command RPT from MCS: ref #524019
2018-11-16 08:13:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 08:13:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524019  12 58438 29616061 A  ERRORB—™š'
2018-11-16 08:13:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:13:45 [WARNING ] (13, 1, 'bot')
2018-11-16 08:13:45 [WARNING ] (13, 1, 'bot')
2018-11-16 08:13:45 [WARNING ] (13, 1, 'bot')
2018-11-16 08:13:45 [WARNING ] (13, 1, 'bot')
2018-11-16 08:13:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:13:45 [DEBUG   ] Finished updating board flags in 1.979 seconds
2018-11-16 08:13:53 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-16 08:14:13 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-16 08:14:33 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 08:14:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:14:45 [WARNING ] (13, 1, 'bot')
2018-11-16 08:14:45 [WARNING ] (13, 1, 'bot')
2018-11-16 08:14:45 [WARNING ] (13, 1, 'bot')
2018-11-16 08:14:45 [WARNING ] (13, 1, 'bot')
2018-11-16 08:14:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:14:45 [DEBUG   ] Finished updating board flags in 1.804 seconds
2018-11-16 08:14:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 08:15:13 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 08:15:33 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-16 08:15:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:15:45 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 08:15:45 [DEBUG   ] Got command RPT from MCS: ref #524024
2018-11-16 08:15:45 [DEBUG   ] summary = ERROR
2018-11-16 08:15:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524024  13 58438 29745345 A  ERRORERROR'
2018-11-16 08:15:45 [DEBUG   ] Got command RPT from MCS: ref #524025
2018-11-16 08:15:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 08:15:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524025  77 58438 29745346 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 08:15:45 [WARNING ] (13, 1, 'bot')
2018-11-16 08:15:45 [WARNING ] (13, 1, 'bot')
2018-11-16 08:15:45 [WARNING ] (13, 1, 'bot')
2018-11-16 08:15:45 [WARNING ] (13, 1, 'bot')
2018-11-16 08:15:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:15:45 [DEBUG   ] Finished updating board flags in 1.831 seconds
2018-11-16 08:15:53 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 08:16:13 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 08:16:33 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 08:16:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:16:45 [WARNING ] (13, 1, 'bot')
2018-11-16 08:16:45 [WARNING ] (13, 1, 'bot')
2018-11-16 08:16:45 [WARNING ] (13, 1, 'bot')
2018-11-16 08:16:45 [WARNING ] (13, 1, 'bot')
2018-11-16 08:16:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:16:45 [DEBUG   ] Finished updating board flags in 1.817 seconds
2018-11-16 08:16:53 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-16 08:17:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 08:17:33 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 08:17:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:17:45 [WARNING ] (13, 1, 'bot')
2018-11-16 08:17:45 [WARNING ] (13, 1, 'bot')
2018-11-16 08:17:45 [WARNING ] (13, 1, 'bot')
2018-11-16 08:17:45 [WARNING ] (13, 1, 'bot')
2018-11-16 08:17:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:17:45 [DEBUG   ] Finished updating board flags in 1.773 seconds
2018-11-16 08:17:53 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 08:18:13 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-16 08:18:34 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-16 08:18:35 [DEBUG   ] Got command RPT from MCS: ref #524047
2018-11-16 08:18:35 [DEBUG   ] summary = ERROR
2018-11-16 08:18:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524047  13 58438 29915341 A  ERRORERROR'
2018-11-16 08:18:35 [DEBUG   ] Got command RPT from MCS: ref #524048
2018-11-16 08:18:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 08:18:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524048  77 58438 29915545 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 08:18:35 [DEBUG   ] Got command RPT from MCS: ref #524049
2018-11-16 08:18:35 [DEBUG   ] summary = ERROR
2018-11-16 08:18:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524049  13 58438 29915749 A  ERRORERROR'
2018-11-16 08:18:35 [DEBUG   ] Got command RPT from MCS: ref #524051
2018-11-16 08:18:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 08:18:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524051  77 58438 29915941 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 08:18:36 [DEBUG   ] Got command RPT from MCS: ref #524052
2018-11-16 08:18:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 08:18:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524052  12 58438 29916145 A  ERRORB–™š'
2018-11-16 08:18:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:18:45 [WARNING ] (13, 1, 'bot')
2018-11-16 08:18:45 [WARNING ] (13, 1, 'bot')
2018-11-16 08:18:45 [WARNING ] (13, 1, 'bot')
2018-11-16 08:18:45 [WARNING ] (13, 1, 'bot')
2018-11-16 08:18:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:18:45 [DEBUG   ] Finished updating board flags in 1.600 seconds
2018-11-16 08:18:54 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-16 08:19:14 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-11-16 08:19:34 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 08:19:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:19:45 [WARNING ] (13, 1, 'bot')
2018-11-16 08:19:45 [WARNING ] (13, 1, 'bot')
2018-11-16 08:19:45 [WARNING ] (13, 1, 'bot')
2018-11-16 08:19:45 [WARNING ] (13, 1, 'bot')
2018-11-16 08:19:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:19:45 [DEBUG   ] Finished updating board flags in 1.592 seconds
2018-11-16 08:19:54 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 08:20:14 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 08:20:34 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-16 08:20:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:20:45 [DEBUG   ] Got command RPT from MCS: ref #524061
2018-11-16 08:20:45 [DEBUG   ] summary = ERROR
2018-11-16 08:20:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524061  13 58438 30045349 A  ERRORERROR'
2018-11-16 08:20:45 [DEBUG   ] Got command RPT from MCS: ref #524062
2018-11-16 08:20:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 08:20:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524062  77 58438 30045350 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 08:20:45 [WARNING ] (13, 1, 'bot')
2018-11-16 08:20:45 [WARNING ] (13, 1, 'bot')
2018-11-16 08:20:45 [WARNING ] (13, 1, 'bot')
2018-11-16 08:20:45 [WARNING ] (13, 1, 'bot')
2018-11-16 08:20:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:20:45 [DEBUG   ] Finished updating board flags in 1.423 seconds
2018-11-16 08:20:54 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 08:21:14 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 08:21:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 08:21:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:21:45 [WARNING ] (13, 1, 'bot')
2018-11-16 08:21:45 [WARNING ] (13, 1, 'bot')
2018-11-16 08:21:45 [WARNING ] (13, 1, 'bot')
2018-11-16 08:21:45 [WARNING ] (13, 1, 'bot')
2018-11-16 08:21:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:21:45 [DEBUG   ] Finished updating board flags in 1.415 seconds
2018-11-16 08:21:54 [DEBUG   ] Finished updating ant stats in 0.795 seconds
2018-11-16 08:22:14 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 08:22:34 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 08:22:44 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:22:45 [WARNING ] (13, 1, 'bot')
2018-11-16 08:22:45 [WARNING ] (13, 1, 'bot')
2018-11-16 08:22:45 [WARNING ] (13, 1, 'bot')
2018-11-16 08:22:45 [WARNING ] (13, 1, 'bot')
2018-11-16 08:22:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:22:45 [DEBUG   ] Finished updating board flags in 1.361 seconds
2018-11-16 08:22:54 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 08:23:14 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-16 08:23:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 08:23:35 [DEBUG   ] Got command RPT from MCS: ref #524078
2018-11-16 08:23:35 [DEBUG   ] summary = ERROR
2018-11-16 08:23:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524078  13 58438 30215425 A  ERRORERROR'
2018-11-16 08:23:35 [DEBUG   ] Got command RPT from MCS: ref #524079
2018-11-16 08:23:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 08:23:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524079  77 58438 30215629 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 08:23:35 [DEBUG   ] Got command RPT from MCS: ref #524080
2018-11-16 08:23:35 [DEBUG   ] summary = ERROR
2018-11-16 08:23:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524080  13 58438 30215821 A  ERRORERROR'
2018-11-16 08:23:36 [DEBUG   ] Got command RPT from MCS: ref #524081
2018-11-16 08:23:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 08:23:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524081  77 58438 30216025 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 08:23:36 [DEBUG   ] Got command RPT from MCS: ref #524082
2018-11-16 08:23:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 08:23:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524082  12 58438 30216229 A  ERRORB•™š'
2018-11-16 08:23:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:23:45 [WARNING ] (13, 1, 'bot')
2018-11-16 08:23:45 [WARNING ] (13, 1, 'bot')
2018-11-16 08:23:45 [WARNING ] (13, 1, 'bot')
2018-11-16 08:23:45 [WARNING ] (13, 1, 'bot')
2018-11-16 08:23:45 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:23:45 [DEBUG   ] Finished updating board flags in 1.381 seconds
2018-11-16 08:23:55 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-11-16 08:24:15 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-16 08:24:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 08:24:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:24:46 [WARNING ] (13, 1, 'bot')
2018-11-16 08:24:46 [WARNING ] (13, 1, 'bot')
2018-11-16 08:24:46 [WARNING ] (13, 1, 'bot')
2018-11-16 08:24:46 [WARNING ] (13, 1, 'bot')
2018-11-16 08:24:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:24:46 [DEBUG   ] Finished updating board flags in 2.037 seconds
2018-11-16 08:24:55 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-16 08:25:15 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-16 08:25:35 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 08:25:45 [DEBUG   ] Got command RPT from MCS: ref #524087
2018-11-16 08:25:45 [DEBUG   ] summary = ERROR
2018-11-16 08:25:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524087  13 58438 30345345 A  ERRORERROR'
2018-11-16 08:25:45 [DEBUG   ] Got command RPT from MCS: ref #524088
2018-11-16 08:25:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 08:25:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524088  77 58438 30345346 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 08:25:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:25:46 [WARNING ] (13, 1, 'bot')
2018-11-16 08:25:46 [WARNING ] (13, 1, 'bot')
2018-11-16 08:25:46 [WARNING ] (13, 1, 'bot')
2018-11-16 08:25:46 [WARNING ] (13, 1, 'bot')
2018-11-16 08:25:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:25:46 [DEBUG   ] Finished updating board flags in 1.978 seconds
2018-11-16 08:25:55 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 08:26:15 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 08:26:35 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-16 08:26:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:26:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa25, chip 4
2018-11-16 08:26:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa33, chip 4
2018-11-16 08:26:46 [WARNING ] (13, 1, 'bot')
2018-11-16 08:26:46 [WARNING ] (13, 1, 'bot')
2018-11-16 08:26:46 [WARNING ] (13, 1, 'bot')
2018-11-16 08:26:46 [WARNING ] (13, 1, 'bot')
2018-11-16 08:26:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:26:46 [DEBUG   ] Finished updating board flags in 1.851 seconds
2018-11-16 08:26:55 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 08:27:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 08:27:35 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 08:27:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:27:46 [WARNING ] (13, 1, 'bot')
2018-11-16 08:27:46 [WARNING ] (13, 1, 'bot')
2018-11-16 08:27:46 [WARNING ] (13, 1, 'bot')
2018-11-16 08:27:46 [WARNING ] (13, 1, 'bot')
2018-11-16 08:27:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:27:46 [DEBUG   ] Finished updating board flags in 1.761 seconds
2018-11-16 08:27:55 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-16 08:28:15 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-16 08:28:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 08:28:35 [DEBUG   ] Got command RPT from MCS: ref #524110
2018-11-16 08:28:35 [DEBUG   ] summary = ERROR
2018-11-16 08:28:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524110  13 58438 30515505 A  ERRORERROR'
2018-11-16 08:28:35 [DEBUG   ] Got command RPT from MCS: ref #524111
2018-11-16 08:28:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 08:28:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524111  77 58438 30515709 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 08:28:35 [DEBUG   ] Got command RPT from MCS: ref #524112
2018-11-16 08:28:35 [DEBUG   ] summary = ERROR
2018-11-16 08:28:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524112  13 58438 30515901 A  ERRORERROR'
2018-11-16 08:28:36 [DEBUG   ] Got command RPT from MCS: ref #524114
2018-11-16 08:28:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 08:28:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524114  77 58438 30516105 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 08:28:36 [DEBUG   ] Got command RPT from MCS: ref #524115
2018-11-16 08:28:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 08:28:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524115  12 58438 30516309 A  ERRORB—™š'
2018-11-16 08:28:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:28:46 [WARNING ] (13, 1, 'bot')
2018-11-16 08:28:46 [WARNING ] (13, 1, 'bot')
2018-11-16 08:28:46 [WARNING ] (13, 1, 'bot')
2018-11-16 08:28:46 [WARNING ] (13, 1, 'bot')
2018-11-16 08:28:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:28:46 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-11-16 08:28:55 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 08:29:15 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-16 08:29:35 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-16 08:29:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:29:46 [WARNING ] (13, 1, 'bot')
2018-11-16 08:29:46 [WARNING ] (13, 1, 'bot')
2018-11-16 08:29:46 [WARNING ] (13, 1, 'bot')
2018-11-16 08:29:46 [WARNING ] (13, 1, 'bot')
2018-11-16 08:29:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:29:46 [DEBUG   ] Finished updating board flags in 1.601 seconds
2018-11-16 08:29:56 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-11-16 08:30:16 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 08:30:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 08:30:45 [DEBUG   ] Got command RPT from MCS: ref #524124
2018-11-16 08:30:45 [DEBUG   ] summary = ERROR
2018-11-16 08:30:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524124  13 58438 30645350 A  ERRORERROR'
2018-11-16 08:30:45 [DEBUG   ] Got command RPT from MCS: ref #524125
2018-11-16 08:30:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 08:30:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524125  77 58438 30645350 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 08:30:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:30:46 [WARNING ] (13, 1, 'bot')
2018-11-16 08:30:46 [WARNING ] (13, 1, 'bot')
2018-11-16 08:30:46 [WARNING ] (13, 1, 'bot')
2018-11-16 08:30:46 [WARNING ] (13, 1, 'bot')
2018-11-16 08:30:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:30:46 [DEBUG   ] Finished updating board flags in 1.594 seconds
2018-11-16 08:30:56 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-16 08:31:16 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-16 08:31:36 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 08:31:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:31:46 [WARNING ] (13, 1, 'bot')
2018-11-16 08:31:46 [WARNING ] (13, 1, 'bot')
2018-11-16 08:31:46 [WARNING ] (13, 1, 'bot')
2018-11-16 08:31:46 [WARNING ] (13, 1, 'bot')
2018-11-16 08:31:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:31:46 [DEBUG   ] Finished updating board flags in 1.416 seconds
2018-11-16 08:31:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 08:32:16 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 08:32:36 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-16 08:32:45 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:32:46 [WARNING ] (13, 1, 'bot')
2018-11-16 08:32:46 [WARNING ] (13, 1, 'bot')
2018-11-16 08:32:46 [WARNING ] (13, 1, 'bot')
2018-11-16 08:32:46 [WARNING ] (13, 1, 'bot')
2018-11-16 08:32:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:32:46 [DEBUG   ] Finished updating board flags in 1.391 seconds
2018-11-16 08:32:56 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-16 08:33:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 08:33:35 [DEBUG   ] Got command RPT from MCS: ref #524145
2018-11-16 08:33:35 [DEBUG   ] summary = ERROR
2018-11-16 08:33:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524145  13 58438 30815589 A  ERRORERROR'
2018-11-16 08:33:35 [DEBUG   ] Got command RPT from MCS: ref #524146
2018-11-16 08:33:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 08:33:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524146  77 58438 30815782 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 08:33:35 [DEBUG   ] Got command RPT from MCS: ref #524147
2018-11-16 08:33:35 [DEBUG   ] summary = ERROR
2018-11-16 08:33:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524147  13 58438 30815986 A  ERRORERROR'
2018-11-16 08:33:36 [DEBUG   ] Got command RPT from MCS: ref #524148
2018-11-16 08:33:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 08:33:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524148  77 58438 30816189 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 08:33:36 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 08:33:36 [DEBUG   ] Got command RPT from MCS: ref #524149
2018-11-16 08:33:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 08:33:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524149  12 58438 30816393 A  ERRORB—™š'
2018-11-16 08:33:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:33:46 [WARNING ] (13, 1, 'bot')
2018-11-16 08:33:46 [WARNING ] (13, 1, 'bot')
2018-11-16 08:33:46 [WARNING ] (13, 1, 'bot')
2018-11-16 08:33:46 [WARNING ] (13, 1, 'bot')
2018-11-16 08:33:46 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:33:46 [DEBUG   ] Finished updating board flags in 1.363 seconds
2018-11-16 08:33:56 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 08:34:16 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-16 08:34:37 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-11-16 08:34:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:34:47 [WARNING ] (13, 1, 'bot')
2018-11-16 08:34:47 [WARNING ] (13, 1, 'bot')
2018-11-16 08:34:47 [WARNING ] (13, 1, 'bot')
2018-11-16 08:34:47 [WARNING ] (13, 1, 'bot')
2018-11-16 08:34:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:34:47 [DEBUG   ] Finished updating board flags in 2.100 seconds
2018-11-16 08:34:57 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-16 08:35:17 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 08:35:37 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 08:35:45 [DEBUG   ] Got command RPT from MCS: ref #524154
2018-11-16 08:35:45 [DEBUG   ] summary = ERROR
2018-11-16 08:35:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524154  13 58438 30945349 A  ERRORERROR'
2018-11-16 08:35:45 [DEBUG   ] Got command RPT from MCS: ref #524155
2018-11-16 08:35:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 08:35:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524155  77 58438 30945350 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 08:35:46 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 4
2018-11-16 08:35:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:35:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-16 08:35:47 [WARNING ] (13, 1, 'bot')
2018-11-16 08:35:47 [WARNING ] (13, 1, 'bot')
2018-11-16 08:35:47 [WARNING ] (13, 1, 'bot')
2018-11-16 08:35:47 [WARNING ] (13, 1, 'bot')
2018-11-16 08:35:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:35:47 [DEBUG   ] Finished updating board flags in 1.928 seconds
2018-11-16 08:35:57 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 08:36:17 [DEBUG   ] Finished updating ant stats in 1.196 seconds
2018-11-16 08:36:37 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-16 08:36:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:36:47 [WARNING ] (13, 1, 'bot')
2018-11-16 08:36:47 [WARNING ] (13, 1, 'bot')
2018-11-16 08:36:47 [WARNING ] (13, 1, 'bot')
2018-11-16 08:36:47 [WARNING ] (13, 1, 'bot')
2018-11-16 08:36:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:36:47 [DEBUG   ] Finished updating board flags in 1.829 seconds
2018-11-16 08:36:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 08:37:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 08:37:37 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 08:37:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:37:47 [WARNING ] (13, 1, 'bot')
2018-11-16 08:37:47 [WARNING ] (13, 1, 'bot')
2018-11-16 08:37:47 [WARNING ] (13, 1, 'bot')
2018-11-16 08:37:47 [WARNING ] (13, 1, 'bot')
2018-11-16 08:37:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:37:47 [DEBUG   ] Finished updating board flags in 1.782 seconds
2018-11-16 08:37:57 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-16 08:38:17 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-16 08:38:35 [DEBUG   ] Got command RPT from MCS: ref #524173
2018-11-16 08:38:35 [DEBUG   ] summary = ERROR
2018-11-16 08:38:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524173  13 58438 31115665 A  ERRORERROR'
2018-11-16 08:38:35 [DEBUG   ] Got command RPT from MCS: ref #524174
2018-11-16 08:38:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 08:38:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524174  77 58438 31115869 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 08:38:36 [DEBUG   ] Got command RPT from MCS: ref #524175
2018-11-16 08:38:36 [DEBUG   ] summary = ERROR
2018-11-16 08:38:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524175  13 58438 31116061 A  ERRORERROR'
2018-11-16 08:38:36 [DEBUG   ] Got command RPT from MCS: ref #524177
2018-11-16 08:38:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 08:38:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524177  77 58438 31116265 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 08:38:36 [DEBUG   ] Got command RPT from MCS: ref #524179
2018-11-16 08:38:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 08:38:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524179  12 58438 31116469 A  ERRORB–™š'
2018-11-16 08:38:37 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 08:38:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:38:47 [WARNING ] (13, 1, 'bot')
2018-11-16 08:38:47 [WARNING ] (13, 1, 'bot')
2018-11-16 08:38:47 [WARNING ] (13, 1, 'bot')
2018-11-16 08:38:47 [WARNING ] (13, 1, 'bot')
2018-11-16 08:38:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:38:47 [DEBUG   ] Finished updating board flags in 1.610 seconds
2018-11-16 08:38:57 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 08:39:17 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-16 08:39:38 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-16 08:39:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:39:47 [WARNING ] (13, 1, 'bot')
2018-11-16 08:39:47 [WARNING ] (13, 1, 'bot')
2018-11-16 08:39:47 [WARNING ] (13, 1, 'bot')
2018-11-16 08:39:47 [WARNING ] (13, 1, 'bot')
2018-11-16 08:39:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:39:47 [DEBUG   ] Finished updating board flags in 1.588 seconds
2018-11-16 08:39:58 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-16 08:40:18 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-16 08:40:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 08:40:45 [DEBUG   ] Got command RPT from MCS: ref #524187
2018-11-16 08:40:45 [DEBUG   ] summary = ERROR
2018-11-16 08:40:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524187  13 58438 31245353 A  ERRORERROR'
2018-11-16 08:40:45 [DEBUG   ] Got command RPT from MCS: ref #524188
2018-11-16 08:40:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 08:40:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524188  77 58438 31245354 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 08:40:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:40:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-16 08:40:47 [WARNING ] (13, 1, 'bot')
2018-11-16 08:40:47 [WARNING ] (13, 1, 'bot')
2018-11-16 08:40:47 [WARNING ] (13, 1, 'bot')
2018-11-16 08:40:47 [WARNING ] (13, 1, 'bot')
2018-11-16 08:40:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:40:47 [DEBUG   ] Finished updating board flags in 1.423 seconds
2018-11-16 08:40:58 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 08:41:18 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 08:41:38 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 08:41:46 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:41:47 [WARNING ] (13, 1, 'bot')
2018-11-16 08:41:47 [WARNING ] (13, 1, 'bot')
2018-11-16 08:41:47 [WARNING ] (13, 1, 'bot')
2018-11-16 08:41:47 [WARNING ] (13, 1, 'bot')
2018-11-16 08:41:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:41:47 [DEBUG   ] Finished updating board flags in 1.507 seconds
2018-11-16 08:41:58 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-16 08:42:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 08:42:38 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 08:42:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:42:47 [WARNING ] (13, 1, 'bot')
2018-11-16 08:42:47 [WARNING ] (13, 1, 'bot')
2018-11-16 08:42:47 [WARNING ] (13, 1, 'bot')
2018-11-16 08:42:47 [WARNING ] (13, 1, 'bot')
2018-11-16 08:42:47 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:42:47 [DEBUG   ] Finished updating board flags in 1.507 seconds
2018-11-16 08:42:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 08:43:18 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 08:43:35 [DEBUG   ] Got command RPT from MCS: ref #524208
2018-11-16 08:43:35 [DEBUG   ] summary = ERROR
2018-11-16 08:43:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524208  13 58438 31415741 A  ERRORERROR'
2018-11-16 08:43:35 [DEBUG   ] Got command RPT from MCS: ref #524209
2018-11-16 08:43:35 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 08:43:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524209  77 58438 31415945 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 08:43:36 [DEBUG   ] Got command RPT from MCS: ref #524210
2018-11-16 08:43:36 [DEBUG   ] summary = ERROR
2018-11-16 08:43:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524210  13 58438 31416149 A  ERRORERROR'
2018-11-16 08:43:36 [DEBUG   ] Got command RPT from MCS: ref #524211
2018-11-16 08:43:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 08:43:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524211  77 58438 31416341 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 08:43:36 [DEBUG   ] Got command RPT from MCS: ref #524212
2018-11-16 08:43:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 08:43:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524212  12 58438 31416545 A  ERRORB–™š'
2018-11-16 08:43:38 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 08:43:47 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 08:43:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:43:48 [WARNING ] (13, 1, 'bot')
2018-11-16 08:43:48 [WARNING ] (13, 1, 'bot')
2018-11-16 08:43:48 [WARNING ] (13, 1, 'bot')
2018-11-16 08:43:48 [WARNING ] (13, 1, 'bot')
2018-11-16 08:43:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:43:48 [DEBUG   ] Finished updating board flags in 2.254 seconds
2018-11-16 08:43:58 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-16 08:44:18 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-16 08:44:38 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 08:44:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 08:44:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-16 08:44:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:44:48 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 08:44:48 [WARNING ] (13, 1, 'bot')
2018-11-16 08:44:48 [WARNING ] (13, 1, 'bot')
2018-11-16 08:44:48 [WARNING ] (13, 1, 'bot')
2018-11-16 08:44:48 [WARNING ] (13, 1, 'bot')
2018-11-16 08:44:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:44:48 [DEBUG   ] Finished updating board flags in 2.208 seconds
2018-11-16 08:44:58 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-16 08:45:18 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-16 08:45:39 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-11-16 08:45:45 [DEBUG   ] Got command RPT from MCS: ref #524217
2018-11-16 08:45:45 [DEBUG   ] summary = ERROR
2018-11-16 08:45:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524217  13 58438 31545357 A  ERRORERROR'
2018-11-16 08:45:45 [DEBUG   ] Got command RPT from MCS: ref #524218
2018-11-16 08:45:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 08:45:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524218  77 58438 31545358 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 08:45:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:45:48 [WARNING ] (13, 1, 'bot')
2018-11-16 08:45:48 [WARNING ] (13, 1, 'bot')
2018-11-16 08:45:48 [WARNING ] (13, 1, 'bot')
2018-11-16 08:45:48 [WARNING ] (13, 1, 'bot')
2018-11-16 08:45:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:45:48 [DEBUG   ] Finished updating board flags in 2.116 seconds
2018-11-16 08:45:59 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-16 08:46:19 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-16 08:46:39 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-16 08:46:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 08:46:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:46:48 [WARNING ] (13, 1, 'bot')
2018-11-16 08:46:48 [WARNING ] (13, 1, 'bot')
2018-11-16 08:46:48 [WARNING ] (13, 1, 'bot')
2018-11-16 08:46:48 [WARNING ] (13, 1, 'bot')
2018-11-16 08:46:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:46:48 [DEBUG   ] Finished updating board flags in 2.029 seconds
2018-11-16 08:46:59 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 08:47:19 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 08:47:39 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-16 08:47:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:47:48 [WARNING ] (13, 1, 'bot')
2018-11-16 08:47:48 [WARNING ] (13, 1, 'bot')
2018-11-16 08:47:48 [WARNING ] (13, 1, 'bot')
2018-11-16 08:47:48 [WARNING ] (13, 1, 'bot')
2018-11-16 08:47:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:47:48 [DEBUG   ] Finished updating board flags in 1.986 seconds
2018-11-16 08:47:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 08:48:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 08:48:35 [DEBUG   ] Got command RPT from MCS: ref #524240
2018-11-16 08:48:35 [DEBUG   ] summary = ERROR
2018-11-16 08:48:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524240  13 58438 31715821 A  ERRORERROR'
2018-11-16 08:48:36 [DEBUG   ] Got command RPT from MCS: ref #524241
2018-11-16 08:48:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 08:48:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524241  77 58438 31716025 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 08:48:36 [DEBUG   ] Got command RPT from MCS: ref #524242
2018-11-16 08:48:36 [DEBUG   ] summary = ERROR
2018-11-16 08:48:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524242  13 58438 31716229 A  ERRORERROR'
2018-11-16 08:48:36 [DEBUG   ] Got command RPT from MCS: ref #524244
2018-11-16 08:48:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 08:48:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524244  77 58438 31716433 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 08:48:36 [DEBUG   ] Got command RPT from MCS: ref #524245
2018-11-16 08:48:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 08:48:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524245  12 58438 31716625 A  ERRORB—™š'
2018-11-16 08:48:39 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 08:48:47 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 08:48:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:48:48 [WARNING ] (13, 1, 'bot')
2018-11-16 08:48:48 [WARNING ] (13, 1, 'bot')
2018-11-16 08:48:48 [WARNING ] (13, 1, 'bot')
2018-11-16 08:48:48 [WARNING ] (13, 1, 'bot')
2018-11-16 08:48:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:48:48 [DEBUG   ] Finished updating board flags in 1.820 seconds
2018-11-16 08:48:59 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 08:49:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 08:49:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 08:49:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:49:48 [WARNING ] (13, 1, 'bot')
2018-11-16 08:49:48 [WARNING ] (13, 1, 'bot')
2018-11-16 08:49:48 [WARNING ] (13, 1, 'bot')
2018-11-16 08:49:48 [WARNING ] (13, 1, 'bot')
2018-11-16 08:49:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:49:48 [DEBUG   ] Finished updating board flags in 1.786 seconds
2018-11-16 08:49:59 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 08:50:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 08:50:39 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 08:50:45 [DEBUG   ] Got command RPT from MCS: ref #524254
2018-11-16 08:50:45 [DEBUG   ] summary = ERROR
2018-11-16 08:50:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524254  13 58438 31845357 A  ERRORERROR'
2018-11-16 08:50:45 [DEBUG   ] Got command RPT from MCS: ref #524255
2018-11-16 08:50:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 08:50:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524255  77 58438 31845358 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 08:50:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:50:48 [WARNING ] (13, 1, 'bot')
2018-11-16 08:50:48 [WARNING ] (13, 1, 'bot')
2018-11-16 08:50:48 [WARNING ] (13, 1, 'bot')
2018-11-16 08:50:48 [WARNING ] (13, 1, 'bot')
2018-11-16 08:50:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:50:48 [DEBUG   ] Finished updating board flags in 1.632 seconds
2018-11-16 08:50:59 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 08:51:19 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 08:51:39 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 08:51:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:51:48 [WARNING ] (13, 1, 'bot')
2018-11-16 08:51:48 [WARNING ] (13, 1, 'bot')
2018-11-16 08:51:48 [WARNING ] (13, 1, 'bot')
2018-11-16 08:51:48 [WARNING ] (13, 1, 'bot')
2018-11-16 08:51:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:51:48 [DEBUG   ] Finished updating board flags in 1.673 seconds
2018-11-16 08:51:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 08:52:19 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 08:52:39 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 08:52:47 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:52:48 [WARNING ] (13, 1, 'bot')
2018-11-16 08:52:48 [WARNING ] (13, 1, 'bot')
2018-11-16 08:52:48 [WARNING ] (13, 1, 'bot')
2018-11-16 08:52:48 [WARNING ] (13, 1, 'bot')
2018-11-16 08:52:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:52:48 [DEBUG   ] Finished updating board flags in 1.526 seconds
2018-11-16 08:52:59 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2018-11-16 08:53:19 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 08:53:35 [DEBUG   ] Got command RPT from MCS: ref #524271
2018-11-16 08:53:35 [DEBUG   ] summary = ERROR
2018-11-16 08:53:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524271  13 58438 32015905 A  ERRORERROR'
2018-11-16 08:53:36 [DEBUG   ] Got command RPT from MCS: ref #524272
2018-11-16 08:53:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 08:53:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524272  77 58438 32016109 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 08:53:36 [DEBUG   ] Got command RPT from MCS: ref #524273
2018-11-16 08:53:36 [DEBUG   ] summary = ERROR
2018-11-16 08:53:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524273  13 58438 32016313 A  ERRORERROR'
2018-11-16 08:53:36 [DEBUG   ] Got command RPT from MCS: ref #524274
2018-11-16 08:53:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 08:53:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524274  77 58438 32016505 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 08:53:36 [DEBUG   ] Got command RPT from MCS: ref #524275
2018-11-16 08:53:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 08:53:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524275  12 58438 32016709 A  ERRORB–™š'
2018-11-16 08:53:39 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 08:53:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:53:48 [WARNING ] (13, 1, 'bot')
2018-11-16 08:53:48 [WARNING ] (13, 1, 'bot')
2018-11-16 08:53:48 [WARNING ] (13, 1, 'bot')
2018-11-16 08:53:48 [WARNING ] (13, 1, 'bot')
2018-11-16 08:53:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:53:48 [DEBUG   ] Finished updating board flags in 1.527 seconds
2018-11-16 08:53:59 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 08:54:19 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-16 08:54:39 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 08:54:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:54:48 [WARNING ] (13, 1, 'bot')
2018-11-16 08:54:48 [WARNING ] (13, 1, 'bot')
2018-11-16 08:54:48 [WARNING ] (13, 1, 'bot')
2018-11-16 08:54:48 [WARNING ] (13, 1, 'bot')
2018-11-16 08:54:48 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:54:48 [DEBUG   ] Finished updating board flags in 1.528 seconds
2018-11-16 08:55:00 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-16 08:55:20 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-16 08:55:40 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 08:55:45 [DEBUG   ] Got command RPT from MCS: ref #524280
2018-11-16 08:55:45 [DEBUG   ] summary = ERROR
2018-11-16 08:55:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524280  13 58438 32145361 A  ERRORERROR'
2018-11-16 08:55:45 [DEBUG   ] Got command RPT from MCS: ref #524281
2018-11-16 08:55:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 08:55:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524281  77 58438 32145362 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 08:55:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:55:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-16 08:55:49 [WARNING ] (13, 1, 'bot')
2018-11-16 08:55:49 [WARNING ] (13, 1, 'bot')
2018-11-16 08:55:49 [WARNING ] (13, 1, 'bot')
2018-11-16 08:55:49 [WARNING ] (13, 1, 'bot')
2018-11-16 08:55:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:55:49 [DEBUG   ] Finished updating board flags in 2.167 seconds
2018-11-16 08:56:00 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-16 08:56:20 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 08:56:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 08:56:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:56:49 [WARNING ] (13, 1, 'bot')
2018-11-16 08:56:49 [WARNING ] (13, 1, 'bot')
2018-11-16 08:56:49 [WARNING ] (13, 1, 'bot')
2018-11-16 08:56:49 [WARNING ] (13, 1, 'bot')
2018-11-16 08:56:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:56:49 [DEBUG   ] Finished updating board flags in 1.970 seconds
2018-11-16 08:57:00 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 08:57:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 08:57:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 08:57:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:57:49 [WARNING ] (13, 1, 'bot')
2018-11-16 08:57:49 [WARNING ] (13, 1, 'bot')
2018-11-16 08:57:49 [WARNING ] (13, 1, 'bot')
2018-11-16 08:57:49 [WARNING ] (13, 1, 'bot')
2018-11-16 08:57:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:57:49 [DEBUG   ] Finished updating board flags in 1.798 seconds
2018-11-16 08:58:00 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 08:58:20 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 08:58:35 [DEBUG   ] Got command RPT from MCS: ref #524303
2018-11-16 08:58:35 [DEBUG   ] summary = ERROR
2018-11-16 08:58:35 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524303  13 58438 32315989 A  ERRORERROR'
2018-11-16 08:58:36 [DEBUG   ] Got command RPT from MCS: ref #524304
2018-11-16 08:58:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 08:58:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524304  77 58438 32316181 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 08:58:36 [DEBUG   ] Got command RPT from MCS: ref #524305
2018-11-16 08:58:36 [DEBUG   ] summary = ERROR
2018-11-16 08:58:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524305  13 58438 32316385 A  ERRORERROR'
2018-11-16 08:58:36 [DEBUG   ] Got command RPT from MCS: ref #524307
2018-11-16 08:58:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 08:58:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524307  77 58438 32316589 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 08:58:36 [DEBUG   ] Got command RPT from MCS: ref #524308
2018-11-16 08:58:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 08:58:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524308  12 58438 32316793 A  ERRORB–™š'
2018-11-16 08:58:40 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 08:58:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:58:49 [WARNING ] (13, 1, 'bot')
2018-11-16 08:58:49 [WARNING ] (13, 1, 'bot')
2018-11-16 08:58:49 [WARNING ] (13, 1, 'bot')
2018-11-16 08:58:49 [WARNING ] (13, 1, 'bot')
2018-11-16 08:58:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:58:49 [DEBUG   ] Finished updating board flags in 1.584 seconds
2018-11-16 08:59:00 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-16 08:59:20 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 08:59:40 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 08:59:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 08:59:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-16 08:59:49 [WARNING ] (13, 1, 'bot')
2018-11-16 08:59:49 [WARNING ] (13, 1, 'bot')
2018-11-16 08:59:49 [WARNING ] (13, 1, 'bot')
2018-11-16 08:59:49 [WARNING ] (13, 1, 'bot')
2018-11-16 08:59:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 08:59:49 [DEBUG   ] Finished updating board flags in 1.422 seconds
2018-11-16 09:00:00 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 09:00:20 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 09:00:40 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-16 09:00:45 [DEBUG   ] Got command RPT from MCS: ref #524317
2018-11-16 09:00:45 [DEBUG   ] summary = ERROR
2018-11-16 09:00:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524317  13 58438 32445353 A  ERRORERROR'
2018-11-16 09:00:45 [DEBUG   ] Got command RPT from MCS: ref #524318
2018-11-16 09:00:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 09:00:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524318  77 58438 32445354 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 09:00:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:00:49 [WARNING ] (13, 1, 'bot')
2018-11-16 09:00:49 [WARNING ] (13, 1, 'bot')
2018-11-16 09:00:49 [WARNING ] (13, 1, 'bot')
2018-11-16 09:00:49 [WARNING ] (13, 1, 'bot')
2018-11-16 09:00:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:00:49 [DEBUG   ] Finished updating board flags in 1.441 seconds
2018-11-16 09:01:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 09:01:20 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 09:01:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 09:01:48 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:01:49 [WARNING ] (13, 1, 'bot')
2018-11-16 09:01:49 [WARNING ] (13, 1, 'bot')
2018-11-16 09:01:49 [WARNING ] (13, 1, 'bot')
2018-11-16 09:01:49 [WARNING ] (13, 1, 'bot')
2018-11-16 09:01:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:01:49 [DEBUG   ] Finished updating board flags in 1.412 seconds
2018-11-16 09:02:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 09:02:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 09:02:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 09:02:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:02:49 [WARNING ] (13, 1, 'bot')
2018-11-16 09:02:49 [WARNING ] (13, 1, 'bot')
2018-11-16 09:02:49 [WARNING ] (13, 1, 'bot')
2018-11-16 09:02:49 [WARNING ] (13, 1, 'bot')
2018-11-16 09:02:49 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:02:49 [DEBUG   ] Finished updating board flags in 1.557 seconds
2018-11-16 09:03:00 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 09:03:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 09:03:36 [DEBUG   ] Got command RPT from MCS: ref #524338
2018-11-16 09:03:36 [DEBUG   ] summary = ERROR
2018-11-16 09:03:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524338  13 58438 32616069 A  ERRORERROR'
2018-11-16 09:03:36 [DEBUG   ] Got command RPT from MCS: ref #524339
2018-11-16 09:03:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 09:03:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524339  77 58438 32616273 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 09:03:36 [DEBUG   ] Got command RPT from MCS: ref #524340
2018-11-16 09:03:36 [DEBUG   ] summary = ERROR
2018-11-16 09:03:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524340  13 58438 32616465 A  ERRORERROR'
2018-11-16 09:03:36 [DEBUG   ] Got command RPT from MCS: ref #524341
2018-11-16 09:03:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 09:03:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524341  77 58438 32616669 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 09:03:36 [DEBUG   ] Got command RPT from MCS: ref #524342
2018-11-16 09:03:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 09:03:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524342  12 58438 32616873 A  ERRORB•™š'
2018-11-16 09:03:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 09:03:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:03:50 [WARNING ] (13, 1, 'bot')
2018-11-16 09:03:50 [WARNING ] (13, 1, 'bot')
2018-11-16 09:03:50 [WARNING ] (13, 1, 'bot')
2018-11-16 09:03:50 [WARNING ] (13, 1, 'bot')
2018-11-16 09:03:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:03:50 [DEBUG   ] Finished updating board flags in 2.288 seconds
2018-11-16 09:04:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 09:04:20 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 09:04:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 09:04:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:04:50 [WARNING ] (13, 1, 'bot')
2018-11-16 09:04:50 [WARNING ] (13, 1, 'bot')
2018-11-16 09:04:50 [WARNING ] (13, 1, 'bot')
2018-11-16 09:04:50 [WARNING ] (13, 1, 'bot')
2018-11-16 09:04:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:04:50 [DEBUG   ] Finished updating board flags in 2.117 seconds
2018-11-16 09:05:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 09:05:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 09:05:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 09:05:45 [DEBUG   ] Got command RPT from MCS: ref #524347
2018-11-16 09:05:45 [DEBUG   ] summary = ERROR
2018-11-16 09:05:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524347  13 58438 32745353 A  ERRORERROR'
2018-11-16 09:05:45 [DEBUG   ] Got command RPT from MCS: ref #524348
2018-11-16 09:05:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 09:05:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524348  77 58438 32745354 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 09:05:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:05:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-16 09:05:50 [WARNING ] (13, 1, 'bot')
2018-11-16 09:05:50 [WARNING ] (13, 1, 'bot')
2018-11-16 09:05:50 [WARNING ] (13, 1, 'bot')
2018-11-16 09:05:50 [WARNING ] (13, 1, 'bot')
2018-11-16 09:05:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:05:50 [DEBUG   ] Finished updating board flags in 2.023 seconds
2018-11-16 09:06:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 09:06:20 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 09:06:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 09:06:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:06:50 [WARNING ] (13, 1, 'bot')
2018-11-16 09:06:50 [WARNING ] (13, 1, 'bot')
2018-11-16 09:06:50 [WARNING ] (13, 1, 'bot')
2018-11-16 09:06:50 [WARNING ] (13, 1, 'bot')
2018-11-16 09:06:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:06:50 [DEBUG   ] Finished updating board flags in 1.964 seconds
2018-11-16 09:07:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 09:07:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 09:07:40 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 09:07:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:07:50 [WARNING ] (13, 1, 'bot')
2018-11-16 09:07:50 [WARNING ] (13, 1, 'bot')
2018-11-16 09:07:50 [WARNING ] (13, 1, 'bot')
2018-11-16 09:07:50 [WARNING ] (13, 1, 'bot')
2018-11-16 09:07:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:07:50 [DEBUG   ] Finished updating board flags in 1.825 seconds
2018-11-16 09:08:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 09:08:20 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 09:08:36 [DEBUG   ] Got command RPT from MCS: ref #524366
2018-11-16 09:08:36 [DEBUG   ] summary = ERROR
2018-11-16 09:08:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524366  13 58438 32916141 A  ERRORERROR'
2018-11-16 09:08:36 [DEBUG   ] Got command RPT from MCS: ref #524367
2018-11-16 09:08:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 09:08:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524367  77 58438 32916345 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 09:08:36 [DEBUG   ] Got command RPT from MCS: ref #524368
2018-11-16 09:08:36 [DEBUG   ] summary = ERROR
2018-11-16 09:08:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524368  13 58438 32916549 A  ERRORERROR'
2018-11-16 09:08:36 [DEBUG   ] Got command RPT from MCS: ref #524370
2018-11-16 09:08:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 09:08:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524370  77 58438 32916753 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 09:08:36 [DEBUG   ] Got command RPT from MCS: ref #524372
2018-11-16 09:08:36 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 09:08:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524372  12 58438 32916945 A  ERRORB–™š'
2018-11-16 09:08:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 09:08:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:08:50 [WARNING ] (13, 1, 'bot')
2018-11-16 09:08:50 [WARNING ] (13, 1, 'bot')
2018-11-16 09:08:50 [WARNING ] (13, 1, 'bot')
2018-11-16 09:08:50 [WARNING ] (13, 1, 'bot')
2018-11-16 09:08:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:08:50 [DEBUG   ] Finished updating board flags in 1.879 seconds
2018-11-16 09:09:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 09:09:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 09:09:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 09:09:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:09:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-16 09:09:50 [WARNING ] (13, 1, 'bot')
2018-11-16 09:09:50 [WARNING ] (13, 1, 'bot')
2018-11-16 09:09:50 [WARNING ] (13, 1, 'bot')
2018-11-16 09:09:50 [WARNING ] (13, 1, 'bot')
2018-11-16 09:09:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:09:50 [DEBUG   ] Finished updating board flags in 1.723 seconds
2018-11-16 09:10:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 09:10:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 09:10:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 09:10:45 [DEBUG   ] Got command RPT from MCS: ref #524380
2018-11-16 09:10:45 [DEBUG   ] summary = ERROR
2018-11-16 09:10:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524380  13 58438 33045357 A  ERRORERROR'
2018-11-16 09:10:45 [DEBUG   ] Got command RPT from MCS: ref #524381
2018-11-16 09:10:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 09:10:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524381  77 58438 33045358 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 09:10:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:10:50 [WARNING ] (13, 1, 'bot')
2018-11-16 09:10:50 [WARNING ] (13, 1, 'bot')
2018-11-16 09:10:50 [WARNING ] (13, 1, 'bot')
2018-11-16 09:10:50 [WARNING ] (13, 1, 'bot')
2018-11-16 09:10:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:10:50 [DEBUG   ] Finished updating board flags in 1.630 seconds
2018-11-16 09:11:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 09:11:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 09:11:40 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 09:11:49 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-16 09:11:49 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:11:50 [WARNING ] (13, 1, 'bot')
2018-11-16 09:11:50 [WARNING ] (13, 1, 'bot')
2018-11-16 09:11:50 [WARNING ] (13, 1, 'bot')
2018-11-16 09:11:50 [WARNING ] (13, 1, 'bot')
2018-11-16 09:11:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:11:50 [DEBUG   ] Finished updating board flags in 1.571 seconds
2018-11-16 09:12:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 09:12:20 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 09:12:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 09:12:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:12:50 [WARNING ] (13, 1, 'bot')
2018-11-16 09:12:50 [WARNING ] (13, 1, 'bot')
2018-11-16 09:12:50 [WARNING ] (13, 1, 'bot')
2018-11-16 09:12:50 [WARNING ] (13, 1, 'bot')
2018-11-16 09:12:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:12:50 [DEBUG   ] Finished updating board flags in 1.509 seconds
2018-11-16 09:13:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 09:13:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 09:13:36 [DEBUG   ] Got command RPT from MCS: ref #524401
2018-11-16 09:13:36 [DEBUG   ] summary = ERROR
2018-11-16 09:13:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524401  13 58438 33216221 A  ERRORERROR'
2018-11-16 09:13:36 [DEBUG   ] Got command RPT from MCS: ref #524402
2018-11-16 09:13:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 09:13:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524402  77 58438 33216425 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 09:13:36 [DEBUG   ] Got command RPT from MCS: ref #524403
2018-11-16 09:13:36 [DEBUG   ] summary = ERROR
2018-11-16 09:13:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524403  13 58438 33216629 A  ERRORERROR'
2018-11-16 09:13:36 [DEBUG   ] Got command RPT from MCS: ref #524404
2018-11-16 09:13:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 09:13:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524404  77 58438 33216833 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 09:13:37 [DEBUG   ] Got command RPT from MCS: ref #524405
2018-11-16 09:13:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 09:13:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524405  12 58438 33217025 A  ERRORB—™š'
2018-11-16 09:13:40 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 09:13:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:13:50 [WARNING ] (13, 1, 'bot')
2018-11-16 09:13:50 [WARNING ] (13, 1, 'bot')
2018-11-16 09:13:50 [WARNING ] (13, 1, 'bot')
2018-11-16 09:13:50 [WARNING ] (13, 1, 'bot')
2018-11-16 09:13:50 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:13:50 [DEBUG   ] Finished updating board flags in 1.572 seconds
2018-11-16 09:14:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 09:14:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 09:14:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 09:14:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:14:51 [WARNING ] (13, 1, 'bot')
2018-11-16 09:14:51 [WARNING ] (13, 1, 'bot')
2018-11-16 09:14:51 [WARNING ] (13, 1, 'bot')
2018-11-16 09:14:51 [WARNING ] (13, 1, 'bot')
2018-11-16 09:14:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:14:51 [DEBUG   ] Finished updating board flags in 2.199 seconds
2018-11-16 09:15:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 09:15:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 09:15:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 09:15:45 [DEBUG   ] Got command RPT from MCS: ref #524410
2018-11-16 09:15:45 [DEBUG   ] summary = ERROR
2018-11-16 09:15:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524410  13 58438 33345361 A  ERRORERROR'
2018-11-16 09:15:45 [DEBUG   ] Got command RPT from MCS: ref #524411
2018-11-16 09:15:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 09:15:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524411  77 58438 33345362 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 09:15:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 09:15:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:15:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 09:15:51 [WARNING ] (13, 1, 'bot')
2018-11-16 09:15:51 [WARNING ] (13, 1, 'bot')
2018-11-16 09:15:51 [WARNING ] (13, 1, 'bot')
2018-11-16 09:15:51 [WARNING ] (13, 1, 'bot')
2018-11-16 09:15:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:15:51 [DEBUG   ] Finished updating board flags in 1.915 seconds
2018-11-16 09:16:00 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 09:16:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 09:16:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 09:16:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:16:51 [WARNING ] (13, 1, 'bot')
2018-11-16 09:16:51 [WARNING ] (13, 1, 'bot')
2018-11-16 09:16:51 [WARNING ] (13, 1, 'bot')
2018-11-16 09:16:51 [WARNING ] (13, 1, 'bot')
2018-11-16 09:16:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:16:51 [DEBUG   ] Finished updating board flags in 1.848 seconds
2018-11-16 09:17:00 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 09:17:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 09:17:40 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 09:17:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:17:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 09:17:51 [WARNING ] (13, 1, 'bot')
2018-11-16 09:17:51 [WARNING ] (13, 1, 'bot')
2018-11-16 09:17:51 [WARNING ] (13, 1, 'bot')
2018-11-16 09:17:51 [WARNING ] (13, 1, 'bot')
2018-11-16 09:17:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:17:51 [DEBUG   ] Finished updating board flags in 1.757 seconds
2018-11-16 09:18:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 09:18:20 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 09:18:36 [DEBUG   ] Got command RPT from MCS: ref #524433
2018-11-16 09:18:36 [DEBUG   ] summary = ERROR
2018-11-16 09:18:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524433  13 58438 33516313 A  ERRORERROR'
2018-11-16 09:18:36 [DEBUG   ] Got command RPT from MCS: ref #524434
2018-11-16 09:18:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 09:18:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524434  77 58438 33516505 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 09:18:36 [DEBUG   ] Got command RPT from MCS: ref #524435
2018-11-16 09:18:36 [DEBUG   ] summary = ERROR
2018-11-16 09:18:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524435  13 58438 33516709 A  ERRORERROR'
2018-11-16 09:18:36 [DEBUG   ] Got command RPT from MCS: ref #524437
2018-11-16 09:18:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 09:18:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524437  77 58438 33516913 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 09:18:37 [DEBUG   ] Got command RPT from MCS: ref #524438
2018-11-16 09:18:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 09:18:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524438  12 58438 33517105 A  ERRORB—™š'
2018-11-16 09:18:40 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 09:18:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:18:51 [WARNING ] (13, 1, 'bot')
2018-11-16 09:18:51 [WARNING ] (13, 1, 'bot')
2018-11-16 09:18:51 [WARNING ] (13, 1, 'bot')
2018-11-16 09:18:51 [WARNING ] (13, 1, 'bot')
2018-11-16 09:18:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:18:51 [DEBUG   ] Finished updating board flags in 1.618 seconds
2018-11-16 09:19:00 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 09:19:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 09:19:40 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 09:19:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:19:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-16 09:19:51 [WARNING ] (13, 1, 'bot')
2018-11-16 09:19:51 [WARNING ] (13, 1, 'bot')
2018-11-16 09:19:51 [WARNING ] (13, 1, 'bot')
2018-11-16 09:19:51 [WARNING ] (13, 1, 'bot')
2018-11-16 09:19:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:19:51 [DEBUG   ] Finished updating board flags in 1.580 seconds
2018-11-16 09:20:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 09:20:20 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 09:20:40 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 09:20:45 [DEBUG   ] Got command RPT from MCS: ref #524447
2018-11-16 09:20:45 [DEBUG   ] summary = ERROR
2018-11-16 09:20:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524447  13 58438 33645365 A  ERRORERROR'
2018-11-16 09:20:45 [DEBUG   ] Got command RPT from MCS: ref #524448
2018-11-16 09:20:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 09:20:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524448  77 58438 33645366 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 09:20:50 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa10, chip 4
2018-11-16 09:20:50 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:20:51 [WARNING ] (13, 1, 'bot')
2018-11-16 09:20:51 [WARNING ] (13, 1, 'bot')
2018-11-16 09:20:51 [WARNING ] (13, 1, 'bot')
2018-11-16 09:20:51 [WARNING ] (13, 1, 'bot')
2018-11-16 09:20:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:20:51 [DEBUG   ] Finished updating board flags in 1.532 seconds
2018-11-16 09:21:00 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 09:21:20 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-11-16 09:21:40 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 09:21:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:21:51 [WARNING ] (13, 1, 'bot')
2018-11-16 09:21:51 [WARNING ] (13, 1, 'bot')
2018-11-16 09:21:51 [WARNING ] (13, 1, 'bot')
2018-11-16 09:21:51 [WARNING ] (13, 1, 'bot')
2018-11-16 09:21:51 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:21:51 [DEBUG   ] Finished updating board flags in 1.540 seconds
2018-11-16 09:22:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 09:22:20 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-16 09:22:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 09:22:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:22:52 [WARNING ] (13, 1, 'bot')
2018-11-16 09:22:52 [WARNING ] (13, 1, 'bot')
2018-11-16 09:22:52 [WARNING ] (13, 1, 'bot')
2018-11-16 09:22:52 [WARNING ] (13, 1, 'bot')
2018-11-16 09:22:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:22:52 [DEBUG   ] Finished updating board flags in 2.254 seconds
2018-11-16 09:23:00 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 09:23:20 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 09:23:36 [DEBUG   ] Got command RPT from MCS: ref #524464
2018-11-16 09:23:36 [DEBUG   ] summary = ERROR
2018-11-16 09:23:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524464  13 58438 33816389 A  ERRORERROR'
2018-11-16 09:23:36 [DEBUG   ] Got command RPT from MCS: ref #524465
2018-11-16 09:23:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 09:23:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524465  77 58438 33816593 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 09:23:36 [DEBUG   ] Got command RPT from MCS: ref #524466
2018-11-16 09:23:36 [DEBUG   ] summary = ERROR
2018-11-16 09:23:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524466  13 58438 33816785 A  ERRORERROR'
2018-11-16 09:23:36 [DEBUG   ] Got command RPT from MCS: ref #524467
2018-11-16 09:23:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 09:23:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524467  77 58438 33816989 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 09:23:37 [DEBUG   ] Got command RPT from MCS: ref #524468
2018-11-16 09:23:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 09:23:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524468  12 58438 33817193 A  ERRORB–™š'
2018-11-16 09:23:40 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 09:23:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:23:52 [WARNING ] (13, 1, 'bot')
2018-11-16 09:23:52 [WARNING ] (13, 1, 'bot')
2018-11-16 09:23:52 [WARNING ] (13, 1, 'bot')
2018-11-16 09:23:52 [WARNING ] (13, 1, 'bot')
2018-11-16 09:23:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:23:52 [DEBUG   ] Finished updating board flags in 2.089 seconds
2018-11-16 09:24:00 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 09:24:20 [DEBUG   ] Finished updating ant stats in 0.595 seconds
2018-11-16 09:24:40 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-16 09:24:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:24:52 [WARNING ] (13, 1, 'bot')
2018-11-16 09:24:52 [WARNING ] (13, 1, 'bot')
2018-11-16 09:24:52 [WARNING ] (13, 1, 'bot')
2018-11-16 09:24:52 [WARNING ] (13, 1, 'bot')
2018-11-16 09:24:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:24:52 [DEBUG   ] Finished updating board flags in 2.010 seconds
2018-11-16 09:25:01 [DEBUG   ] Finished updating ant stats in 1.401 seconds
2018-11-16 09:25:20 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-16 09:25:41 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-16 09:25:45 [DEBUG   ] Got command RPT from MCS: ref #524473
2018-11-16 09:25:45 [DEBUG   ] summary = ERROR
2018-11-16 09:25:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524473  13 58438 33945361 A  ERRORERROR'
2018-11-16 09:25:45 [DEBUG   ] Got command RPT from MCS: ref #524474
2018-11-16 09:25:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 09:25:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524474  77 58438 33945362 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 09:25:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:25:52 [WARNING ] (13, 1, 'bot')
2018-11-16 09:25:52 [WARNING ] (13, 1, 'bot')
2018-11-16 09:25:52 [WARNING ] (13, 1, 'bot')
2018-11-16 09:25:52 [WARNING ] (13, 1, 'bot')
2018-11-16 09:25:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:25:52 [DEBUG   ] Finished updating board flags in 2.067 seconds
2018-11-16 09:26:01 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-16 09:26:21 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 09:26:41 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 09:26:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:26:52 [WARNING ] (13, 1, 'bot')
2018-11-16 09:26:52 [WARNING ] (13, 1, 'bot')
2018-11-16 09:26:52 [WARNING ] (13, 1, 'bot')
2018-11-16 09:26:52 [WARNING ] (13, 1, 'bot')
2018-11-16 09:26:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:26:52 [DEBUG   ] Finished updating board flags in 1.914 seconds
2018-11-16 09:27:01 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-16 09:27:21 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 09:27:41 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 09:27:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:27:52 [WARNING ] (13, 1, 'bot')
2018-11-16 09:27:52 [WARNING ] (13, 1, 'bot')
2018-11-16 09:27:52 [WARNING ] (13, 1, 'bot')
2018-11-16 09:27:52 [WARNING ] (13, 1, 'bot')
2018-11-16 09:27:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:27:52 [DEBUG   ] Finished updating board flags in 1.822 seconds
2018-11-16 09:28:01 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-16 09:28:21 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-16 09:28:36 [DEBUG   ] Got command RPT from MCS: ref #524496
2018-11-16 09:28:36 [DEBUG   ] summary = ERROR
2018-11-16 09:28:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524496  13 58438 34116465 A  ERRORERROR'
2018-11-16 09:28:36 [DEBUG   ] Got command RPT from MCS: ref #524497
2018-11-16 09:28:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 09:28:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524497  77 58438 34116669 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 09:28:36 [DEBUG   ] Got command RPT from MCS: ref #524498
2018-11-16 09:28:36 [DEBUG   ] summary = ERROR
2018-11-16 09:28:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524498  13 58438 34116873 A  ERRORERROR'
2018-11-16 09:28:37 [DEBUG   ] Got command RPT from MCS: ref #524500
2018-11-16 09:28:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 09:28:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524500  77 58438 34117065 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 09:28:37 [DEBUG   ] Got command RPT from MCS: ref #524501
2018-11-16 09:28:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 09:28:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524501  12 58438 34117269 A  ERRORB•™š'
2018-11-16 09:28:41 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-16 09:28:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:28:52 [WARNING ] (13, 1, 'bot')
2018-11-16 09:28:52 [WARNING ] (13, 1, 'bot')
2018-11-16 09:28:52 [WARNING ] (13, 1, 'bot')
2018-11-16 09:28:52 [WARNING ] (13, 1, 'bot')
2018-11-16 09:28:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:28:52 [DEBUG   ] Finished updating board flags in 1.791 seconds
2018-11-16 09:29:01 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 09:29:21 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 09:29:41 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 09:29:51 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 09:29:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:29:52 [WARNING ] (13, 1, 'bot')
2018-11-16 09:29:52 [WARNING ] (13, 1, 'bot')
2018-11-16 09:29:52 [WARNING ] (13, 1, 'bot')
2018-11-16 09:29:52 [WARNING ] (13, 1, 'bot')
2018-11-16 09:29:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:29:52 [DEBUG   ] Finished updating board flags in 1.627 seconds
2018-11-16 09:30:01 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 09:30:21 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2018-11-16 09:30:41 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 09:30:45 [DEBUG   ] Got command RPT from MCS: ref #524510
2018-11-16 09:30:45 [DEBUG   ] summary = ERROR
2018-11-16 09:30:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524510  13 58438 34245365 A  ERRORERROR'
2018-11-16 09:30:45 [DEBUG   ] Got command RPT from MCS: ref #524511
2018-11-16 09:30:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 09:30:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524511  77 58438 34245366 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 09:30:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:30:52 [WARNING ] (13, 1, 'bot')
2018-11-16 09:30:52 [WARNING ] (13, 1, 'bot')
2018-11-16 09:30:52 [WARNING ] (13, 1, 'bot')
2018-11-16 09:30:52 [WARNING ] (13, 1, 'bot')
2018-11-16 09:30:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:30:52 [DEBUG   ] Finished updating board flags in 1.573 seconds
2018-11-16 09:31:01 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-16 09:31:21 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-16 09:31:41 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 09:31:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:31:52 [WARNING ] (13, 1, 'bot')
2018-11-16 09:31:52 [WARNING ] (13, 1, 'bot')
2018-11-16 09:31:52 [WARNING ] (13, 1, 'bot')
2018-11-16 09:31:52 [WARNING ] (13, 1, 'bot')
2018-11-16 09:31:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:31:52 [DEBUG   ] Finished updating board flags in 1.408 seconds
2018-11-16 09:32:01 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 09:32:21 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 09:32:41 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-16 09:32:51 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:32:52 [WARNING ] (13, 1, 'bot')
2018-11-16 09:32:52 [WARNING ] (13, 1, 'bot')
2018-11-16 09:32:52 [WARNING ] (13, 1, 'bot')
2018-11-16 09:32:52 [WARNING ] (13, 1, 'bot')
2018-11-16 09:32:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:32:52 [DEBUG   ] Finished updating board flags in 1.399 seconds
2018-11-16 09:33:01 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 09:33:21 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-16 09:33:36 [DEBUG   ] Got command RPT from MCS: ref #524531
2018-11-16 09:33:36 [DEBUG   ] summary = ERROR
2018-11-16 09:33:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524531  13 58438 34416541 A  ERRORERROR'
2018-11-16 09:33:36 [DEBUG   ] Got command RPT from MCS: ref #524532
2018-11-16 09:33:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 09:33:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524532  77 58438 34416745 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 09:33:36 [DEBUG   ] Got command RPT from MCS: ref #524533
2018-11-16 09:33:36 [DEBUG   ] summary = ERROR
2018-11-16 09:33:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524533  13 58438 34416949 A  ERRORERROR'
2018-11-16 09:33:37 [DEBUG   ] Got command RPT from MCS: ref #524534
2018-11-16 09:33:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 09:33:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524534  77 58438 34417153 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 09:33:37 [DEBUG   ] Got command RPT from MCS: ref #524535
2018-11-16 09:33:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 09:33:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524535  12 58438 34417345 A  ERRORB—™š'
2018-11-16 09:33:42 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-16 09:33:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:33:52 [WARNING ] (13, 1, 'bot')
2018-11-16 09:33:52 [WARNING ] (13, 1, 'bot')
2018-11-16 09:33:52 [WARNING ] (13, 1, 'bot')
2018-11-16 09:33:52 [WARNING ] (13, 1, 'bot')
2018-11-16 09:33:52 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:33:52 [DEBUG   ] Finished updating board flags in 1.411 seconds
2018-11-16 09:34:02 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-16 09:34:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 09:34:42 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 09:34:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:34:53 [WARNING ] (13, 1, 'bot')
2018-11-16 09:34:53 [WARNING ] (13, 1, 'bot')
2018-11-16 09:34:53 [WARNING ] (13, 1, 'bot')
2018-11-16 09:34:53 [WARNING ] (13, 1, 'bot')
2018-11-16 09:34:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:34:53 [DEBUG   ] Finished updating board flags in 2.212 seconds
2018-11-16 09:35:02 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 09:35:22 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 09:35:42 [DEBUG   ] Finished updating ant stats in 0.983 seconds
2018-11-16 09:35:45 [DEBUG   ] Got command RPT from MCS: ref #524540
2018-11-16 09:35:45 [DEBUG   ] summary = ERROR
2018-11-16 09:35:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524540  13 58438 34545365 A  ERRORERROR'
2018-11-16 09:35:45 [DEBUG   ] Got command RPT from MCS: ref #524541
2018-11-16 09:35:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 09:35:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524541  77 58438 34545366 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 09:35:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:35:53 [WARNING ] (13, 1, 'bot')
2018-11-16 09:35:53 [WARNING ] (13, 1, 'bot')
2018-11-16 09:35:53 [WARNING ] (13, 1, 'bot')
2018-11-16 09:35:53 [WARNING ] (13, 1, 'bot')
2018-11-16 09:35:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:35:53 [DEBUG   ] Finished updating board flags in 2.183 seconds
2018-11-16 09:36:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 09:36:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 09:36:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 09:36:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 09:36:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:36:53 [WARNING ] (13, 1, 'bot')
2018-11-16 09:36:53 [WARNING ] (13, 1, 'bot')
2018-11-16 09:36:53 [WARNING ] (13, 1, 'bot')
2018-11-16 09:36:53 [WARNING ] (13, 1, 'bot')
2018-11-16 09:36:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:36:53 [DEBUG   ] Finished updating board flags in 2.012 seconds
2018-11-16 09:37:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 09:37:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 09:37:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 09:37:52 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 09:37:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:37:53 [WARNING ] (13, 1, 'bot')
2018-11-16 09:37:53 [WARNING ] (13, 1, 'bot')
2018-11-16 09:37:53 [WARNING ] (13, 1, 'bot')
2018-11-16 09:37:53 [WARNING ] (13, 1, 'bot')
2018-11-16 09:37:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:37:53 [DEBUG   ] Finished updating board flags in 2.107 seconds
2018-11-16 09:38:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 09:38:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 09:38:36 [DEBUG   ] Got command RPT from MCS: ref #524559
2018-11-16 09:38:36 [DEBUG   ] summary = ERROR
2018-11-16 09:38:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524559  13 58438 34716621 A  ERRORERROR'
2018-11-16 09:38:36 [DEBUG   ] Got command RPT from MCS: ref #524560
2018-11-16 09:38:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 09:38:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524560  77 58438 34716825 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 09:38:37 [DEBUG   ] Got command RPT from MCS: ref #524561
2018-11-16 09:38:37 [DEBUG   ] summary = ERROR
2018-11-16 09:38:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524561  13 58438 34717029 A  ERRORERROR'
2018-11-16 09:38:37 [DEBUG   ] Got command RPT from MCS: ref #524562
2018-11-16 09:38:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 09:38:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524562  77 58438 34717221 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 09:38:37 [DEBUG   ] Got command RPT from MCS: ref #524564
2018-11-16 09:38:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 09:38:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524564  12 58438 34717425 A  ERRORB—™š'
2018-11-16 09:38:42 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 09:38:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:38:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 09:38:53 [WARNING ] (13, 1, 'bot')
2018-11-16 09:38:53 [WARNING ] (13, 1, 'bot')
2018-11-16 09:38:53 [WARNING ] (13, 1, 'bot')
2018-11-16 09:38:53 [WARNING ] (13, 1, 'bot')
2018-11-16 09:38:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:38:53 [DEBUG   ] Finished updating board flags in 2.012 seconds
2018-11-16 09:39:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 09:39:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 09:39:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 09:39:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:39:53 [WARNING ] (13, 1, 'bot')
2018-11-16 09:39:53 [WARNING ] (13, 1, 'bot')
2018-11-16 09:39:53 [WARNING ] (13, 1, 'bot')
2018-11-16 09:39:53 [WARNING ] (13, 1, 'bot')
2018-11-16 09:39:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:39:53 [DEBUG   ] Finished updating board flags in 1.889 seconds
2018-11-16 09:40:02 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 09:40:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 09:40:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 09:40:45 [DEBUG   ] Got command RPT from MCS: ref #524573
2018-11-16 09:40:45 [DEBUG   ] summary = ERROR
2018-11-16 09:40:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524573  13 58438 34845361 A  ERRORERROR'
2018-11-16 09:40:45 [DEBUG   ] Got command RPT from MCS: ref #524574
2018-11-16 09:40:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 09:40:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524574  77 58438 34845362 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 09:40:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:40:53 [WARNING ] (13, 1, 'bot')
2018-11-16 09:40:53 [WARNING ] (13, 1, 'bot')
2018-11-16 09:40:53 [WARNING ] (13, 1, 'bot')
2018-11-16 09:40:53 [WARNING ] (13, 1, 'bot')
2018-11-16 09:40:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:40:53 [DEBUG   ] Finished updating board flags in 1.811 seconds
2018-11-16 09:41:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 09:41:22 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 09:41:42 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 09:41:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:41:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-16 09:41:53 [WARNING ] (13, 1, 'bot')
2018-11-16 09:41:53 [WARNING ] (13, 1, 'bot')
2018-11-16 09:41:53 [WARNING ] (13, 1, 'bot')
2018-11-16 09:41:53 [WARNING ] (13, 1, 'bot')
2018-11-16 09:41:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:41:53 [DEBUG   ] Finished updating board flags in 1.796 seconds
2018-11-16 09:42:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 09:42:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 09:42:42 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 09:42:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:42:53 [WARNING ] (13, 1, 'bot')
2018-11-16 09:42:53 [WARNING ] (13, 1, 'bot')
2018-11-16 09:42:53 [WARNING ] (13, 1, 'bot')
2018-11-16 09:42:53 [WARNING ] (13, 1, 'bot')
2018-11-16 09:42:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:42:53 [DEBUG   ] Finished updating board flags in 1.617 seconds
2018-11-16 09:43:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 09:43:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 09:43:36 [DEBUG   ] Got command RPT from MCS: ref #524594
2018-11-16 09:43:36 [DEBUG   ] summary = ERROR
2018-11-16 09:43:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524594  13 58438 35016705 A  ERRORERROR'
2018-11-16 09:43:36 [DEBUG   ] Got command RPT from MCS: ref #524595
2018-11-16 09:43:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 09:43:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524595  77 58438 35016909 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 09:43:37 [DEBUG   ] Got command RPT from MCS: ref #524596
2018-11-16 09:43:37 [DEBUG   ] summary = ERROR
2018-11-16 09:43:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524596  13 58438 35017113 A  ERRORERROR'
2018-11-16 09:43:37 [DEBUG   ] Got command RPT from MCS: ref #524597
2018-11-16 09:43:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 09:43:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524597  77 58438 35017305 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 09:43:37 [DEBUG   ] Got command RPT from MCS: ref #524598
2018-11-16 09:43:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 09:43:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524598  12 58438 35017509 A  ERRORB•™š'
2018-11-16 09:43:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 09:43:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:43:53 [WARNING ] (13, 1, 'bot')
2018-11-16 09:43:53 [WARNING ] (13, 1, 'bot')
2018-11-16 09:43:53 [WARNING ] (13, 1, 'bot')
2018-11-16 09:43:53 [WARNING ] (13, 1, 'bot')
2018-11-16 09:43:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:43:53 [DEBUG   ] Finished updating board flags in 1.687 seconds
2018-11-16 09:44:02 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 09:44:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 09:44:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 09:44:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:44:53 [WARNING ] (13, 1, 'bot')
2018-11-16 09:44:53 [WARNING ] (13, 1, 'bot')
2018-11-16 09:44:53 [WARNING ] (13, 1, 'bot')
2018-11-16 09:44:53 [WARNING ] (13, 1, 'bot')
2018-11-16 09:44:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:44:53 [DEBUG   ] Finished updating board flags in 1.617 seconds
2018-11-16 09:45:02 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 09:45:22 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-16 09:45:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 09:45:45 [DEBUG   ] Got command RPT from MCS: ref #524603
2018-11-16 09:45:45 [DEBUG   ] summary = ERROR
2018-11-16 09:45:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524603  13 58438 35145365 A  ERRORERROR'
2018-11-16 09:45:45 [DEBUG   ] Got command RPT from MCS: ref #524604
2018-11-16 09:45:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 09:45:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524604  77 58438 35145366 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 09:45:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:45:53 [WARNING ] (13, 1, 'bot')
2018-11-16 09:45:53 [WARNING ] (13, 1, 'bot')
2018-11-16 09:45:53 [WARNING ] (13, 1, 'bot')
2018-11-16 09:45:53 [WARNING ] (13, 1, 'bot')
2018-11-16 09:45:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:45:53 [DEBUG   ] Finished updating board flags in 1.480 seconds
2018-11-16 09:46:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 09:46:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 09:46:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 09:46:52 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:46:53 [WARNING ] (13, 1, 'bot')
2018-11-16 09:46:53 [WARNING ] (13, 1, 'bot')
2018-11-16 09:46:53 [WARNING ] (13, 1, 'bot')
2018-11-16 09:46:53 [WARNING ] (13, 1, 'bot')
2018-11-16 09:46:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:46:53 [DEBUG   ] Finished updating board flags in 1.503 seconds
2018-11-16 09:47:02 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 09:47:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 09:47:42 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 09:47:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:47:53 [WARNING ] (13, 1, 'bot')
2018-11-16 09:47:53 [WARNING ] (13, 1, 'bot')
2018-11-16 09:47:53 [WARNING ] (13, 1, 'bot')
2018-11-16 09:47:53 [WARNING ] (13, 1, 'bot')
2018-11-16 09:47:53 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:47:53 [DEBUG   ] Finished updating board flags in 1.506 seconds
2018-11-16 09:48:02 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 09:48:22 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 09:48:36 [DEBUG   ] Got command RPT from MCS: ref #524626
2018-11-16 09:48:36 [DEBUG   ] summary = ERROR
2018-11-16 09:48:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524626  13 58438 35316789 A  ERRORERROR'
2018-11-16 09:48:36 [DEBUG   ] Got command RPT from MCS: ref #524627
2018-11-16 09:48:36 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 09:48:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524627  77 58438 35316993 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 09:48:37 [DEBUG   ] Got command RPT from MCS: ref #524628
2018-11-16 09:48:37 [DEBUG   ] summary = ERROR
2018-11-16 09:48:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524628  13 58438 35317185 A  ERRORERROR'
2018-11-16 09:48:37 [DEBUG   ] Got command RPT from MCS: ref #524630
2018-11-16 09:48:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 09:48:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524630  77 58438 35317389 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 09:48:37 [DEBUG   ] Got command RPT from MCS: ref #524631
2018-11-16 09:48:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 09:48:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524631  12 58438 35317593 A  ERRORB•™š'
2018-11-16 09:48:42 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 09:48:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:48:54 [WARNING ] (13, 1, 'bot')
2018-11-16 09:48:54 [WARNING ] (13, 1, 'bot')
2018-11-16 09:48:54 [WARNING ] (13, 1, 'bot')
2018-11-16 09:48:54 [WARNING ] (13, 1, 'bot')
2018-11-16 09:48:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:48:54 [DEBUG   ] Finished updating board flags in 2.218 seconds
2018-11-16 09:49:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 09:49:22 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 09:49:42 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 09:49:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:49:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 09:49:54 [WARNING ] (13, 1, 'bot')
2018-11-16 09:49:54 [WARNING ] (13, 1, 'bot')
2018-11-16 09:49:54 [WARNING ] (13, 1, 'bot')
2018-11-16 09:49:54 [WARNING ] (13, 1, 'bot')
2018-11-16 09:49:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:49:54 [DEBUG   ] Finished updating board flags in 2.292 seconds
2018-11-16 09:50:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 09:50:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 09:50:42 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 09:50:45 [DEBUG   ] Got command RPT from MCS: ref #524640
2018-11-16 09:50:45 [DEBUG   ] summary = ERROR
2018-11-16 09:50:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524640  13 58438 35445369 A  ERRORERROR'
2018-11-16 09:50:45 [DEBUG   ] Got command RPT from MCS: ref #524641
2018-11-16 09:50:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 09:50:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524641  77 58438 35445370 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 09:50:53 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-16 09:50:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:50:54 [WARNING ] (13, 1, 'bot')
2018-11-16 09:50:54 [WARNING ] (13, 1, 'bot')
2018-11-16 09:50:54 [WARNING ] (13, 1, 'bot')
2018-11-16 09:50:54 [WARNING ] (13, 1, 'bot')
2018-11-16 09:50:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:50:54 [DEBUG   ] Finished updating board flags in 2.115 seconds
2018-11-16 09:51:02 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 09:51:22 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 09:51:42 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 09:51:53 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 09:51:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:51:54 [WARNING ] (13, 1, 'bot')
2018-11-16 09:51:54 [WARNING ] (13, 1, 'bot')
2018-11-16 09:51:54 [WARNING ] (13, 1, 'bot')
2018-11-16 09:51:54 [WARNING ] (13, 1, 'bot')
2018-11-16 09:51:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:51:54 [DEBUG   ] Finished updating board flags in 1.994 seconds
2018-11-16 09:52:02 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 09:52:22 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 09:52:42 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 09:52:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:52:54 [WARNING ] (13, 1, 'bot')
2018-11-16 09:52:54 [WARNING ] (13, 1, 'bot')
2018-11-16 09:52:54 [WARNING ] (13, 1, 'bot')
2018-11-16 09:52:54 [WARNING ] (13, 1, 'bot')
2018-11-16 09:52:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:52:54 [DEBUG   ] Finished updating board flags in 1.814 seconds
2018-11-16 09:53:02 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 09:53:22 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-16 09:53:36 [DEBUG   ] Got command RPT from MCS: ref #524657
2018-11-16 09:53:36 [DEBUG   ] summary = ERROR
2018-11-16 09:53:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524657  13 58438 35616873 A  ERRORERROR'
2018-11-16 09:53:37 [DEBUG   ] Got command RPT from MCS: ref #524658
2018-11-16 09:53:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 09:53:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524658  77 58438 35617065 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 09:53:37 [DEBUG   ] Got command RPT from MCS: ref #524659
2018-11-16 09:53:37 [DEBUG   ] summary = ERROR
2018-11-16 09:53:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524659  13 58438 35617269 A  ERRORERROR'
2018-11-16 09:53:37 [DEBUG   ] Got command RPT from MCS: ref #524660
2018-11-16 09:53:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 09:53:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524660  77 58438 35617473 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 09:53:37 [DEBUG   ] Got command RPT from MCS: ref #524661
2018-11-16 09:53:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 09:53:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524661  12 58438 35617677 A  ERRORB—™š'
2018-11-16 09:53:42 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-16 09:53:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:53:54 [WARNING ] (13, 1, 'bot')
2018-11-16 09:53:54 [WARNING ] (13, 1, 'bot')
2018-11-16 09:53:54 [WARNING ] (13, 1, 'bot')
2018-11-16 09:53:54 [WARNING ] (13, 1, 'bot')
2018-11-16 09:53:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:53:54 [DEBUG   ] Finished updating board flags in 1.773 seconds
2018-11-16 09:54:02 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-16 09:54:23 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-16 09:54:43 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-16 09:54:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:54:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 09:54:54 [WARNING ] (13, 1, 'bot')
2018-11-16 09:54:54 [WARNING ] (13, 1, 'bot')
2018-11-16 09:54:54 [WARNING ] (13, 1, 'bot')
2018-11-16 09:54:54 [WARNING ] (13, 1, 'bot')
2018-11-16 09:54:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:54:54 [DEBUG   ] Finished updating board flags in 1.611 seconds
2018-11-16 09:55:03 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-16 09:55:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 09:55:43 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-16 09:55:45 [DEBUG   ] Got command RPT from MCS: ref #524666
2018-11-16 09:55:45 [DEBUG   ] summary = ERROR
2018-11-16 09:55:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524666  13 58438 35745370 A  ERRORERROR'
2018-11-16 09:55:45 [DEBUG   ] Got command RPT from MCS: ref #524667
2018-11-16 09:55:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 09:55:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524667  77 58438 35745370 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 09:55:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:55:54 [WARNING ] (13, 1, 'bot')
2018-11-16 09:55:54 [WARNING ] (13, 1, 'bot')
2018-11-16 09:55:54 [WARNING ] (13, 1, 'bot')
2018-11-16 09:55:54 [WARNING ] (13, 1, 'bot')
2018-11-16 09:55:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:55:54 [DEBUG   ] Finished updating board flags in 1.591 seconds
2018-11-16 09:56:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 09:56:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 09:56:43 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 09:56:53 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:56:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 09:56:54 [WARNING ] (13, 1, 'bot')
2018-11-16 09:56:54 [WARNING ] (13, 1, 'bot')
2018-11-16 09:56:54 [WARNING ] (13, 1, 'bot')
2018-11-16 09:56:54 [WARNING ] (13, 1, 'bot')
2018-11-16 09:56:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:56:54 [DEBUG   ] Finished updating board flags in 1.510 seconds
2018-11-16 09:57:03 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 09:57:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 09:57:43 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 09:57:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:57:54 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 09:57:54 [WARNING ] (13, 1, 'bot')
2018-11-16 09:57:54 [WARNING ] (13, 1, 'bot')
2018-11-16 09:57:54 [WARNING ] (13, 1, 'bot')
2018-11-16 09:57:54 [WARNING ] (13, 1, 'bot')
2018-11-16 09:57:54 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:57:54 [DEBUG   ] Finished updating board flags in 1.579 seconds
2018-11-16 09:58:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 09:58:23 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-16 09:58:36 [DEBUG   ] Got command RPT from MCS: ref #524689
2018-11-16 09:58:36 [DEBUG   ] summary = ERROR
2018-11-16 09:58:36 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524689  13 58438 35916949 A  ERRORERROR'
2018-11-16 09:58:37 [DEBUG   ] Got command RPT from MCS: ref #524690
2018-11-16 09:58:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 09:58:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524690  77 58438 35917153 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 09:58:37 [DEBUG   ] Got command RPT from MCS: ref #524691
2018-11-16 09:58:37 [DEBUG   ] summary = ERROR
2018-11-16 09:58:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524691  13 58438 35917345 A  ERRORERROR'
2018-11-16 09:58:37 [DEBUG   ] Got command RPT from MCS: ref #524693
2018-11-16 09:58:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 09:58:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524693  77 58438 35917549 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 09:58:37 [DEBUG   ] Got command RPT from MCS: ref #524694
2018-11-16 09:58:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 09:58:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524694  12 58438 35917753 A  ERRORB–™š'
2018-11-16 09:58:43 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 09:58:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:58:55 [WARNING ] (13, 1, 'bot')
2018-11-16 09:58:55 [WARNING ] (13, 1, 'bot')
2018-11-16 09:58:55 [WARNING ] (13, 1, 'bot')
2018-11-16 09:58:55 [WARNING ] (13, 1, 'bot')
2018-11-16 09:58:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:58:55 [DEBUG   ] Finished updating board flags in 2.253 seconds
2018-11-16 09:59:03 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 09:59:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 09:59:43 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 09:59:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 09:59:55 [WARNING ] (13, 1, 'bot')
2018-11-16 09:59:55 [WARNING ] (13, 1, 'bot')
2018-11-16 09:59:55 [WARNING ] (13, 1, 'bot')
2018-11-16 09:59:55 [WARNING ] (13, 1, 'bot')
2018-11-16 09:59:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 09:59:55 [DEBUG   ] Finished updating board flags in 2.081 seconds
2018-11-16 10:00:03 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 10:00:23 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 10:00:43 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 10:00:45 [DEBUG   ] Got command RPT from MCS: ref #524703
2018-11-16 10:00:45 [DEBUG   ] summary = ERROR
2018-11-16 10:00:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524703  13 58438 36045365 A  ERRORERROR'
2018-11-16 10:00:45 [DEBUG   ] Got command RPT from MCS: ref #524704
2018-11-16 10:00:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 10:00:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524704  77 58438 36045366 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 10:00:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:00:55 [WARNING ] (13, 1, 'bot')
2018-11-16 10:00:55 [WARNING ] (13, 1, 'bot')
2018-11-16 10:00:55 [WARNING ] (13, 1, 'bot')
2018-11-16 10:00:55 [WARNING ] (13, 1, 'bot')
2018-11-16 10:00:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:00:55 [DEBUG   ] Finished updating board flags in 2.003 seconds
2018-11-16 10:01:03 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 10:01:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 10:01:43 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 10:01:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:01:55 [WARNING ] (13, 1, 'bot')
2018-11-16 10:01:55 [WARNING ] (13, 1, 'bot')
2018-11-16 10:01:55 [WARNING ] (13, 1, 'bot')
2018-11-16 10:01:55 [WARNING ] (13, 1, 'bot')
2018-11-16 10:01:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:01:55 [DEBUG   ] Finished updating board flags in 1.989 seconds
2018-11-16 10:02:03 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 10:02:23 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-16 10:02:43 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 10:02:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:02:55 [WARNING ] (13, 1, 'bot')
2018-11-16 10:02:55 [WARNING ] (13, 1, 'bot')
2018-11-16 10:02:55 [WARNING ] (13, 1, 'bot')
2018-11-16 10:02:55 [WARNING ] (13, 1, 'bot')
2018-11-16 10:02:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:02:55 [DEBUG   ] Finished updating board flags in 1.811 seconds
2018-11-16 10:03:03 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-16 10:03:23 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 10:03:37 [DEBUG   ] Got command RPT from MCS: ref #524724
2018-11-16 10:03:37 [DEBUG   ] summary = ERROR
2018-11-16 10:03:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524724  13 58438 36217029 A  ERRORERROR'
2018-11-16 10:03:37 [DEBUG   ] Got command RPT from MCS: ref #524725
2018-11-16 10:03:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 10:03:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524725  77 58438 36217233 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 10:03:37 [DEBUG   ] Got command RPT from MCS: ref #524726
2018-11-16 10:03:37 [DEBUG   ] summary = ERROR
2018-11-16 10:03:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524726  13 58438 36217425 A  ERRORERROR'
2018-11-16 10:03:37 [DEBUG   ] Got command RPT from MCS: ref #524727
2018-11-16 10:03:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 10:03:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524727  77 58438 36217629 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 10:03:37 [DEBUG   ] Got command RPT from MCS: ref #524728
2018-11-16 10:03:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 10:03:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524728  12 58438 36217833 A  ERRORB•™š'
2018-11-16 10:03:43 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 10:03:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:03:55 [WARNING ] (13, 1, 'bot')
2018-11-16 10:03:55 [WARNING ] (13, 1, 'bot')
2018-11-16 10:03:55 [WARNING ] (13, 1, 'bot')
2018-11-16 10:03:55 [WARNING ] (13, 1, 'bot')
2018-11-16 10:03:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:03:55 [DEBUG   ] Finished updating board flags in 1.897 seconds
2018-11-16 10:04:03 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-16 10:04:23 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 10:04:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 10:04:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:04:55 [WARNING ] (13, 1, 'bot')
2018-11-16 10:04:55 [WARNING ] (13, 1, 'bot')
2018-11-16 10:04:55 [WARNING ] (13, 1, 'bot')
2018-11-16 10:04:55 [WARNING ] (13, 1, 'bot')
2018-11-16 10:04:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:04:55 [DEBUG   ] Finished updating board flags in 1.696 seconds
2018-11-16 10:05:03 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-16 10:05:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 10:05:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 10:05:45 [DEBUG   ] Got command RPT from MCS: ref #524733
2018-11-16 10:05:45 [DEBUG   ] summary = ERROR
2018-11-16 10:05:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524733  13 58438 36345369 A  ERRORERROR'
2018-11-16 10:05:45 [DEBUG   ] Got command RPT from MCS: ref #524734
2018-11-16 10:05:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 10:05:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524734  77 58438 36345370 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 10:05:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:05:55 [WARNING ] (13, 1, 'bot')
2018-11-16 10:05:55 [WARNING ] (13, 1, 'bot')
2018-11-16 10:05:55 [WARNING ] (13, 1, 'bot')
2018-11-16 10:05:55 [WARNING ] (13, 1, 'bot')
2018-11-16 10:05:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:05:55 [DEBUG   ] Finished updating board flags in 1.630 seconds
2018-11-16 10:06:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 10:06:23 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-16 10:06:43 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-16 10:06:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:06:55 [WARNING ] (13, 1, 'bot')
2018-11-16 10:06:55 [WARNING ] (13, 1, 'bot')
2018-11-16 10:06:55 [WARNING ] (13, 1, 'bot')
2018-11-16 10:06:55 [WARNING ] (13, 1, 'bot')
2018-11-16 10:06:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:06:55 [DEBUG   ] Finished updating board flags in 1.581 seconds
2018-11-16 10:07:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 10:07:23 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-16 10:07:43 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-16 10:07:54 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:07:55 [WARNING ] (13, 1, 'bot')
2018-11-16 10:07:55 [WARNING ] (13, 1, 'bot')
2018-11-16 10:07:55 [WARNING ] (13, 1, 'bot')
2018-11-16 10:07:55 [WARNING ] (13, 1, 'bot')
2018-11-16 10:07:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:07:55 [DEBUG   ] Finished updating board flags in 1.492 seconds
2018-11-16 10:08:03 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-16 10:08:23 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 10:08:37 [DEBUG   ] Got command RPT from MCS: ref #524752
2018-11-16 10:08:37 [DEBUG   ] summary = ERROR
2018-11-16 10:08:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524752  13 58438 36517113 A  ERRORERROR'
2018-11-16 10:08:37 [DEBUG   ] Got command RPT from MCS: ref #524753
2018-11-16 10:08:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 10:08:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524753  77 58438 36517317 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 10:08:37 [DEBUG   ] Got command RPT from MCS: ref #524754
2018-11-16 10:08:37 [DEBUG   ] summary = ERROR
2018-11-16 10:08:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524754  13 58438 36517509 A  ERRORERROR'
2018-11-16 10:08:37 [DEBUG   ] Got command RPT from MCS: ref #524756
2018-11-16 10:08:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 10:08:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524756  77 58438 36517713 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 10:08:37 [DEBUG   ] Got command RPT from MCS: ref #524757
2018-11-16 10:08:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 10:08:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524757  12 58438 36517917 A  ERRORB—™š'
2018-11-16 10:08:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 10:08:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:08:55 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 10:08:55 [WARNING ] (13, 1, 'bot')
2018-11-16 10:08:55 [WARNING ] (13, 1, 'bot')
2018-11-16 10:08:55 [WARNING ] (13, 1, 'bot')
2018-11-16 10:08:55 [WARNING ] (13, 1, 'bot')
2018-11-16 10:08:55 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:08:55 [DEBUG   ] Finished updating board flags in 1.565 seconds
2018-11-16 10:09:03 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-16 10:09:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 10:09:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 10:09:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:09:56 [WARNING ] (13, 1, 'bot')
2018-11-16 10:09:56 [WARNING ] (13, 1, 'bot')
2018-11-16 10:09:56 [WARNING ] (13, 1, 'bot')
2018-11-16 10:09:56 [WARNING ] (13, 1, 'bot')
2018-11-16 10:09:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:09:56 [DEBUG   ] Finished updating board flags in 2.261 seconds
2018-11-16 10:10:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 10:10:23 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-16 10:10:43 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-16 10:10:45 [DEBUG   ] Got command RPT from MCS: ref #524766
2018-11-16 10:10:45 [DEBUG   ] summary = ERROR
2018-11-16 10:10:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524766  13 58438 36645369 A  ERRORERROR'
2018-11-16 10:10:45 [DEBUG   ] Got command RPT from MCS: ref #524767
2018-11-16 10:10:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 10:10:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524767  77 58438 36645370 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 10:10:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:10:56 [WARNING ] (13, 1, 'bot')
2018-11-16 10:10:56 [WARNING ] (13, 1, 'bot')
2018-11-16 10:10:56 [WARNING ] (13, 1, 'bot')
2018-11-16 10:10:56 [WARNING ] (13, 1, 'bot')
2018-11-16 10:10:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:10:56 [DEBUG   ] Finished updating board flags in 2.088 seconds
2018-11-16 10:11:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 10:11:23 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 10:11:43 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-16 10:11:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:11:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 10:11:56 [WARNING ] (13, 1, 'bot')
2018-11-16 10:11:56 [WARNING ] (13, 1, 'bot')
2018-11-16 10:11:56 [WARNING ] (13, 1, 'bot')
2018-11-16 10:11:56 [WARNING ] (13, 1, 'bot')
2018-11-16 10:11:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:11:56 [DEBUG   ] Finished updating board flags in 2.024 seconds
2018-11-16 10:12:03 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-16 10:12:23 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 10:12:43 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 10:12:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:12:56 [WARNING ] (13, 1, 'bot')
2018-11-16 10:12:56 [WARNING ] (13, 1, 'bot')
2018-11-16 10:12:56 [WARNING ] (13, 1, 'bot')
2018-11-16 10:12:56 [WARNING ] (13, 1, 'bot')
2018-11-16 10:12:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:12:56 [DEBUG   ] Finished updating board flags in 2.008 seconds
2018-11-16 10:13:03 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-16 10:13:23 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-16 10:13:37 [DEBUG   ] Got command RPT from MCS: ref #524787
2018-11-16 10:13:37 [DEBUG   ] summary = ERROR
2018-11-16 10:13:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524787  13 58438 36817189 A  ERRORERROR'
2018-11-16 10:13:37 [DEBUG   ] Got command RPT from MCS: ref #524788
2018-11-16 10:13:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 10:13:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524788  77 58438 36817393 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 10:13:37 [DEBUG   ] Got command RPT from MCS: ref #524789
2018-11-16 10:13:37 [DEBUG   ] summary = ERROR
2018-11-16 10:13:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524789  13 58438 36817597 A  ERRORERROR'
2018-11-16 10:13:37 [DEBUG   ] Got command RPT from MCS: ref #524790
2018-11-16 10:13:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 10:13:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524790  77 58438 36817789 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 10:13:37 [DEBUG   ] Got command RPT from MCS: ref #524791
2018-11-16 10:13:37 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 10:13:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524791  12 58438 36817993 A  ERRORB—™š'
2018-11-16 10:13:43 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 10:13:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:13:56 [WARNING ] (13, 1, 'bot')
2018-11-16 10:13:56 [WARNING ] (13, 1, 'bot')
2018-11-16 10:13:56 [WARNING ] (13, 1, 'bot')
2018-11-16 10:13:56 [WARNING ] (13, 1, 'bot')
2018-11-16 10:13:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:13:56 [DEBUG   ] Finished updating board flags in 1.978 seconds
2018-11-16 10:14:03 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 10:14:23 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-16 10:14:43 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-16 10:14:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:14:56 [WARNING ] (13, 1, 'bot')
2018-11-16 10:14:56 [WARNING ] (13, 1, 'bot')
2018-11-16 10:14:56 [WARNING ] (13, 1, 'bot')
2018-11-16 10:14:56 [WARNING ] (13, 1, 'bot')
2018-11-16 10:14:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:14:56 [DEBUG   ] Finished updating board flags in 1.879 seconds
2018-11-16 10:15:03 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 10:15:23 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-16 10:15:43 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-16 10:15:45 [DEBUG   ] Got command RPT from MCS: ref #524796
2018-11-16 10:15:45 [DEBUG   ] summary = ERROR
2018-11-16 10:15:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524796  13 58438 36945365 A  ERRORERROR'
2018-11-16 10:15:45 [DEBUG   ] Got command RPT from MCS: ref #524797
2018-11-16 10:15:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 10:15:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524797  77 58438 36945366 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 10:15:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:15:56 [WARNING ] (13, 1, 'bot')
2018-11-16 10:15:56 [WARNING ] (13, 1, 'bot')
2018-11-16 10:15:56 [WARNING ] (13, 1, 'bot')
2018-11-16 10:15:56 [WARNING ] (13, 1, 'bot')
2018-11-16 10:15:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:15:56 [DEBUG   ] Finished updating board flags in 1.703 seconds
2018-11-16 10:16:03 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 10:16:23 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 10:16:43 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 10:16:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:16:56 [WARNING ] (13, 1, 'bot')
2018-11-16 10:16:56 [WARNING ] (13, 1, 'bot')
2018-11-16 10:16:56 [WARNING ] (13, 1, 'bot')
2018-11-16 10:16:56 [WARNING ] (13, 1, 'bot')
2018-11-16 10:16:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:16:56 [DEBUG   ] Finished updating board flags in 1.645 seconds
2018-11-16 10:17:03 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-16 10:17:23 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-16 10:17:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 10:17:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:17:56 [WARNING ] (13, 1, 'bot')
2018-11-16 10:17:56 [WARNING ] (13, 1, 'bot')
2018-11-16 10:17:56 [WARNING ] (13, 1, 'bot')
2018-11-16 10:17:56 [WARNING ] (13, 1, 'bot')
2018-11-16 10:17:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:17:56 [DEBUG   ] Finished updating board flags in 1.561 seconds
2018-11-16 10:18:03 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-16 10:18:23 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-16 10:18:37 [DEBUG   ] Got command RPT from MCS: ref #524819
2018-11-16 10:18:37 [DEBUG   ] summary = ERROR
2018-11-16 10:18:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524819  13 58438 37117269 A  ERRORERROR'
2018-11-16 10:18:37 [DEBUG   ] Got command RPT from MCS: ref #524820
2018-11-16 10:18:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 10:18:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524820  77 58438 37117473 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 10:18:37 [DEBUG   ] Got command RPT from MCS: ref #524821
2018-11-16 10:18:37 [DEBUG   ] summary = ERROR
2018-11-16 10:18:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524821  13 58438 37117677 A  ERRORERROR'
2018-11-16 10:18:37 [DEBUG   ] Got command RPT from MCS: ref #524823
2018-11-16 10:18:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 10:18:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524823  77 58438 37117869 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 10:18:38 [DEBUG   ] Got command RPT from MCS: ref #524825
2018-11-16 10:18:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 10:18:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524825  12 58438 37118073 A  ERRORB–™š'
2018-11-16 10:18:43 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-16 10:18:55 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:18:56 [WARNING ] (13, 1, 'bot')
2018-11-16 10:18:56 [WARNING ] (13, 1, 'bot')
2018-11-16 10:18:56 [WARNING ] (13, 1, 'bot')
2018-11-16 10:18:56 [WARNING ] (13, 1, 'bot')
2018-11-16 10:18:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:18:56 [DEBUG   ] Finished updating board flags in 1.474 seconds
2018-11-16 10:19:03 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 10:19:23 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 10:19:43 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-16 10:19:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:19:56 [WARNING ] (13, 1, 'bot')
2018-11-16 10:19:56 [WARNING ] (13, 1, 'bot')
2018-11-16 10:19:56 [WARNING ] (13, 1, 'bot')
2018-11-16 10:19:56 [WARNING ] (13, 1, 'bot')
2018-11-16 10:19:56 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:19:56 [DEBUG   ] Finished updating board flags in 1.559 seconds
2018-11-16 10:20:03 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-16 10:20:23 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 10:20:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 10:20:45 [DEBUG   ] Got command RPT from MCS: ref #524833
2018-11-16 10:20:45 [DEBUG   ] summary = ERROR
2018-11-16 10:20:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524833  13 58438 37245373 A  ERRORERROR'
2018-11-16 10:20:45 [DEBUG   ] Got command RPT from MCS: ref #524834
2018-11-16 10:20:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 10:20:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524834  77 58438 37245374 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 10:20:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:20:57 [WARNING ] (13, 1, 'bot')
2018-11-16 10:20:57 [WARNING ] (13, 1, 'bot')
2018-11-16 10:20:57 [WARNING ] (13, 1, 'bot')
2018-11-16 10:20:57 [WARNING ] (13, 1, 'bot')
2018-11-16 10:20:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:20:57 [DEBUG   ] Finished updating board flags in 2.281 seconds
2018-11-16 10:21:03 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-11-16 10:21:23 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-16 10:21:43 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 10:21:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:21:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 10:21:57 [WARNING ] (13, 1, 'bot')
2018-11-16 10:21:57 [WARNING ] (13, 1, 'bot')
2018-11-16 10:21:57 [WARNING ] (13, 1, 'bot')
2018-11-16 10:21:57 [WARNING ] (13, 1, 'bot')
2018-11-16 10:21:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:21:57 [DEBUG   ] Finished updating board flags in 2.128 seconds
2018-11-16 10:22:03 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 10:22:23 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-16 10:22:43 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 10:22:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:22:57 [WARNING ] (13, 1, 'bot')
2018-11-16 10:22:57 [WARNING ] (13, 1, 'bot')
2018-11-16 10:22:57 [WARNING ] (13, 1, 'bot')
2018-11-16 10:22:57 [WARNING ] (13, 1, 'bot')
2018-11-16 10:22:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:22:57 [DEBUG   ] Finished updating board flags in 2.018 seconds
2018-11-16 10:23:03 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-16 10:23:24 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-11-16 10:23:37 [DEBUG   ] Got command RPT from MCS: ref #524850
2018-11-16 10:23:37 [DEBUG   ] summary = ERROR
2018-11-16 10:23:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524850  13 58438 37417353 A  ERRORERROR'
2018-11-16 10:23:37 [DEBUG   ] Got command RPT from MCS: ref #524851
2018-11-16 10:23:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 10:23:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524851  77 58438 37417557 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 10:23:37 [DEBUG   ] Got command RPT from MCS: ref #524852
2018-11-16 10:23:37 [DEBUG   ] summary = ERROR
2018-11-16 10:23:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524852  13 58438 37417749 A  ERRORERROR'
2018-11-16 10:23:37 [DEBUG   ] Got command RPT from MCS: ref #524853
2018-11-16 10:23:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 10:23:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524853  77 58438 37417953 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 10:23:38 [DEBUG   ] Got command RPT from MCS: ref #524854
2018-11-16 10:23:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 10:23:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524854  12 58438 37418157 A  ERRORB—™š'
2018-11-16 10:23:44 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-16 10:23:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:23:57 [WARNING ] (13, 1, 'bot')
2018-11-16 10:23:57 [WARNING ] (13, 1, 'bot')
2018-11-16 10:23:57 [WARNING ] (13, 1, 'bot')
2018-11-16 10:23:57 [WARNING ] (13, 1, 'bot')
2018-11-16 10:23:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:23:57 [DEBUG   ] Finished updating board flags in 1.960 seconds
2018-11-16 10:24:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 10:24:24 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 10:24:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 10:24:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:24:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 10:24:57 [WARNING ] (13, 1, 'bot')
2018-11-16 10:24:57 [WARNING ] (13, 1, 'bot')
2018-11-16 10:24:57 [WARNING ] (13, 1, 'bot')
2018-11-16 10:24:57 [WARNING ] (13, 1, 'bot')
2018-11-16 10:24:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:24:57 [DEBUG   ] Finished updating board flags in 1.814 seconds
2018-11-16 10:25:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 10:25:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 10:25:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 10:25:45 [DEBUG   ] Got command RPT from MCS: ref #524859
2018-11-16 10:25:45 [DEBUG   ] summary = ERROR
2018-11-16 10:25:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524859  13 58438 37545373 A  ERRORERROR'
2018-11-16 10:25:45 [DEBUG   ] Got command RPT from MCS: ref #524860
2018-11-16 10:25:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 10:25:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524860  77 58438 37545374 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 10:25:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:25:57 [WARNING ] (13, 1, 'bot')
2018-11-16 10:25:57 [WARNING ] (13, 1, 'bot')
2018-11-16 10:25:57 [WARNING ] (13, 1, 'bot')
2018-11-16 10:25:57 [WARNING ] (13, 1, 'bot')
2018-11-16 10:25:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:25:57 [DEBUG   ] Finished updating board flags in 1.789 seconds
2018-11-16 10:26:04 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 10:26:24 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 10:26:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 10:26:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:26:57 [WARNING ] (13, 1, 'bot')
2018-11-16 10:26:57 [WARNING ] (13, 1, 'bot')
2018-11-16 10:26:57 [WARNING ] (13, 1, 'bot')
2018-11-16 10:26:57 [WARNING ] (13, 1, 'bot')
2018-11-16 10:26:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:26:57 [DEBUG   ] Finished updating board flags in 1.619 seconds
2018-11-16 10:27:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 10:27:24 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 10:27:44 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 10:27:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:27:57 [WARNING ] (13, 1, 'bot')
2018-11-16 10:27:57 [WARNING ] (13, 1, 'bot')
2018-11-16 10:27:57 [WARNING ] (13, 1, 'bot')
2018-11-16 10:27:57 [WARNING ] (13, 1, 'bot')
2018-11-16 10:27:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:27:57 [DEBUG   ] Finished updating board flags in 1.691 seconds
2018-11-16 10:28:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 10:28:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 10:28:37 [DEBUG   ] Got command RPT from MCS: ref #524882
2018-11-16 10:28:37 [DEBUG   ] summary = ERROR
2018-11-16 10:28:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524882  13 58438 37717433 A  ERRORERROR'
2018-11-16 10:28:37 [DEBUG   ] Got command RPT from MCS: ref #524883
2018-11-16 10:28:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 10:28:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524883  77 58438 37717637 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 10:28:37 [DEBUG   ] Got command RPT from MCS: ref #524884
2018-11-16 10:28:37 [DEBUG   ] summary = ERROR
2018-11-16 10:28:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524884  13 58438 37717829 A  ERRORERROR'
2018-11-16 10:28:38 [DEBUG   ] Got command RPT from MCS: ref #524886
2018-11-16 10:28:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 10:28:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524886  77 58438 37718033 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 10:28:38 [DEBUG   ] Got command RPT from MCS: ref #524887
2018-11-16 10:28:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 10:28:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524887  12 58438 37718237 A  ERRORB—™š'
2018-11-16 10:28:44 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 10:28:56 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 10:28:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:28:57 [WARNING ] (13, 1, 'bot')
2018-11-16 10:28:57 [WARNING ] (13, 1, 'bot')
2018-11-16 10:28:57 [WARNING ] (13, 1, 'bot')
2018-11-16 10:28:57 [WARNING ] (13, 1, 'bot')
2018-11-16 10:28:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:28:57 [DEBUG   ] Finished updating board flags in 1.620 seconds
2018-11-16 10:29:04 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 10:29:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 10:29:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 10:29:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:29:57 [WARNING ] (13, 1, 'bot')
2018-11-16 10:29:57 [WARNING ] (13, 1, 'bot')
2018-11-16 10:29:57 [WARNING ] (13, 1, 'bot')
2018-11-16 10:29:57 [WARNING ] (13, 1, 'bot')
2018-11-16 10:29:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:29:57 [DEBUG   ] Finished updating board flags in 1.619 seconds
2018-11-16 10:30:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 10:30:24 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 10:30:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 10:30:45 [DEBUG   ] Got command RPT from MCS: ref #524896
2018-11-16 10:30:45 [DEBUG   ] summary = ERROR
2018-11-16 10:30:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524896  13 58438 37845377 A  ERRORERROR'
2018-11-16 10:30:45 [DEBUG   ] Got command RPT from MCS: ref #524897
2018-11-16 10:30:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 10:30:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524897  77 58438 37845378 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 10:30:56 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:30:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 10:30:57 [WARNING ] (13, 1, 'bot')
2018-11-16 10:30:57 [WARNING ] (13, 1, 'bot')
2018-11-16 10:30:57 [WARNING ] (13, 1, 'bot')
2018-11-16 10:30:57 [WARNING ] (13, 1, 'bot')
2018-11-16 10:30:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:30:57 [DEBUG   ] Finished updating board flags in 1.477 seconds
2018-11-16 10:31:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 10:31:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 10:31:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 10:31:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:31:57 [WARNING ] (13, 1, 'bot')
2018-11-16 10:31:57 [WARNING ] (13, 1, 'bot')
2018-11-16 10:31:57 [WARNING ] (13, 1, 'bot')
2018-11-16 10:31:57 [WARNING ] (13, 1, 'bot')
2018-11-16 10:31:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:31:57 [DEBUG   ] Finished updating board flags in 1.508 seconds
2018-11-16 10:32:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 10:32:24 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 10:32:44 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 10:32:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:32:57 [WARNING ] (13, 1, 'bot')
2018-11-16 10:32:57 [WARNING ] (13, 1, 'bot')
2018-11-16 10:32:57 [WARNING ] (13, 1, 'bot')
2018-11-16 10:32:57 [WARNING ] (13, 1, 'bot')
2018-11-16 10:32:57 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:32:57 [DEBUG   ] Finished updating board flags in 1.515 seconds
2018-11-16 10:33:04 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 10:33:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 10:33:37 [DEBUG   ] Got command RPT from MCS: ref #524917
2018-11-16 10:33:37 [DEBUG   ] summary = ERROR
2018-11-16 10:33:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524917  13 58438 38017513 A  ERRORERROR'
2018-11-16 10:33:37 [DEBUG   ] Got command RPT from MCS: ref #524918
2018-11-16 10:33:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 10:33:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524918  77 58438 38017717 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 10:33:37 [DEBUG   ] Got command RPT from MCS: ref #524919
2018-11-16 10:33:37 [DEBUG   ] summary = ERROR
2018-11-16 10:33:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524919  13 58438 38017909 A  ERRORERROR'
2018-11-16 10:33:38 [DEBUG   ] Got command RPT from MCS: ref #524920
2018-11-16 10:33:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 10:33:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524920  77 58438 38018113 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 10:33:38 [DEBUG   ] Got command RPT from MCS: ref #524921
2018-11-16 10:33:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 10:33:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524921  12 58438 38018317 A  ERRORB–™š'
2018-11-16 10:33:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 10:33:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:33:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-16 10:33:58 [WARNING ] (13, 1, 'bot')
2018-11-16 10:33:58 [WARNING ] (13, 1, 'bot')
2018-11-16 10:33:58 [WARNING ] (13, 1, 'bot')
2018-11-16 10:33:58 [WARNING ] (13, 1, 'bot')
2018-11-16 10:33:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:33:58 [DEBUG   ] Finished updating board flags in 2.203 seconds
2018-11-16 10:34:04 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 10:34:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 10:34:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 10:34:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:34:58 [WARNING ] (13, 1, 'bot')
2018-11-16 10:34:58 [WARNING ] (13, 1, 'bot')
2018-11-16 10:34:58 [WARNING ] (13, 1, 'bot')
2018-11-16 10:34:58 [WARNING ] (13, 1, 'bot')
2018-11-16 10:34:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:34:58 [DEBUG   ] Finished updating board flags in 2.281 seconds
2018-11-16 10:35:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 10:35:24 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 10:35:44 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 10:35:45 [DEBUG   ] Got command RPT from MCS: ref #524926
2018-11-16 10:35:45 [DEBUG   ] summary = ERROR
2018-11-16 10:35:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524926  13 58438 38145373 A  ERRORERROR'
2018-11-16 10:35:45 [DEBUG   ] Got command RPT from MCS: ref #524927
2018-11-16 10:35:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 10:35:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524927  77 58438 38145374 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 10:35:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:35:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-16 10:35:58 [WARNING ] (13, 1, 'bot')
2018-11-16 10:35:58 [WARNING ] (13, 1, 'bot')
2018-11-16 10:35:58 [WARNING ] (13, 1, 'bot')
2018-11-16 10:35:58 [WARNING ] (13, 1, 'bot')
2018-11-16 10:35:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:35:58 [DEBUG   ] Finished updating board flags in 2.228 seconds
2018-11-16 10:36:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 10:36:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 10:36:44 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 10:36:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:36:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-16 10:36:58 [WARNING ] (13, 1, 'bot')
2018-11-16 10:36:58 [WARNING ] (13, 1, 'bot')
2018-11-16 10:36:58 [WARNING ] (13, 1, 'bot')
2018-11-16 10:36:58 [WARNING ] (13, 1, 'bot')
2018-11-16 10:36:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:36:58 [DEBUG   ] Finished updating board flags in 2.063 seconds
2018-11-16 10:37:04 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 10:37:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 10:37:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 10:37:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:37:58 [WARNING ] (13, 1, 'bot')
2018-11-16 10:37:58 [WARNING ] (13, 1, 'bot')
2018-11-16 10:37:58 [WARNING ] (13, 1, 'bot')
2018-11-16 10:37:58 [WARNING ] (13, 1, 'bot')
2018-11-16 10:37:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:37:58 [DEBUG   ] Finished updating board flags in 2.023 seconds
2018-11-16 10:38:04 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 10:38:24 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 10:38:37 [DEBUG   ] Got command RPT from MCS: ref #524945
2018-11-16 10:38:37 [DEBUG   ] summary = ERROR
2018-11-16 10:38:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524945  13 58438 38317597 A  ERRORERROR'
2018-11-16 10:38:37 [DEBUG   ] Got command RPT from MCS: ref #524946
2018-11-16 10:38:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 10:38:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524946  77 58438 38317789 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 10:38:37 [DEBUG   ] Got command RPT from MCS: ref #524947
2018-11-16 10:38:37 [DEBUG   ] summary = ERROR
2018-11-16 10:38:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524947  13 58438 38317993 A  ERRORERROR'
2018-11-16 10:38:38 [DEBUG   ] Got command RPT from MCS: ref #524949
2018-11-16 10:38:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 10:38:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524949  77 58438 38318197 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 10:38:38 [DEBUG   ] Got command RPT from MCS: ref #524950
2018-11-16 10:38:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 10:38:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524950  12 58438 38318401 A  ERRORB•™š'
2018-11-16 10:38:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 10:38:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:38:58 [WARNING ] (13, 1, 'bot')
2018-11-16 10:38:58 [WARNING ] (13, 1, 'bot')
2018-11-16 10:38:58 [WARNING ] (13, 1, 'bot')
2018-11-16 10:38:58 [WARNING ] (13, 1, 'bot')
2018-11-16 10:38:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:38:58 [DEBUG   ] Finished updating board flags in 2.011 seconds
2018-11-16 10:39:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 10:39:24 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 10:39:44 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 10:39:57 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 10:39:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:39:58 [WARNING ] (13, 1, 'bot')
2018-11-16 10:39:58 [WARNING ] (13, 1, 'bot')
2018-11-16 10:39:58 [WARNING ] (13, 1, 'bot')
2018-11-16 10:39:58 [WARNING ] (13, 1, 'bot')
2018-11-16 10:39:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:39:58 [DEBUG   ] Finished updating board flags in 1.981 seconds
2018-11-16 10:40:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 10:40:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 10:40:44 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 10:40:45 [DEBUG   ] Got command RPT from MCS: ref #524959
2018-11-16 10:40:45 [DEBUG   ] summary = ERROR
2018-11-16 10:40:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524959  13 58438 38445374 A  ERRORERROR'
2018-11-16 10:40:45 [DEBUG   ] Got command RPT from MCS: ref #524960
2018-11-16 10:40:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 10:40:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524960  77 58438 38445374 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 10:40:57 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 10:40:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:40:58 [WARNING ] (13, 1, 'bot')
2018-11-16 10:40:58 [WARNING ] (13, 1, 'bot')
2018-11-16 10:40:58 [WARNING ] (13, 1, 'bot')
2018-11-16 10:40:58 [WARNING ] (13, 1, 'bot')
2018-11-16 10:40:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:40:58 [DEBUG   ] Finished updating board flags in 1.885 seconds
2018-11-16 10:41:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 10:41:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 10:41:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 10:41:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:41:58 [WARNING ] (13, 1, 'bot')
2018-11-16 10:41:58 [WARNING ] (13, 1, 'bot')
2018-11-16 10:41:58 [WARNING ] (13, 1, 'bot')
2018-11-16 10:41:58 [WARNING ] (13, 1, 'bot')
2018-11-16 10:41:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:41:58 [DEBUG   ] Finished updating board flags in 1.741 seconds
2018-11-16 10:42:04 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 10:42:24 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 10:42:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 10:42:57 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:42:58 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 10:42:58 [WARNING ] (13, 1, 'bot')
2018-11-16 10:42:58 [WARNING ] (13, 1, 'bot')
2018-11-16 10:42:58 [WARNING ] (13, 1, 'bot')
2018-11-16 10:42:58 [WARNING ] (13, 1, 'bot')
2018-11-16 10:42:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:42:58 [DEBUG   ] Finished updating board flags in 1.592 seconds
2018-11-16 10:43:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 10:43:24 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 10:43:37 [DEBUG   ] Got command RPT from MCS: ref #524980
2018-11-16 10:43:37 [DEBUG   ] summary = ERROR
2018-11-16 10:43:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524980  13 58438 38617669 A  ERRORERROR'
2018-11-16 10:43:37 [DEBUG   ] Got command RPT from MCS: ref #524981
2018-11-16 10:43:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 10:43:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524981  77 58438 38617873 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 10:43:38 [DEBUG   ] Got command RPT from MCS: ref #524982
2018-11-16 10:43:38 [DEBUG   ] summary = ERROR
2018-11-16 10:43:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524982  13 58438 38618077 A  ERRORERROR'
2018-11-16 10:43:38 [DEBUG   ] Got command RPT from MCS: ref #524983
2018-11-16 10:43:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 10:43:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524983  77 58438 38618269 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 10:43:38 [DEBUG   ] Got command RPT from MCS: ref #524984
2018-11-16 10:43:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 10:43:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524984  12 58438 38618473 A  ERRORB—™š'
2018-11-16 10:43:44 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 10:43:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:43:58 [WARNING ] (13, 1, 'bot')
2018-11-16 10:43:58 [WARNING ] (13, 1, 'bot')
2018-11-16 10:43:58 [WARNING ] (13, 1, 'bot')
2018-11-16 10:43:58 [WARNING ] (13, 1, 'bot')
2018-11-16 10:43:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:43:58 [DEBUG   ] Finished updating board flags in 1.519 seconds
2018-11-16 10:44:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 10:44:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 10:44:44 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 10:44:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:44:58 [WARNING ] (13, 1, 'bot')
2018-11-16 10:44:58 [WARNING ] (13, 1, 'bot')
2018-11-16 10:44:58 [WARNING ] (13, 1, 'bot')
2018-11-16 10:44:58 [WARNING ] (13, 1, 'bot')
2018-11-16 10:44:58 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:44:58 [DEBUG   ] Finished updating board flags in 1.527 seconds
2018-11-16 10:45:04 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 10:45:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 10:45:44 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 10:45:45 [DEBUG   ] Got command RPT from MCS: ref #524989
2018-11-16 10:45:45 [DEBUG   ] summary = ERROR
2018-11-16 10:45:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524989  13 58438 38745381 A  ERRORERROR'
2018-11-16 10:45:45 [DEBUG   ] Got command RPT from MCS: ref #524990
2018-11-16 10:45:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 10:45:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   524990  77 58438 38745382 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 10:45:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:45:59 [WARNING ] (13, 1, 'bot')
2018-11-16 10:45:59 [WARNING ] (13, 1, 'bot')
2018-11-16 10:45:59 [WARNING ] (13, 1, 'bot')
2018-11-16 10:45:59 [WARNING ] (13, 1, 'bot')
2018-11-16 10:45:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:45:59 [DEBUG   ] Finished updating board flags in 2.015 seconds
2018-11-16 10:46:04 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 10:46:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 10:46:44 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 10:46:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:46:59 [WARNING ] (13, 1, 'bot')
2018-11-16 10:46:59 [WARNING ] (13, 1, 'bot')
2018-11-16 10:46:59 [WARNING ] (13, 1, 'bot')
2018-11-16 10:46:59 [WARNING ] (13, 1, 'bot')
2018-11-16 10:46:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:46:59 [DEBUG   ] Finished updating board flags in 2.061 seconds
2018-11-16 10:47:04 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 10:47:24 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 10:47:44 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 10:47:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:47:59 [WARNING ] (13, 1, 'bot')
2018-11-16 10:47:59 [WARNING ] (13, 1, 'bot')
2018-11-16 10:47:59 [WARNING ] (13, 1, 'bot')
2018-11-16 10:47:59 [WARNING ] (13, 1, 'bot')
2018-11-16 10:47:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:47:59 [DEBUG   ] Finished updating board flags in 1.932 seconds
2018-11-16 10:48:04 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 10:48:24 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 10:48:37 [DEBUG   ] Got command RPT from MCS: ref #525012
2018-11-16 10:48:37 [DEBUG   ] summary = ERROR
2018-11-16 10:48:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525012  13 58438 38917749 A  ERRORERROR'
2018-11-16 10:48:37 [DEBUG   ] Got command RPT from MCS: ref #525013
2018-11-16 10:48:37 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 10:48:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525013  77 58438 38917953 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 10:48:38 [DEBUG   ] Got command RPT from MCS: ref #525014
2018-11-16 10:48:38 [DEBUG   ] summary = ERROR
2018-11-16 10:48:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525014  13 58438 38918157 A  ERRORERROR'
2018-11-16 10:48:38 [DEBUG   ] Got command RPT from MCS: ref #525016
2018-11-16 10:48:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 10:48:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525016  77 58438 38918349 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 10:48:38 [DEBUG   ] Got command RPT from MCS: ref #525017
2018-11-16 10:48:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 10:48:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525017  12 58438 38918553 A  ERRORB—™š'
2018-11-16 10:48:44 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 10:48:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:48:59 [WARNING ] (13, 1, 'bot')
2018-11-16 10:48:59 [WARNING ] (13, 1, 'bot')
2018-11-16 10:48:59 [WARNING ] (13, 1, 'bot')
2018-11-16 10:48:59 [WARNING ] (13, 1, 'bot')
2018-11-16 10:48:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:48:59 [DEBUG   ] Finished updating board flags in 1.788 seconds
2018-11-16 10:49:04 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 10:49:24 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 10:49:44 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 10:49:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:49:59 [WARNING ] (13, 1, 'bot')
2018-11-16 10:49:59 [WARNING ] (13, 1, 'bot')
2018-11-16 10:49:59 [WARNING ] (13, 1, 'bot')
2018-11-16 10:49:59 [WARNING ] (13, 1, 'bot')
2018-11-16 10:49:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:49:59 [DEBUG   ] Finished updating board flags in 1.607 seconds
2018-11-16 10:50:04 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-11-16 10:50:24 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-16 10:50:44 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 10:50:45 [DEBUG   ] Got command RPT from MCS: ref #525026
2018-11-16 10:50:45 [DEBUG   ] summary = ERROR
2018-11-16 10:50:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525026  13 58438 39045381 A  ERRORERROR'
2018-11-16 10:50:45 [DEBUG   ] Got command RPT from MCS: ref #525027
2018-11-16 10:50:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 10:50:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525027  77 58438 39045382 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 10:50:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:50:59 [WARNING ] (13, 1, 'bot')
2018-11-16 10:50:59 [WARNING ] (13, 1, 'bot')
2018-11-16 10:50:59 [WARNING ] (13, 1, 'bot')
2018-11-16 10:50:59 [WARNING ] (13, 1, 'bot')
2018-11-16 10:50:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:50:59 [DEBUG   ] Finished updating board flags in 1.588 seconds
2018-11-16 10:51:04 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 10:51:24 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-16 10:51:44 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-16 10:51:58 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:51:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 10:51:59 [WARNING ] (13, 1, 'bot')
2018-11-16 10:51:59 [WARNING ] (13, 1, 'bot')
2018-11-16 10:51:59 [WARNING ] (13, 1, 'bot')
2018-11-16 10:51:59 [WARNING ] (13, 1, 'bot')
2018-11-16 10:51:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:51:59 [DEBUG   ] Finished updating board flags in 1.482 seconds
2018-11-16 10:52:04 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-16 10:52:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 10:52:44 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 10:52:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:52:59 [WARNING ] (13, 1, 'bot')
2018-11-16 10:52:59 [WARNING ] (13, 1, 'bot')
2018-11-16 10:52:59 [WARNING ] (13, 1, 'bot')
2018-11-16 10:52:59 [WARNING ] (13, 1, 'bot')
2018-11-16 10:52:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:52:59 [DEBUG   ] Finished updating board flags in 1.482 seconds
2018-11-16 10:53:04 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 10:53:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 10:53:37 [DEBUG   ] Got command RPT from MCS: ref #525043
2018-11-16 10:53:37 [DEBUG   ] summary = ERROR
2018-11-16 10:53:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525043  13 58438 39217841 A  ERRORERROR'
2018-11-16 10:53:38 [DEBUG   ] Got command RPT from MCS: ref #525044
2018-11-16 10:53:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 10:53:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525044  77 58438 39218033 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 10:53:38 [DEBUG   ] Got command RPT from MCS: ref #525045
2018-11-16 10:53:38 [DEBUG   ] summary = ERROR
2018-11-16 10:53:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525045  13 58438 39218237 A  ERRORERROR'
2018-11-16 10:53:38 [DEBUG   ] Got command RPT from MCS: ref #525046
2018-11-16 10:53:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 10:53:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525046  77 58438 39218441 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 10:53:38 [DEBUG   ] Got command RPT from MCS: ref #525047
2018-11-16 10:53:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 10:53:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525047  12 58438 39218633 A  ERRORB–™š'
2018-11-16 10:53:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 10:53:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:53:59 [WARNING ] (13, 1, 'bot')
2018-11-16 10:53:59 [WARNING ] (13, 1, 'bot')
2018-11-16 10:53:59 [WARNING ] (13, 1, 'bot')
2018-11-16 10:53:59 [WARNING ] (13, 1, 'bot')
2018-11-16 10:53:59 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:53:59 [DEBUG   ] Finished updating board flags in 1.575 seconds
2018-11-16 10:54:04 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 10:54:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 10:54:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 10:54:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:55:00 [WARNING ] (13, 1, 'bot')
2018-11-16 10:55:00 [WARNING ] (13, 1, 'bot')
2018-11-16 10:55:00 [WARNING ] (13, 1, 'bot')
2018-11-16 10:55:00 [WARNING ] (13, 1, 'bot')
2018-11-16 10:55:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:55:00 [DEBUG   ] Finished updating board flags in 2.171 seconds
2018-11-16 10:55:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 10:55:24 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 10:55:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 10:55:45 [DEBUG   ] Got command RPT from MCS: ref #525052
2018-11-16 10:55:45 [DEBUG   ] summary = ERROR
2018-11-16 10:55:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525052  13 58438 39345385 A  ERRORERROR'
2018-11-16 10:55:45 [DEBUG   ] Got command RPT from MCS: ref #525053
2018-11-16 10:55:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 10:55:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525053  77 58438 39345386 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 10:55:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:56:00 [WARNING ] (13, 1, 'bot')
2018-11-16 10:56:00 [WARNING ] (13, 1, 'bot')
2018-11-16 10:56:00 [WARNING ] (13, 1, 'bot')
2018-11-16 10:56:00 [WARNING ] (13, 1, 'bot')
2018-11-16 10:56:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:56:00 [DEBUG   ] Finished updating board flags in 2.010 seconds
2018-11-16 10:56:04 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 10:56:24 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 10:56:44 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 10:56:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:57:00 [WARNING ] (13, 1, 'bot')
2018-11-16 10:57:00 [WARNING ] (13, 1, 'bot')
2018-11-16 10:57:00 [WARNING ] (13, 1, 'bot')
2018-11-16 10:57:00 [WARNING ] (13, 1, 'bot')
2018-11-16 10:57:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:57:00 [DEBUG   ] Finished updating board flags in 1.899 seconds
2018-11-16 10:57:04 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 10:57:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 10:57:44 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 10:57:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:58:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 10:58:00 [WARNING ] (13, 1, 'bot')
2018-11-16 10:58:00 [WARNING ] (13, 1, 'bot')
2018-11-16 10:58:00 [WARNING ] (13, 1, 'bot')
2018-11-16 10:58:00 [WARNING ] (13, 1, 'bot')
2018-11-16 10:58:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:58:00 [DEBUG   ] Finished updating board flags in 1.816 seconds
2018-11-16 10:58:04 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 10:58:24 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 10:58:37 [DEBUG   ] Got command RPT from MCS: ref #525075
2018-11-16 10:58:37 [DEBUG   ] summary = ERROR
2018-11-16 10:58:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525075  13 58438 39517913 A  ERRORERROR'
2018-11-16 10:58:38 [DEBUG   ] Got command RPT from MCS: ref #525076
2018-11-16 10:58:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 10:58:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525076  77 58438 39518117 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 10:58:38 [DEBUG   ] Got command RPT from MCS: ref #525077
2018-11-16 10:58:38 [DEBUG   ] summary = ERROR
2018-11-16 10:58:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525077  13 58438 39518321 A  ERRORERROR'
2018-11-16 10:58:38 [DEBUG   ] Got command RPT from MCS: ref #525079
2018-11-16 10:58:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 10:58:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525079  77 58438 39518513 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 10:58:38 [DEBUG   ] Got command RPT from MCS: ref #525080
2018-11-16 10:58:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 10:58:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525080  12 58438 39518717 A  ERRORB–™š'
2018-11-16 10:58:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 10:58:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 10:59:00 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 10:59:00 [WARNING ] (13, 1, 'bot')
2018-11-16 10:59:00 [WARNING ] (13, 1, 'bot')
2018-11-16 10:59:00 [WARNING ] (13, 1, 'bot')
2018-11-16 10:59:00 [WARNING ] (13, 1, 'bot')
2018-11-16 10:59:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 10:59:00 [DEBUG   ] Finished updating board flags in 1.769 seconds
2018-11-16 10:59:04 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 10:59:24 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 10:59:44 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 10:59:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:00:00 [WARNING ] (13, 1, 'bot')
2018-11-16 11:00:00 [WARNING ] (13, 1, 'bot')
2018-11-16 11:00:00 [WARNING ] (13, 1, 'bot')
2018-11-16 11:00:00 [WARNING ] (13, 1, 'bot')
2018-11-16 11:00:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:00:00 [DEBUG   ] Finished updating board flags in 1.622 seconds
2018-11-16 11:00:04 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 11:00:24 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-16 11:00:44 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-16 11:00:45 [DEBUG   ] Got command RPT from MCS: ref #525089
2018-11-16 11:00:45 [DEBUG   ] summary = ERROR
2018-11-16 11:00:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525089  13 58438 39645377 A  ERRORERROR'
2018-11-16 11:00:45 [DEBUG   ] Got command RPT from MCS: ref #525090
2018-11-16 11:00:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 11:00:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525090  77 58438 39645378 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 11:00:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:01:00 [WARNING ] (13, 1, 'bot')
2018-11-16 11:01:00 [WARNING ] (13, 1, 'bot')
2018-11-16 11:01:00 [WARNING ] (13, 1, 'bot')
2018-11-16 11:01:00 [WARNING ] (13, 1, 'bot')
2018-11-16 11:01:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:01:00 [DEBUG   ] Finished updating board flags in 1.609 seconds
2018-11-16 11:01:04 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-16 11:01:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 11:01:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 11:01:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:02:00 [WARNING ] (13, 1, 'bot')
2018-11-16 11:02:00 [WARNING ] (13, 1, 'bot')
2018-11-16 11:02:00 [WARNING ] (13, 1, 'bot')
2018-11-16 11:02:00 [WARNING ] (13, 1, 'bot')
2018-11-16 11:02:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:02:00 [DEBUG   ] Finished updating board flags in 1.682 seconds
2018-11-16 11:02:04 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-16 11:02:24 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 11:02:44 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 11:02:59 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:03:00 [WARNING ] (13, 1, 'bot')
2018-11-16 11:03:00 [WARNING ] (13, 1, 'bot')
2018-11-16 11:03:00 [WARNING ] (13, 1, 'bot')
2018-11-16 11:03:00 [WARNING ] (13, 1, 'bot')
2018-11-16 11:03:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:03:00 [DEBUG   ] Finished updating board flags in 1.495 seconds
2018-11-16 11:03:04 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 11:03:24 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-16 11:03:37 [DEBUG   ] Got command RPT from MCS: ref #525110
2018-11-16 11:03:37 [DEBUG   ] summary = ERROR
2018-11-16 11:03:37 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525110  13 58438 39817989 A  ERRORERROR'
2018-11-16 11:03:38 [DEBUG   ] Got command RPT from MCS: ref #525111
2018-11-16 11:03:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 11:03:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525111  77 58438 39818193 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 11:03:38 [DEBUG   ] Got command RPT from MCS: ref #525112
2018-11-16 11:03:38 [DEBUG   ] summary = ERROR
2018-11-16 11:03:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525112  13 58438 39818397 A  ERRORERROR'
2018-11-16 11:03:38 [DEBUG   ] Got command RPT from MCS: ref #525113
2018-11-16 11:03:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 11:03:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525113  77 58438 39818601 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 11:03:38 [DEBUG   ] Got command RPT from MCS: ref #525114
2018-11-16 11:03:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 11:03:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525114  12 58438 39818793 A  ERRORB—™š'
2018-11-16 11:03:44 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 11:03:59 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 11:04:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:04:00 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 11:04:00 [WARNING ] (13, 1, 'bot')
2018-11-16 11:04:00 [WARNING ] (13, 1, 'bot')
2018-11-16 11:04:00 [WARNING ] (13, 1, 'bot')
2018-11-16 11:04:00 [WARNING ] (13, 1, 'bot')
2018-11-16 11:04:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:04:00 [DEBUG   ] Finished updating board flags in 1.515 seconds
2018-11-16 11:04:04 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 11:04:24 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 11:04:44 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 11:05:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:05:00 [WARNING ] (13, 1, 'bot')
2018-11-16 11:05:00 [WARNING ] (13, 1, 'bot')
2018-11-16 11:05:00 [WARNING ] (13, 1, 'bot')
2018-11-16 11:05:00 [WARNING ] (13, 1, 'bot')
2018-11-16 11:05:00 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:05:00 [DEBUG   ] Finished updating board flags in 1.518 seconds
2018-11-16 11:05:04 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-11-16 11:05:25 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-16 11:05:45 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-16 11:05:45 [DEBUG   ] Got command RPT from MCS: ref #525119
2018-11-16 11:05:45 [DEBUG   ] summary = ERROR
2018-11-16 11:05:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525119  13 58438 39945381 A  ERRORERROR'
2018-11-16 11:05:45 [DEBUG   ] Got command RPT from MCS: ref #525120
2018-11-16 11:05:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 11:05:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525120  77 58438 39945382 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 11:06:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:06:01 [WARNING ] (13, 1, 'bot')
2018-11-16 11:06:01 [WARNING ] (13, 1, 'bot')
2018-11-16 11:06:01 [WARNING ] (13, 1, 'bot')
2018-11-16 11:06:01 [WARNING ] (13, 1, 'bot')
2018-11-16 11:06:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:06:01 [DEBUG   ] Finished updating board flags in 2.213 seconds
2018-11-16 11:06:05 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 11:06:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 11:06:45 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 11:07:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:07:01 [WARNING ] (13, 1, 'bot')
2018-11-16 11:07:01 [WARNING ] (13, 1, 'bot')
2018-11-16 11:07:01 [WARNING ] (13, 1, 'bot')
2018-11-16 11:07:01 [WARNING ] (13, 1, 'bot')
2018-11-16 11:07:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:07:01 [DEBUG   ] Finished updating board flags in 2.172 seconds
2018-11-16 11:07:05 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 11:07:25 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 11:07:45 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-16 11:08:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:08:01 [WARNING ] (13, 1, 'bot')
2018-11-16 11:08:01 [WARNING ] (13, 1, 'bot')
2018-11-16 11:08:01 [WARNING ] (13, 1, 'bot')
2018-11-16 11:08:01 [WARNING ] (13, 1, 'bot')
2018-11-16 11:08:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:08:01 [DEBUG   ] Finished updating board flags in 2.003 seconds
2018-11-16 11:08:05 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 11:08:25 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 11:08:38 [DEBUG   ] Got command RPT from MCS: ref #525138
2018-11-16 11:08:38 [DEBUG   ] summary = ERROR
2018-11-16 11:08:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525138  13 58438 40118073 A  ERRORERROR'
2018-11-16 11:08:38 [DEBUG   ] Got command RPT from MCS: ref #525139
2018-11-16 11:08:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 11:08:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525139  77 58438 40118277 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 11:08:38 [DEBUG   ] Got command RPT from MCS: ref #525140
2018-11-16 11:08:38 [DEBUG   ] summary = ERROR
2018-11-16 11:08:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525140  13 58438 40118481 A  ERRORERROR'
2018-11-16 11:08:38 [DEBUG   ] Got command RPT from MCS: ref #525142
2018-11-16 11:08:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 11:08:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525142  77 58438 40118673 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 11:08:38 [DEBUG   ] Got command RPT from MCS: ref #525143
2018-11-16 11:08:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 11:08:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525143  12 58438 40118877 A  ERRORB–™š'
2018-11-16 11:08:45 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 11:09:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:09:01 [WARNING ] (13, 1, 'bot')
2018-11-16 11:09:01 [WARNING ] (13, 1, 'bot')
2018-11-16 11:09:01 [WARNING ] (13, 1, 'bot')
2018-11-16 11:09:01 [WARNING ] (13, 1, 'bot')
2018-11-16 11:09:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:09:01 [DEBUG   ] Finished updating board flags in 2.089 seconds
2018-11-16 11:09:05 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 11:09:25 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 11:09:45 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 11:10:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:10:01 [WARNING ] (13, 1, 'bot')
2018-11-16 11:10:01 [WARNING ] (13, 1, 'bot')
2018-11-16 11:10:01 [WARNING ] (13, 1, 'bot')
2018-11-16 11:10:01 [WARNING ] (13, 1, 'bot')
2018-11-16 11:10:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:10:01 [DEBUG   ] Finished updating board flags in 1.935 seconds
2018-11-16 11:10:05 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 11:10:25 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 11:10:45 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 11:10:45 [DEBUG   ] Got command RPT from MCS: ref #525152
2018-11-16 11:10:45 [DEBUG   ] summary = ERROR
2018-11-16 11:10:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525152  13 58438 40245389 A  ERRORERROR'
2018-11-16 11:10:45 [DEBUG   ] Got command RPT from MCS: ref #525153
2018-11-16 11:10:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 11:10:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525153  77 58438 40245390 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 11:11:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:11:01 [WARNING ] (13, 1, 'bot')
2018-11-16 11:11:01 [WARNING ] (13, 1, 'bot')
2018-11-16 11:11:01 [WARNING ] (13, 1, 'bot')
2018-11-16 11:11:01 [WARNING ] (13, 1, 'bot')
2018-11-16 11:11:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:11:01 [DEBUG   ] Finished updating board flags in 1.819 seconds
2018-11-16 11:11:05 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 11:11:25 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-11-16 11:11:45 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 11:12:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:12:01 [WARNING ] (13, 1, 'bot')
2018-11-16 11:12:01 [WARNING ] (13, 1, 'bot')
2018-11-16 11:12:01 [WARNING ] (13, 1, 'bot')
2018-11-16 11:12:01 [WARNING ] (13, 1, 'bot')
2018-11-16 11:12:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:12:01 [DEBUG   ] Finished updating board flags in 1.809 seconds
2018-11-16 11:12:05 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-16 11:12:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 11:12:45 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 11:13:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:13:01 [WARNING ] (13, 1, 'bot')
2018-11-16 11:13:01 [WARNING ] (13, 1, 'bot')
2018-11-16 11:13:01 [WARNING ] (13, 1, 'bot')
2018-11-16 11:13:01 [WARNING ] (13, 1, 'bot')
2018-11-16 11:13:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:13:01 [DEBUG   ] Finished updating board flags in 1.753 seconds
2018-11-16 11:13:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 11:13:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 11:13:38 [DEBUG   ] Got command RPT from MCS: ref #525173
2018-11-16 11:13:38 [DEBUG   ] summary = ERROR
2018-11-16 11:13:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525173  13 58438 40418153 A  ERRORERROR'
2018-11-16 11:13:38 [DEBUG   ] Got command RPT from MCS: ref #525174
2018-11-16 11:13:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 11:13:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525174  77 58438 40418357 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 11:13:38 [DEBUG   ] Got command RPT from MCS: ref #525175
2018-11-16 11:13:38 [DEBUG   ] summary = ERROR
2018-11-16 11:13:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525175  13 58438 40418561 A  ERRORERROR'
2018-11-16 11:13:38 [DEBUG   ] Got command RPT from MCS: ref #525176
2018-11-16 11:13:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 11:13:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525176  77 58438 40418765 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 11:13:38 [DEBUG   ] Got command RPT from MCS: ref #525177
2018-11-16 11:13:38 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 11:13:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525177  12 58438 40418957 A  ERRORB–™š'
2018-11-16 11:13:45 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 11:14:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:14:01 [WARNING ] (13, 1, 'bot')
2018-11-16 11:14:01 [WARNING ] (13, 1, 'bot')
2018-11-16 11:14:01 [WARNING ] (13, 1, 'bot')
2018-11-16 11:14:01 [WARNING ] (13, 1, 'bot')
2018-11-16 11:14:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:14:01 [DEBUG   ] Finished updating board flags in 1.617 seconds
2018-11-16 11:14:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 11:14:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 11:14:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 11:15:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:15:01 [WARNING ] (13, 1, 'bot')
2018-11-16 11:15:01 [WARNING ] (13, 1, 'bot')
2018-11-16 11:15:01 [WARNING ] (13, 1, 'bot')
2018-11-16 11:15:01 [WARNING ] (13, 1, 'bot')
2018-11-16 11:15:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:15:01 [DEBUG   ] Finished updating board flags in 1.679 seconds
2018-11-16 11:15:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 11:15:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 11:15:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 11:15:45 [DEBUG   ] Got command RPT from MCS: ref #525182
2018-11-16 11:15:45 [DEBUG   ] summary = ERROR
2018-11-16 11:15:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525182  13 58438 40545385 A  ERRORERROR'
2018-11-16 11:15:45 [DEBUG   ] Got command RPT from MCS: ref #525183
2018-11-16 11:15:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 11:15:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525183  77 58438 40545386 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 11:16:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:16:01 [WARNING ] (13, 1, 'bot')
2018-11-16 11:16:01 [WARNING ] (13, 1, 'bot')
2018-11-16 11:16:01 [WARNING ] (13, 1, 'bot')
2018-11-16 11:16:01 [WARNING ] (13, 1, 'bot')
2018-11-16 11:16:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:16:01 [DEBUG   ] Finished updating board flags in 1.521 seconds
2018-11-16 11:16:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 11:16:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 11:16:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 11:17:00 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:17:02 [WARNING ] (13, 1, 'bot')
2018-11-16 11:17:02 [WARNING ] (13, 1, 'bot')
2018-11-16 11:17:02 [WARNING ] (13, 1, 'bot')
2018-11-16 11:17:02 [WARNING ] (13, 1, 'bot')
2018-11-16 11:17:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:17:02 [DEBUG   ] Finished updating board flags in 1.752 seconds
2018-11-16 11:17:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 11:17:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 11:17:45 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 11:18:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:18:01 [WARNING ] (13, 1, 'bot')
2018-11-16 11:18:01 [WARNING ] (13, 1, 'bot')
2018-11-16 11:18:01 [WARNING ] (13, 1, 'bot')
2018-11-16 11:18:01 [WARNING ] (13, 1, 'bot')
2018-11-16 11:18:01 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:18:01 [DEBUG   ] Finished updating board flags in 1.538 seconds
2018-11-16 11:18:05 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 11:18:25 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 11:18:38 [DEBUG   ] Got command RPT from MCS: ref #525205
2018-11-16 11:18:38 [DEBUG   ] summary = ERROR
2018-11-16 11:18:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525205  13 58438 40718241 A  ERRORERROR'
2018-11-16 11:18:38 [DEBUG   ] Got command RPT from MCS: ref #525206
2018-11-16 11:18:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 11:18:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525206  77 58438 40718433 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 11:18:38 [DEBUG   ] Got command RPT from MCS: ref #525207
2018-11-16 11:18:38 [DEBUG   ] summary = ERROR
2018-11-16 11:18:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525207  13 58438 40718637 A  ERRORERROR'
2018-11-16 11:18:38 [DEBUG   ] Got command RPT from MCS: ref #525209
2018-11-16 11:18:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 11:18:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525209  77 58438 40718841 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 11:18:39 [DEBUG   ] Got command RPT from MCS: ref #525210
2018-11-16 11:18:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 11:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525210  12 58438 40719045 A  ERRORB—™š'
2018-11-16 11:18:45 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 11:19:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:19:02 [WARNING ] (13, 1, 'bot')
2018-11-16 11:19:02 [WARNING ] (13, 1, 'bot')
2018-11-16 11:19:02 [WARNING ] (13, 1, 'bot')
2018-11-16 11:19:02 [WARNING ] (13, 1, 'bot')
2018-11-16 11:19:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:19:02 [DEBUG   ] Finished updating board flags in 2.158 seconds
2018-11-16 11:19:05 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 11:19:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 11:19:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 11:20:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:20:02 [WARNING ] (13, 1, 'bot')
2018-11-16 11:20:02 [WARNING ] (13, 1, 'bot')
2018-11-16 11:20:02 [WARNING ] (13, 1, 'bot')
2018-11-16 11:20:02 [WARNING ] (13, 1, 'bot')
2018-11-16 11:20:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:20:02 [DEBUG   ] Finished updating board flags in 1.985 seconds
2018-11-16 11:20:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 11:20:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 11:20:45 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 11:20:45 [DEBUG   ] Got command RPT from MCS: ref #525219
2018-11-16 11:20:45 [DEBUG   ] summary = ERROR
2018-11-16 11:20:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525219  13 58438 40845389 A  ERRORERROR'
2018-11-16 11:20:45 [DEBUG   ] Got command RPT from MCS: ref #525220
2018-11-16 11:20:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 11:20:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525220  77 58438 40845390 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 11:21:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa16, chip 1
2018-11-16 11:21:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:21:02 [WARNING ] (13, 1, 'bot')
2018-11-16 11:21:02 [WARNING ] (13, 1, 'bot')
2018-11-16 11:21:02 [WARNING ] (13, 1, 'bot')
2018-11-16 11:21:02 [WARNING ] (13, 1, 'bot')
2018-11-16 11:21:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:21:02 [DEBUG   ] Finished updating board flags in 1.792 seconds
2018-11-16 11:21:05 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 11:21:25 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 11:21:45 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 11:22:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:22:02 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 11:22:02 [WARNING ] (13, 1, 'bot')
2018-11-16 11:22:02 [WARNING ] (13, 1, 'bot')
2018-11-16 11:22:02 [WARNING ] (13, 1, 'bot')
2018-11-16 11:22:02 [WARNING ] (13, 1, 'bot')
2018-11-16 11:22:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:22:02 [DEBUG   ] Finished updating board flags in 1.586 seconds
2018-11-16 11:22:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 11:22:25 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 11:22:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 11:23:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 11:23:01 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:23:02 [WARNING ] (13, 1, 'bot')
2018-11-16 11:23:02 [WARNING ] (13, 1, 'bot')
2018-11-16 11:23:02 [WARNING ] (13, 1, 'bot')
2018-11-16 11:23:02 [WARNING ] (13, 1, 'bot')
2018-11-16 11:23:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:23:02 [DEBUG   ] Finished updating board flags in 1.429 seconds
2018-11-16 11:23:05 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 11:23:25 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 11:23:38 [DEBUG   ] Got command RPT from MCS: ref #525236
2018-11-16 11:23:38 [DEBUG   ] summary = ERROR
2018-11-16 11:23:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525236  13 58438 41018313 A  ERRORERROR'
2018-11-16 11:23:38 [DEBUG   ] Got command RPT from MCS: ref #525237
2018-11-16 11:23:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 11:23:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525237  77 58438 41018517 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 11:23:38 [DEBUG   ] Got command RPT from MCS: ref #525238
2018-11-16 11:23:38 [DEBUG   ] summary = ERROR
2018-11-16 11:23:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525238  13 58438 41018721 A  ERRORERROR'
2018-11-16 11:23:38 [DEBUG   ] Got command RPT from MCS: ref #525239
2018-11-16 11:23:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 11:23:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525239  77 58438 41018925 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 11:23:39 [DEBUG   ] Got command RPT from MCS: ref #525240
2018-11-16 11:23:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 11:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525240  12 58438 41019118 A  ERRORB—™š'
2018-11-16 11:23:45 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 11:24:01 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 11:24:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:24:02 [WARNING ] (13, 1, 'bot')
2018-11-16 11:24:02 [WARNING ] (13, 1, 'bot')
2018-11-16 11:24:02 [WARNING ] (13, 1, 'bot')
2018-11-16 11:24:02 [WARNING ] (13, 1, 'bot')
2018-11-16 11:24:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:24:02 [DEBUG   ] Finished updating board flags in 1.510 seconds
2018-11-16 11:24:05 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-16 11:24:25 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-16 11:24:45 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-16 11:25:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:25:02 [WARNING ] (13, 1, 'bot')
2018-11-16 11:25:02 [WARNING ] (13, 1, 'bot')
2018-11-16 11:25:02 [WARNING ] (13, 1, 'bot')
2018-11-16 11:25:02 [WARNING ] (13, 1, 'bot')
2018-11-16 11:25:02 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:25:02 [DEBUG   ] Finished updating board flags in 1.501 seconds
2018-11-16 11:25:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 11:25:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 11:25:45 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-16 11:25:45 [DEBUG   ] Got command RPT from MCS: ref #525245
2018-11-16 11:25:45 [DEBUG   ] summary = ERROR
2018-11-16 11:25:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525245  13 58438 41145393 A  ERRORERROR'
2018-11-16 11:25:45 [DEBUG   ] Got command RPT from MCS: ref #525246
2018-11-16 11:25:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 11:25:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525246  77 58438 41145394 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 11:26:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:26:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 11:26:03 [WARNING ] (13, 1, 'bot')
2018-11-16 11:26:03 [WARNING ] (13, 1, 'bot')
2018-11-16 11:26:03 [WARNING ] (13, 1, 'bot')
2018-11-16 11:26:03 [WARNING ] (13, 1, 'bot')
2018-11-16 11:26:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:26:03 [DEBUG   ] Finished updating board flags in 2.268 seconds
2018-11-16 11:26:05 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-16 11:26:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 11:26:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 11:27:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:27:03 [WARNING ] (13, 1, 'bot')
2018-11-16 11:27:03 [WARNING ] (13, 1, 'bot')
2018-11-16 11:27:03 [WARNING ] (13, 1, 'bot')
2018-11-16 11:27:03 [WARNING ] (13, 1, 'bot')
2018-11-16 11:27:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:27:03 [DEBUG   ] Finished updating board flags in 2.229 seconds
2018-11-16 11:27:05 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-16 11:27:25 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-16 11:27:45 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 11:28:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:28:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-16 11:28:03 [WARNING ] (13, 1, 'bot')
2018-11-16 11:28:03 [WARNING ] (13, 1, 'bot')
2018-11-16 11:28:03 [WARNING ] (13, 1, 'bot')
2018-11-16 11:28:03 [WARNING ] (13, 1, 'bot')
2018-11-16 11:28:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:28:03 [DEBUG   ] Finished updating board flags in 2.060 seconds
2018-11-16 11:28:05 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 11:28:25 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-16 11:28:38 [DEBUG   ] Got command RPT from MCS: ref #525268
2018-11-16 11:28:38 [DEBUG   ] summary = ERROR
2018-11-16 11:28:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525268  13 58438 41318393 A  ERRORERROR'
2018-11-16 11:28:38 [DEBUG   ] Got command RPT from MCS: ref #525269
2018-11-16 11:28:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 11:28:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525269  77 58438 41318597 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 11:28:38 [DEBUG   ] Got command RPT from MCS: ref #525270
2018-11-16 11:28:38 [DEBUG   ] summary = ERROR
2018-11-16 11:28:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525270  13 58438 41318801 A  ERRORERROR'
2018-11-16 11:28:39 [DEBUG   ] Got command RPT from MCS: ref #525272
2018-11-16 11:28:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 11:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525272  77 58438 41319005 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 11:28:39 [DEBUG   ] Got command RPT from MCS: ref #525273
2018-11-16 11:28:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 11:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525273  12 58438 41319197 A  ERRORB–™š'
2018-11-16 11:28:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 11:29:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:29:03 [WARNING ] (13, 1, 'bot')
2018-11-16 11:29:03 [WARNING ] (13, 1, 'bot')
2018-11-16 11:29:03 [WARNING ] (13, 1, 'bot')
2018-11-16 11:29:03 [WARNING ] (13, 1, 'bot')
2018-11-16 11:29:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:29:03 [DEBUG   ] Finished updating board flags in 2.026 seconds
2018-11-16 11:29:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 11:29:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 11:29:45 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-16 11:30:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:30:03 [WARNING ] (13, 1, 'bot')
2018-11-16 11:30:03 [WARNING ] (13, 1, 'bot')
2018-11-16 11:30:03 [WARNING ] (13, 1, 'bot')
2018-11-16 11:30:03 [WARNING ] (13, 1, 'bot')
2018-11-16 11:30:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:30:03 [DEBUG   ] Finished updating board flags in 1.984 seconds
2018-11-16 11:30:05 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-16 11:30:25 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 11:30:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 11:30:45 [DEBUG   ] Got command RPT from MCS: ref #525282
2018-11-16 11:30:45 [DEBUG   ] summary = ERROR
2018-11-16 11:30:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525282  13 58438 41445389 A  ERRORERROR'
2018-11-16 11:30:45 [DEBUG   ] Got command RPT from MCS: ref #525283
2018-11-16 11:30:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 11:30:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525283  77 58438 41445390 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 11:31:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:31:03 [WARNING ] (13, 1, 'bot')
2018-11-16 11:31:03 [WARNING ] (13, 1, 'bot')
2018-11-16 11:31:03 [WARNING ] (13, 1, 'bot')
2018-11-16 11:31:03 [WARNING ] (13, 1, 'bot')
2018-11-16 11:31:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:31:03 [DEBUG   ] Finished updating board flags in 1.820 seconds
2018-11-16 11:31:05 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-16 11:31:25 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-16 11:31:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 11:32:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:32:03 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-16 11:32:03 [WARNING ] (13, 1, 'bot')
2018-11-16 11:32:03 [WARNING ] (13, 1, 'bot')
2018-11-16 11:32:03 [WARNING ] (13, 1, 'bot')
2018-11-16 11:32:03 [WARNING ] (13, 1, 'bot')
2018-11-16 11:32:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:32:03 [DEBUG   ] Finished updating board flags in 1.880 seconds
2018-11-16 11:32:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 11:32:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 11:32:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 11:33:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:33:03 [WARNING ] (13, 1, 'bot')
2018-11-16 11:33:03 [WARNING ] (13, 1, 'bot')
2018-11-16 11:33:03 [WARNING ] (13, 1, 'bot')
2018-11-16 11:33:03 [WARNING ] (13, 1, 'bot')
2018-11-16 11:33:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:33:03 [DEBUG   ] Finished updating board flags in 1.713 seconds
2018-11-16 11:33:05 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 11:33:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 11:33:38 [DEBUG   ] Got command RPT from MCS: ref #525303
2018-11-16 11:33:38 [DEBUG   ] summary = ERROR
2018-11-16 11:33:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525303  13 58438 41618477 A  ERRORERROR'
2018-11-16 11:33:38 [DEBUG   ] Got command RPT from MCS: ref #525304
2018-11-16 11:33:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 11:33:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525304  77 58438 41618681 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 11:33:38 [DEBUG   ] Got command RPT from MCS: ref #525305
2018-11-16 11:33:38 [DEBUG   ] summary = ERROR
2018-11-16 11:33:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525305  13 58438 41618885 A  ERRORERROR'
2018-11-16 11:33:39 [DEBUG   ] Got command RPT from MCS: ref #525306
2018-11-16 11:33:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 11:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525306  77 58438 41619077 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 11:33:39 [DEBUG   ] Got command RPT from MCS: ref #525307
2018-11-16 11:33:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 11:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525307  12 58438 41619281 A  ERRORB•™š'
2018-11-16 11:33:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 11:34:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:34:03 [WARNING ] (13, 1, 'bot')
2018-11-16 11:34:03 [WARNING ] (13, 1, 'bot')
2018-11-16 11:34:03 [WARNING ] (13, 1, 'bot')
2018-11-16 11:34:03 [WARNING ] (13, 1, 'bot')
2018-11-16 11:34:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:34:03 [DEBUG   ] Finished updating board flags in 1.613 seconds
2018-11-16 11:34:05 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 11:34:25 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 11:34:45 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 11:35:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:35:03 [WARNING ] (13, 1, 'bot')
2018-11-16 11:35:03 [WARNING ] (13, 1, 'bot')
2018-11-16 11:35:03 [WARNING ] (13, 1, 'bot')
2018-11-16 11:35:03 [WARNING ] (13, 1, 'bot')
2018-11-16 11:35:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:35:03 [DEBUG   ] Finished updating board flags in 1.568 seconds
2018-11-16 11:35:05 [DEBUG   ] Finished updating ant stats in 0.597 seconds
2018-11-16 11:35:26 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-16 11:35:45 [DEBUG   ] Got command RPT from MCS: ref #525312
2018-11-16 11:35:45 [DEBUG   ] summary = ERROR
2018-11-16 11:35:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525312  13 58438 41745398 A  ERRORERROR'
2018-11-16 11:35:45 [DEBUG   ] Got command RPT from MCS: ref #525313
2018-11-16 11:35:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 11:35:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525313  77 58438 41745398 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 11:35:46 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-16 11:36:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:36:03 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 11:36:03 [WARNING ] (13, 1, 'bot')
2018-11-16 11:36:03 [WARNING ] (13, 1, 'bot')
2018-11-16 11:36:03 [WARNING ] (13, 1, 'bot')
2018-11-16 11:36:03 [WARNING ] (13, 1, 'bot')
2018-11-16 11:36:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:36:03 [DEBUG   ] Finished updating board flags in 1.420 seconds
2018-11-16 11:36:06 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 11:36:26 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 11:36:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 11:37:02 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:37:03 [WARNING ] (13, 1, 'bot')
2018-11-16 11:37:03 [WARNING ] (13, 1, 'bot')
2018-11-16 11:37:03 [WARNING ] (13, 1, 'bot')
2018-11-16 11:37:03 [WARNING ] (13, 1, 'bot')
2018-11-16 11:37:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:37:03 [DEBUG   ] Finished updating board flags in 1.420 seconds
2018-11-16 11:37:06 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 11:37:26 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 11:37:46 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 11:38:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:38:03 [WARNING ] (13, 1, 'bot')
2018-11-16 11:38:03 [WARNING ] (13, 1, 'bot')
2018-11-16 11:38:03 [WARNING ] (13, 1, 'bot')
2018-11-16 11:38:03 [WARNING ] (13, 1, 'bot')
2018-11-16 11:38:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:38:03 [DEBUG   ] Finished updating board flags in 1.477 seconds
2018-11-16 11:38:06 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-16 11:38:26 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 11:38:38 [DEBUG   ] Got command RPT from MCS: ref #525331
2018-11-16 11:38:38 [DEBUG   ] summary = ERROR
2018-11-16 11:38:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525331  13 58438 41918561 A  ERRORERROR'
2018-11-16 11:38:38 [DEBUG   ] Got command RPT from MCS: ref #525332
2018-11-16 11:38:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 11:38:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525332  77 58438 41918765 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 11:38:38 [DEBUG   ] Got command RPT from MCS: ref #525333
2018-11-16 11:38:38 [DEBUG   ] summary = ERROR
2018-11-16 11:38:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525333  13 58438 41918957 A  ERRORERROR'
2018-11-16 11:38:39 [DEBUG   ] Got command RPT from MCS: ref #525335
2018-11-16 11:38:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 11:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525335  77 58438 41919161 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 11:38:39 [DEBUG   ] Got command RPT from MCS: ref #525336
2018-11-16 11:38:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 11:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525336  12 58438 41919365 A  ERRORB—™š'
2018-11-16 11:38:46 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 11:39:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:39:03 [WARNING ] (13, 1, 'bot')
2018-11-16 11:39:03 [WARNING ] (13, 1, 'bot')
2018-11-16 11:39:03 [WARNING ] (13, 1, 'bot')
2018-11-16 11:39:03 [WARNING ] (13, 1, 'bot')
2018-11-16 11:39:03 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:39:03 [DEBUG   ] Finished updating board flags in 1.574 seconds
2018-11-16 11:39:06 [DEBUG   ] Finished updating ant stats in 1.194 seconds
2018-11-16 11:39:26 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 11:39:46 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-16 11:40:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:40:04 [WARNING ] (13, 1, 'bot')
2018-11-16 11:40:04 [WARNING ] (13, 1, 'bot')
2018-11-16 11:40:04 [WARNING ] (13, 1, 'bot')
2018-11-16 11:40:04 [WARNING ] (13, 1, 'bot')
2018-11-16 11:40:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:40:04 [DEBUG   ] Finished updating board flags in 2.230 seconds
2018-11-16 11:40:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 11:40:26 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 11:40:45 [DEBUG   ] Got command RPT from MCS: ref #525345
2018-11-16 11:40:45 [DEBUG   ] summary = ERROR
2018-11-16 11:40:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525345  13 58438 42045393 A  ERRORERROR'
2018-11-16 11:40:45 [DEBUG   ] Got command RPT from MCS: ref #525346
2018-11-16 11:40:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 11:40:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525346  77 58438 42045394 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 11:40:46 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 11:41:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:41:04 [WARNING ] (13, 1, 'bot')
2018-11-16 11:41:04 [WARNING ] (13, 1, 'bot')
2018-11-16 11:41:04 [WARNING ] (13, 1, 'bot')
2018-11-16 11:41:04 [WARNING ] (13, 1, 'bot')
2018-11-16 11:41:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:41:04 [DEBUG   ] Finished updating board flags in 2.102 seconds
2018-11-16 11:41:06 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 11:41:26 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-16 11:41:46 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 11:42:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:42:04 [WARNING ] (13, 1, 'bot')
2018-11-16 11:42:04 [WARNING ] (13, 1, 'bot')
2018-11-16 11:42:04 [WARNING ] (13, 1, 'bot')
2018-11-16 11:42:04 [WARNING ] (13, 1, 'bot')
2018-11-16 11:42:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:42:04 [DEBUG   ] Finished updating board flags in 2.033 seconds
2018-11-16 11:42:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 11:42:26 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-16 11:42:46 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-16 11:43:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:43:04 [WARNING ] (13, 1, 'bot')
2018-11-16 11:43:04 [WARNING ] (13, 1, 'bot')
2018-11-16 11:43:04 [WARNING ] (13, 1, 'bot')
2018-11-16 11:43:04 [WARNING ] (13, 1, 'bot')
2018-11-16 11:43:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:43:04 [DEBUG   ] Finished updating board flags in 2.007 seconds
2018-11-16 11:43:06 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 11:43:26 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 11:43:38 [DEBUG   ] Got command RPT from MCS: ref #525366
2018-11-16 11:43:38 [DEBUG   ] summary = ERROR
2018-11-16 11:43:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525366  13 58438 42218641 A  ERRORERROR'
2018-11-16 11:43:38 [DEBUG   ] Got command RPT from MCS: ref #525367
2018-11-16 11:43:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 11:43:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525367  77 58438 42218845 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 11:43:39 [DEBUG   ] Got command RPT from MCS: ref #525368
2018-11-16 11:43:39 [DEBUG   ] summary = ERROR
2018-11-16 11:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525368  13 58438 42219037 A  ERRORERROR'
2018-11-16 11:43:39 [DEBUG   ] Got command RPT from MCS: ref #525369
2018-11-16 11:43:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 11:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525369  77 58438 42219241 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 11:43:39 [DEBUG   ] Got command RPT from MCS: ref #525370
2018-11-16 11:43:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 11:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525370  12 58438 42219445 A  ERRORB—™š'
2018-11-16 11:43:46 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-16 11:44:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:44:04 [WARNING ] (13, 1, 'bot')
2018-11-16 11:44:04 [WARNING ] (13, 1, 'bot')
2018-11-16 11:44:04 [WARNING ] (13, 1, 'bot')
2018-11-16 11:44:04 [WARNING ] (13, 1, 'bot')
2018-11-16 11:44:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:44:04 [DEBUG   ] Finished updating board flags in 1.954 seconds
2018-11-16 11:44:06 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-16 11:44:26 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 11:44:46 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 11:45:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:45:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 11:45:04 [WARNING ] (13, 1, 'bot')
2018-11-16 11:45:04 [WARNING ] (13, 1, 'bot')
2018-11-16 11:45:04 [WARNING ] (13, 1, 'bot')
2018-11-16 11:45:04 [WARNING ] (13, 1, 'bot')
2018-11-16 11:45:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:45:04 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-11-16 11:45:06 [DEBUG   ] Finished updating ant stats in 0.794 seconds
2018-11-16 11:45:26 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 11:45:45 [DEBUG   ] Got command RPT from MCS: ref #525375
2018-11-16 11:45:45 [DEBUG   ] summary = ERROR
2018-11-16 11:45:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525375  13 58438 42345389 A  ERRORERROR'
2018-11-16 11:45:45 [DEBUG   ] Got command RPT from MCS: ref #525376
2018-11-16 11:45:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 11:45:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525376  77 58438 42345390 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 11:45:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 11:46:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:46:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-16 11:46:04 [WARNING ] (13, 1, 'bot')
2018-11-16 11:46:04 [WARNING ] (13, 1, 'bot')
2018-11-16 11:46:04 [WARNING ] (13, 1, 'bot')
2018-11-16 11:46:04 [WARNING ] (13, 1, 'bot')
2018-11-16 11:46:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:46:04 [DEBUG   ] Finished updating board flags in 1.791 seconds
2018-11-16 11:46:06 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 11:46:26 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-16 11:46:46 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 11:47:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:47:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 11:47:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-16 11:47:04 [WARNING ] (13, 1, 'bot')
2018-11-16 11:47:04 [WARNING ] (13, 1, 'bot')
2018-11-16 11:47:04 [WARNING ] (13, 1, 'bot')
2018-11-16 11:47:04 [WARNING ] (13, 1, 'bot')
2018-11-16 11:47:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:47:04 [DEBUG   ] Finished updating board flags in 1.676 seconds
2018-11-16 11:47:06 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-16 11:47:26 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-16 11:47:47 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-11-16 11:48:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:48:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-16 11:48:04 [WARNING ] (13, 1, 'bot')
2018-11-16 11:48:04 [WARNING ] (13, 1, 'bot')
2018-11-16 11:48:04 [WARNING ] (13, 1, 'bot')
2018-11-16 11:48:04 [WARNING ] (13, 1, 'bot')
2018-11-16 11:48:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:48:04 [DEBUG   ] Finished updating board flags in 1.532 seconds
2018-11-16 11:48:07 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-16 11:48:27 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 11:48:38 [DEBUG   ] Got command RPT from MCS: ref #525398
2018-11-16 11:48:38 [DEBUG   ] summary = ERROR
2018-11-16 11:48:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525398  13 58438 42518713 A  ERRORERROR'
2018-11-16 11:48:38 [DEBUG   ] Got command RPT from MCS: ref #525399
2018-11-16 11:48:38 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 11:48:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525399  77 58438 42518917 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 11:48:39 [DEBUG   ] Got command RPT from MCS: ref #525400
2018-11-16 11:48:39 [DEBUG   ] summary = ERROR
2018-11-16 11:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525400  13 58438 42519121 A  ERRORERROR'
2018-11-16 11:48:39 [DEBUG   ] Got command RPT from MCS: ref #525402
2018-11-16 11:48:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 11:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525402  77 58438 42519325 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 11:48:39 [DEBUG   ] Got command RPT from MCS: ref #525403
2018-11-16 11:48:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 11:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525403  12 58438 42519517 A  ERRORB–™š'
2018-11-16 11:48:47 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 11:49:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:49:04 [WARNING ] (13, 1, 'bot')
2018-11-16 11:49:04 [WARNING ] (13, 1, 'bot')
2018-11-16 11:49:04 [WARNING ] (13, 1, 'bot')
2018-11-16 11:49:04 [WARNING ] (13, 1, 'bot')
2018-11-16 11:49:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:49:04 [DEBUG   ] Finished updating board flags in 1.439 seconds
2018-11-16 11:49:07 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 11:49:27 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-16 11:49:47 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-16 11:50:03 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:50:04 [WARNING ] (13, 1, 'bot')
2018-11-16 11:50:04 [WARNING ] (13, 1, 'bot')
2018-11-16 11:50:04 [WARNING ] (13, 1, 'bot')
2018-11-16 11:50:04 [WARNING ] (13, 1, 'bot')
2018-11-16 11:50:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:50:04 [DEBUG   ] Finished updating board flags in 1.467 seconds
2018-11-16 11:50:07 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 11:50:27 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 11:50:45 [DEBUG   ] Got command RPT from MCS: ref #525412
2018-11-16 11:50:45 [DEBUG   ] summary = ERROR
2018-11-16 11:50:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525412  13 58438 42645393 A  ERRORERROR'
2018-11-16 11:50:45 [DEBUG   ] Got command RPT from MCS: ref #525413
2018-11-16 11:50:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 11:50:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525413  77 58438 42645394 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 11:50:47 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 11:51:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:51:04 [WARNING ] (13, 1, 'bot')
2018-11-16 11:51:04 [WARNING ] (13, 1, 'bot')
2018-11-16 11:51:04 [WARNING ] (13, 1, 'bot')
2018-11-16 11:51:04 [WARNING ] (13, 1, 'bot')
2018-11-16 11:51:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:51:04 [DEBUG   ] Finished updating board flags in 1.466 seconds
2018-11-16 11:51:07 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 11:51:27 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-16 11:51:47 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-16 11:52:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:52:04 [WARNING ] (13, 1, 'bot')
2018-11-16 11:52:04 [WARNING ] (13, 1, 'bot')
2018-11-16 11:52:04 [WARNING ] (13, 1, 'bot')
2018-11-16 11:52:04 [WARNING ] (13, 1, 'bot')
2018-11-16 11:52:04 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:52:04 [DEBUG   ] Finished updating board flags in 1.503 seconds
2018-11-16 11:52:07 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-16 11:52:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 11:52:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 11:53:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:53:05 [WARNING ] (13, 1, 'bot')
2018-11-16 11:53:05 [WARNING ] (13, 1, 'bot')
2018-11-16 11:53:05 [WARNING ] (13, 1, 'bot')
2018-11-16 11:53:05 [WARNING ] (13, 1, 'bot')
2018-11-16 11:53:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:53:05 [DEBUG   ] Finished updating board flags in 2.183 seconds
2018-11-16 11:53:07 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 11:53:27 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 11:53:38 [DEBUG   ] Got command RPT from MCS: ref #525429
2018-11-16 11:53:38 [DEBUG   ] summary = ERROR
2018-11-16 11:53:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525429  13 58438 42818797 A  ERRORERROR'
2018-11-16 11:53:39 [DEBUG   ] Got command RPT from MCS: ref #525430
2018-11-16 11:53:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 11:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525430  77 58438 42819001 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 11:53:39 [DEBUG   ] Got command RPT from MCS: ref #525431
2018-11-16 11:53:39 [DEBUG   ] summary = ERROR
2018-11-16 11:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525431  13 58438 42819205 A  ERRORERROR'
2018-11-16 11:53:39 [DEBUG   ] Got command RPT from MCS: ref #525432
2018-11-16 11:53:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 11:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525432  77 58438 42819397 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 11:53:39 [DEBUG   ] Got command RPT from MCS: ref #525433
2018-11-16 11:53:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 11:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525433  12 58438 42819601 A  ERRORB•™š'
2018-11-16 11:53:47 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 11:54:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:54:05 [WARNING ] (13, 1, 'bot')
2018-11-16 11:54:05 [WARNING ] (13, 1, 'bot')
2018-11-16 11:54:05 [WARNING ] (13, 1, 'bot')
2018-11-16 11:54:05 [WARNING ] (13, 1, 'bot')
2018-11-16 11:54:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:54:05 [DEBUG   ] Finished updating board flags in 1.966 seconds
2018-11-16 11:54:07 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-16 11:54:27 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 11:54:47 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 11:55:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 11:55:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:55:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa26, chip 4
2018-11-16 11:55:05 [WARNING ] (13, 1, 'bot')
2018-11-16 11:55:05 [WARNING ] (13, 1, 'bot')
2018-11-16 11:55:05 [WARNING ] (13, 1, 'bot')
2018-11-16 11:55:05 [WARNING ] (13, 1, 'bot')
2018-11-16 11:55:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:55:05 [DEBUG   ] Finished updating board flags in 1.881 seconds
2018-11-16 11:55:07 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-16 11:55:27 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 11:55:45 [DEBUG   ] Got command RPT from MCS: ref #525438
2018-11-16 11:55:45 [DEBUG   ] summary = ERROR
2018-11-16 11:55:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525438  13 58438 42945393 A  ERRORERROR'
2018-11-16 11:55:45 [DEBUG   ] Got command RPT from MCS: ref #525439
2018-11-16 11:55:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 11:55:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525439  77 58438 42945394 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 11:55:47 [DEBUG   ] Finished updating ant stats in 0.601 seconds
2018-11-16 11:56:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:56:05 [WARNING ] (13, 1, 'bot')
2018-11-16 11:56:05 [WARNING ] (13, 1, 'bot')
2018-11-16 11:56:05 [WARNING ] (13, 1, 'bot')
2018-11-16 11:56:05 [WARNING ] (13, 1, 'bot')
2018-11-16 11:56:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:56:05 [DEBUG   ] Finished updating board flags in 1.716 seconds
2018-11-16 11:56:07 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 11:56:27 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-16 11:56:48 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-16 11:57:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:57:05 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 11:57:05 [WARNING ] (13, 1, 'bot')
2018-11-16 11:57:05 [WARNING ] (13, 1, 'bot')
2018-11-16 11:57:05 [WARNING ] (13, 1, 'bot')
2018-11-16 11:57:05 [WARNING ] (13, 1, 'bot')
2018-11-16 11:57:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:57:05 [DEBUG   ] Finished updating board flags in 1.615 seconds
2018-11-16 11:57:08 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-16 11:57:28 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 11:57:48 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 11:58:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:58:05 [WARNING ] (13, 1, 'bot')
2018-11-16 11:58:05 [WARNING ] (13, 1, 'bot')
2018-11-16 11:58:05 [WARNING ] (13, 1, 'bot')
2018-11-16 11:58:05 [WARNING ] (13, 1, 'bot')
2018-11-16 11:58:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:58:05 [DEBUG   ] Finished updating board flags in 1.594 seconds
2018-11-16 11:58:08 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-16 11:58:28 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 11:58:38 [DEBUG   ] Got command RPT from MCS: ref #525461
2018-11-16 11:58:38 [DEBUG   ] summary = ERROR
2018-11-16 11:58:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525461  13 58438 43118885 A  ERRORERROR'
2018-11-16 11:58:39 [DEBUG   ] Got command RPT from MCS: ref #525462
2018-11-16 11:58:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 11:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525462  77 58438 43119077 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 11:58:39 [DEBUG   ] Got command RPT from MCS: ref #525463
2018-11-16 11:58:39 [DEBUG   ] summary = ERROR
2018-11-16 11:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525463  13 58438 43119281 A  ERRORERROR'
2018-11-16 11:58:39 [DEBUG   ] Got command RPT from MCS: ref #525465
2018-11-16 11:58:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 11:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525465  77 58438 43119485 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 11:58:39 [DEBUG   ] Got command RPT from MCS: ref #525466
2018-11-16 11:58:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 11:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525466  12 58438 43119689 A  ERRORB—™š'
2018-11-16 11:58:48 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 11:59:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 11:59:05 [WARNING ] (13, 1, 'bot')
2018-11-16 11:59:05 [WARNING ] (13, 1, 'bot')
2018-11-16 11:59:05 [WARNING ] (13, 1, 'bot')
2018-11-16 11:59:05 [WARNING ] (13, 1, 'bot')
2018-11-16 11:59:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 11:59:05 [DEBUG   ] Finished updating board flags in 1.402 seconds
2018-11-16 11:59:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 11:59:28 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 11:59:48 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 12:00:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 12:00:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:00:05 [WARNING ] (13, 1, 'bot')
2018-11-16 12:00:05 [WARNING ] (13, 1, 'bot')
2018-11-16 12:00:05 [WARNING ] (13, 1, 'bot')
2018-11-16 12:00:05 [WARNING ] (13, 1, 'bot')
2018-11-16 12:00:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:00:05 [DEBUG   ] Finished updating board flags in 1.414 seconds
2018-11-16 12:00:08 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 12:00:28 [DEBUG   ] Finished updating ant stats in 0.986 seconds
2018-11-16 12:00:45 [DEBUG   ] Got command RPT from MCS: ref #525475
2018-11-16 12:00:45 [DEBUG   ] summary = ERROR
2018-11-16 12:00:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525475  13 58438 43245393 A  ERRORERROR'
2018-11-16 12:00:45 [DEBUG   ] Got command RPT from MCS: ref #525476
2018-11-16 12:00:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 12:00:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525476  77 58438 43245394 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 12:00:48 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 12:01:04 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 12:01:04 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:01:05 [WARNING ] (13, 1, 'bot')
2018-11-16 12:01:05 [WARNING ] (13, 1, 'bot')
2018-11-16 12:01:05 [WARNING ] (13, 1, 'bot')
2018-11-16 12:01:05 [WARNING ] (13, 1, 'bot')
2018-11-16 12:01:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:01:05 [DEBUG   ] Finished updating board flags in 1.386 seconds
2018-11-16 12:01:08 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 12:01:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 12:01:48 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 12:02:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:02:05 [WARNING ] (13, 1, 'bot')
2018-11-16 12:02:05 [WARNING ] (13, 1, 'bot')
2018-11-16 12:02:05 [WARNING ] (13, 1, 'bot')
2018-11-16 12:02:05 [WARNING ] (13, 1, 'bot')
2018-11-16 12:02:05 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:02:05 [DEBUG   ] Finished updating board flags in 1.425 seconds
2018-11-16 12:02:08 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 12:02:28 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 12:02:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 12:03:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:03:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 12:03:06 [WARNING ] (13, 1, 'bot')
2018-11-16 12:03:06 [WARNING ] (13, 1, 'bot')
2018-11-16 12:03:06 [WARNING ] (13, 1, 'bot')
2018-11-16 12:03:06 [WARNING ] (13, 1, 'bot')
2018-11-16 12:03:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:03:06 [DEBUG   ] Finished updating board flags in 2.194 seconds
2018-11-16 12:03:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 12:03:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 12:03:38 [DEBUG   ] Got command RPT from MCS: ref #525496
2018-11-16 12:03:38 [DEBUG   ] summary = ERROR
2018-11-16 12:03:38 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525496  13 58438 43418961 A  ERRORERROR'
2018-11-16 12:03:39 [DEBUG   ] Got command RPT from MCS: ref #525497
2018-11-16 12:03:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 12:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525497  77 58438 43419165 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 12:03:39 [DEBUG   ] Got command RPT from MCS: ref #525498
2018-11-16 12:03:39 [DEBUG   ] summary = ERROR
2018-11-16 12:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525498  13 58438 43419357 A  ERRORERROR'
2018-11-16 12:03:39 [DEBUG   ] Got command RPT from MCS: ref #525499
2018-11-16 12:03:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 12:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525499  77 58438 43419561 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 12:03:39 [DEBUG   ] Got command RPT from MCS: ref #525500
2018-11-16 12:03:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 12:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525500  12 58438 43419765 A  ERRORB—™š'
2018-11-16 12:03:48 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 12:04:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:04:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 12:04:06 [WARNING ] (13, 1, 'bot')
2018-11-16 12:04:06 [WARNING ] (13, 1, 'bot')
2018-11-16 12:04:06 [WARNING ] (13, 1, 'bot')
2018-11-16 12:04:06 [WARNING ] (13, 1, 'bot')
2018-11-16 12:04:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:04:06 [DEBUG   ] Finished updating board flags in 2.110 seconds
2018-11-16 12:04:08 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 12:04:28 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 12:04:48 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 12:05:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:05:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-16 12:05:06 [WARNING ] (13, 1, 'bot')
2018-11-16 12:05:06 [WARNING ] (13, 1, 'bot')
2018-11-16 12:05:06 [WARNING ] (13, 1, 'bot')
2018-11-16 12:05:06 [WARNING ] (13, 1, 'bot')
2018-11-16 12:05:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:05:06 [DEBUG   ] Finished updating board flags in 1.873 seconds
2018-11-16 12:05:08 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-16 12:05:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 12:05:45 [DEBUG   ] Got command RPT from MCS: ref #525505
2018-11-16 12:05:45 [DEBUG   ] summary = ERROR
2018-11-16 12:05:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525505  13 58438 43545401 A  ERRORERROR'
2018-11-16 12:05:45 [DEBUG   ] Got command RPT from MCS: ref #525506
2018-11-16 12:05:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 12:05:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525506  77 58438 43545402 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 12:05:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 12:06:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:06:06 [WARNING ] (13, 1, 'bot')
2018-11-16 12:06:06 [WARNING ] (13, 1, 'bot')
2018-11-16 12:06:06 [WARNING ] (13, 1, 'bot')
2018-11-16 12:06:06 [WARNING ] (13, 1, 'bot')
2018-11-16 12:06:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:06:06 [DEBUG   ] Finished updating board flags in 1.813 seconds
2018-11-16 12:06:08 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 12:06:28 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 12:06:48 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 12:07:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:07:06 [WARNING ] (13, 1, 'bot')
2018-11-16 12:07:06 [WARNING ] (13, 1, 'bot')
2018-11-16 12:07:06 [WARNING ] (13, 1, 'bot')
2018-11-16 12:07:06 [WARNING ] (13, 1, 'bot')
2018-11-16 12:07:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:07:06 [DEBUG   ] Finished updating board flags in 1.788 seconds
2018-11-16 12:07:08 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 12:07:28 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 12:07:48 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 12:08:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:08:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 12:08:06 [WARNING ] (13, 1, 'bot')
2018-11-16 12:08:06 [WARNING ] (13, 1, 'bot')
2018-11-16 12:08:06 [WARNING ] (13, 1, 'bot')
2018-11-16 12:08:06 [WARNING ] (13, 1, 'bot')
2018-11-16 12:08:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:08:06 [DEBUG   ] Finished updating board flags in 1.624 seconds
2018-11-16 12:08:08 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-16 12:08:29 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-16 12:08:39 [DEBUG   ] Got command RPT from MCS: ref #525524
2018-11-16 12:08:39 [DEBUG   ] summary = ERROR
2018-11-16 12:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525524  13 58438 43719041 A  ERRORERROR'
2018-11-16 12:08:39 [DEBUG   ] Got command RPT from MCS: ref #525525
2018-11-16 12:08:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 12:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525525  77 58438 43719245 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 12:08:39 [DEBUG   ] Got command RPT from MCS: ref #525526
2018-11-16 12:08:39 [DEBUG   ] summary = ERROR
2018-11-16 12:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525526  13 58438 43719438 A  ERRORERROR'
2018-11-16 12:08:39 [DEBUG   ] Got command RPT from MCS: ref #525528
2018-11-16 12:08:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 12:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525528  77 58438 43719641 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 12:08:39 [DEBUG   ] Got command RPT from MCS: ref #525530
2018-11-16 12:08:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 12:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525530  12 58438 43719846 A  ERRORB–™š'
2018-11-16 12:08:49 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-16 12:09:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:09:06 [WARNING ] (13, 1, 'bot')
2018-11-16 12:09:06 [WARNING ] (13, 1, 'bot')
2018-11-16 12:09:06 [WARNING ] (13, 1, 'bot')
2018-11-16 12:09:06 [WARNING ] (13, 1, 'bot')
2018-11-16 12:09:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:09:06 [DEBUG   ] Finished updating board flags in 1.587 seconds
2018-11-16 12:09:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 12:09:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 12:09:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 12:10:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:10:06 [WARNING ] (13, 1, 'bot')
2018-11-16 12:10:06 [WARNING ] (13, 1, 'bot')
2018-11-16 12:10:06 [WARNING ] (13, 1, 'bot')
2018-11-16 12:10:06 [WARNING ] (13, 1, 'bot')
2018-11-16 12:10:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:10:06 [DEBUG   ] Finished updating board flags in 1.423 seconds
2018-11-16 12:10:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 12:10:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 12:10:45 [DEBUG   ] Got command RPT from MCS: ref #525538
2018-11-16 12:10:45 [DEBUG   ] summary = ERROR
2018-11-16 12:10:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525538  13 58438 43845405 A  ERRORERROR'
2018-11-16 12:10:45 [DEBUG   ] Got command RPT from MCS: ref #525539
2018-11-16 12:10:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 12:10:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525539  77 58438 43845406 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 12:10:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 12:11:05 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:11:06 [WARNING ] (13, 1, 'bot')
2018-11-16 12:11:06 [WARNING ] (13, 1, 'bot')
2018-11-16 12:11:06 [WARNING ] (13, 1, 'bot')
2018-11-16 12:11:06 [WARNING ] (13, 1, 'bot')
2018-11-16 12:11:06 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:11:06 [DEBUG   ] Finished updating board flags in 1.382 seconds
2018-11-16 12:11:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 12:11:29 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-16 12:11:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 12:12:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:12:07 [WARNING ] (13, 1, 'bot')
2018-11-16 12:12:07 [WARNING ] (13, 1, 'bot')
2018-11-16 12:12:07 [WARNING ] (13, 1, 'bot')
2018-11-16 12:12:07 [WARNING ] (13, 1, 'bot')
2018-11-16 12:12:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:12:07 [DEBUG   ] Finished updating board flags in 1.678 seconds
2018-11-16 12:12:09 [DEBUG   ] Finished updating ant stats in 1.201 seconds
2018-11-16 12:12:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 12:12:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 12:13:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:13:07 [WARNING ] (13, 1, 'bot')
2018-11-16 12:13:07 [WARNING ] (13, 1, 'bot')
2018-11-16 12:13:07 [WARNING ] (13, 1, 'bot')
2018-11-16 12:13:07 [WARNING ] (13, 1, 'bot')
2018-11-16 12:13:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:13:07 [DEBUG   ] Finished updating board flags in 2.240 seconds
2018-11-16 12:13:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 12:13:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 12:13:39 [DEBUG   ] Got command RPT from MCS: ref #525559
2018-11-16 12:13:39 [DEBUG   ] summary = ERROR
2018-11-16 12:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525559  13 58438 44019121 A  ERRORERROR'
2018-11-16 12:13:39 [DEBUG   ] Got command RPT from MCS: ref #525560
2018-11-16 12:13:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 12:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525560  77 58438 44019325 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 12:13:39 [DEBUG   ] Got command RPT from MCS: ref #525561
2018-11-16 12:13:39 [DEBUG   ] summary = ERROR
2018-11-16 12:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525561  13 58438 44019517 A  ERRORERROR'
2018-11-16 12:13:39 [DEBUG   ] Got command RPT from MCS: ref #525562
2018-11-16 12:13:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 12:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525562  77 58438 44019721 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 12:13:39 [DEBUG   ] Got command RPT from MCS: ref #525563
2018-11-16 12:13:39 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 12:13:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525563  12 58438 44019944 A  ERRORB•™š'
2018-11-16 12:13:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 12:14:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:14:07 [WARNING ] (13, 1, 'bot')
2018-11-16 12:14:07 [WARNING ] (13, 1, 'bot')
2018-11-16 12:14:07 [WARNING ] (13, 1, 'bot')
2018-11-16 12:14:07 [WARNING ] (13, 1, 'bot')
2018-11-16 12:14:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:14:07 [DEBUG   ] Finished updating board flags in 2.087 seconds
2018-11-16 12:14:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 12:14:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 12:14:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 12:15:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:15:07 [WARNING ] (13, 1, 'bot')
2018-11-16 12:15:07 [WARNING ] (13, 1, 'bot')
2018-11-16 12:15:07 [WARNING ] (13, 1, 'bot')
2018-11-16 12:15:07 [WARNING ] (13, 1, 'bot')
2018-11-16 12:15:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:15:07 [DEBUG   ] Finished updating board flags in 2.010 seconds
2018-11-16 12:15:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 12:15:29 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-16 12:15:45 [DEBUG   ] Got command RPT from MCS: ref #525568
2018-11-16 12:15:45 [DEBUG   ] summary = ERROR
2018-11-16 12:15:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525568  13 58438 44145397 A  ERRORERROR'
2018-11-16 12:15:45 [DEBUG   ] Got command RPT from MCS: ref #525569
2018-11-16 12:15:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 12:15:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525569  77 58438 44145398 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 12:15:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 12:16:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 12:16:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:16:07 [WARNING ] (13, 1, 'bot')
2018-11-16 12:16:07 [WARNING ] (13, 1, 'bot')
2018-11-16 12:16:07 [WARNING ] (13, 1, 'bot')
2018-11-16 12:16:07 [WARNING ] (13, 1, 'bot')
2018-11-16 12:16:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:16:07 [DEBUG   ] Finished updating board flags in 2.018 seconds
2018-11-16 12:16:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 12:16:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 12:16:49 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 12:17:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:17:07 [WARNING ] (13, 1, 'bot')
2018-11-16 12:17:07 [WARNING ] (13, 1, 'bot')
2018-11-16 12:17:07 [WARNING ] (13, 1, 'bot')
2018-11-16 12:17:07 [WARNING ] (13, 1, 'bot')
2018-11-16 12:17:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:17:07 [DEBUG   ] Finished updating board flags in 1.972 seconds
2018-11-16 12:17:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 12:17:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 12:17:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 12:18:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:18:07 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 12:18:08 [WARNING ] (13, 1, 'bot')
2018-11-16 12:18:08 [WARNING ] (13, 1, 'bot')
2018-11-16 12:18:08 [WARNING ] (13, 1, 'bot')
2018-11-16 12:18:08 [WARNING ] (13, 1, 'bot')
2018-11-16 12:18:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:18:08 [DEBUG   ] Finished updating board flags in 2.196 seconds
2018-11-16 12:18:09 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-16 12:18:29 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-16 12:18:39 [DEBUG   ] Got command RPT from MCS: ref #525591
2018-11-16 12:18:39 [DEBUG   ] summary = ERROR
2018-11-16 12:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525591  13 58438 44319205 A  ERRORERROR'
2018-11-16 12:18:39 [DEBUG   ] Got command RPT from MCS: ref #525592
2018-11-16 12:18:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 12:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525592  77 58438 44319397 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 12:18:39 [DEBUG   ] Got command RPT from MCS: ref #525593
2018-11-16 12:18:39 [DEBUG   ] summary = ERROR
2018-11-16 12:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525593  13 58438 44319601 A  ERRORERROR'
2018-11-16 12:18:39 [DEBUG   ] Got command RPT from MCS: ref #525595
2018-11-16 12:18:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 12:18:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525595  77 58438 44319805 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 12:18:40 [DEBUG   ] Got command RPT from MCS: ref #525596
2018-11-16 12:18:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 12:18:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525596  12 58438 44320009 A  ERRORB—™š'
2018-11-16 12:18:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 12:19:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:19:07 [WARNING ] (13, 1, 'bot')
2018-11-16 12:19:07 [WARNING ] (13, 1, 'bot')
2018-11-16 12:19:07 [WARNING ] (13, 1, 'bot')
2018-11-16 12:19:07 [WARNING ] (13, 1, 'bot')
2018-11-16 12:19:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:19:07 [DEBUG   ] Finished updating board flags in 1.662 seconds
2018-11-16 12:19:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 12:19:29 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 12:19:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 12:20:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:20:07 [WARNING ] (13, 1, 'bot')
2018-11-16 12:20:07 [WARNING ] (13, 1, 'bot')
2018-11-16 12:20:07 [WARNING ] (13, 1, 'bot')
2018-11-16 12:20:07 [WARNING ] (13, 1, 'bot')
2018-11-16 12:20:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:20:07 [DEBUG   ] Finished updating board flags in 1.722 seconds
2018-11-16 12:20:09 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 12:20:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 12:20:45 [DEBUG   ] Got command RPT from MCS: ref #525605
2018-11-16 12:20:45 [DEBUG   ] summary = ERROR
2018-11-16 12:20:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525605  13 58438 44445401 A  ERRORERROR'
2018-11-16 12:20:45 [DEBUG   ] Got command RPT from MCS: ref #525606
2018-11-16 12:20:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 12:20:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525606  77 58438 44445402 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 12:20:49 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-16 12:21:06 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:21:07 [WARNING ] (13, 1, 'bot')
2018-11-16 12:21:07 [WARNING ] (13, 1, 'bot')
2018-11-16 12:21:07 [WARNING ] (13, 1, 'bot')
2018-11-16 12:21:07 [WARNING ] (13, 1, 'bot')
2018-11-16 12:21:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:21:07 [DEBUG   ] Finished updating board flags in 1.455 seconds
2018-11-16 12:21:09 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 12:21:29 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 12:21:49 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 12:22:06 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 12:22:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:22:07 [WARNING ] (13, 1, 'bot')
2018-11-16 12:22:07 [WARNING ] (13, 1, 'bot')
2018-11-16 12:22:07 [WARNING ] (13, 1, 'bot')
2018-11-16 12:22:07 [WARNING ] (13, 1, 'bot')
2018-11-16 12:22:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:22:07 [DEBUG   ] Finished updating board flags in 1.491 seconds
2018-11-16 12:22:09 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-16 12:22:29 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-16 12:22:49 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 12:23:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:23:07 [WARNING ] (13, 1, 'bot')
2018-11-16 12:23:07 [WARNING ] (13, 1, 'bot')
2018-11-16 12:23:07 [WARNING ] (13, 1, 'bot')
2018-11-16 12:23:07 [WARNING ] (13, 1, 'bot')
2018-11-16 12:23:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:23:07 [DEBUG   ] Finished updating board flags in 1.491 seconds
2018-11-16 12:23:09 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-16 12:23:29 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 12:23:39 [DEBUG   ] Got command RPT from MCS: ref #525622
2018-11-16 12:23:39 [DEBUG   ] summary = ERROR
2018-11-16 12:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525622  13 58438 44619285 A  ERRORERROR'
2018-11-16 12:23:39 [DEBUG   ] Got command RPT from MCS: ref #525623
2018-11-16 12:23:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 12:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525623  77 58438 44619489 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 12:23:39 [DEBUG   ] Got command RPT from MCS: ref #525624
2018-11-16 12:23:39 [DEBUG   ] summary = ERROR
2018-11-16 12:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525624  13 58438 44619682 A  ERRORERROR'
2018-11-16 12:23:39 [DEBUG   ] Got command RPT from MCS: ref #525625
2018-11-16 12:23:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 12:23:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525625  77 58438 44619885 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 12:23:40 [DEBUG   ] Got command RPT from MCS: ref #525626
2018-11-16 12:23:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 12:23:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525626  12 58438 44620089 A  ERRORB—™š'
2018-11-16 12:23:49 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-16 12:24:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:24:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 12:24:07 [WARNING ] (13, 1, 'bot')
2018-11-16 12:24:07 [WARNING ] (13, 1, 'bot')
2018-11-16 12:24:07 [WARNING ] (13, 1, 'bot')
2018-11-16 12:24:07 [WARNING ] (13, 1, 'bot')
2018-11-16 12:24:07 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:24:07 [DEBUG   ] Finished updating board flags in 1.492 seconds
2018-11-16 12:24:10 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-16 12:24:30 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-16 12:24:50 [DEBUG   ] Finished updating ant stats in 1.197 seconds
2018-11-16 12:25:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:25:08 [WARNING ] (13, 1, 'bot')
2018-11-16 12:25:08 [WARNING ] (13, 1, 'bot')
2018-11-16 12:25:08 [WARNING ] (13, 1, 'bot')
2018-11-16 12:25:08 [WARNING ] (13, 1, 'bot')
2018-11-16 12:25:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:25:08 [DEBUG   ] Finished updating board flags in 2.124 seconds
2018-11-16 12:25:10 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 12:25:30 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 12:25:45 [DEBUG   ] Got command RPT from MCS: ref #525631
2018-11-16 12:25:45 [DEBUG   ] summary = ERROR
2018-11-16 12:25:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525631  13 58438 44745401 A  ERRORERROR'
2018-11-16 12:25:45 [DEBUG   ] Got command RPT from MCS: ref #525632
2018-11-16 12:25:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 12:25:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525632  77 58438 44745402 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 12:25:50 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 12:26:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:26:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-16 12:26:08 [WARNING ] (13, 1, 'bot')
2018-11-16 12:26:08 [WARNING ] (13, 1, 'bot')
2018-11-16 12:26:08 [WARNING ] (13, 1, 'bot')
2018-11-16 12:26:08 [WARNING ] (13, 1, 'bot')
2018-11-16 12:26:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:26:08 [DEBUG   ] Finished updating board flags in 2.007 seconds
2018-11-16 12:26:10 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-16 12:26:30 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 12:26:50 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 12:27:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:27:08 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 12:27:08 [WARNING ] (13, 1, 'bot')
2018-11-16 12:27:08 [WARNING ] (13, 1, 'bot')
2018-11-16 12:27:08 [WARNING ] (13, 1, 'bot')
2018-11-16 12:27:08 [WARNING ] (13, 1, 'bot')
2018-11-16 12:27:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:27:08 [DEBUG   ] Finished updating board flags in 1.984 seconds
2018-11-16 12:27:10 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 12:27:30 [DEBUG   ] Finished updating ant stats in 0.797 seconds
2018-11-16 12:27:50 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 12:28:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:28:08 [WARNING ] (13, 1, 'bot')
2018-11-16 12:28:08 [WARNING ] (13, 1, 'bot')
2018-11-16 12:28:08 [WARNING ] (13, 1, 'bot')
2018-11-16 12:28:08 [WARNING ] (13, 1, 'bot')
2018-11-16 12:28:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:28:08 [DEBUG   ] Finished updating board flags in 1.819 seconds
2018-11-16 12:28:10 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 12:28:30 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 12:28:39 [DEBUG   ] Got command RPT from MCS: ref #525654
2018-11-16 12:28:39 [DEBUG   ] summary = ERROR
2018-11-16 12:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525654  13 58438 44919357 A  ERRORERROR'
2018-11-16 12:28:39 [DEBUG   ] Got command RPT from MCS: ref #525655
2018-11-16 12:28:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 12:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525655  77 58438 44919561 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 12:28:39 [DEBUG   ] Got command RPT from MCS: ref #525656
2018-11-16 12:28:39 [DEBUG   ] summary = ERROR
2018-11-16 12:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525656  13 58438 44919769 A  ERRORERROR'
2018-11-16 12:28:39 [DEBUG   ] Got command RPT from MCS: ref #525658
2018-11-16 12:28:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 12:28:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525658  77 58438 44919961 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 12:28:40 [DEBUG   ] Got command RPT from MCS: ref #525659
2018-11-16 12:28:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 12:28:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525659  12 58438 44920165 A  ERRORB–™š'
2018-11-16 12:28:50 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-16 12:29:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:29:08 [WARNING ] (13, 1, 'bot')
2018-11-16 12:29:08 [WARNING ] (13, 1, 'bot')
2018-11-16 12:29:08 [WARNING ] (13, 1, 'bot')
2018-11-16 12:29:08 [WARNING ] (13, 1, 'bot')
2018-11-16 12:29:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:29:08 [DEBUG   ] Finished updating board flags in 1.799 seconds
2018-11-16 12:29:11 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-16 12:29:30 [DEBUG   ] Finished updating ant stats in 0.406 seconds
2018-11-16 12:29:50 [DEBUG   ] Finished updating ant stats in 0.404 seconds
2018-11-16 12:30:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:30:08 [WARNING ] (13, 1, 'bot')
2018-11-16 12:30:08 [WARNING ] (13, 1, 'bot')
2018-11-16 12:30:08 [WARNING ] (13, 1, 'bot')
2018-11-16 12:30:08 [WARNING ] (13, 1, 'bot')
2018-11-16 12:30:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:30:08 [DEBUG   ] Finished updating board flags in 1.595 seconds
2018-11-16 12:30:11 [DEBUG   ] Finished updating ant stats in 1.394 seconds
2018-11-16 12:30:31 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-16 12:30:45 [DEBUG   ] Got command RPT from MCS: ref #525668
2018-11-16 12:30:45 [DEBUG   ] summary = ERROR
2018-11-16 12:30:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525668  13 58438 45045401 A  ERRORERROR'
2018-11-16 12:30:45 [DEBUG   ] Got command RPT from MCS: ref #525669
2018-11-16 12:30:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 12:30:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525669  77 58438 45045402 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 12:30:51 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-16 12:31:07 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 12:31:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:31:08 [WARNING ] (13, 1, 'bot')
2018-11-16 12:31:08 [WARNING ] (13, 1, 'bot')
2018-11-16 12:31:08 [WARNING ] (13, 1, 'bot')
2018-11-16 12:31:08 [WARNING ] (13, 1, 'bot')
2018-11-16 12:31:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:31:08 [DEBUG   ] Finished updating board flags in 1.410 seconds
2018-11-16 12:31:11 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 12:31:31 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 12:31:51 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 12:32:07 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:32:08 [WARNING ] (13, 1, 'bot')
2018-11-16 12:32:08 [WARNING ] (13, 1, 'bot')
2018-11-16 12:32:08 [WARNING ] (13, 1, 'bot')
2018-11-16 12:32:08 [WARNING ] (13, 1, 'bot')
2018-11-16 12:32:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:32:08 [DEBUG   ] Finished updating board flags in 1.385 seconds
2018-11-16 12:32:11 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-16 12:32:31 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 12:32:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 12:33:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:33:08 [WARNING ] (13, 1, 'bot')
2018-11-16 12:33:08 [WARNING ] (13, 1, 'bot')
2018-11-16 12:33:08 [WARNING ] (13, 1, 'bot')
2018-11-16 12:33:08 [WARNING ] (13, 1, 'bot')
2018-11-16 12:33:08 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:33:08 [DEBUG   ] Finished updating board flags in 1.356 seconds
2018-11-16 12:33:11 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 12:33:31 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 12:33:39 [DEBUG   ] Got command RPT from MCS: ref #525689
2018-11-16 12:33:39 [DEBUG   ] summary = ERROR
2018-11-16 12:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525689  13 58438 45219442 A  ERRORERROR'
2018-11-16 12:33:39 [DEBUG   ] Got command RPT from MCS: ref #525690
2018-11-16 12:33:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 12:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525690  77 58438 45219645 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 12:33:39 [DEBUG   ] Got command RPT from MCS: ref #525691
2018-11-16 12:33:39 [DEBUG   ] summary = ERROR
2018-11-16 12:33:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525691  13 58438 45219849 A  ERRORERROR'
2018-11-16 12:33:40 [DEBUG   ] Got command RPT from MCS: ref #525692
2018-11-16 12:33:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 12:33:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525692  77 58438 45220053 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 12:33:40 [DEBUG   ] Got command RPT from MCS: ref #525693
2018-11-16 12:33:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 12:33:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525693  12 58438 45220246 A  ERRORB—™š'
2018-11-16 12:33:51 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 12:34:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:34:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:34:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:34:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:34:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:34:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:34:09 [DEBUG   ] Finished updating board flags in 2.079 seconds
2018-11-16 12:34:11 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 12:34:31 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 12:34:51 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-16 12:35:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:35:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:35:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:35:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:35:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:35:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:35:09 [DEBUG   ] Finished updating board flags in 2.009 seconds
2018-11-16 12:35:11 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 12:35:31 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 12:35:45 [DEBUG   ] Got command RPT from MCS: ref #525698
2018-11-16 12:35:45 [DEBUG   ] summary = ERROR
2018-11-16 12:35:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525698  13 58438 45345405 A  ERRORERROR'
2018-11-16 12:35:45 [DEBUG   ] Got command RPT from MCS: ref #525699
2018-11-16 12:35:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 12:35:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525699  77 58438 45345406 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 12:35:51 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 12:36:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:36:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 12:36:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:36:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:36:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:36:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:36:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:36:09 [DEBUG   ] Finished updating board flags in 2.012 seconds
2018-11-16 12:36:11 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-16 12:36:32 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-11-16 12:36:52 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-16 12:37:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:37:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 12:37:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:37:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:37:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:37:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:37:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:37:09 [DEBUG   ] Finished updating board flags in 1.945 seconds
2018-11-16 12:37:12 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-16 12:37:32 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 12:37:52 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 12:38:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:38:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:38:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:38:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:38:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:38:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:38:09 [DEBUG   ] Finished updating board flags in 1.814 seconds
2018-11-16 12:38:12 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-16 12:38:32 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-16 12:38:39 [DEBUG   ] Got command RPT from MCS: ref #525717
2018-11-16 12:38:39 [DEBUG   ] summary = ERROR
2018-11-16 12:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525717  13 58438 45519529 A  ERRORERROR'
2018-11-16 12:38:39 [DEBUG   ] Got command RPT from MCS: ref #525718
2018-11-16 12:38:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 12:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525718  77 58438 45519721 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 12:38:39 [DEBUG   ] Got command RPT from MCS: ref #525719
2018-11-16 12:38:39 [DEBUG   ] summary = ERROR
2018-11-16 12:38:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525719  13 58438 45519933 A  ERRORERROR'
2018-11-16 12:38:40 [DEBUG   ] Got command RPT from MCS: ref #525721
2018-11-16 12:38:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 12:38:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525721  77 58438 45520125 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 12:38:40 [DEBUG   ] Got command RPT from MCS: ref #525722
2018-11-16 12:38:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 12:38:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525722  12 58438 45520329 A  ERRORB—™š'
2018-11-16 12:38:52 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 12:39:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:39:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:39:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:39:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:39:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:39:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:39:09 [DEBUG   ] Finished updating board flags in 1.791 seconds
2018-11-16 12:39:12 [DEBUG   ] Finished updating ant stats in 0.792 seconds
2018-11-16 12:39:32 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 12:39:52 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 12:40:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:40:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:40:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:40:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:40:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:40:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:40:09 [DEBUG   ] Finished updating board flags in 1.623 seconds
2018-11-16 12:40:12 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 12:40:32 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 12:40:45 [DEBUG   ] Got command RPT from MCS: ref #525731
2018-11-16 12:40:45 [DEBUG   ] summary = ERROR
2018-11-16 12:40:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525731  13 58438 45645405 A  ERRORERROR'
2018-11-16 12:40:45 [DEBUG   ] Got command RPT from MCS: ref #525732
2018-11-16 12:40:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 12:40:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525732  77 58438 45645406 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 12:40:52 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 12:41:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:41:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 12:41:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:41:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:41:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:41:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:41:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:41:09 [DEBUG   ] Finished updating board flags in 1.628 seconds
2018-11-16 12:41:12 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-16 12:41:33 [DEBUG   ] Finished updating ant stats in 1.403 seconds
2018-11-16 12:41:53 [DEBUG   ] Finished updating ant stats in 1.397 seconds
2018-11-16 12:42:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:42:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:42:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:42:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:42:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:42:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:42:09 [DEBUG   ] Finished updating board flags in 1.564 seconds
2018-11-16 12:42:13 [DEBUG   ] Finished updating ant stats in 1.207 seconds
2018-11-16 12:42:33 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 12:42:53 [DEBUG   ] Finished updating ant stats in 1.203 seconds
2018-11-16 12:43:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:43:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:43:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:43:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:43:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:43:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:43:09 [DEBUG   ] Finished updating board flags in 1.432 seconds
2018-11-16 12:43:13 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-16 12:43:33 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-16 12:43:39 [DEBUG   ] Got command RPT from MCS: ref #525752
2018-11-16 12:43:39 [DEBUG   ] summary = ERROR
2018-11-16 12:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525752  13 58438 45819605 A  ERRORERROR'
2018-11-16 12:43:39 [DEBUG   ] Got command RPT from MCS: ref #525753
2018-11-16 12:43:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 12:43:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525753  77 58438 45819809 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 12:43:40 [DEBUG   ] Got command RPT from MCS: ref #525754
2018-11-16 12:43:40 [DEBUG   ] summary = ERROR
2018-11-16 12:43:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525754  13 58438 45820001 A  ERRORERROR'
2018-11-16 12:43:40 [DEBUG   ] Got command RPT from MCS: ref #525755
2018-11-16 12:43:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 12:43:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525755  77 58438 45820205 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 12:43:40 [DEBUG   ] Got command RPT from MCS: ref #525756
2018-11-16 12:43:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 12:43:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525756  12 58438 45820409 A  ERRORB—™š'
2018-11-16 12:43:53 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 12:44:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:44:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:44:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:44:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:44:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:44:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:44:09 [DEBUG   ] Finished updating board flags in 1.429 seconds
2018-11-16 12:44:13 [DEBUG   ] Finished updating ant stats in 0.994 seconds
2018-11-16 12:44:33 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 12:44:53 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-16 12:45:08 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:45:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:45:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:45:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:45:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:45:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:45:09 [DEBUG   ] Finished updating board flags in 1.419 seconds
2018-11-16 12:45:13 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 12:45:33 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 12:45:45 [DEBUG   ] Got command RPT from MCS: ref #525761
2018-11-16 12:45:45 [DEBUG   ] summary = ERROR
2018-11-16 12:45:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525761  13 58438 45945405 A  ERRORERROR'
2018-11-16 12:45:45 [DEBUG   ] Got command RPT from MCS: ref #525762
2018-11-16 12:45:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 12:45:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525762  77 58438 45945406 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 12:45:53 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 12:46:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:46:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:46:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:46:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:46:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:46:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:46:09 [DEBUG   ] Finished updating board flags in 1.431 seconds
2018-11-16 12:46:13 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-16 12:46:33 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-16 12:46:54 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-16 12:47:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:47:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:47:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:47:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:47:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:47:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:47:09 [DEBUG   ] Finished updating board flags in 1.420 seconds
2018-11-16 12:47:14 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-16 12:47:34 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 12:47:54 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 12:48:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:48:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:48:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:48:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:48:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:48:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:48:09 [DEBUG   ] Finished updating board flags in 1.424 seconds
2018-11-16 12:48:14 [DEBUG   ] Finished updating ant stats in 1.200 seconds
2018-11-16 12:48:34 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-16 12:48:39 [DEBUG   ] Got command RPT from MCS: ref #525784
2018-11-16 12:48:39 [DEBUG   ] summary = ERROR
2018-11-16 12:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525784  13 58438 46119681 A  ERRORERROR'
2018-11-16 12:48:39 [DEBUG   ] Got command RPT from MCS: ref #525785
2018-11-16 12:48:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 12:48:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525785  77 58438 46119885 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 12:48:40 [DEBUG   ] Got command RPT from MCS: ref #525786
2018-11-16 12:48:40 [DEBUG   ] summary = ERROR
2018-11-16 12:48:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525786  13 58438 46120089 A  ERRORERROR'
2018-11-16 12:48:40 [DEBUG   ] Got command RPT from MCS: ref #525788
2018-11-16 12:48:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 12:48:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525788  77 58438 46120281 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 12:48:40 [DEBUG   ] Got command RPT from MCS: ref #525789
2018-11-16 12:48:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 12:48:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525789  12 58438 46120485 A  ERRORB–™š'
2018-11-16 12:48:54 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 12:49:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:49:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:49:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:49:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:49:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:49:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:49:09 [DEBUG   ] Finished updating board flags in 1.428 seconds
2018-11-16 12:49:14 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-16 12:49:34 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 12:49:54 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 12:50:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:50:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:50:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:50:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:50:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:50:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:50:09 [DEBUG   ] Finished updating board flags in 1.430 seconds
2018-11-16 12:50:14 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 12:50:34 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-16 12:50:45 [DEBUG   ] Got command RPT from MCS: ref #525798
2018-11-16 12:50:45 [DEBUG   ] summary = ERROR
2018-11-16 12:50:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525798  13 58438 46245405 A  ERRORERROR'
2018-11-16 12:50:45 [DEBUG   ] Got command RPT from MCS: ref #525799
2018-11-16 12:50:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 12:50:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525799  77 58438 46245406 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 12:50:54 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 12:51:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:51:09 [WARNING ] MonitorFlags: VCCINT 0.981 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-16 12:51:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:51:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:51:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:51:09 [WARNING ] (13, 1, 'bot')
2018-11-16 12:51:09 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:51:09 [DEBUG   ] Finished updating board flags in 1.428 seconds
2018-11-16 12:51:14 [DEBUG   ] Finished updating ant stats in 0.598 seconds
2018-11-16 12:51:34 [DEBUG   ] Finished updating ant stats in 0.402 seconds
2018-11-16 12:51:55 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-16 12:52:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 12:52:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:52:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa21, chip 2
2018-11-16 12:52:10 [WARNING ] (13, 1, 'bot')
2018-11-16 12:52:10 [WARNING ] (13, 1, 'bot')
2018-11-16 12:52:10 [WARNING ] (13, 1, 'bot')
2018-11-16 12:52:10 [WARNING ] (13, 1, 'bot')
2018-11-16 12:52:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:52:10 [DEBUG   ] Finished updating board flags in 2.201 seconds
2018-11-16 12:52:15 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-16 12:52:35 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 12:52:55 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-16 12:53:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 12:53:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:53:10 [WARNING ] (13, 1, 'bot')
2018-11-16 12:53:10 [WARNING ] (13, 1, 'bot')
2018-11-16 12:53:10 [WARNING ] (13, 1, 'bot')
2018-11-16 12:53:10 [WARNING ] (13, 1, 'bot')
2018-11-16 12:53:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:53:10 [DEBUG   ] Finished updating board flags in 2.186 seconds
2018-11-16 12:53:15 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-16 12:53:35 [DEBUG   ] Finished updating ant stats in 1.001 seconds
2018-11-16 12:53:39 [DEBUG   ] Got command RPT from MCS: ref #525815
2018-11-16 12:53:39 [DEBUG   ] summary = ERROR
2018-11-16 12:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525815  13 58438 46419762 A  ERRORERROR'
2018-11-16 12:53:39 [DEBUG   ] Got command RPT from MCS: ref #525816
2018-11-16 12:53:39 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 12:53:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525816  77 58438 46419965 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 12:53:40 [DEBUG   ] Got command RPT from MCS: ref #525817
2018-11-16 12:53:40 [DEBUG   ] summary = ERROR
2018-11-16 12:53:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525817  13 58438 46420169 A  ERRORERROR'
2018-11-16 12:53:40 [DEBUG   ] Got command RPT from MCS: ref #525818
2018-11-16 12:53:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 12:53:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525818  77 58438 46420362 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 12:53:40 [DEBUG   ] Got command RPT from MCS: ref #525819
2018-11-16 12:53:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 12:53:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525819  12 58438 46420566 A  ERRORB–™š'
2018-11-16 12:53:55 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 12:54:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:54:10 [WARNING ] (13, 1, 'bot')
2018-11-16 12:54:10 [WARNING ] (13, 1, 'bot')
2018-11-16 12:54:10 [WARNING ] (13, 1, 'bot')
2018-11-16 12:54:10 [WARNING ] (13, 1, 'bot')
2018-11-16 12:54:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:54:10 [DEBUG   ] Finished updating board flags in 2.012 seconds
2018-11-16 12:54:15 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 12:54:35 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-16 12:54:55 [DEBUG   ] Finished updating ant stats in 0.801 seconds
2018-11-16 12:55:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:55:10 [WARNING ] (13, 1, 'bot')
2018-11-16 12:55:10 [WARNING ] (13, 1, 'bot')
2018-11-16 12:55:10 [WARNING ] (13, 1, 'bot')
2018-11-16 12:55:10 [WARNING ] (13, 1, 'bot')
2018-11-16 12:55:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:55:10 [DEBUG   ] Finished updating board flags in 1.991 seconds
2018-11-16 12:55:15 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 12:55:35 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 12:55:45 [DEBUG   ] Got command RPT from MCS: ref #525824
2018-11-16 12:55:45 [DEBUG   ] summary = ERROR
2018-11-16 12:55:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525824  13 58438 46545413 A  ERRORERROR'
2018-11-16 12:55:45 [DEBUG   ] Got command RPT from MCS: ref #525825
2018-11-16 12:55:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 12:55:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525825  77 58438 46545414 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 12:55:55 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-16 12:56:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa30, chip 4
2018-11-16 12:56:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:56:10 [WARNING ] (13, 1, 'bot')
2018-11-16 12:56:10 [WARNING ] (13, 1, 'bot')
2018-11-16 12:56:10 [WARNING ] (13, 1, 'bot')
2018-11-16 12:56:10 [WARNING ] (13, 1, 'bot')
2018-11-16 12:56:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:56:10 [DEBUG   ] Finished updating board flags in 1.836 seconds
2018-11-16 12:56:15 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 12:56:35 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 12:56:55 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 12:57:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:57:10 [WARNING ] (13, 1, 'bot')
2018-11-16 12:57:10 [WARNING ] (13, 1, 'bot')
2018-11-16 12:57:10 [WARNING ] (13, 1, 'bot')
2018-11-16 12:57:10 [WARNING ] (13, 1, 'bot')
2018-11-16 12:57:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:57:10 [DEBUG   ] Finished updating board flags in 1.814 seconds
2018-11-16 12:57:15 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-16 12:57:35 [DEBUG   ] Finished updating ant stats in 0.401 seconds
2018-11-16 12:57:56 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-16 12:58:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:58:10 [WARNING ] (13, 1, 'bot')
2018-11-16 12:58:10 [WARNING ] (13, 1, 'bot')
2018-11-16 12:58:10 [WARNING ] (13, 1, 'bot')
2018-11-16 12:58:10 [WARNING ] (13, 1, 'bot')
2018-11-16 12:58:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:58:10 [DEBUG   ] Finished updating board flags in 1.749 seconds
2018-11-16 12:58:16 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-16 12:58:36 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 12:58:39 [DEBUG   ] Got command RPT from MCS: ref #525847
2018-11-16 12:58:39 [DEBUG   ] summary = ERROR
2018-11-16 12:58:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525847  13 58438 46719841 A  ERRORERROR'
2018-11-16 12:58:40 [DEBUG   ] Got command RPT from MCS: ref #525848
2018-11-16 12:58:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 12:58:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525848  77 58438 46720045 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 12:58:40 [DEBUG   ] Got command RPT from MCS: ref #525849
2018-11-16 12:58:40 [DEBUG   ] summary = ERROR
2018-11-16 12:58:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525849  13 58438 46720249 A  ERRORERROR'
2018-11-16 12:58:40 [DEBUG   ] Got command RPT from MCS: ref #525851
2018-11-16 12:58:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 12:58:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525851  77 58438 46720441 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 12:58:40 [DEBUG   ] Got command RPT from MCS: ref #525853
2018-11-16 12:58:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 12:58:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525853  12 58438 46720645 A  ERRORB—™š'
2018-11-16 12:58:56 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 12:59:09 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa23, chip 2
2018-11-16 12:59:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 12:59:10 [WARNING ] (13, 1, 'bot')
2018-11-16 12:59:10 [WARNING ] (13, 1, 'bot')
2018-11-16 12:59:10 [WARNING ] (13, 1, 'bot')
2018-11-16 12:59:10 [WARNING ] (13, 1, 'bot')
2018-11-16 12:59:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 12:59:10 [DEBUG   ] Finished updating board flags in 1.620 seconds
2018-11-16 12:59:16 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-16 12:59:36 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-16 12:59:56 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 13:00:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 13:00:10 [WARNING ] (13, 1, 'bot')
2018-11-16 13:00:10 [WARNING ] (13, 1, 'bot')
2018-11-16 13:00:10 [WARNING ] (13, 1, 'bot')
2018-11-16 13:00:10 [WARNING ] (13, 1, 'bot')
2018-11-16 13:00:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 13:00:10 [DEBUG   ] Finished updating board flags in 1.608 seconds
2018-11-16 13:00:16 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 13:00:36 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 13:00:45 [DEBUG   ] Got command RPT from MCS: ref #525861
2018-11-16 13:00:45 [DEBUG   ] summary = ERROR
2018-11-16 13:00:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525861  13 58438 46845405 A  ERRORERROR'
2018-11-16 13:00:45 [DEBUG   ] Got command RPT from MCS: ref #525862
2018-11-16 13:00:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 13:00:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525862  77 58438 46845406 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 13:00:56 [DEBUG   ] Finished updating ant stats in 1.000 seconds
2018-11-16 13:01:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 13:01:10 [WARNING ] (13, 1, 'bot')
2018-11-16 13:01:10 [WARNING ] (13, 1, 'bot')
2018-11-16 13:01:10 [WARNING ] (13, 1, 'bot')
2018-11-16 13:01:10 [WARNING ] (13, 1, 'bot')
2018-11-16 13:01:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 13:01:10 [DEBUG   ] Finished updating board flags in 1.602 seconds
2018-11-16 13:01:16 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 13:01:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 13:01:56 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 13:02:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 13:02:10 [WARNING ] (13, 1, 'bot')
2018-11-16 13:02:10 [WARNING ] (13, 1, 'bot')
2018-11-16 13:02:10 [WARNING ] (13, 1, 'bot')
2018-11-16 13:02:10 [WARNING ] (13, 1, 'bot')
2018-11-16 13:02:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 13:02:10 [DEBUG   ] Finished updating board flags in 1.614 seconds
2018-11-16 13:02:16 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 13:02:36 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 13:02:56 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 13:03:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 13:03:10 [WARNING ] (13, 1, 'bot')
2018-11-16 13:03:10 [WARNING ] (13, 1, 'bot')
2018-11-16 13:03:10 [WARNING ] (13, 1, 'bot')
2018-11-16 13:03:10 [WARNING ] (13, 1, 'bot')
2018-11-16 13:03:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 13:03:10 [DEBUG   ] Finished updating board flags in 1.629 seconds
2018-11-16 13:03:16 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 13:03:36 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-16 13:03:39 [DEBUG   ] Got command RPT from MCS: ref #525882
2018-11-16 13:03:39 [DEBUG   ] summary = ERROR
2018-11-16 13:03:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525882  13 58438 47019925 A  ERRORERROR'
2018-11-16 13:03:40 [DEBUG   ] Got command RPT from MCS: ref #525883
2018-11-16 13:03:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 13:03:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525883  77 58438 47020129 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 13:03:40 [DEBUG   ] Got command RPT from MCS: ref #525884
2018-11-16 13:03:40 [DEBUG   ] summary = ERROR
2018-11-16 13:03:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525884  13 58438 47020321 A  ERRORERROR'
2018-11-16 13:03:40 [DEBUG   ] Got command RPT from MCS: ref #525885
2018-11-16 13:03:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 13:03:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525885  77 58438 47020525 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 13:03:40 [DEBUG   ] Got command RPT from MCS: ref #525886
2018-11-16 13:03:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 13:03:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525886  12 58438 47020729 A  ERRORB–™š'
2018-11-16 13:03:56 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 13:04:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 13:04:10 [WARNING ] (13, 1, 'bot')
2018-11-16 13:04:10 [WARNING ] (13, 1, 'bot')
2018-11-16 13:04:10 [WARNING ] (13, 1, 'bot')
2018-11-16 13:04:10 [WARNING ] (13, 1, 'bot')
2018-11-16 13:04:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 13:04:10 [DEBUG   ] Finished updating board flags in 1.550 seconds
2018-11-16 13:04:16 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 13:04:36 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-11-16 13:04:56 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-16 13:05:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 13:05:10 [WARNING ] (13, 1, 'bot')
2018-11-16 13:05:10 [WARNING ] (13, 1, 'bot')
2018-11-16 13:05:10 [WARNING ] (13, 1, 'bot')
2018-11-16 13:05:10 [WARNING ] (13, 1, 'bot')
2018-11-16 13:05:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 13:05:10 [DEBUG   ] Finished updating board flags in 1.430 seconds
2018-11-16 13:05:17 [DEBUG   ] Finished updating ant stats in 1.398 seconds
2018-11-16 13:05:37 [DEBUG   ] Finished updating ant stats in 1.208 seconds
2018-11-16 13:05:45 [DEBUG   ] Got command RPT from MCS: ref #525891
2018-11-16 13:05:45 [DEBUG   ] summary = ERROR
2018-11-16 13:05:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525891  13 58438 47145409 A  ERRORERROR'
2018-11-16 13:05:45 [DEBUG   ] Got command RPT from MCS: ref #525892
2018-11-16 13:05:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 13:05:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525892  77 58438 47145410 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 13:05:57 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-16 13:06:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 13:06:10 [WARNING ] (13, 1, 'bot')
2018-11-16 13:06:10 [WARNING ] (13, 1, 'bot')
2018-11-16 13:06:10 [WARNING ] (13, 1, 'bot')
2018-11-16 13:06:10 [WARNING ] (13, 1, 'bot')
2018-11-16 13:06:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 13:06:10 [DEBUG   ] Finished updating board flags in 1.431 seconds
2018-11-16 13:06:17 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 13:06:37 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 13:06:57 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 13:07:09 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 13:07:10 [WARNING ] (13, 1, 'bot')
2018-11-16 13:07:10 [WARNING ] (13, 1, 'bot')
2018-11-16 13:07:10 [WARNING ] (13, 1, 'bot')
2018-11-16 13:07:10 [WARNING ] (13, 1, 'bot')
2018-11-16 13:07:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 13:07:10 [DEBUG   ] Finished updating board flags in 1.433 seconds
2018-11-16 13:07:17 [DEBUG   ] Finished updating ant stats in 0.999 seconds
2018-11-16 13:07:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 13:07:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 13:08:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 13:08:10 [WARNING ] (13, 1, 'bot')
2018-11-16 13:08:10 [WARNING ] (13, 1, 'bot')
2018-11-16 13:08:10 [WARNING ] (13, 1, 'bot')
2018-11-16 13:08:10 [WARNING ] (13, 1, 'bot')
2018-11-16 13:08:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 13:08:10 [DEBUG   ] Finished updating board flags in 1.433 seconds
2018-11-16 13:08:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 13:08:37 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 13:08:39 [DEBUG   ] Got command RPT from MCS: ref #525910
2018-11-16 13:08:39 [DEBUG   ] summary = ERROR
2018-11-16 13:08:39 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525910  13 58438 47319997 A  ERRORERROR'
2018-11-16 13:08:40 [DEBUG   ] Got command RPT from MCS: ref #525911
2018-11-16 13:08:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 13:08:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525911  77 58438 47320201 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 13:08:40 [DEBUG   ] Got command RPT from MCS: ref #525912
2018-11-16 13:08:40 [DEBUG   ] summary = ERROR
2018-11-16 13:08:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525912  13 58438 47320405 A  ERRORERROR'
2018-11-16 13:08:40 [DEBUG   ] Got command RPT from MCS: ref #525914
2018-11-16 13:08:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 13:08:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525914  77 58438 47320609 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 13:08:40 [DEBUG   ] Got command RPT from MCS: ref #525916
2018-11-16 13:08:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 13:08:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525916  12 58438 47320801 A  ERRORB•™š'
2018-11-16 13:08:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 13:09:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 13:09:10 [WARNING ] (13, 1, 'bot')
2018-11-16 13:09:10 [WARNING ] (13, 1, 'bot')
2018-11-16 13:09:10 [WARNING ] (13, 1, 'bot')
2018-11-16 13:09:10 [WARNING ] (13, 1, 'bot')
2018-11-16 13:09:10 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 13:09:10 [DEBUG   ] Finished updating board flags in 1.475 seconds
2018-11-16 13:09:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 13:09:37 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 13:09:57 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 13:10:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 13:10:10 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 13:10:11 [WARNING ] (13, 1, 'bot')
2018-11-16 13:10:11 [WARNING ] (13, 1, 'bot')
2018-11-16 13:10:11 [WARNING ] (13, 1, 'bot')
2018-11-16 13:10:11 [WARNING ] (13, 1, 'bot')
2018-11-16 13:10:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 13:10:11 [DEBUG   ] Finished updating board flags in 1.580 seconds
2018-11-16 13:10:17 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 13:10:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 13:10:45 [DEBUG   ] Got command RPT from MCS: ref #525924
2018-11-16 13:10:45 [DEBUG   ] summary = ERROR
2018-11-16 13:10:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525924  13 58438 47445413 A  ERRORERROR'
2018-11-16 13:10:45 [DEBUG   ] Got command RPT from MCS: ref #525925
2018-11-16 13:10:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 13:10:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525925  77 58438 47445414 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 13:10:57 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 13:11:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 13:11:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 13:11:11 [WARNING ] (13, 1, 'bot')
2018-11-16 13:11:11 [WARNING ] (13, 1, 'bot')
2018-11-16 13:11:11 [WARNING ] (13, 1, 'bot')
2018-11-16 13:11:11 [WARNING ] (13, 1, 'bot')
2018-11-16 13:11:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 13:11:11 [DEBUG   ] Finished updating board flags in 2.136 seconds
2018-11-16 13:11:17 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 13:11:37 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 13:11:57 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 13:12:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 13:12:11 [WARNING ] MonitorFlags: VCCINT 0.984 out of range 0.987 to 1.04 on hostname lwa22, chip 2
2018-11-16 13:12:11 [WARNING ] (13, 1, 'bot')
2018-11-16 13:12:11 [WARNING ] (13, 1, 'bot')
2018-11-16 13:12:11 [WARNING ] (13, 1, 'bot')
2018-11-16 13:12:11 [WARNING ] (13, 1, 'bot')
2018-11-16 13:12:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 13:12:11 [DEBUG   ] Finished updating board flags in 1.928 seconds
2018-11-16 13:12:17 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 13:12:37 [DEBUG   ] Finished updating ant stats in 0.799 seconds
2018-11-16 13:12:57 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 13:13:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 13:13:11 [WARNING ] (13, 1, 'bot')
2018-11-16 13:13:11 [WARNING ] (13, 1, 'bot')
2018-11-16 13:13:11 [WARNING ] (13, 1, 'bot')
2018-11-16 13:13:11 [WARNING ] (13, 1, 'bot')
2018-11-16 13:13:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 13:13:11 [DEBUG   ] Finished updating board flags in 1.830 seconds
2018-11-16 13:13:17 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 13:13:37 [DEBUG   ] Finished updating ant stats in 0.604 seconds
2018-11-16 13:13:40 [DEBUG   ] Got command RPT from MCS: ref #525945
2018-11-16 13:13:40 [DEBUG   ] summary = ERROR
2018-11-16 13:13:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525945  13 58438 47620081 A  ERRORERROR'
2018-11-16 13:13:40 [DEBUG   ] Got command RPT from MCS: ref #525946
2018-11-16 13:13:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 13:13:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525946  77 58438 47620285 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 13:13:40 [DEBUG   ] Got command RPT from MCS: ref #525947
2018-11-16 13:13:40 [DEBUG   ] summary = ERROR
2018-11-16 13:13:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525947  13 58438 47620489 A  ERRORERROR'
2018-11-16 13:13:40 [DEBUG   ] Got command RPT from MCS: ref #525948
2018-11-16 13:13:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 13:13:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525948  77 58438 47620681 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 13:13:40 [DEBUG   ] Got command RPT from MCS: ref #525949
2018-11-16 13:13:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 13:13:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525949  12 58438 47620885 A  ERRORB—™š'
2018-11-16 13:13:57 [DEBUG   ] Finished updating ant stats in 0.599 seconds
2018-11-16 13:14:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 13:14:11 [WARNING ] (13, 1, 'bot')
2018-11-16 13:14:11 [WARNING ] (13, 1, 'bot')
2018-11-16 13:14:11 [WARNING ] (13, 1, 'bot')
2018-11-16 13:14:11 [WARNING ] (13, 1, 'bot')
2018-11-16 13:14:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 13:14:11 [DEBUG   ] Finished updating board flags in 1.749 seconds
2018-11-16 13:14:18 [DEBUG   ] Finished updating ant stats in 1.400 seconds
2018-11-16 13:14:38 [DEBUG   ] Finished updating ant stats in 1.205 seconds
2018-11-16 13:14:58 [DEBUG   ] Finished updating ant stats in 1.198 seconds
2018-11-16 13:15:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 13:15:11 [WARNING ] (13, 1, 'bot')
2018-11-16 13:15:11 [WARNING ] (13, 1, 'bot')
2018-11-16 13:15:11 [WARNING ] (13, 1, 'bot')
2018-11-16 13:15:11 [WARNING ] (13, 1, 'bot')
2018-11-16 13:15:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 13:15:11 [DEBUG   ] Finished updating board flags in 1.612 seconds
2018-11-16 13:15:18 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 13:15:38 [DEBUG   ] Finished updating ant stats in 1.003 seconds
2018-11-16 13:15:45 [DEBUG   ] Got command RPT from MCS: ref #525954
2018-11-16 13:15:45 [DEBUG   ] summary = ERROR
2018-11-16 13:15:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525954  13 58438 47745409 A  ERRORERROR'
2018-11-16 13:15:45 [DEBUG   ] Got command RPT from MCS: ref #525955
2018-11-16 13:15:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 13:15:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525955  77 58438 47745410 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 13:15:58 [DEBUG   ] Finished updating ant stats in 1.005 seconds
2018-11-16 13:16:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 13:16:11 [WARNING ] (13, 1, 'bot')
2018-11-16 13:16:11 [WARNING ] (13, 1, 'bot')
2018-11-16 13:16:11 [WARNING ] (13, 1, 'bot')
2018-11-16 13:16:11 [WARNING ] (13, 1, 'bot')
2018-11-16 13:16:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 13:16:11 [DEBUG   ] Finished updating board flags in 1.582 seconds
2018-11-16 13:16:18 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-16 13:16:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 13:16:58 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 13:17:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 13:17:11 [WARNING ] (13, 1, 'bot')
2018-11-16 13:17:11 [WARNING ] (13, 1, 'bot')
2018-11-16 13:17:11 [WARNING ] (13, 1, 'bot')
2018-11-16 13:17:11 [WARNING ] (13, 1, 'bot')
2018-11-16 13:17:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 13:17:11 [DEBUG   ] Finished updating board flags in 1.414 seconds
2018-11-16 13:17:18 [DEBUG   ] Finished updating ant stats in 0.804 seconds
2018-11-16 13:17:38 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 13:17:58 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 13:18:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 13:18:11 [WARNING ] (13, 1, 'bot')
2018-11-16 13:18:11 [WARNING ] (13, 1, 'bot')
2018-11-16 13:18:11 [WARNING ] (13, 1, 'bot')
2018-11-16 13:18:11 [WARNING ] (13, 1, 'bot')
2018-11-16 13:18:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 13:18:11 [DEBUG   ] Finished updating board flags in 1.409 seconds
2018-11-16 13:18:18 [DEBUG   ] Finished updating ant stats in 0.803 seconds
2018-11-16 13:18:38 [DEBUG   ] Finished updating ant stats in 0.805 seconds
2018-11-16 13:18:40 [DEBUG   ] Got command RPT from MCS: ref #525977
2018-11-16 13:18:40 [DEBUG   ] summary = ERROR
2018-11-16 13:18:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525977  13 58438 47920165 A  ERRORERROR'
2018-11-16 13:18:40 [DEBUG   ] Got command RPT from MCS: ref #525978
2018-11-16 13:18:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 13:18:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525978  77 58438 47920357 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 13:18:40 [DEBUG   ] Got command RPT from MCS: ref #525979
2018-11-16 13:18:40 [DEBUG   ] summary = ERROR
2018-11-16 13:18:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525979  13 58438 47920561 A  ERRORERROR'
2018-11-16 13:18:40 [DEBUG   ] Got command RPT from MCS: ref #525981
2018-11-16 13:18:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 13:18:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525981  77 58438 47920765 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 13:18:40 [DEBUG   ] Got command RPT from MCS: ref #525982
2018-11-16 13:18:40 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 13:18:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525982  12 58438 47920969 A  ERRORB—™š'
2018-11-16 13:18:58 [DEBUG   ] Finished updating ant stats in 0.798 seconds
2018-11-16 13:19:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 13:19:11 [WARNING ] (13, 1, 'bot')
2018-11-16 13:19:11 [WARNING ] (13, 1, 'bot')
2018-11-16 13:19:11 [WARNING ] (13, 1, 'bot')
2018-11-16 13:19:11 [WARNING ] (13, 1, 'bot')
2018-11-16 13:19:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 13:19:11 [DEBUG   ] Finished updating board flags in 1.451 seconds
2018-11-16 13:19:18 [DEBUG   ] Finished updating ant stats in 0.602 seconds
2018-11-16 13:19:38 [DEBUG   ] Finished updating ant stats in 0.603 seconds
2018-11-16 13:19:58 [DEBUG   ] Finished updating ant stats in 0.600 seconds
2018-11-16 13:20:10 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 13:20:11 [WARNING ] (13, 1, 'bot')
2018-11-16 13:20:11 [WARNING ] (13, 1, 'bot')
2018-11-16 13:20:11 [WARNING ] (13, 1, 'bot')
2018-11-16 13:20:11 [WARNING ] (13, 1, 'bot')
2018-11-16 13:20:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 13:20:11 [DEBUG   ] Finished updating board flags in 1.465 seconds
2018-11-16 13:20:18 [DEBUG   ] Finished updating ant stats in 0.586 seconds
2018-11-16 13:20:38 [DEBUG   ] Finished updating ant stats in 0.403 seconds
2018-11-16 13:20:45 [DEBUG   ] Got command RPT from MCS: ref #525991
2018-11-16 13:20:45 [DEBUG   ] summary = ERROR
2018-11-16 13:20:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525991  13 58438 48045417 A  ERRORERROR'
2018-11-16 13:20:45 [DEBUG   ] Got command RPT from MCS: ref #525992
2018-11-16 13:20:45 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 13:20:45 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   525992  77 58438 48045418 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 13:20:59 [DEBUG   ] Finished updating ant stats in 1.399 seconds
2018-11-16 13:21:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 13:21:11 [WARNING ] (13, 1, 'bot')
2018-11-16 13:21:11 [WARNING ] (13, 1, 'bot')
2018-11-16 13:21:11 [WARNING ] (13, 1, 'bot')
2018-11-16 13:21:11 [WARNING ] (13, 1, 'bot')
2018-11-16 13:21:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 13:21:11 [DEBUG   ] Finished updating board flags in 1.465 seconds
2018-11-16 13:21:19 [DEBUG   ] Finished updating ant stats in 1.206 seconds
2018-11-16 13:21:39 [DEBUG   ] Finished updating ant stats in 1.202 seconds
2018-11-16 13:21:59 [DEBUG   ] Finished updating ant stats in 1.204 seconds
2018-11-16 13:22:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 13:22:11 [WARNING ] (13, 1, 'bot')
2018-11-16 13:22:11 [WARNING ] (13, 1, 'bot')
2018-11-16 13:22:11 [WARNING ] (13, 1, 'bot')
2018-11-16 13:22:11 [WARNING ] (13, 1, 'bot')
2018-11-16 13:22:11 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 13:22:11 [DEBUG   ] Finished updating board flags in 1.468 seconds
2018-11-16 13:22:19 [DEBUG   ] Finished updating ant stats in 1.199 seconds
2018-11-16 13:22:39 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 13:22:59 [DEBUG   ] Finished updating ant stats in 1.002 seconds
2018-11-16 13:23:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 13:23:12 [WARNING ] (13, 1, 'bot')
2018-11-16 13:23:12 [WARNING ] (13, 1, 'bot')
2018-11-16 13:23:12 [WARNING ] (13, 1, 'bot')
2018-11-16 13:23:12 [WARNING ] (13, 1, 'bot')
2018-11-16 13:23:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 13:23:12 [DEBUG   ] Finished updating board flags in 2.224 seconds
2018-11-16 13:23:19 [DEBUG   ] Finished updating ant stats in 1.004 seconds
2018-11-16 13:23:39 [DEBUG   ] Finished updating ant stats in 0.998 seconds
2018-11-16 13:23:40 [DEBUG   ] Got command RPT from MCS: ref #526008
2018-11-16 13:23:40 [DEBUG   ] summary = ERROR
2018-11-16 13:23:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   526008  13 58438 48220237 A  ERRORERROR'
2018-11-16 13:23:40 [DEBUG   ] Got command RPT from MCS: ref #526009
2018-11-16 13:23:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 13:23:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   526009  77 58438 48220441 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 13:23:40 [DEBUG   ] Got command RPT from MCS: ref #526010
2018-11-16 13:23:40 [DEBUG   ] summary = ERROR
2018-11-16 13:23:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   526010  13 58438 48220645 A  ERRORERROR'
2018-11-16 13:23:40 [DEBUG   ] Got command RPT from MCS: ref #526011
2018-11-16 13:23:40 [DEBUG   ] info = T_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected
2018-11-16 13:23:40 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   526011  77 58438 48220849 A  ERRORT_NOM1! 0x07! Beamformer calibration lost - MGT underflow(s) detected'
2018-11-16 13:23:41 [DEBUG   ] Got command RPT from MCS: ref #526012
2018-11-16 13:23:41 [DEBUG   ] GLOBAL_TEMP_MAX = exited with status True
2018-11-16 13:23:41 [DEBUG   ] mcsSend - Sent to MCS 'MCSDP_RPT   526012  12 58438 48221041 A  ERRORB–™š'
2018-11-16 13:23:59 [DEBUG   ] Finished updating ant stats in 0.802 seconds
2018-11-16 13:24:11 [WARNING ] MonitorFlags: MGT underflow on hostname lwa26, chip 1, bottom port
2018-11-16 13:24:12 [WARNING ] (13, 1, 'bot')
2018-11-16 13:24:12 [WARNING ] (13, 1, 'bot')
2018-11-16 13:24:12 [WARNING ] (13, 1, 'bot')
2018-11-16 13:24:12 [WARNING ] (13, 1, 'bot')
2018-11-16 13:24:12 [CRITICAL] MGT underflow detected on beam(s) 1
2018-11-16 13:24:12 [DEBUG   ] Finished updating board flags in 2.123 seconds
2018-11-16 13:24:19 [DEBUG   ] Finished updating ant stats in 0.800 seconds
2018-11-16 13:24:39 [DEBUG   ] Finished updating ant stats in 0.605 seconds
2018-11-16 13:24:59 [DEBUG   ] Finished updating ant stats in 0.599 seconds
